Companies too dependent on AI

[bjl584]

The below scenario made me think about companies going "all in" on AI and depending on it even against common sense or logic.
I wonder how common this is becoming?
Online, people are calling it the "delusion of competence." Basically, AI will be wrong, but it is in the hands of people who don't know that it is wrong, and forge ahead with its advice.


My boss has ai psychosis and we’re f-d.


Go to meeting. Boss shares the conversation he had with Claude and stone cold serious tells us we need to appease Claude and meet “his” projections.

Claude doesn’t understand our clients or their needs, so things don’t happen the way Claude projected.

Boss flips out. Has another conversation with Claude to ask why. Claude can’t figure it out so we must be the problem.

I’m watching him get deeper and deeper into the hole and it’s depressing to watch, and for his sake too. This can’t be good for his mental health, it’s not good for any of us. I don’t want to participate in the dog and pony show anymore. I want to lay in the grass. I think we all need to log off. Vent over. Thanks for listening.

[myrdale]

One major problem with AI is it isn't necessarily a closed box. If you have confidential information about processes or equipment, the information you feed AI may be accessible by others.

[kork13]

AI is a tool, not a fountain of knowledge & wisdom. It can be very useful if employed as an aid to consolidate information, provide a starting point, or trigger ideas. But relying upon it without applying your own critical thought is foolish. Plus, it's an embodiment of the 'garbage in, garbage out' philosophy ... if you don't provide it with enough relevant information to integrate into a meaningful answer (like all of the contributing factors that must be considered in building plans), it most assuredly can't magically spit out great ideas to be followed to a 'T'. It often takes alot of forethought & fine-tuning to craft effective prompts that will get it pointed in a meaningful direction.

People can be lazy. Over-reliance upon technology, however brilliant & remarkable it may be, will only lead to problems. Use AI as the assistive tool that it is, and it can be incredibly helpful.