I’m Losing All Trust in the AI Industry \ stacker news ~AI

pull down to refresh

I’m Losing All Trust in the AI Industry www.thealgorithmicbridge.com/p/im-losing-all-trust-in-the-ai-industry

I think the AI industry is facing a handful of urgent problems it’s not addressing adequately. I believe everything I write here is at least directionally true, but I could be wrong. My aim isn’t to be definitive, just to spark a conversation. What follows is a set of expanded thoughts on those problems, in no particular order.

view all related items

153 sats \ 3 replies \ @Cje95 17h

So just curious did you write this or did you post it to spark a discussion? I have some critiques because in the article its noted that AI are losing money while also saying their moral compass is off with their products. Many of these companies have much grander plans than a chatbot but that's what bring in the $ so they have to use it to help keep that cash coming in.

Another thing is what do you mean by AGI (if you wrote this) the reason why there is such a widespread and varying use of this boils down to contracts. OpenAI is stuck with Microsoft due to contacts signed a couple of years ago over the development of AGI.

With hallucinations there have been some LLM that have solved this. Polymathic AI did you by eliminating the use of English inputs for data outputs. They feed the model mathematical data and train it on that getting rid of the English/human language and sticking to the native language for computers and technology in general

103 sats \ 2 replies \ @carter OP 15h

I mostly posted it to spark discussion, I didn't find all the arguments super compelling but the title gets attention and I feel like it hits on some of the valid criticisms i've seen about the latest llm arms race. The problems are solvable but I am definitely a little tired of hearing how AI programmers will take my job when anyone who has used Devon knows how lacking the commercial tools available right now are.

0 sats \ 0 replies \ @optimism 2h

I am definitely a little tired of hearing how AI programmers will take my job

They won't take yours, they'll take your successor's job, simply because in a decade there will be no experienced coders in their 30s.

So don't fuck up. lol

0 sats \ 0 replies \ @carter OP 15h

More articles that seems to be in similar threads https://www.tbray.org/ongoing/When/202x/2025/07/06/AI-Manifesto https://dmitriid.com/everything-around-llms-is-still-magical-and-wishful-thinking #1020821 #1021060

5 sats \ 5 replies \ @SimpleStacker 16h

I don't trust their moral compass at all, but I can't deny the usefulness of their product. I just tried Claude Code yesterday and it blew me away. It enables me to build things in a few minutes that would have taken me a whole week's worth of work in the past.

30 sats \ 4 replies \ @carter OP 16h

I feel like it shows me I was writing a lot more boilerplate historically than I want to admit

0 sats \ 3 replies \ @SimpleStacker 15h

It can still sometimes be hard to remember the boilerplate or remember which boilerplate goes where. Ai is really useful for that kinda thing

127 sats \ 2 replies \ @carter OP 15h

I was thinking a good programming interview task would be to just have somebody set up their preferred stack from scratch. Like how to they approach CI, webpack, database. Most people never do this because its done once by smart people and rarely touched again

30 sats \ 0 replies \ @optimism 3h

I used to like questions/tasks about code and repo architecture because it's a choice and there is no "best" answer but there are bad ones: the ones without thought.

I'm not so sure that I would do that in 2025 anymore because it's easy now to fake a single answer and emulate thoughtfulness without actually thinking. If I were hiring now, I'd fall back to "attitude over everything" and not really test coding skills.

100 sats \ 0 replies \ @SimpleStacker 15h

In my experience, getting set up is usually the hardest part.

0 sats \ 0 replies \ @optimism 2h

The focus on addictive products shows their moral compass is off

The more I learn, the more I feel this becomes the fight I need to pick.

AI companies, like social media companies did before, are focused on increasing the number of monthly active users, the average session duration, etc. Those metrics, apparently inoffensive, lead to the same instrumental goal: to make the product maximally engaging.

There are two similarities to FB that I expect to apply to the large chatbot services, in particular OpenAI/Anthropic for whom this is their main product, but at a much larger scale and to a much larger effect:

The people involved will become extremely rich off of user addiction
As a long-term outcome, a significant subset of the users will have at some point regrets and another set will stay oblivious for a very long time and be harvested cycle after cycle. Two problems that will make the impact of the regrets much larger with chatbots:
- It actually "fixes" something, though in very bad quality, so people become dependent beyond the addiction
- It has significantly higher detrimental effect on cognitive skills and behavior; nowadays, documentaries and news items about detoxing from social media are a thing and the process is portrayed as hard. But, this will be nothing compared to detoxing chatbots.