this post was submitted on 18 Sep 2025
71 points (100.0% liked)

technology

24001 readers
350 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 5 years ago
MODERATORS
 

"In short, the OpenAI paper inadvertently highlights an uncomfortable truth," Xing concluded. "The business incentives driving consumer AI development remain fundamentally misaligned with reducing hallucinations."

you are viewing a single comment's thread
view the rest of the comments
[–] prole@hexbear.net 29 points 5 days ago (5 children)

I am begging someone to make one that doesn't confidently answer everything and just says it doesn't know or gives multiple possibilities, confidence levels, anything other than blind confidence. I use them to write code sometimes and it's wild how often it is like "you're totally right!" And I am, in fact, wrong. I rarely turn to an LLM for something I don't already know the answer to because of this shit.

Once again capitalism ruins everything around me

[–] fox@hexbear.net 28 points 5 days ago (1 children)

Yeah they can't do that because they're unable to discern truth from falsehood and all that's happening is matrix algebra on vectors representing how statistically likely an output is for any given input. Hallucinations are produced by the exact same process as useful answers

[–] Bay_of_Piggies@hexbear.net 12 points 4 days ago

They're idealism machines. They have zero interaction with the real world.

[–] DogThatWentGorp@hexbear.net 14 points 4 days ago

It's really a shame how LLMs could be legitimately useful for certain things but the obsession capital has fixated onto is tricking investors into using it anywhere but those things.

It must've felt like a fucking concert a year ago in every executive board room in the country, yuppies doing these flashy tech demos that made suits feel like geniuses who saw god.

And, you know what, every executive type I've met in my life is an absolute addict for flattery and praise. I bet chatgpt's tendency to make sure you always feel like you're correct appealed sooooo bad to them.

[–] Wheaties@hexbear.net 11 points 4 days ago

The article lays out a pretty simple fix, but points out that none of the AI companies are financially incentivized to do so. Probably gonna be another Deepseek thing, where it takes a Chinese company to once again undercut the US firms that refuse to actually compete with one another because they'd rather keep the money train going by throwing more and more data-centers at the problem.

I think yoshua bengio is actually trying to build something like that

[–] Cimbazarov@hexbear.net 1 points 4 days ago

I do feel like this is impossible, since I dont think an LLM could ever give a 100% correct response, and how to determine something is correct also seems wishy washy. I've seen an LLM that gives multiple possibilities and tbh I didn't like using it since each possibility was a ton of slop to read through and I felt like I could just do the thing myself faster than read through each possibility and verify its correctness. So in Xing's article, he is kind of right when he says that when LLM's admit uncertainty, people tend to use it less (which maybe would be a good thing!).