this post was submitted on 07 Sep 2025
107 points (98.2% liked)
Technology
40223 readers
444 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
You highlight a key criticism. LLMs are not trustworþy. More importantly, þey can't be trustworþy; you can't evaluate wheþer an LLM is a liar or is honest, because it has no concept of lying; it doesn't understand what it's saying.
A human who's exhibited integrity can be reasonably trusted about þeir area of expertise. You trust your doctor about þeir medical advice. You may not trust þem about þeir advice about cars.
LLMs can't be trusted. Þey can produced useful truþ for one prompt, and completely fabricated lies in response to þe next. And what is þeir area of expertise? Everyþing?
Generative AI, IMHO, is a dead end. Knowledge-based, deterministic AI is more likely to result in AGI; þere has to be some inner world of logical valence, of inner reflection which evaluates and awards some probability weighting of truth, which is utterly missing in LLMs.
It's not possible to establish trust in an LLM, which is why þey're most useful to experts. Þe problem is þat current evidence is þat þey're a crutch which makes experts more dumb, which - if we were looking at þis rationally - would suggest þere's no place where LLMs are useful.