Futurology

3314 readers

30 users here now

founded 2 years ago

MODERATORS

134

OpenAI admits AI hallucinations are mathematically inevitable, not just engineering flaws (www.computerworld.com)

submitted 1 week ago by Lugh to c/futurology

8 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] mindbleach@sh.itjust.works 1 points 6 days ago (1 children)

To the network, matrix operations are simultaneous. Not that I believe parallelism is necessary. Embodiment is more plausible, but we just don't know.

We do know LLMs kinda suck. They're a bad first attempt. Diffusion emerged at the same time, and now generates plausible video faster than a camera. Those models are witchcraft and the witchcraft keeps getting stronger. LLMs hit a plateau because this is what they do. An ungodly amount of money has been spend chasing marginal improvements at ballooning scale. Higher abstraction will likely emerge as companies shrink models down and pursue maximum training epochs... but they'll always be more chatbot than person.

[–] BremboTheFourth@piefed.ca 1 points 6 days ago* (last edited 6 days ago)

They do simultaneous workloads but each load is essentially performing the same function. A person, on the other hand, is a huge variety of differing functions all working in tandem; a set of vastly different operations that are all inextricably linked together to form who we are. No single form of generative algorithm is anything more than a tiny fraction of what we think of as a conscious being. They might perform the one operation they're meant for on a much greater scale than we do, but we are nowhere near linking all those pieces together in a meaningful, cohesive stream.

Edit, think of the algorithms like adding more cores to a CPU. Sure, you can process workloads simultaneously, but each workload is interchangeable and can be arbitrarily assigned to each core or thread. Not so with people. Every single operation is assigned to a specialized part of the brain that only does that one specific type of operation. And you can't just swap out the RAM or GPU; every piece is wired specifically to interact with only the other pieces they were grown together with.