this post was submitted on 28 Feb 2025
36 points (100.0% liked)

Futurology

2429 readers
237 users here now

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] DavidGarcia@feddit.nl 4 points 1 month ago (5 children)

what's more likely is that OpenAI just lost all their talent to other companies/startups

[–] thevoidzero@lemmy.world 4 points 1 month ago (4 children)

Talent alone can't just exponentially improve something that has fundamentally peaked. They could say "oh this is the limit of this kinda model, I guess we need a different kind of architecture from the ground up" if they are lucky, or will just keep trying and failing.

It's like fitting a linear model to a parabola points, you can keep trying and improve the results a bit every time but you have a limit, you can't overcome that unless you change how your model works.

Current AI is just a statistical model, it's not intelligent. They made a model that can take data and generate similar data, they've exhausted resources training it, and it's hit the limits. Unless it can actually think, extrapolate from the data it has in a coherent way, it's not going to grow.

[–] Lugh 1 points 1 month ago* (last edited 1 month ago) (2 children)

Yes, I think that is what the problem is here. Some people used to have the idea that more scaling would be enough for reasoning to appear, but that hasn't happened.

[–] SlopppyEngineer@lemmy.world 1 points 1 month ago

the idea that more scaling would be enough for reasoning to appear

That's kinda like saying that with bigger and more boilers you can eventually make a steam engine fly. To be fair, somebody eventually flew a steam powered plane but it was never a success story.

[–] thevoidzero@lemmy.world 1 points 1 month ago

Yeah, and the problem is also the expectation. They don't want to say the product is done, it's the best it can do because it hurts their shares, money source.

load more comments (1 replies)
load more comments (1 replies)