this post was submitted on 16 Aug 2025
100 points (100.0% liked)
Fuck AI
4191 readers
1153 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
People need to realise this point. Difference between previous models and new ones are so much dependent on the amount of data it has eaten.
and the seed lottery. You can see this if you try training a simple network with two inputs to learn xor. It can converge in multiple ways, and sometimes it converges to a really bad approximation. And sometimes it doesn't converge at all (or it converges so slowly that it might as well be considered not to converge). And even then it might still converge to an approximation that's more accurate on one side of the input space than the other. Tons of ways to get an undesirable result. For a simple 2-input network.
Imagine how unlikely it is for txese models to actually converge to the optimal thing. And how often the training is for nothing.
I am sure they weed out bad seeds but in the end, it is still kind of random
yes, but the only way to weed out a bad seed is to "play the lottery"
By the time you discover a seed is bad, you've already spent a shitton on training. Money down the drain, you gotta start over
Just train another AI to train AI, then train another and another, and another. Imagine the stock rally