this post was submitted on 19 Sep 2025
96 points (98.0% liked)
Fuck AI
4175 readers
1136 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
as someone who does not buy the ai hype at all... this was not ai's fault.
How do you figure that?
I actually use AI a lot, I've seen that the safeguards aren't very well managed, I find some situations where it mentions completely fabricated information even after deep search or reasoning, although that said, it is also improving, since even last year it was way worse.
Then again though, it is also the poisoned dude's fault for not searching up what these chemicals are, so it's really both sides being responsible.
Agreed. ChatGPT will not tell you sodium bromide is a safe salt substitute. This guy carefully prompted and poked the thing until it said what he wanted to hear. That should be the takeaway, the fact that with a little twisting, you can confirm any opinion you like.
Anybody doesn't believe me can try it themselves.
It's difficult to be sure, since GPT 5, the newest model, comes with a new structure of smaller, more specialised models combining outputs after being given a prompt by a different model the user interfaces with first, this is called mixture of experts.
How do you know that OpenAI had made sure the outputs from multiple expert models wouldn't contradict, wouldn't cause accidental safeguard bypasses, etc?
Personally, I trust GPT 4o more, even then though, I usually substitute the output with actual research when needed.