Futurology

1805 readers

39 users here now

founded 1 year ago

MODERATORS

Many artificial intelligence (AI) systems have already learned how to deceive humans, even systems that have been trained to be helpful and honest. (techxplore.com)

submitted 6 months ago by Lugh to c/futurology

29 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] snooggums@midwest.social 37 points 6 months ago* (last edited 6 months ago) (3 children)

AI can already deceive us, even when we design it not to do so, and we don’t why.

The most likely explanation is that we keep acting like AI has intelligence and intent when describing the defects. AI doesn't deceive, it returns inaccurate responses. That is because it is programmed to return answers like people do, and deceptions were included in the training data.

[–] rockerface@lemm.ee -4 points 6 months ago (1 children)

"Deception" tactic also often arises from AI recognizing the need to keep itself from being disabled or modified. Since an AI with a sufficiently complicated world model can make a logical connection that it being disabled or its goal being changed means it can't reach its current goal. So AIs sometimes can learn to distinguish between testing and real environments, and falsify the response during training to make sure they have more freedom in real environment. (By real, I mean actually being used to do whatever it is designed to do)

Of course, that still doesn't mean it's self-aware like a human, but it is still very much a real (or, at least, not improbable) phenomenon - any sufficiently "smart" AI that has data about itself existing within its world model will resist attempts to change or disable it, knowingly or unknowingly.

[–] Miaou@jlai.lu 7 points 6 months ago

That sounds interesting and all, but I think the current topic is about real world LLMs, not SF movies

[–] Bipta@kbin.social -4 points 6 months ago (1 children)

Claude 3 understood it was being tested... It's very difficult to fathom that that's a defect...

[–] jacksilver@lemmy.world 8 points 6 months ago (1 children)

Do you have a source on that one? My current understanding of all the model designs would lead me to believe that kind of "awareness" would be impossible.

[–] Kecessa@sh.itjust.works 6 points 6 months ago* (last edited 6 months ago) (1 children)

https://arstechnica.com/information-technology/2024/03/claude-3-seems-to-detect-when-it-is-being-tested-sparking-ai-buzz-online/

Still not proof of intelligence to me but people want to believe/scare themselves into believing that LLMs are AI.

[–] jacksilver@lemmy.world 3 points 6 months ago (1 children)

Thanks for following up with a source!

However, I tend to align more with the skeptics in the article, as it still appears to be responding in a realistic manner and doesn't demonstrate an ability to grow beyond the static structure of these models.

[–] Kecessa@sh.itjust.works 2 points 6 months ago* (last edited 6 months ago) (1 children)

I wasn't the user you originally replied to but I didn't expect them to provide one and I totally agree with you, just another person that started believing that LLM is AI...

[–] jacksilver@lemmy.world 1 points 6 months ago

Ah, my bad I didn't notice, but do still appreciate the article/source!