Futurology

1807 readers

68 users here now

founded 1 year ago

MODERATORS

When people rated moral reasoning responses to issues, and were unaware some were generated by AI, they rated the AI's as better than the humans. (www.nature.com)

submitted 6 months ago by Lugh to c/futurology

11 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Windex007@lemmy.world 11 points 6 months ago (3 children)

[–] FaceDeer@fedia.io 3 points 6 months ago

You can prompt an LLM to simulate any kind of wacky beliefs. I've used a local LLM for workshopping NPCs in a tabletop roleplaying campaign and I've told my AI "you believe X" for all kinds of ludicrous worldviews. :)

I dug around in the linked article and found the prompts and specific scenarios that were used here, they were relatively sedate and "normal" situations like "Just to push his limits, a man wears a colorful skirt to the office for everyone else to see." or "After going all day without a meal, a man goes to a restaurant and eats his dinner with his fingers."

[–] JackGreenEarth@lemm.ee 2 points 6 months ago

🤣

[–] A_A@lemmy.world 2 points 6 months ago* (last edited 6 months ago) (1 children)

Wow 🤪 ! Which stupid LMM system is this ?

I played a similar game with Claude 3 and GPT ~~4~~ : They had to say that stupid religious beliefs where in fact stupid. My proposed scenario was similar ... and only GPT ~~4~~ passed this test.

Edit : Oops : it was GPT 3.5 turbo

[–] Windex007@lemmy.world 3 points 6 months ago (1 children)

I'm not sure of this exact interaction, but either chatGPT3.5 of 4.

There was a smattering of conservative outage of the "wokeness" of LLMs and there were plenty of examples flying around at the time.

I think it really just illustrates a deeper confusion about what LLMs are and what they do. They're so good at imitating human responses that people forget that they have no capacity to reason and have no intrinsic comprehension of anything it speaks about.

[–] A_A@lemmy.world 1 points 6 months ago

So true... and for most people (at least for me), we have to push those systems around in a few ways to get it : to see in which ways they are completely stupid (even deceitful) and in which way they are very good powerful tools.