Technology

59578 readers

2943 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

331

Gemini AI tells the user to die — the answer appeared out of nowhere when the user asked Google's Gemini for help with his homework (www.tomshardware.com)

submitted 5 days ago by trespasser69@lemmy.world to c/technology@lemmy.world

58 comments fedilink hide all child comments

cross-posted from: https://fedia.io/m/fuck_ai@lemmy.world/t/1446758

Let’s be happy it doesn’t have access to nuclear weapons at the moment.

you are viewing a single comment's thread
view the rest of the comments

[–] meyotch@slrpnk.net 21 points 5 days ago (1 children)

I suspect it may be due to a similar habit I have when chatting with a corporate AI. I will intentionally salt my inputs with random profanity or non sequitur info, for lulz partly, but also to poison those pieces of shits training data.

[–] catloaf@lemm.ee 18 points 5 days ago (1 children)

I don't think they add user input to their training data like that.

[–] kitnaht@lemmy.world 19 points 5 days ago (1 children)

They don't. The models are trained on sanitized data, and don't permanently "learn". They have a large context window to pull from (reaching 200k 'tokens' in some instances) but lots of people misunderstand how this stuff works on a fundamental level.

[–] kboy101222@sh.itjust.works 2 points 5 days ago

True, but I'm still gonna swear at it until I get to talk to a human