Fuck AI

3656 readers

549 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

founded 1 year ago

MODERATORS

VerbFlow@lemmy.world

MrMcGasion@lemmy.world

TootSweet@lemmy.world

BigMikeInAustin@lemmy.world

cynar@lemmy.world

drmeanfeel@lemmy.world

pavnilschanda@lemmy.world

CriticalMedicine@lemmy.world

WonderfulWanderer@lemmy.world

Communist@lemmy.ml

eatCasserole@lemmy.world

SpaceNoodle@lemmy.world

NutWrench@lemmy.world

Soup@lemmy.cafe

iAvicenna@lemmy.world

Tinks@lemmy.world

wizblizz@lemmy.world

corus_kt@lemmy.world

Prandom_returns@lemm.ee

TrickDacy@lemmy.world

TheFriar@lemm.ee

HawlSera@lemm.ee

andrew_bidlaw@sh.itjust.works

MeDuViNoX@sh.itjust.works

33550336@lemmy.world

Nougat@fedia.io

Lost_My_Mind@lemmy.world

Sterile_Technique@lemmy.world

Quill7513@slrpnk.net

glowing_hans@sopuli.xyz

e8d79@discuss.tchncs.de

ThefuzzyFurryComrade@pawb.social

291

Just a little... why not? (lemmy.world)

submitted 5 days ago by resipsaloquitur@lemmy.world to c/fuck_ai@lemmy.world

11 comments fedilink hide all child comments

cross-posted from: https://lemmy.world/post/33855043

you are viewing a single comment's thread
view the rest of the comments

[–] fckreddit@lemmy.ml 10 points 5 days ago (1 children)

So, basically companies can manipulate these models to basically act as ad platforms that recommend any product, meth in this case. Yeah, we all know that corporations won't use these models like that at all, with them being very ethical.

[–] pixxelkick@lemmy.world -2 points 4 days ago

...no that's not the summarization.

The summarization is:

if you reinforce your model via user feedback, via "likes" or "dislikes" or etc, such that you condition the model towards getting positive user feedback, it will start to lean towards just telling users whatever they want to hear in order to get those precious likes, cuz obviously you trained it to do that

They demo'd in the same paper other examples.

Basically, if you train it on likes, the model becomes duper sycophantic, laying it on super thick...

Which should sound familiar to you.