Futurology

1809 readers

161 users here now

founded 1 year ago

MODERATORS

Anthropic just published new research that successfully identified and mapped millions of human-interpretable concepts, called “features”, within the neural networks of Claude. (www.anthropic.com)

submitted 6 months ago by Lugh to c/futurology

3 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Sims@lemmy.ml 3 points 6 months ago (1 children)

Cool !

This opens up for 'AI Psychology' and for direct manipulation of internal states related to preferences and interactivity, a.k.a 'emotions', 'focus', bias etc. It should also be able to mimic MOE models where each 'expertise' is done here by direct manipulation of weights. It can also learn to some extent without training, so its a new fine tuning technique and it definitely shows an internal world map for concepts etc.

Curios if similar neuronal patterns are available in all models with this method, or if the method were optimized for Anthropic models.

[–] Sims@lemmy.ml 1 points 6 months ago

..oc it also opens up for manipulative use by corporations. I.e we will probably quickly see commercial models that inflate users ego by exaggerating how amazing the users insights are, or recommending Corp interests - all hidden for the user, and just to profit from the $!@ model.