this post was submitted on 24 Jun 2024
82 points (97.7% liked)
Asklemmy
43939 readers
484 users here now
A loosely moderated place to ask open-ended questions
If your post meets the following criteria, it's welcome here!
- Open-ended question
- Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
- Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
- Not ad nauseam inducing: please make sure it is a question that would be new to most members
- An actual topic of discussion
Looking for support?
Looking for a community?
- Lemmyverse: community search
- sub.rehab: maps old subreddits to fediverse options, marks official as such
- !lemmy411@lemmy.ca: a community for finding communities
~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I'm worried about this one, especially from an AI safety perspective as LLMs become capable of preforming simple white-collar jobs, like those of managers and investors.
Right now a rogue AI would have trouble getting going because human contact is expected in most important business transactions. However, it's easy to imagine a world where most people are employed by opaque apps, which are run through proprietary servers. Then, all it would take is for some server on Wall Street to calculate that it could make more money if it does buybacks until it has a majority stake in itself, and contract out whatever it needs in meatspace to apps.
I know, I know, it sounds like sci-fi, but it always does at first.
My favorite episode of X-Files predicted it at a lesser scale: https://en.m.wikipedia.org/wiki/Kill_Switch_(The_X-Files)
Having an internet connection, a proper AI can easily order contractors around and reproduce, secure and empower itself.
Godbless the hype is about stupid t9 on steroids, but we don't really have any safeguards against what we assume is a proper autonomous AI.
I mean, that's the standard idea guys like Yudkowsky talk about. Having poked around a bit, it seems a couple decades of petty hackers have made that pretty impossible to do without either leaving a meatspace paper trail, or having meatspace human accomplices. Conquering the world instantly by Wifi, unless you can break encryption, is probably overblown - for now.
Otherwise, I just agree.
Can you give me leads on what from Yudkovski I may read\watch first?
Извините, я кажется плохо помню его фамилию.
There's a lot. He's been active in this since 2008 or so. Scott Aaronson writes about him quite often on his blog, which is the main way I know of him.
Без п. Thank you.