Statement on Superintelligence taken from https://superintelligence-statement.org/
Context:
Innovative AI tools may bring unprecedented health and prosperity. However, alongside tools, many leading AI companies have the stated goal of building superintelligence in the coming decade that can significantly outperform all humans on essentially all cognitive tasks. This has raised concerns, ranging from human economic obsolescence and disempowerment, losses of freedom, civil liberties, dignity, and control, to national security risks and even potential human extinction. The succinct statement below aims to create common knowledge of the growing number of experts and public figures who oppose a rush to superintelligence.
Statement:
We call for a prohibition on the development of superintelligence, not lifted before there is
- broad scientific consensus that it will be done safely and controllably
- strong public buy-in.
Always sounds like marketing to me since all we really have so far are shitty LLMs. If they actually were close to AGI there's no way any single government would stop the armsrace to it anyway. We're currently pumping all our eggs into the AI basket and headlines like these encourage it. They imply this breakthrough that is around the corner that will justify the current state of the market while the reality will most likely be a massive disappointment.
I am expecting disappointment, and maybe a few cool technologies that will stick around. Don't think we are going to get AGI soon, but if we did, no-one asked for it anyways.