"AI takeover x-risk is high, but not extremely high (e.g. 1%-40%)."
How is that range not "extremely high" risk of the end of human civilization and human extinction? If there was a magic 20-sided die where 1 face had a skull and the other 19 had a smiley face. And you could name any real world human problem and then roll the die. On a smiley face, the problem is solved, but in the skull everyone in the world dies. You would be insane to roll that die. The risk is too immense.
And yet, over and over again people telling us how low the risk is, are saying this gamble is acceptable. Even your own response just changes it to a 40-sided die, which is still absolutely crazy. There has never been an invention so dangerous that just creating the technology at all carried even a 0.5% chance of human extinction. Not even nuclear weapons were so dangerous because they required massive arsenals of them to pose an extinction threat. The notion that as much as 10% risk of extinction is somehow acceptable is actually deranged. No sane person would roll that die.
"AI takeover x-risk is high, but not extremely high (e.g. 1%-40%)."
How is that range not "extremely high" risk of the end of human civilization and human extinction? If there was a magic 20-sided die where 1 face had a skull and the other 19 had a smiley face. And you could name any real world human problem and then roll the die. On a smiley face, the problem is solved, but in the skull everyone in the world dies. You would be insane to roll that die. The risk is too immense.
And yet, over and over again people telling us how low the risk is, are saying this gamble is acceptable. Even your own response just changes it to a 40-sided die, which is still absolutely crazy. There has never been an invention so dangerous that just creating the technology at all carried even a 0.5% chance of human extinction. Not even nuclear weapons were so dangerous because they required massive arsenals of them to pose an extinction threat. The notion that as much as 10% risk of extinction is somehow acceptable is actually deranged. No sane person would roll that die.