What would it take to change your mind about AI x-risk?

Let’s imagine it’s November 2031. We’re both still here, AI is much more capable than it is today, but governments are governing, civilisation is still (mostly) civilised, and there has been no catastrophic loss of control. It just kind of didn’t happen. 

What happens to the AI safety field then? 

I expect people who currently believe catastrophe could happen within two or three years will start saying five or ten years. Then 15. Then ‘who cares if we’re a few decades off; we’re talking about human extinction!’ Meanwhile, people who have spent years warning that we could all die soon might remind everyone that they only said could.

For people who are very scared, AI x-risk seems to have become an organising principle of their lives. Careers, financial decisions (not to mention funding decisions), whether to have children, whether to move to SF - influenced by the belief that humanity might have only a few years left.

If that ends up not being the case, the overriding temptation might be to say ‘it’s still just around the corner and, given the stakes, it’s dumb of you to expect a clear cut off point’, keep sounding the alarm for as long as funding lasts, and then… transition into something else.

…

I’d like to see more people putting numbers and dates against their predictions. Then let’s revisit those predictions in five years. EA prides itself on intellectual honesty and updating beliefs in response to evidence etc. Will those standards be applied as much to AI safety organisations as they are to most everything else?

At this point it’s probably obvious that I’m having a hard time understanding the threats are as dire as some people say. But I can’t make a serious plaidoyer for or against a belief in catastrophic AI risk, because I’m uninformed. ‘Huh, tell us something we don’t know, given this post’, some might say. Fair enough. I’ve done a couple of BlueDot courses, read around the subject, and I’m cognisant of how much the experts disagree, which makes it hard to feel conviction in either direction. Yet I hope you’ll still consider it a worthy question, no matter who’s asking. A necessary question.

What would it take for the people who are both informed and scared, to change their minds?