The discussion of AI risk is only recently mainstream and therefore amateurs made contributions within the past decade. I think this experience exacerbates the self-assuredness of nuke risk amateurs and leads them to not bother researching the expertise of the nuke community.
For decades, many experts have worked on nuke strategy, and have come up with at least a few risk-reducing paradigms:
- Arms control can work, and nations can achieve their achievable nuke goals (eg deterrence and maybe compellance) despite lower nuke counts and can save money doing so.
- Counterforce is (arguably) better than countervalue
- Escalation is arguably a ladder, not a binary on/off switch
Based on its history of at least partial risk-reducing success, academically rigorous argument, and the sheer number of thoughtful hours spent, the establishment nuke community has probably done a decent job and improvements are probably hard to find. One place to start is the book Wizards of Armageddon by Fred Kaplan. It isn't the best book on nuke strategy generally, but it focuses on the history of the nuke community, so it will hopefully engender at least some respect for the nuke community and inspire further reading.
I think that in a field as well-established as nuke risk, improvements are more likely to be made on top of the existing field rather than by trying to re-invent the field.
Post-script: The EA community is criticized as unusefully amateurish in a recent podcast by a nuke professional https://www.armscontrolwonk.com/archive/1216048/the-wizards-of-armageddon/ but he does mention some positive work by Peter Scoblic, which I believe is https://forum.effectivealtruism.org/posts/W8dpCJGkwrwn7BfLk/nuclear-expert-comment-on-samotsvety-nuclear-risk-forecast-2
It seems extremely clear that working with the existing field is necessary to have any idea what to do about nuclear risk. That said, being a field specialist seems like a surprisingly small factor in forecasting accuracy, so I’m surprised by that being the focus of criticism.
I was interested in the criticism (32:02), so I transcribed it here:
It’s a shame that this doesn’t identify any specific errors, although that is consistent with Lewis’ view that the errors can’t be explained in minutes, perhaps even in years.
Speaking for myself, I agree with Lewis that popular ideas about nuclear weapons can be wildly, bizarrely wrong. That said, I’m surprised he highlights effective altruism as a community he’s pessimistic about being able to teach. The normal ‘cocktail party’ level of discourse includes alluring claims like ‘XYZ policy is totally obvious; we just have to implement it’, and the effective altruism people I’ve spoken to on nuclear issues are generally way less credulous than this, and hence more interested in understanding how things actually work.