EA is facing its most serious PR crisis in history, and nobody in EA seems to be discussing it or doing anything effective about it. Everyone seems to be carrying on as if this is business as usual.
President Donald Trump, AI Czar David Sacks, and the Department of War have launched a coordinated campaign in the last week to portray EA as treasonous and toxic.
Their campaign motto is 'Americanism, not Effective Altruism'. Tens of thousands of MAGA political influencers are attacking EA (often from positions of total ignorance) on social media platforms such as X, Truth Social, and Facebook. They're also portraying all concerns about catastrophic risks from AI as a 'hoax', a 'psyop', and a CCP influence campaign -- part of a 'Doomer Industrial Complex'.
This is unprecedented. It's far worse than any previous scandal or crisis that EA has faced. Even the SBF/FTX debacle didn't lead to key American leaders and legions of influencers directly attacking EA.
Are we going to do anything about this, or just let the pro-AI accelerationists, in the current White House administration and the Pentagon, trash-talk the movement that we've spent the last 15 years growing and defending?
Some quick observations on the attacks on METR, EA, and other AI safety orgs (from my perspective as a political campaigner and former Communications Director for a union and mayor during COVID):
I want to write something longer on this but don't have time right now. Lots of opportunity for good crisis comms here. Let me know what's wrong about this take and if you'd like to hear more!
Stuff I tell student organizers: Do more meta communication.
Represent the range of views that are in your group. If some people in your student group think “do the normal thing in university and explore your career options” and others think “drop out to urgently work on 2-person AI safety projects," represent to your group members that those are both views held in your group.
If you always serve vegan food, people will assume all EAs are vegan / you’re supposed to be vegan if you’re in EA. I suggest saying something like “We serve vegan food because that’s what works best for the combination of people in our group, but it’s not that everybody is vegan.” About half the people in the EA survey are vegetarian or vegan.
YC never had any sort of monopoly on the best startups though, its own terms are much better than they used to be, and its still definitely the most prestigious. The question isn't "why didn't Anthropic join YC", it's "why, if AI truly makes most developers 10x more productive and transforms the unit economics of customers, are the valuations of a cohort of prestigious "AI-enabled" startups round about their non-AI enabled 2019 peers?". There really aren't enough people founding research labs for that to be the issue
Of course, any early stage valuations graph is as much a graph of investor sentiment as anything else, but if AI was really making these companies significantly more productive, investors would have to be very bearish on AI or YC selection effect to have gone down the toilet for that not to show in the data. I presume median data looks similar?
The best counterargument is that AI also makes it easier for competitors leading to less defensible business models even if AI actually enables them to grow faster, but if that was the case investor sentiment should be much more bearish on incumbents...
I'm not convinced the recent capabilities advancements (highly concentrated in pure math, the section which by definition can't be applied) support the forecasts that misaligned superintelligence is on balance harmful. In general, I think there is not enough evidence to draw the conclusion that multi-agent alignment (which was far from inevitable ex-ante in comparison to the sometimes monotheist conceptions of ASI) is impossible, especially with AI eventually automating and enforcing the institutional mechanisms.
However, this is not guaranteed either. The labs are making the biggest bet that humanity has taken by far; that RSI will automate and solve the alignment problem, and the ensuing intelligence explosion will solve most of humanity's suffering. This explains much of the race dynamics until now, where the balance of tail-risks are now undoubtedly on the upside. Note also the competition with China, which plays particular relevance for open-source.
My p(doom) probably sits somewhere just over halfway (to account for the right-tailed distribution here) between my pre and (initial) post Hugging-Face likelihoods: perhaps 8%. It would be unwise not to update since this saga unfolded.
Some of the latest macroeconomic models from the likes of Anthropic and Acemoglu suggest rather grim futures for employment relative to what economists were previously predicting, hence its fair to say our methods lean overly conservative towards excess rigour here. Perhaps the recent backlash from the mathematicians, and some of the sentiment behind the anti data-centre movement, reflect these (increasingly justified) anxieties.
Nonetheless, this is orders of magnitude more dangerous than nuclear weapons. That's enough for me to take AI-safety incredibly seriously!
Thanks for the post. I think this is an important strategic debate to have, so I'll reply in more length than usual.
I agree with you that we should be honest about what we believe, pursue a variety of strategies, and try to expand the moral circle. I also think you're right that animal liberation played an important role in recruiting many of the movement's current leaders. And I have immense respect for liberation-focused activists like Wayne Hsiung who do courageous work to help animals. None of the following is intended as a criticism of their work. That said, I disagree with you on a number of other points:
Thanks again for this thoughtful post, which I think makes an important point.