I think of November 4th as Rotblat Day.
Joseph Rotblat was the only scientist to leave the Manhattan Project on moral grounds. I have a little “Rotblat doc” inspired by him, where I’ve written down what motivates me and what might cause me to leave a job (or seriously consider it). I think of this as a way to avoid getting swept up or drifting over time in ways I don’t endorse.[1]
At the moment, though, I get even more out of his later work against nuclear weapons and war -- especially what others described as his “enduring optimism” and “pragmatic idealism” in the face of catastrophe.
In his own words:
I would describe myself as a realistic pacifist although this sounds like an oxymoron. [...] Even events that seem out of this world can be realized if we put enough effort and faith into them. One such event is a world without war.
and:
A campaign for abolition [of nuclear weapons] based on moral principles will be seen as a fanciful dream by many. But the situation is grim; the way things are moving is bound to lead to catastrophe. If there is a way out, even if seemingly unrealistic, it is our duty to pursue it.
More in a post I wrote about him. (I also really appreciated this more recent post.)
The idea of keeping a doc like this isn’t mine.
AI Safety is important - yes, but you don't have to pivot. Maybe you just don't have a horse in that race.
War makes me sad. The war in Russia-Ukraine. The war in Israel-Palestine. People impoverished and holding the butt of decisions they had no say in due to politics & power.
I really cannot do anything about this. I can vote for officials who care about peace and would advocate for that! But I cannot put Putin & Zelensky in the same room and make them:
I talk to individuals from various career paths who have fear about AI for various reasons and feel pressured to pivot, but I dont think it makes sense to advise everyone to simply pivot, especially if there is not a role for them to land.
If you're a nurse and enjoy nursing, please stay and help your patients. If you're a teacher and enjoy teaching, please stay and enrich the lives of children. If you're a PhD in pharmaceutics, please stay and help the creation of medicine to address ailments.
The superintelligence race is playing out under a governance regime more lax than the Premier League or the NBA. Absurd.
Conspiracy season: How Man City, Kawhi Leonard and the Hugging Face hack are all connected.
From Mirrorball, the EA blog about sport and suchlike.
Some people have recently been talking about a decrease in activity on the forum. I've written before about the possibility of a yearly theme. I don't know if it would work, but it seems like it might be worth a shot to counter the risk of stasis. It's somewhat hard to articulate why I think things like this might be valuable, but one of the barriers that a community can face in terms of moving forward is that there's so many potential different topics that people could talk about. Purely relying on the marketplace of ideas often means that it's hard to build momentum around any particular direction the community could be exploring. Now maybe running weeks focused on particular topics already covers this and does it better, but I think it's at least worth exploring.
Thanks for writing this! I agree it is a bit odd that both 1) funders say they are short on for grantakers, and 2) lots of people would love to do AI safety grantmaking. I basically think funders are right to keep a high bar, and have strong AI safety knowledge/experience as an important hiring desideratum. I think the more logistical/operational aspects of investigating and making grants can be learned quite quickly on the job, whereas developing taste and judgement about AI strategy and safety is harder. So I think the current strategy of taking existing research-y/policy/technical AI safety people and training them up to be grantmakers seems better than taking existing non-AI grantmakers and training them up in AI safety (though of course running career transition programs for people getting into AI safety is also valuable!).
(I am biased by being one of those EA/AI safety research-y people who transitioned into grantmaking.)
Fascinating analysis! In what follows I'll focus on criticisms/queries, because it's in my nature it seems most productive, but in general I thought it was a great essay, anticipating most of my criticisms.
A couple of general thoughts
1. My biggest overall criticism is in the choice to model the cost for hard lockout as a fixed cost rather than an arms race dynamic. It can't be the case that both the US and China already have enough money in their military budgets to achieve a decisive single-actor victory - the cost to any actor has to depend on the costs other actors are willing to pay to get it themselves or at least deny their opponent, so you surely need a recursive function or at least a ratio. From a very quick bit of research it seems like the costs of arms races are substantively explored in game theory - it looks like the classic concepts are Tullock contests and Richardson arms races (annoyingly it doesn't look like there's a good simple intro or surprisingly even a Wikipedia page for either).
2. I'd much prefer to see this as a Monte Carlo analysis rather than point estimates. We literally have an in-movement tool for this - and at this point I think it would be relatively easy to vibecode it to accept arbitrarily complex functions, which was a sticking point in the past. (I have this criticism of pretty much all quantitative EA analyses, but that's a topic for another day :)
3. On the economic scales you're looking at, prices seem like they'd often be more useful given as ratios or percentages than $ values (or rather as both). For eg
Grabbing the best sites in the south polar region therefore imposes a workaround cost of only ~$1.4–14B at plausible post-Starship delivery prices (Appendix 2). For comparison, NASA's Inspector General projected in 2021 that Artemis spend through FY2025 would reach ~$93B.
This comparison feels kind of apples to oranges. NASA spending over that period seems at best very loosely correlated to mature Starship launch prices. The latter presumably assume Starship development costs have been amortised, so could be many years out, in a substantially larger economy. The former includes a lot of R&D that other actors won't need to repeat.
I think absolute estimated costs are useful, since they give some sense of which actors might be able to afford them, but it would also be useful to estimate how much of a proportionate cost-increase such a change would be. Also for such grandiose questions, it would be helpful to supplement $ value with something like an estimate of cost as a percentage of anticipated US or global GDP. That has the downside/upside that it makes the estimate quite sensitive to the interval in which the moon colonisation (or in general imagined event) happens, which is harder work with more room for error, but meaningfully matters if we take seriously the possibility of a century of growth in a decade - depending on what you consider a century of growth, this seems like it could reduce the 'real' cost of a fixed $-value by anywhere from 20-1000-fold per decade.
For the really big picture stuff, like Dyson swarm building, maybe you want to just measure things in terms of something like 'energy cost as a fraction of the sun's output'.
Thoughts on specific passages
just three (Moon-landing sites) dominate the accessible water ice tonnage, together holding up to ~1,200 tonnes of water ice
This sounds like it wouldn't end up being much of a factor - 1200 tonnes of water ice split 3 ways sounds like virtually nothing. Taking just the max amount, which looks like ~636 tonnes in the PNS03 site, ChatGPT reckons a lunar Starship would consume that within single-digit launches to high lunar orbit.
If instead it was used for human consumption, based on ISS astronaut use of approx a gallon (3.7 litres) a day it could support a population of somewhere around 100-150 people with perfect recyling (depending on how much redundancy you built in). But at, say the ISS recycling efficiency of 98% per cycle, you'd lose about half of the water in around a month. Maybe on the Moon/in future you could get dramatically higher efficiency? But it still seems like even with radical efficiency improvements, absent a lot more water ice being found near the surface this could at best be a small windfall for a new settlement, not much of a DSA.
The benefits of lock-out39 could still justify absorbing the unfavourable marginal exchanges a lesser rival can force (e.g. cheap decoy boosters), so the rival cannot simply drain the leader's economy.
This sounds basically like loss-leading. I wonder if there's some straightforward models of loss-leading dynamics you could apply here (although maybe they're so straghtforward as to come down to 'expected return on investment').
The rate of technological progress during an intelligence explosion may be so great as to rapidly render the kinetic interceptors obsolete. Such progress may unlock cheaper ways to expand to space, allowing the system to be overwhelmed.
AIUI most or all ways of reducing cost to space rely on substantial static or orbital infrastrcture, which would prob be much easier to target than rockets (though maybe that would work to later movers' advantage, if it wasn't realistic to move significant mass outside the cislunar system without using such tech).
Where the risk of war is real, one option is for the leader to offer rivals a share of space: a small share is a great deal in absolute terms, and the leader keeps most of what it wanted.
This seems like a form of 'free' market trade. But it also seems very hard to enforce the initial deal, and somewhat at odds with your idea that launching from Earth is the key chokepoint. Unless the first mover has already physically taken most of the solar system (in which case they prob don't have much incentive to bargain), a rival that had access to a decent amount of the solar system could surely expand to capture more than they'd been offered (or if they coudn't, that suggests Earth wasn't that key a chokepoint).
at strong growth differentials, outgrowing Earth would take decades (plausibly 10–40 years)
Variance seems extremely high here especially at the upper end. If we don't see an industrial explosion (and it seems too early to treat it as inevitable) it could take a century+, especially if along the way there are substantial backslides of the kind I sort-of modelled here ('The perils-focused model' section) - obviously longer still if civilisation actually collapsed, but that's prob outside scope for this analysis.
An actor takes permanent control of the whole future specifically by expanding to space, locking out every other actor by force, and maintaining a supply line from Earth until it outgrows everyone else.
I'm not sure this would necessarily be permanent, at least in the sense that it might splinter into factions, or at least lose a sense of original national identity over time (though it would prob still have a strong counterfactual effect on future values)
Serious case. Space-side growth compounds, so whoever expanded significant industry to space first holds a big lead, and soft lock-out adds to it at the margin. Kinetic interceptors are also used to confer major military advantages on first movers, but hard lock-out is either not attempted or does not hold.
I'm a bit confused that you're putting soft lock and kinetic interceptors together, having spent most of the essay conceptually distinguishing them. Also using them as you've described seems at odds with 'not attempting hard lock out' (unless you mean they're trying to hard-lock a proper subset of rivals, while allowing multiple players first-n-mover advantage)?
Other companies seem to be ~3–5 years behind SpaceX on launch capabilities. ... SpaceX launched 165 Falcon 9 missions in 2025, more than every non-US launch provider combined, versus its closest Western competitor Rocket Lab at 18.
This actually seems very conservative to me, as a commercial comparison. SpaceX launched 18 rockets in 2018 years ago, and have been ~growing exponentially since, so that would naively put them about 8 years ahead of their closest competitor. But also Rocket Lab's Electron rocket has a payload to orbit of 300kg vs Falcon 9's 23000, so by total mass to orbit Rocket Lab are still behind where SpaceX were in the early 2010s!
That said, it seems like by far the biggest competitor is China's space program, which is nontrivial to calculate since it includes several rocket classes, but which launched 51 times in 2025, and looks like it has a payload capacity maybe half Falcon 9's (but their launch cadence growth rate is much lower).
If SpaceX can nonetheless fill the band within the window, a later entrant wanting to put data centres in SSO would have three options: demonstrate to the FCC that far tighter packing still meets the collision-probability threshold, which means negotiating manoeuvre responsibility with an incumbent million-satellite operator; put its data centres in higher, more expensive shells; or invest more in terrestrial data centres.
Is there anything preventing non-American companies, from just putting their data centres into the same orbit? That could be a halfway measure between a scorched Earth policy of denying it to the US, with plausible deniability ('their satellite collided with mine, your honour'). Also, the US might prevent SpaceX dominance internally, on antitrust laws, if it looked like they were really crowding everyone out of this orbit (that outcome seems like it might be quite sensitive to which party was in power in the crucial interval).
FWIW, I think there are some comms risks here — I've noticed that Claude sites in particular start looking really same-y without a good design eye editing them. The new User-Friendly site I would have immediately clocked as Claude-made (and applied some automatic discount to it based on this had you not said it, based on things like):
Little glyphs and words above headings
Random italicized words for emphasis
Using 01, 02, 03 in things that don't need numbering, with the leading 0.
Along with the neutral color palette.
Here are some examples of sites that are clearly made by Claude, and have a lot of these features:
Claude Academy's example websites also look this way: https://academy.claude.com/use-cases/create-a-custom-webpage
I used Claude design with just this prompt: "Can you make me some slides? Don't use my design system - just use whatever you feel like. Fill them in with filler content."
Here are some screenshots of that:
I think that working with a good designer (like you!) seems great for folks doing this, but also, if we're already concerned about EA websites being really same-y, this poses the same kind of risk, or at least for me, as someone who has starting feeling negative about seeing endless amounts of Claude-designed things.
Very low confidence in this take, but I suspect that in university groups, Better Futures fieldbuilding looks much better under short timelines than technical safety research fieldbuilding. As far as I can tell, the barriers to doing important stuff in that field are much lower.