I think of November 4th as Rotblat Day.
Joseph Rotblat was the only scientist to leave the Manhattan Project on moral grounds. I have a little “Rotblat doc” inspired by him, where I’ve written down what motivates me and what might cause me to leave a job (or seriously consider it). I think of this as a way to avoid getting swept up or drifting over time in ways I don’t endorse.[1]
At the moment, though, I get even more out of his later work against nuclear weapons and war -- especially what others described as his “enduring optimism” and “pragmatic idealism” in the face of catastrophe.
In his own words:
I would describe myself as a realistic pacifist although this sounds like an oxymoron. [...] Even events that seem out of this world can be realized if we put enough effort and faith into them. One such event is a world without war.
and:
A campaign for abolition [of nuclear weapons] based on moral principles will be seen as a fanciful dream by many. But the situation is grim; the way things are moving is bound to lead to catastrophe. If there is a way out, even if seemingly unrealistic, it is our duty to pursue it.
More in a post I wrote about him. (I also really appreciated this more recent post.)
The idea of keeping a doc like this isn’t mine.
It looks to me like OpenAI's latest model spec is the first version which explicitly asks its models to weigh animal welfare in their responses.
It’s encouraging to see OpenAI’s model spec joining Claude’s constitution in explicitly weighing animal welfare.
Be advised: Due to the way that the Survival & Flourishing Fund does speculation grants, it is in some respects advantageous to your application if you apply far away from a round's deadline. E.g. right now.
https://survivalandflourishing.fund
I was a Recommender in a past Theme Round & I'm currently a speculation grantor. Some projects I'd be interested in making speculation grants to (though note that I'm not currently scheduled to be a Recommender in any round): https://lesswrong.com/posts/MBxSbzYECJEoeTkwZ/sff-s-hsee-grant-round-human-intelligence-amplification
In particular, I'm interested in reprogenetics: https://reprogeneticsinstitute.org/articles/Projects_that_might_help_accelerate_strong_reprogenetics.html
(Feel free to reach out to me if you have a relevant project.)
I'm still looking for someone who's willing to bet me (for a nominal amount of money for charity) on whether the AI industry is currently in a bubble that will pop within the next ~7 years: https://forum.effectivealtruism.org/posts/eCWDZb4rcCjiCtrt7/if-you-re-confident-there-s-no-ai-bubble-consider-betting-me
I think AI is in a bubble that will pop within ~7 years, so I'm looking for someone who will take the other side, who strongly believes AI is not in a bubble.
If multiple people end up accepting, that's good too, since it's a small amount of money for charity.
This is one of the more objective, more easily resolvable bets that can be made about near-term general AI capabilities progress. Moreover, unlike, say, bets on many LLM benchmarks, the outcome can't easily be gamed by AI companies in a way that's antithetical to the spirit of what the bet was trying to capture.
Check out the bet! If you don't like any of the details, propose a change and I'll seriously consider it.
Fascinating analysis! In what follows I'll focus on criticisms/queries, because it's in my nature it seems most productive, but in general I thought it was a great essay, anticipating most of my criticisms.
A couple of general thoughts
1. My biggest overall criticism is in the choice to model the cost for hard lockout as a fixed cost rather than an arms race dynamic. It can't be the case that both the US and China already have enough money in their military budgets to achieve a decisive single-actor victory - the cost to any actor has to depend on the costs other actors are willing to pay to get it themselves or at least deny their opponent, so you surely need a recursive function or at least a ratio. From a very quick bit of research it seems like the costs of arms races are substantively explored in game theory - it looks like the classic concepts are Tullock contests and Richardson arms races (annoyingly it doesn't look like there's a good simple intro or surprisingly even a Wikipedia page for either).
2. I'd much prefer to see this as a Monte Carlo analysis rather than point estimates. We literally have an in-movement tool for this - and at this point I think it would be relatively easy to vibecode it to accept arbitrarily complex functions, which was a sticking point in the past. (I have this criticism of pretty much all quantitative EA analyses, but that's a topic for another day :)
3. On the economic scales you're looking at, prices seem like they'd often be more useful given as ratios or percentages than $ values (or rather as both). For eg
Grabbing the best sites in the south polar region therefore imposes a workaround cost of only ~$1.4–14B at plausible post-Starship delivery prices (Appendix 2). For comparison, NASA's Inspector General projected in 2021 that Artemis spend through FY2025 would reach ~$93B.
This comparison feels kind of apples to oranges. NASA spending over that period seems at best very loosely correlated to mature Starship launch prices. The latter presumably assume Starship development costs have been amortised, so could be many years out, in a substantially larger economy. The former includes a lot of R&D that other actors won't need to repeat.
I think absolute estimated costs are useful, since they give some sense of which actors might be able to afford them, but it would also be useful to estimate how much of a proportionate cost-increase such a change would be. Also for such grandiose questions, it would be helpful to supplement $ value with something like an estimate of cost as a percentage of anticipated US or global GDP. That has the downside/upside that it makes the estimate quite sensitive to the interval in which the moon colonisation (or in general imagined event) happens, which is harder work with more room for error, but meaningfully matters if we take seriously the possibility of a century of growth in a decade - depending on what you consider a century of growth, this seems like it could reduce the 'real' cost of a fixed $-value by anywhere from 20-1000-fold per decade.
For the really big picture stuff, like Dyson swarm building, maybe you want to just measure things in terms of something like 'energy cost as a fraction of the sun's output'.
Thoughts on specific passages
just three (Moon-landing sites) dominate the accessible water ice tonnage, together holding up to ~1,200 tonnes of water ice
This sounds like it wouldn't end up being much of a factor - 1200 tonnes of water ice split 3 ways sounds like virtually nothing. Taking just the max amount, which looks like ~636 tonnes in the PNS03 site, ChatGPT reckons a lunar Starship would consume that within single-digit launches to high lunar orbit.
If instead it was used for human consumption, based on ISS astronaut use of approx a gallon (3.7 litres) a day it could support a population of somewhere around 100-150 people with perfect recyling (depending on how much redundancy you built in). But at, say the ISS recycling efficiency of 98% per cycle, you'd lose about half of the water in around a month. Maybe on the Moon/in future you could get dramatically higher efficiency? But it still seems like even with radical efficiency improvements, absent a lot more water ice being found near the surface this could at best be a small windfall for a new settlement, not much of a DSA.
The benefits of lock-out39 could still justify absorbing the unfavourable marginal exchanges a lesser rival can force (e.g. cheap decoy boosters), so the rival cannot simply drain the leader's economy.
This sounds basically like loss-leading. I wonder if there's some straightforward models of loss-leading dynamics you could apply here (although maybe they're so straghtforward as to come down to 'expected return on investment').
The rate of technological progress during an intelligence explosion may be so great as to rapidly render the kinetic interceptors obsolete. Such progress may unlock cheaper ways to expand to space, allowing the system to be overwhelmed.
AIUI most or all ways of reducing cost to space rely on substantial static or orbital infrastrcture, which would prob be much easier to target than rockets (though maybe that would work to later movers' advantage, if it wasn't realistic to move significant mass outside the cislunar system without using such tech).
Where the risk of war is real, one option is for the leader to offer rivals a share of space: a small share is a great deal in absolute terms, and the leader keeps most of what it wanted.
This seems like a form of 'free' market trade. But it also seems very hard to enforce the initial deal, and somewhat at odds with your idea that launching from Earth is the key chokepoint. Unless the first mover has already physically taken most of the solar system (in which case they prob don't have much incentive to bargain), a rival that had access to a decent amount of the solar system could surely expand to capture more than they'd been offered (or if they coudn't, that suggests Earth wasn't that key a chokepoint).
at strong growth differentials, outgrowing Earth would take decades (plausibly 10–40 years)
Variance seems extremely high here especially at the upper end. If we don't see an industrial explosion (and it seems too early to treat it as inevitable) it could take a century+, especially if along the way there are substantial backslides of the kind I sort-of modelled here ('The perils-focused model' section) - obviously longer still if civilisation actually collapsed, but that's prob outside scope for this analysis.
An actor takes permanent control of the whole future specifically by expanding to space, locking out every other actor by force, and maintaining a supply line from Earth until it outgrows everyone else.
I'm not sure this would necessarily be permanent, at least in the sense that it might splinter into factions, or at least lose a sense of original national identity over time (though it would prob still have a strong counterfactual effect on future values)
Serious case. Space-side growth compounds, so whoever expanded significant industry to space first holds a big lead, and soft lock-out adds to it at the margin. Kinetic interceptors are also used to confer major military advantages on first movers, but hard lock-out is either not attempted or does not hold.
I'm a bit confused that you're putting soft lock and kinetic interceptors together, having spent most of the essay conceptually distinguishing them. Also using them as you've described seems at odds with 'not attempting hard lock out' (unless you mean they're trying to hard-lock a proper subset of rivals, while allowing multiple players first-n-mover advantage)?
Other companies seem to be ~3–5 years behind SpaceX on launch capabilities. ... SpaceX launched 165 Falcon 9 missions in 2025, more than every non-US launch provider combined, versus its closest Western competitor Rocket Lab at 18.
This actually seems very conservative to me, as a commercial comparison. SpaceX launched 18 rockets in 2018 years ago, and have been ~growing exponentially since, so that would naively put them about 8 years ahead of their closest competitor. But also Rocket Lab's Electron rocket has a payload to orbit of 300kg vs Falcon 9's 23000, so by total mass to orbit Rocket Lab are still behind where SpaceX were in the early 2010s!
That said, it seems like by far the biggest competitor is China's space program, which is nontrivial to calculate since it includes several rocket classes, but which launched 51 times in 2025, and looks like it has a payload capacity maybe half Falcon 9's (but their launch cadence growth rate is much lower).
If SpaceX can nonetheless fill the band within the window, a later entrant wanting to put data centres in SSO would have three options: demonstrate to the FCC that far tighter packing still meets the collision-probability threshold, which means negotiating manoeuvre responsibility with an incumbent million-satellite operator; put its data centres in higher, more expensive shells; or invest more in terrestrial data centres.
Is there anything preventing non-American companies, from just putting their data centres into the same orbit? That could be a halfway measure between a scorched Earth policy of denying it to the US, with plausible deniability ('their satellite collided with mine, your honour'). Also, the US might prevent SpaceX dominance internally, on antitrust laws, if it looked like they were really crowding everyone out of this orbit (that outcome seems like it might be quite sensitive to which party was in power in the crucial interval).
FWIW, I think there are some comms risks here — I've noticed that Claude sites in particular start looking really same-y without a good design eye editing them. The new User-Friendly site I would have immediately clocked as Claude-made (and applied some automatic discount to it based on this had you not said it, based on things like):
Little glyphs and words above headings
Random italicized words for emphasis
Using 01, 02, 03 in things that don't need numbering, with the leading 0.
Along with the neutral color palette.
Here are some examples of sites that are clearly made by Claude, and have a lot of these features:
Claude Academy's example websites also look this way: https://academy.claude.com/use-cases/create-a-custom-webpage
I used Claude design with just this prompt: "Can you make me some slides? Don't use my design system - just use whatever you feel like. Fill them in with filler content."
Here are some screenshots of that:
I think that working with a good designer (like you!) seems great for folks doing this, but also, if we're already concerned about EA websites being really same-y, this poses the same kind of risk, or at least for me, as someone who has starting feeling negative about seeing endless amounts of Claude-designed things.
“If you include PETA's $80M annual budget, and the ~$50M annually spent on diet change globally, animal liberation and diet change currently account for over a third of the animal movement's funding.”[2]
Lewis Bollard is right that the wider movement is not neglecting diet change. The question his point opens up is whether that spending is trying new directions and testing them rigorously, which is where EA has a comparative advantage, and where a prize would pull new efforts.
Moreover, if the budget of EA is going to increase x-fold, as many expect it to under the AI windfall, this would greatly increase the EA share of total movement money in animal advocacy, meaning a proportionally greater share of responsibility to ensure all vital parts of the movement are covered.
The arguments here seem confused to me. Are you arguing for EAs to work on diet change advocacy or for 'EA money' to go to this intervention? The middle paragraph quoted seems to be arguing you want EA's to work on the problem, which is not about funding but about talent. FWIW I think testing new efforts is not that hard to do, and with $100m+ a year on diet change advocacy there should be no issue getting some funding to run some studies (as you have already done).
If, however, the claim is that a portion of EA funding should go towards diet change advocacy, then I think the order of evidence <> money is the wrong way arouns. The broad consensus in EA, to the extent there is one, is that the current state of evidence is not nearly as cost-effective as other interventions, despite there being a lot of research to date (e.g. see a summary here). If new high quality research came in to suggest otherwise, I expect more EA funding would come in (assuming marginal dollars would be cost-effective). The order should be test then scale, not scale then test.
AI Safety is important - yes, but you don't have to pivot. Maybe you just don't have a horse in that race.
War makes me sad. The war in Russia-Ukraine. The war in Israel-Palestine. People impoverished and holding the butt of decisions they had no say in due to politics & power.
I really cannot do anything about this. I can vote for officials who care about peace and would advocate for that! But I cannot put Putin & Zelensky in the same room and make them:
I talk to individuals from various career paths who have fear about AI for various reasons and feel pressured to pivot, but I dont think it makes sense to advise everyone to simply pivot, especially if there is not a role for them to land.
If you're a nurse and enjoy nursing, please stay and help your patients. If you're a teacher and enjoy teaching, please stay and enrich the lives of children. If you're a PhD in pharmaceutics, please stay and help the creation of medicine to address ailments.