
The word "longtermism" was coined in 2017 and discussed here on the Effective Altruism Forum at least as early as 2018. In the intervening eight years, a few books on longtermism have been written, many papers have been published, and countless forum posts, blog posts, tweets, and podcasts have discussed the topic.
Why haven’t we seen a promising longtermist intervention yet? For clarity, longtermist interventions should meet the following criteria:
- Promising: the intervention seems like a good idea and has strong evidence and reasoning to support it
- Novel: it’s a new idea proposed since the term "longtermism" was coined in 2017 and it was first proposed by someone associated with longtermism in explicit connection to the term "longtermism"
- Actionable: it’s something people could realistically do now or soon
- Genuinely longtermist: it’s something that we wouldn’t want to do anyway based on neartermist concerns
In my view, the strongest arguments pertaining to the moral value of far future lives are arguments about existential risk. However, the philosopher Nick Bostrom’s first paper on existential risk, highlighting the moral value of the far future, was published in 2002, which is 15 years before the term "longtermism" was coined. The philosopher Derek Parfit discussed the moral value of far future lives in the context of human extinction in his 1984 book Reasons and Persons. So, the origin of these ideas goes back much further than 2017. Moreover, existential risk and global catastrophic risk has developed into a small field of study of its own, and a topic that was well-known in effective altruism before 2017. For this reason, I don’t see interventions related to existential risk (or global catastrophic risk) as novel longtermist interventions.
Many of the non-existential risk-related interventions I’ve heard about are things people have been doing in some form for a very long time. General appeals to long-term thinking, as wise as they might be, do not present a novel idea. The philosophers Will MacAskill and Toby Ord coined the term "longtermism" while working at Oxford University, which is believed to be at least 929 years old. I’ve always thought it was ironic, therefore, to present long-term thinking as novel. ("You think you just fell out of a coconut tree?")
I have seen that (at least some) longtermists acknowledge this. In What We Owe the Future, MacAskill discusses the Haudenosaunee (or Iroquois) Seventh Generation philosophy, which enjoins leaders to consider the effects of their decisions on the subsequent seven generations. MacAskill also acknowledges the California non-profit the Long Now Foundation, created in 1996, which encourages people to think about the next 10,000 years. While 10,000 years is not the usual timespan people think about, some form of long-term thinking is an ancient part of humanity.
Two proposed longtermist interventions are promoting economic growth and trying to make moral progress. These are not novel; people have been doing both for a long time. Whether these ideas are actionable is unclear, since so much effort is already allocated toward these goals. It’s also unclear whether they are genuinely longtermist. The benefits of economic growth and moral progress start paying off within one’s own lifetime, and seem to be sufficient motivation to pursue them to nearly the maximum extent.
Other projects like space exploration — besides not being a novel idea — might be promising and genuinely longtermist, but not actionable in the near term. The optimal strategy with regard to space exploration, if we’re thinking about the very long-term future, is probably procrastination. The cost of delaying a major increase in spending on space exploration for at least a few more decades, or even for the next century, is small in the grand scheme of things. There is Bostrom’s astronomical waste argument, sure — every moment we delay interstellar expansion means we can reach fewer stars in the fullness of time — but Bostrom and everyone else believed that doing well over the next century or so, and securing a path to a good future, is more important than rushing to expand into space as fast as possible. Right now, we have problems like global poverty, factory farming, pandemics, asteroids, and large volcanoes to worry about. If everything goes right, in a hundred years, we’ll be in a much better position to invest much more in space travel.
Another proposal is patient philanthropy, the idea that longtermists should set up foundations that invest donations in a stock market index fund for a century or more. The idea is to allow the wealth to compound and accumulate. There are various arguments against patient philanthropy. Patient philanthropy mathematically blows up within 500 years because the wealth concentrated in the foundations grows to a politically (and morally) unacceptable level, i.e., from 40% to 100% of all of society’s wealth. Some people define longtermism as being concerned with outcomes 1,000 years in the future or more, so an intervention that can’t continue for even 500 years maybe shouldn’t count as longtermist. It’s also unclear if this should count as an intervention in its own right. Patient philanthropy doesn’t say what the money should actually be used for, it just says that the money should be put aside indefinitely so it grow and be used later, with the decision about what to use it for and when to use it deferred indefinitely.
The rationale for patient philanthropy is that the money can be used to respond to future emergencies or for exceptionally good opportunities for giving. However, it isn’t clear why patient philanthropy would be the best way to make that funding available. We saw in 2020 the huge amount of resources that societies can quickly mobilize to respond to emergencies. Normal foundations that regularly disburse funds are often already on the lookout for good opportunities; we should expect, barring catastrophe, foundations like these will exist in the future. The promisingness of patient philanthropy is, therefore, dubious.
This is the pattern I keep seeing. Every proposed longtermist intervention I’ve been able to find so far fails to meet at least one of the four criteria listed above (and often more than one). This wouldn’t be so bad if not for the way longtermism has been presented and promoted. We have been told that longtermism is bracing new idea of great moral importance, around which the effective altruist movement, philanthropy, and possibly much else besides should change course. I think it’s a wonderful thing to generate creative or provocative ideas, but the declaration that an idea is morally and practically important should not get ahead of producing some solid advice, motivated by the new idea, that is novel and actionable.
Occasionally, I’ll see someone in the wider world mention longtermism as a radical, unsettling idea. It typically seems like they’ve confused longtermism with another idea, like transhumanism. (In fairness, I’ve also seen people within the effective altruism community conflate these ideas.) As I see it, the problem with longtermism is not that it’s radical and unsettling, but that it’s boring, disappointing, overly philosophical, and insufficiently practical. If longtermism is such a radical, important idea, why haven’t we seen a promising longtermist intervention yet?
I don't think longtermism necessarily needs new priorities to be valuable if it offers a better perspective on existing ones (although I don't think it does this well either).
Understanding what the far future might need is very difficult. If you'd asked someone 1000 years what they should focus on to benefit us, you'd get answers largely irrelevant to our needs today.[1] If you asked someone a little over 100 years ago their ideas might seem more intelligible and one guy was even perceptive enough to imagine nuclear weapons, although his optimism about what became known as mutually assured destruction setting the world free looks very wrong now, and people 100 years ago that did boring things focused on the current world did more for us than people dreaming of post-work utopias.
To that extent, the focus on x-risk seems quite reasonable: still existing is something we actually can reasonably believe will be valued by humans in a million years time[2] Of course, there are also over 8 billion reasons to try to avoid human extinction alive today (and most non-longtermists consider at least as far as their children) but longtermism makes arguments for it being more important than we think. This logically leads to willingness to allocate more money to x-risk causes, and consider more unconventional and highly unlikely approaches x-risk. This is a consideration, but in practice I'm not sure that it leads to better outcomes: some of the approaches to x-risk seeking funding make directionally different assumptions about whether more or less AGI is crucial to survival: they can't both be right and the 'very long shot' proposals that only start to make sense if we introduce fantastically large numbers of humans to the benefit side of the equation look suspiciously like Pascal's muggings.[3]
Plus people making longtermist arguments typically seem to attach fairly high probabilities to stuff like AGI that they're working on in their own estimations, which if true would make their work entirely justifiable even focusing only on humans living today.
(A moot point but I'd have also thought that although the word 'longtermist' wasn't coined until much later, Bostrom and to a lesser extent Parfit fit in with the description of longtermist philosophy. Of course they also weren't the first people to write about x-risk)
I suspect the main answers would be to do with religious prophecies or strengthening their no-longer-extant empire/state
Notwithstanding fringe possibilities like the possibility humans in a million years might be better off not existing, or for impartial total utilitarians humanity might be displacing something capable of experiencing much higher aggregate welfare.
Not just superficially in that someone is asking to suspend scepticism by invoking huge reward, but also that the huge rewards themselves make sense only if you believe in very specific claims about x-risk over the long term future being highly concentrated in the present (very large numbers of future humans in expectation or x-risk being nontrivial for any extended period of time might seem superficially uncontroversial possibilities but they're actually strongly in conflict with each other).
One of the more excellent comments I've ever read on the EA Forum. Perceptive and nimbly expressed. Thank you.
Very well said!
I totally agree. To be clear, I support mitigation of existential risks, global catastrophic risks, and all sorts of low-probability, high-impact risks, including those on the scale of another pandemic like covid-19 or large volcanic eruptions. I love NASA's NEO Surveyor.
I think, though, we may need to draw a line between acts of nature — asteroids, volcanoes, and natural pandemics — and acts of humankind — nuclear war, bioterror, etc.
The difference between nature and humankind is that nature does not respond to what we do. Asteroids don't try to foul our defenses. In a sense, viruses "try" to beat our vaccines and so on, but that's already baked-in to our idea what viruses have been for a long time, and it isn't the same thing as what humans do when we're in an adversarial relationship with them.
I certainly think we should still try our absolute best to protect humanity against acts of humankind like nuclear war and bioterror. But it's much harder, if not outright impossible, to get good statistical evidence for the probability of events that depend on what humans decide to do, using all their intelligence and creativity, as opposed to a natural phenomenon like an asteroid or a virus (or a volcano). We might need to draw a line between nature and humankind and say that rigorous, cost-effectiveness estimates on the other side of the line may not be possible, and at the very least are much more speculative and uncertain.
I don't think that's an argument against doing a lot about them, but it's an important point nonetheless.
With AI, the uncertainty that exists with nuclear war and bioterror is cranked up to 11. We're talking about fundamentally new technologies based on, most likely, new science yet to be discovered, and even new theoretical concepts in the science yet to be developed, if not an outright new theoretical paradigm. This is quite different from bombs that already exist and have been exploded before. With bioterror, we already know natural viruses are quite dangerous (e.g. just releasing natural smallpox could be bad), and I believe there have been proofs-of-concept of techniques bioterrorists could use. So, it's more speculative, but not all that speculative.
Imagine this idea: someday in the hazy future, we invent the first AGI. Little do we know, this AGI is perfectly "friendly", aligned, safe, benevolent, wise, nonviolent, and so on. It will be a wonderful ally to humanity, like Data from Star Trek or Samantha from Her. Until... we decide to apply the alignment techniques we've been developing to it. Oh no, what a mistake! Our alignment techniques actually do the opposite of what we wanted, and turn a friendly, aligned, safe, benevolent AI into an unfriendly, misaligned, unsafe, rogue, dangerous AI. We caused the very disaster we were trying to prevent!
How likely is such a scenario? There's no way to know. We simply have no idea, and we have no way of finding out.
This helps illustrate, I hope, one of the problems (out of multiple distinct problems) with precautionary arguments about AGI, particularly if back-of-the-envelope cost-effectiveness calculations are used to justify spending on precautionary research. There is no completely agnostic way to reduce risk. You have to make certain technical and scientific assumptions to justify funding AI alignment research. And how well-thought-out, or well-studied, or well-scrutinized are those assumptions?