Hide table of contents

Recently, I outlined a new framework and model that goes beyond marginal, ITN-style thinking by accounting for the optimal size of funding. This framework was originally developed to help major donors and impact investors with their prioritization decisions. That said, the associated ideas may be useful to any donor. This post highlights one of these ideas.

The idea is that you should choose opportunities for further investigation based both on your current assessments of marginal effectiveness and how much your assessments might change with further investigation. Because, if an opportunity turns out to be great then you can put lots of funding into it. That is, there is 'value of information'.

I think this is intuitive. It also follows from other heuristics, like 'explore and exploit'. Thus, many people in the EA community may already be acting in alignment with this idea. 

However, I think there has been so much emphasis on marginal, ITN-style thinking in the EA community that it is worth highlighting this idea. 'Value of information' doesn't have to be a separate consideration or heuristic - it arises simply when you take the first step towards non-marginal thinking by also considering funding size.

To make this clear, suppose you are trying to choose which high-level opportunities to prioritize (e.g. cause areas, or even charities within an area). You have an initial assessment, , of the marginal impact per dollar, , of an opportunity. Perhaps from doing ITN-style assessments or direct cost-effectiveness analyses. You also expect that if you conduct further analyses then your assessment of  will update with zero average expected change and standard deviation .

If you only prioritize based on , then there is zero value in doing further analysis because the expected value of  after doing that work is still .

However, all else equal, you will want to put more funding into opportunities with higher . Conceptually, think of this as the optimal funding size depending linearly on . Then the total impact value you expect to generate with an opportunity will depend on the product of marginal impact per dollar and funding size: 

So, you should prioritize opportunities based on their expected value after further analysis . The value of information is .

This can result in some opportunities with low  but high  being top priorities.

One potential example of this is (was) climate change. Over the past several years, I would say that climate has gone from being a relatively neglected cause area in EA (e.g. see this post) to being an important part of the EA funding landscape. 

The big strike against climate in pure ITN-style framing is that it isn't neglected because almost everyone is aware of the issue and tons of funders are putting money towards it. However, it's such a big, varied topic that it seems reasonable to expect high  from additional research. Given this, and with the benefit of hindsight, it seems correct that many EAs looked into climate (and continue to do so).

What other examples can you think of?

23

0
0

Reactions

0
0
Comments


No comments on this post yet.
Be the first to respond.
Curated and popular this week
 ·  · 16m read
 · 
This is a crosspost for The Case for Insect Consciousness by Bob Fischer, which was originally published on Asterisk in January 2025. [Subtitle.] The evidence that insects feel pain is mounting, however we approach the issue. For years, I was on the fence about the possibility of insects feeling pain — sometimes, I defended the hypothesis;[1] more often, I argued against it.[2] Then, in 2021, I started working on the puzzle of how to compare pain intensity across species. If a human and a pig are suffering as much as each one can, are they suffering the same amount? Or is the human’s pain worse? When my colleagues and I looked at several species, investigating both the probability of pain and its relative intensity,[3] we found something unexpected: on both scores, insects aren’t that different from many other animals.  Around the same time, I started working with an entomologist with a background in neuroscience. She helped me appreciate the weaknesses of the arguments against insect pain. (For instance, people make a big deal of stories about praying mantises mating while being eaten; they ignore how often male mantises fight fiercely to avoid being devoured.) The more I studied the science of sentience, the less confident I became about any theory that would let us rule insect sentience out.  I’m a philosopher, and philosophers pride themselves on following arguments wherever they lead. But we all have our limits, and I worry, quite sincerely, that I’ve been too willing to give insects the benefit of the doubt. I’ve been troubled by what we do to farmed animals for my entire adult life, whereas it’s hard to feel much for flies. Still, I find the argument for insect pain persuasive enough to devote a lot of my time to insect welfare research. In brief, the apparent evidence for the capacity of insects to feel pain is uncomfortably strong.[4] We could dismiss it if we had a consensus-commanding theory of sentience that explained why the apparent evidence is ir
 ·  · 40m read
 · 
I am Jason Green-Lowe, the executive director of the Center for AI Policy (CAIP). Our mission is to directly convince Congress to pass strong AI safety legislation. As I explain in some detail in this post, I think our organization has been doing extremely important work, and that we’ve been doing well at it. Unfortunately, we have been unable to get funding from traditional donors to continue our operations. If we don’t get more funding in the next 30 days, we will have to shut down, which will damage our relationships with Congress and make it harder for future advocates to get traction on AI governance. In this post, I explain what we’ve been doing, why I think it’s valuable, and how your donations could help.  This is the first post in what I expect will be a 3-part series. The first post focuses on CAIP’s particular need for funding. The second post will lay out a more general case for why effective altruists and others who worry about AI safety should spend more money on advocacy and less money on research – even if you don’t think my organization in particular deserves any more funding, you might be convinced that it’s a priority to make sure other advocates get more funding. The third post will take a look at some institutional problems that might be part of why our movement has been systematically underfunding advocacy and offer suggestions about how to correct those problems. OUR MISSION AND STRATEGY The Center for AI Policy’s mission is to directly and openly urge the US Congress to pass strong AI safety legislation. By “strong AI safety legislation,” we mean laws that will significantly change AI developers’ incentives and make them less likely to develop or deploy extremely dangerous AI models. The particular dangers we are most worried about are (a) bioweapons, (b) intelligence explosions, and (c) gradual disempowerment. Most AI models do not significantly increase these risks, and so we advocate for narrowly-targeted laws that would focus their att
 ·  · 10m read
 · 
Citation: McKay, H. and Shah, S. (2025). Forecasting farmed animal numbers in 2033. Rethink Priorities. The report is also available on the Rethink Priorities website. Executive summary We produced rough-and-ready forecasts of the number of animals farmed in 2033 with the aim of helping advocates and funders with prioritization decisions. We focus on the most numerous groups of farmed animals: broiler chickens, finfishes, shrimps, and select insect species. Our forecasts suggest almost 6 trillion of these animals could be slaughtered in 2033 (Figure 1).   Figure 1: Invertebrates could account for 95% of farmed animals slaughtered in 2033 according to our midpoint estimates. Note that ‘Insects’ only includes black soldier fly larvae and mealworms. Our midpoint estimates point to a potential fourfold increase in the number of animals slaughtered from 2023 to 2033 and a doubling of the number of animals farmed at any time. Invertebrates drive the majority of this growth, and could account for 95% of farmed animals slaughtered in 2033 (see Figure 1) and three quarters of those alive at any time in our mid-point projections. We believe our forecasts point to an urgent need to address critical questions around the sentience and welfare of farmed invertebrates. Our estimates come with many caveats and warnings. In particular: * Species scope: For practicality, we produced numbers only for a few key animal groups: broiler chickens, finfishes, shrimp, and certain insects (black soldier flies and mealworms only). * Sensitivity to insect farming growth: Our forecasts are particularly sensitive to the growth in insect farming, which is highly sensitive to the success of insect farming business models and their ability to attract future investment. The recent and forecasted estimates, with 90% subjective credible intervals, can be viewed below in Table 1.  Table 1: Estimates of recent and forecasted numbers of broiler chickens, finfishes, shrimps, and insects slau