from the paper:
Any perfectly rational agent who is sequentially offered
bets A and B in the above circumstances (full disclosure in
advance about the whole setup, no change of belief in H
during the whole process, utilities linear in dollars) will ac-
cept at least one of the bets.
I kind of struggle to understand what "full disclosure in advance" really means and how it does not invalidate the sequential structure itself. Perhaps I'm missing something.
Any agent who knows the entire set up in advance could just interpret this as "if you take both bets you will get $5 regardless of your probability estimates of anything or lack thereof" so it would be irrational not to do so. Is this in the "Plan" or "Sequence" category?
I suspect "full disclosure" is less strict than what I'm interpreting it to be here?
There’s a descriptive and normative component to your observation.
I’d argue that many donors are surprisingly diversified given direct application of philosophical theory, yes. I’d say the ultimate decision makers are donors, not eg evaluators.
Does said theory predict well what they do? No. Should it? I’m not sure, this is not a theory designed to describe what actors that call themselves altruistic do.
Does it prescribe what they should do? Possibly, but I’d argue diversification is both good and you need another mechanism than diminishing returns to justify it.
(Tbf the animal space is probably where you are most likely to hit diminishing returns among EA cause areas right now. (If you’re a ~ billionaire))
“Maximising expected choiceworthiness involves diversification because the cost-effectiveness of each intervention decreases with spending. Going "all in" on the option with the highest marginal cost-effectiveness would only make sense for a very limited budget”
I’d argue almost all decision makers in the EA space operate in the linear regime where cost effectiveness does not meaningfully decrease.
Yeah I agree - expected utility maximisation really starts to fall apart in this existential risk regime, even over trajectories rather than applied statically, and it only makes sense “locally” and at the margin.
Personally I’m very happy to bite the bullet and not be rigorously utilitarian, but I’m also a global health focussed “old school EA” thinking about how much to diversify donations across charities ;)
I guess the obvious question is: Where do you draw the line regarding who to include in "the community", why, and how does it affect the results?
An explicit swap is very clean and the counterfactual is known. Could they make a non-official, un-enforcable deal (I am very much not an expert on this at all and much less a lawyer!)?
Thinking about how ones situation impacts effective opportunities is also reasonable [1], but who is to say that they have not already assessed their specific viable options and are still convinced that their preferred choice is the best? People want to use their donations to "vote" and express an opinion, and that's probably valuable?
[1] I suspect this is relatively common among people donating to underfunded areas in Animal welfare.
While this sounds intuitively right, I think in the simplest utility maximising setting (iid additive errors with mean zero) your first claim does not seem true? The best looking noisy option is still most likely to be the best?
(I need to think more about the maths, but at least you need some kind of shrinkage to a prior that can change the ranking, which you’re unlikely to get, and if you’re maximising utility the solution is always fully concentrated?)
I burned some tokens iterating with Claude fable and ended up learning quite a bit here: