Data scientist working on AI governance at MIRI, previously forecasting at Epoch and the Stanford AI Index. GWWC pledge member since 2017. Formerly social chair at Harvard Effective Altruism, facilitator for Arete Fellowship, and founder of the DC Slate Star Codex meetup.
There's a field where applicants can paste previous applications as text, but can you add a way to upload attachments?
Resilience as in reducing x-risk by improving our chances of surviving a catastrophe, as opposed to reducing x-risk by decreasing the chances of catastrophes occurring.
I have multiple project proposals that could use funding. Is there a way to submit another application, besides making another account?
I hope I'm not strawmanning cluelessness advocates, but they seem to constantly make this basic error. I haven't seen this point accounted for anywhere but if it is, perhaps you can point me to it.
...no, it's not? The EV of kicking the puppy is still a small negative amount, after incorporating all of the cluelessness-possibilities described above.
If the expected long-run effects precisely cancel out, then you shouldn't kick the puppy, same as you already wouldn't before accounting for highly uncertain long-term effects.
If the expected long-run effects don't precisely cancel out, then you incorporate them into the EV calculation and act based on that.
Cluelessness doesn't change the EV of kicking the puppy from -5 to 0. It changes the EV of the puppy from -5 to -5 ± 1000000. But it doesn't move puppy-kicking up or down in the rank-ordering of possible actions you could take. (You could argue for risk aversion and say this favors neartermist work, but that's a very different claim from the radical cluelessness stuff.)
Do cluelessness advocates have a response to this?
Yeah, if the problem is scarcity of manager time then @lukeprog should be hiring more managers so the managers can manage more grantmakers.
To decide whether you should act based on your cluelessness world preferences or your non-cluelessness world preferences, you'd have to use evidence (either empirical or theoretical) for which world you're in.
But an ordinary consequentialist decision-making process would already take this evidence into account. (I think cluelessness-believers sometimes strawman cluelessness-skeptics and assume that they haven't thought of this or wouldn't update on such evidence.)
I think a more interesting crux is that cluelessness advocates believe that cluelessness undermines consequentialism while leaving deontology or virtue ethics relatively unscathed, but it seems to me that all the cluelessness arguments against consequentialism also undermine other decision-making systems as well.
Even if it's true that it's unjustified, that's not relevant. If the decision-making process can't justify any actions, you can do whatever you want. Might as well act as if it can and do whatever I would have done anyway. (It would be less justified, but... shrug)
Conveniently, it's not necessary to justify it and try to increase anyone's credence that it's true, because the alternative doesn't affect what decision they should make, so they should behave as if it's true regardless of the probability, anywhere from 0 to 100%.
Yes, I understand that you're saying that's a problem that you can't assign a probability-weighted expectation. I'm pointing out that if you can't do that, then cluelessness doesn't support any claims that any other action (besides the highest-EV action based on the premise that you can assign a non-arbitrary probability-weighted expectation) is higher-EV, so you should do the previously-chosen highest-EV action anyway. Therefore cluelessness is irrelevant.
But it's not answered there. If you're pointing at the thing about how UEV isn't a point estimate but a range, that's still irrelevant: even if true, the preferred action is still decided by the scalar value that comes from taking your probability-weighted expectation of that range.
Yes.
If cluelessness is false, then you have some preferred action.
If cluelessness is true, then your preferred action is unjustified.
There's some level of credence in cluelessness. The worst case for your otherwise-preferred action is when p(cluelessness)=100%. In that case it doesn't matter what you do.
So you might as well do whatever you were going to do anyway.
There's no case where cluelessness is relevant to your decision process.