Headline finding: I audited 17 AI Safety Talent programmes. Zero of 17 have published any comparison group, rejected-applicant follow-up, matched control or randomisation. Not one. Every programme that mentions a counterfactual does it by asking participants to self-report.
Background
At least $70 million...
Author: Grace Ryba (she/her), Executive Director
TL;DR:
* BluePerch is a new animal welfare grantmaker.
* Grant applications aren't open yet - we're aiming to open applications in roughly mid-2027.
* We welcome early expressions of interest from potential grantseekers so we can notify you when applications open - express your interest here or see further details below.
* We're also seeking boa...
In celebration of still being alive and fighting, we are giving away 1,000 Amazon e-books of “If Anyone Builds It, Everyone Dies”. Feel free to send a copy to yourself, a loved one, or a friend—we need all hands on deck.
Today marks exactly one year since If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All, by Eliezer Yudkowsky and Nate Soare...
Wrt the first post. This is the largest update I have had on openphil's chances of successfully funding something transformative. I had previously experienced several large updates in the negative direction. Based on those, my prediction was that the list of grants in this new program would be highly disappointing. Instead, all of them actually seem to be in the correct genre. Things that the outside view say sometimes lead to major breakthroughs. This is in contrast to almost all funding to date which I thought fell within the category of interventions or speed ups in development that might improve things but definitely not lead to breakthroughs. My current model says this sort of thing is taste limited, in the same sense that Paul Graham attributes much of the success of yc to Jessica Livingston's taste in founders. In this case I am claiming that the given grants 'taste right' because they are at least aiming at new methods, which is the genre of improvement most heavily overrepresented in top cited research over the last century. I would have a second significant update in the positive direction if this is part of a bigger strategy of exploring a broader range of search strategies, like piggybacking the NIH was.
Edit: double whammy. Added benefit that this sort of thing is noteworthy, raising awareness for these sorts of strategies: https://www.nature.com/articles/d41586-017-08795-0
also made the front page of HN: https://news.ycombinator.com/item?id=16016945