Comments
More from the author
Curated and popular this week
55
I used AI to fix transcription errors, rerrarange the ideas, and suggest tweaks to the title and some sentences.
Three of the most exciting projects to come out of EA in recent years are, in a vague sense, CEA spinouts:
* Kairos is directly a spinout of CEA and now handles most support for university AI safety groups. Basically everyone I've found who knows them is really excited about what they do
* NEST is an opinionated ideas-fi...
This post presents the executive summary from Giving What We Can’s impact evaluation for 2025. At the end of this post we share links to more information, including the full report and...
Recent opportunities to take action
I felt very discouraged when I heard that there were over 1300 applications for the Gov AI winter fellowship. But now I'm frankly appalled to hear that there were over 7500 applications for the 2025 FIG Winter Fellowship.
Should we officially declare that AI governance is oversaturated, and not recommend this career path except for the ultra-talented?
No on appalled; No on oversaturated; Yes on being clear that AIS projects are looking for the ultra-talented, but be mindful how hard it is to be well calibrated on who is ultra-talented, including yourself.
In my experience, a sizable majority of applicants in big figures like these are both plainly unqualified and don't understand the mission of AIS orgs. You shouldn't assume most or even many resemble you or other people on the EA Forum.
Everyone should be open to not being a fit for many projects or open to the idea that better candidates are out there. I wish for the world's sake that I become unhirable!
Ok that's fair, I guess 'appalled' was just my own personal reaction as someone who'd hoped to have a chance at this. And I agree, if I put my own interests aside, it is good that a lot of people are going for this. And it's good if I'm not needed.
By 'oversaturated' I didn't mean that there's no need for greater talent, but rather that many people will be wasting their time trying to pursue this path. Even if many of the 7500 applicants weren't aligned with FIG's mission... I'm sure the number who are is still very high. With such slim chances of getting a position, I don't think it makes sense to recommend people pursue this path unless they're really a good fit or highly talented.
Yep. I agree there's too great a default towards optimism and that some people are wasting their time as a result.
Based on the numbers I saw when I worked on hiring, I'd say something like 125-200 of the GovAI applicants were determined to work in AIS, properly conceived, as the primary thing they wanted to do. FIG is harder to guess, but I wouldn't be surprised is they just got added to some popular lists of random/"easy" internship opportunities and got flooded with totally irrelevant apps.