TL;DR: 9-week, full-time AI safety research fellowship in London. Work closely with mentors from leading orgs such as Google DeepMind, Redwood Research, SecureBio, etc. Receive a £6-8k stipend, £2k accommodation + travel support, £2.5k+ compute, co-working (with meals) at LISA. ~70% of recent fellows continued on fully-funded extensions (up to 6 months).
Work with your mentor from Google DeepMind, GovAI, UK AISI, Redwood Research, SecureBio, FAR AI, and other leading organisations to produce AI safety research (in Technical Safety, Governance & Policy, Technical Governance, or AIxBio). Most fellows complete a 10-20 page research paper or report. 70% of recent fellows are doing fully funded extensions for up to 6 months.
Support
We try to provide everything that helps you focus on and succeed with your research:
Julian Stastny (Redwood): Studying Scheming and Alignment
Lewis Hammond (Cooperative AI): Cooperative AI
Max Reddel (CFG): Middle-Power Strategies for Transformative AI
Noah Y. Siegel (GDM): Understanding Explanatory Faithfulness
Noam Kolt (Hebrew University): Legal Safety Evals
Oscar Delaney (IAPS): Geopolitical Power and ASI
Peter Peneder & Jasper Götting (SecureBio): Building next-generation evals for AIxBio
Stefan Heimersheim (FAR AI): Mechanistic Interpretability
Tyler Tracy (Redwood): Running control evals on more complicated settings
Who Should Apply
Anyone wanting to dedicate at least 9 weeks to intensive research and excited about making AI safe for everyone. Our fellows share one thing (in our biased opinion): they're all excellent. But otherwise, they vary tremendously – from 18 y.o. CS undergrad to physics PhD to software engineer with 20 years of experience.
Our alumni have gone on to:
Work at leading organisations like GovAI, UK AISI, Google DeepMind, Timaeus, etc.
Found AI safety organisations like PRISM Evals and Catalyze Impact
This is our 7th cohort. If you're on the fence about applying, we encourage you to do so. Reading the mentor profiles and application process itself helps clarify research interests, and we've seen fellows from diverse backgrounds produce excellent work.
This post is co-authored with Ben Garfinkel. It is cross-posted from the CEA blog. A PDF version can be found here.
Summary: Some strategic decisions available to the effective altruism m...
Disclaimer: Although I work on the Groups Team at CEA, I’m writing this in a personal capacity, and this post does not constitute an endorsement by CEA.
Agency - the realisation that you really can just do things.
TL;DR
Biosecurity needs people (of any background) who are agentic and have a high execution velocity and track record....
Summary
Making AI safe and good requires many people to be ready to address crucial problems. However, our current “pipelines” for finding, training, and accelerating talented individuals who could work on these problems are “leaky”, meaning there are many ways they can be improved. This post shows my full overview of the AI safety talent pipeline: where people come from, where they go to learn more, and why this is impactful. I also describe some “leaks” in the pipeline: stages that...