Three passions, simple but overwhelmingly strong, govern my life: the longing for love, the desire to make my time on earth count, and unbearable pity for the suffering of all sentient beings. (To paraphrase Bertrand Russell.)
I'm looking for grantmaking roles in AI safety, AI x animals, and grantmaking infrastructure.
I hold an MSc in computer science, worked as a senior quantitative software engineer (16 years professional experience, 26 years total), have been in the charity space for 16 years, effective altruism for 12 years, and animal rights and AI safety for 11 years.
My top three missions are:
I would like to pursue these and more proactively through incubation, research grants, and retroactive funding.
Previously, I launched a crowdsourced, market-based charity evaluator that efficiently finds and prefilters large numbers of giving opportunities under $100k; ran two charities whose purpose it was to fundraise through events, music, and art, and to grantmake for charities in animal rights and international development; founded EA Berlin; and worked for what is now the Center on Long-Term Risk.
You can get up to speed on my thinking at Impartial Priorities.
Usually, the people who are best positioned to do this are high-context in AI safety, and have been thinking about what’s missing in the field for a while.
Hi, that's me! I've applied as a Field Strategist. It's refreshing to see people think along the same lines! (For the second time really: same with Hypercerts/Impact Markets.)
It's been exasperating to go 5–8 years pitching various ideas to people and hoping someone will fill various gaps in the ecosystem because I'm too busy with my own projects to do it myself. I really want to go meta and facilitate this incubation process more intentionally.
Interesting! It doesn't seem too costly to implement these requirements.
I had to google Zakat though:
Zakat is a mandatory Islamic duty of almsgiving. Every sane, adult Muslim whose wealth exceeds a minimum threshold (called the Nisab) must donate a specific portion of their accumulated assets—typically 2.5%—to help the poor and needy. It is the third of the Five Pillars of Islam.
Surplus sounds useful!
I think everything hinges on the funding unfortunately…
Most of the projects on my list require some $200–500k in the first year to get started, and then can scale to a few million per year over time. The large-scale retrofunding needs to start higher – $10m might work, $100m works for the XPrize, $1b could be the goal.
The natural starting point is the incubator itself, which falls into the $200–500k range, but more towards the upper end to provide seed funding for the incubated projects.
Why did Guesstimate/Squiggle as for-profit not work out?
I'd love to have a call and catch up in any case! I'm curious whether you already have an opinion on whether places like DeepMind will be interested in paying for evals like the two types mentioned here (character and backdoors).
I'd like to throw my hat in the ring and indicate that I'd at least find it very interesting to take over for you to ensure that QURI's mission continues! I'm currently trying to get back into the AI safety grantmaking space, but that'll most likely fail, in which case I would welcome a plan B.
I imagine that the grantmaking bottleneck is overblown – that a 100–1000x increase in grantmaking capacity is easily achievable through hiring obvious candidates (10x) and streamlining the processes through retroactive funding (10–100x). If the funds actually end up doing that, it'll be better again to contribute as a charity entrepreneur, and the plan B would become a plan A.
I'd prefer to expand QURI to projects that have less to do with quantification and more with ranking and clustering, and to adopt more of an incubator-like approach where successful projects turn into spin-offs with their own legal structure over time to introduce more resilience through redundancy. (And more Python.)
That'll probably require about $1m in funding over ~2 years. Is that realistic? Also I'm not sure if it clashes with your vision?
Thanks for surveying this! <3
I'm totally aligned in spirit and have a track record of starting project after project because no one else does.
But I find that for most of the projects that I wish existed, you either need money or fame to get them started. I don't mean a bit of money for the rent but like $1m to incentivize downstream projects or the kind of fame that allows you to beat the cold start problem because it lets you motivate enough people to all try something new.
I'm putting my own projects on the backburner now to focus on applications that can put me in a position where I'm better able to fund them.
My current practical ethics
The question often comes up how we should make decisions under epistemic uncertainty and normative diversity of opinion. Since I need to make such decisions every day, I had to develop a personal system, however inchoative, to assist me.
A concrete (or granite) pyramid
My personal system can be thought of like a pyramid.
The ground floor
The ground floor of principles and heuristics is really the most interesting part for anyone who has to act in the world, so I won't further explain the top two floors.
The principles and heuristics should be expected to be messy. That is, I think, because they are by necessity the result of an intersubjective process of negotiation and moral trade (positive-sum compromise) with all the other agents and their preferences. (This should probably include acausal moral trades like Evidential Cooperation in Large Worlds.)
It should also be expected to be messy because these principles and heuristics have to satisfy all sorts of awkward criteria:
Three types of freedom
But really that leaves us still a lot of freedom (for better or worse):
These suggest a particular stance toward other activists:
Very few examples
In my experience, principles and heuristics are best identified by chatting with friends and generalizing from their various intuitions.
Various non-consequentialist ethical theories can come in handy here to generate further useful principles and heuristics. That is probably because they are attempts at generalizing from the intuitions of certain authors, which puts them almost on par (to the extent to which these authors are relateable to you) with generalizations from the intuitions of your friends.
(If you find my writing style hard to read, you can ask Claude to rephrase the message into a style that works for you.)