perhaps I really botched the writeup but I meant to say that feeling a debt to the future fund is why I'd consider the idea of hiring an unpopular, convicted individual, while many other people would just reject that idea prima facie
while the decision to actually hire Caroline comes from having interviewed her, work trialed her, and assessed her competence and skillset, and having considered Manifund's talent shortages
and as a quick point of clarification, I've returned to working after approximately a week of parental leave.
Okay, unfortunately the EA Forum DM functionality is also broken for me, atm. Could you post a reply with an anonymous email address for me to email the letter to? I'll email from [email protected].
Separately, you seem to think the $500k figure is particularly important. Does that mean that, even if we reached a settlement with the FTX estate to return some lower amount, you believe that we ought to return $500k anyways? This is how I interpret your original post, but this seems somewhat unintuitive to me and I'd appreciate you explaining more.
(I first tried an EA Forum poll, but 1. it error'd and wouldn't create, and 2. it doesn't support multiple choice, just a spectrum agree/disagree, and I couldn't figure out how to express these options correctly.)
Hi! Thank you very much for writing this. It's clear that you've spent a lot of time thinking about this subject, are well-informed, and care about doing the right thing. I will aim for a quick response now in the interest of having you & the public understand the current state of things; I might like to do a more thorough/thoughtful response in the future, but will have to balance that against ongoing bandwidth and legal counsel. (I also have a private letter I've been circulating about this situation which I'm happy to DM you, provided you don't share without checking in.)
I am considering a range of options for what to do about the lawsuit. As I've previously written, and no doubt you've seen:
Manifund ran this program for ~2 years and distributed most of this funding to charities & charitable projects, with the top 3 being Givewell (~$61k), LTFF (~$38k), Rethink Priorities (~$27k). We offered to return remaining funds to the estate; we are still in litigation. This case has been going on for years, and may continue for months at least; litigation takes a while. I do hope to write a retro on this overall program someday.
And then, some context on Manifund's finances: we're not an especially rich organization. We've never received a grant from CG, or most other philanthropic funders; we're primarily bootstrapped off of a 5% ops fee when we match projects and donors. As of earlier this month, we held an estimated $6-8m of assets, depending on how you count, but most of it is assigned to various Manifund donor accounts, or subprojects like Frame Fellowship. See https://manifund.org/finances. We estimated our net unrestricted assets at about $400k, which is something like 3-6 months of runway across all of our ongoing projects (primarily due to ongoing burn from operating Mox).
So, I am mostly considering whether I should make a large personal donation to Manifund to help resolve the lawsuit. I do have some money personally, mostly from having worked at Google for a couple years, and then through public stock investments; but, not that much money. Between me and my wife, we have ~$1.6m in liquid assets. (On paper, my Manifold stock might be worth another $1-2m, but for various reasons I think it's correct to sharply discount that number; for example, the original 3 founders have all left Manifold.) Sometimes, $1.6m feels like a lot, and sometimes, given our 2 kids and the cost of SF, it doesn't feel like very much. (FWIW, I've never taken a salary at Manifund, and at Manifold the founders drew a salary of $80k-$100k, as we were trying to conserve runway.)
Anyhow, I honestly would be pretty open to picking option 2, if it meant that Manifund could work with Caroline in a capacity that is endorsed by the community and the world. (It does depend a bit on Caroline's own plans too.)
I appreciate your writeup for laying out these considerations. Some of my worry is that even if we return the full amount, most people will continue thinking that they don't wish to collaborate with Manifund; your post (and, Andy's?) provide some evidence to the contrary. I think I'll set up a quick EA Forum poll for others to weigh in on this matter.
Thank you very much for writing this! We've integrated Pangram into Manifund, as a flag and visibility filter on projects; on net it's been very helpful due to the volume of low-quality AI submissions we get through the site. However, I am sympathetic eg to your example of a non-native speaker using AI to get their points across. Recently, I had a back and forth with a Chinese-speaking student on Manifund who started with an AI writing proposal which put me off, but I eventually decided to give him a small grant after more dialogue.
I appreciate your headline statement that Pangram's 99.9% accuracy is overstated as well, that was a useful update.
(Disclaimer, I've also recently made a minor ($10k) personal investment into Pangram.)
Thanks again for writing this, Chris. I'm revisiting this essay right now as part of a reading group my colleague @Jen baik is hosting, so wanted to take the chance to write some reflections:
In general, I think all 5 strands make sense: mass outreach, online community, conference, AIS fundamentals, advising. Overall, "more dakka" seems great. If Mox had more money, we could easily turn up the dial on making these things happen. But beyond this:
I feel like these approaches are still more generic for general AIS/EA fieldbuilding, but the shape of fieldbuilding for SF might be particularly different, because a lot of the people you care about reaching are very busy, have high opportunity costs. They're Anthropic or OpenAI employees, or maybe city staffers and policy people
Again, the events scene in SF is quite competitive -- a lot of excellent parties and socials and talks and mixers and conference bid for people's time. It's relatively easy to get any 100 people to show up for a talk, but requires more thinking to get the most relevant 100 people.
I have no idea what's up with the SF AI policy scene. Surely not all these people hang out in DC. Maybe they're in CAIS? (Maybe they're all in Berkeley)
Effective giving and philanthropy, currently, seem quite underserved in SF. Both for the EA-pilled lab employees, and also for sth like "tech CEO who's taken founder's pledge", and a much broader, good ol' fashioned earning-to-give folks -- they seem almost forgotten in the mad rush to have everyone upskill in AIS and/or court the Anthropic $
Also, AI safety founders seem underserved. People keep saying this should be Mox's competitive advantage, and, maybe it should, but it's a bit hard to figure out what specific for-profits seem well positioned to do AI safety stuff. I think Geoff Ralston's Safe AI Fund has mostly pivoted to biosec for this reason? And other AI safety adjacent VCs I know are closing up shop.
Beyond AI safety, emerging tech (biotech/biosec, robotics, fusion etc) seem to do well in SF.
You touch on it already but I also still don't know what the balance between "AI safety" and "EA overall" fieldbuilding we should invest into. I'm a big tent kinda guy, I guess.
I would love to do more of this ourselves (or, fund someone to do this), but as you mention the talent required for it is scarce. I wish, to start, that CG would just publish their own internal analyses about their $10m+ grants, because I expect they spend a fair amount of their own grantmaker time creating those botecs, and having them published would be so much better than nothing.
Thanks! Cool to see Kaya's data; I've always been proud of pushing Manifold to make its stats page public as well
Can you say more about regulatory hazards in global health, and/or give an example? I'm imagining something like "you publish what you did in a developing country, then the regime changes, and then they notice you did a bunch of things they don't like, and put you in jail"
Thank you for the work you do at AIM; it's long been one of my favorite charities. At our wedding, my wife and I each picked a charity for attendees to donate to in lieu of a wedding gift; my wife picked The Humane League, and I picked the then-Charity Entrepreneurship, now AIM. AIM has also been one of the inspirations for the incubator I now organize, Surplus. Best wishes going forward.
Grace, thank you for the work that you do at EA Australia, and at GWWC previously. I still have fond memories of the EAG talk you gave about the importance of marketing for EA, a subject that I think many people still underrate. And while I haven't been to Australia myself, again and again I'm impressed by the quality of the impactful work and people, from the land down under; keep it up.
hi! as I've posted on X:
and as a quick point of clarification, I've returned to working after approximately a week of parental leave.
Okay, unfortunately the EA Forum DM functionality is also broken for me, atm. Could you post a reply with an anonymous email address for me to email the letter to? I'll email from [email protected].
Separately, you seem to think the $500k figure is particularly important. Does that mean that, even if we reached a settlement with the FTX estate to return some lower amount, you believe that we ought to return $500k anyways? This is how I interpret your original post, but this seems somewhat unintuitive to me and I'd appreciate you explaining more.
I've set up a poll now on Manifold:
(I first tried an EA Forum poll, but 1. it error'd and wouldn't create, and 2. it doesn't support multiple choice, just a spectrum agree/disagree, and I couldn't figure out how to express these options correctly.)
Hi! Thank you very much for writing this. It's clear that you've spent a lot of time thinking about this subject, are well-informed, and care about doing the right thing. I will aim for a quick response now in the interest of having you & the public understand the current state of things; I might like to do a more thorough/thoughtful response in the future, but will have to balance that against ongoing bandwidth and legal counsel. (I also have a private letter I've been circulating about this situation which I'm happy to DM you, provided you don't share without checking in.)
I am considering a range of options for what to do about the lawsuit. As I've previously written, and no doubt you've seen:
And then, some context on Manifund's finances: we're not an especially rich organization. We've never received a grant from CG, or most other philanthropic funders; we're primarily bootstrapped off of a 5% ops fee when we match projects and donors. As of earlier this month, we held an estimated $6-8m of assets, depending on how you count, but most of it is assigned to various Manifund donor accounts, or subprojects like Frame Fellowship. See https://manifund.org/finances. We estimated our net unrestricted assets at about $400k, which is something like 3-6 months of runway across all of our ongoing projects (primarily due to ongoing burn from operating Mox).
So, I am mostly considering whether I should make a large personal donation to Manifund to help resolve the lawsuit. I do have some money personally, mostly from having worked at Google for a couple years, and then through public stock investments; but, not that much money. Between me and my wife, we have ~$1.6m in liquid assets. (On paper, my Manifold stock might be worth another $1-2m, but for various reasons I think it's correct to sharply discount that number; for example, the original 3 founders have all left Manifold.) Sometimes, $1.6m feels like a lot, and sometimes, given our 2 kids and the cost of SF, it doesn't feel like very much. (FWIW, I've never taken a salary at Manifund, and at Manifold the founders drew a salary of $80k-$100k, as we were trying to conserve runway.)
Anyhow, I honestly would be pretty open to picking option 2, if it meant that Manifund could work with Caroline in a capacity that is endorsed by the community and the world. (It does depend a bit on Caroline's own plans too.)
I appreciate your writeup for laying out these considerations. Some of my worry is that even if we return the full amount, most people will continue thinking that they don't wish to collaborate with Manifund; your post (and, Andy's?) provide some evidence to the contrary. I think I'll set up a quick EA Forum poll for others to weigh in on this matter.
Thank you very much for writing this! We've integrated Pangram into Manifund, as a flag and visibility filter on projects; on net it's been very helpful due to the volume of low-quality AI submissions we get through the site. However, I am sympathetic eg to your example of a non-native speaker using AI to get their points across. Recently, I had a back and forth with a Chinese-speaking student on Manifund who started with an AI writing proposal which put me off, but I eventually decided to give him a small grant after more dialogue.
I appreciate your headline statement that Pangram's 99.9% accuracy is overstated as well, that was a useful update.
(Disclaimer, I've also recently made a minor ($10k) personal investment into Pangram.)
Thanks again for writing this, Chris. I'm revisiting this essay right now as part of a reading group my colleague @Jen baik is hosting, so wanted to take the chance to write some reflections:
"GiveWell for AI safety" is a subject I've discussed a lot for Manifund and have tried to do very very very briefly (see https://manifund.substack.com/p/how-cost-effective-are-ai-safety)
I would love to do more of this ourselves (or, fund someone to do this), but as you mention the talent required for it is scarce. I wish, to start, that CG would just publish their own internal analyses about their $10m+ grants, because I expect they spend a fair amount of their own grantmaker time creating those botecs, and having them published would be so much better than nothing.
Thanks! Cool to see Kaya's data; I've always been proud of pushing Manifold to make its stats page public as well
Can you say more about regulatory hazards in global health, and/or give an example? I'm imagining something like "you publish what you did in a developing country, then the regime changes, and then they notice you did a bunch of things they don't like, and put you in jail"
Thank you for the work you do at AIM; it's long been one of my favorite charities. At our wedding, my wife and I each picked a charity for attendees to donate to in lieu of a wedding gift; my wife picked The Humane League, and I picked the then-Charity Entrepreneurship, now AIM. AIM has also been one of the inspirations for the incubator I now organize, Surplus. Best wishes going forward.
Grace, thank you for the work that you do at EA Australia, and at GWWC previously. I still have fond memories of the EAG talk you gave about the importance of marketing for EA, a subject that I think many people still underrate. And while I haven't been to Australia myself, again and again I'm impressed by the quality of the impactful work and people, from the land down under; keep it up.