Austin: I’m happy to announce that Caroline Ellison has accepted a role at Manifund, to develop our funding platform and research how to effectively direct philanthropic dollars.
In fact, she started a work trial on July 13, which converted to a fulltime role on Aug 10. Over the past two months, she’s been publishing her work and supporting Manifund users under the pseudonym “Carol”.
How did I come to consider this at all?
Why did I hire Caroline for Manifund?
Manifund strives to be unusually transparent. And so, I apologize for our minor deception, in using a pseudonym over the last couple months. I still endorse having done this — I think it’s relatively common to work with people pseudonymously, when their real identity is famous. But I want to call out that we compromised on transparency here, which I do not take lightly.
I understand that some of our users, donors, and partners may now be skittish about working with Manifund, given this announcement. I appreciate any trust you are willing to extend, and ask that you judge us by our historical and future outputs. You (or your LLM) can take a look at Manifund’s source code, underlying data, finances and research; if you wish, you can see Caroline’s specific code commits and comments on Manifund.
I’m happy to take questions, over public comments or emailed to [email protected]. (I can’t promise I’ll be able to reply to every one.) In the meantime, I’d like to ask Caroline to say a few words.
Caroline: I’ve said a lot about what I did wrong at Alameda/FTX—you can read what I said at my plea, during trial, and remarks at sentencing. I’m deeply sorry for what I did, and I completely understand why people may not want to work with me. But I’m very grateful to Austin for giving me a second chance, and judging me on my current work performance rather than my past. I feel very lucky not only to have a job, but to be working somewhere that I think is doing great work and has a mission I believe in.
When I started my work trial, unsure if I’d get a full-time offer at the end, I didn’t want to go through a public announcement just to potentially be let go a month later. But now that I’ve accepted a full-time offer at Manifund, I want to be upfront about it.
I’m excited to continue improving our technical infrastructure, working on operations and customer support, and posting updates on our newsletter.
I probably won’t reply to comments on this post—sorry.
While I am thankful for the transparency and understand that you don't want to take part in discussing this in public forum threads, I, and maybe others, want to.
I have to say, I think this is harming what remains of the Effective Altruism name/brand and is making me reconsider openly associating with it.
If we ever hope to rebuild the trust that was lost and construct a better public image of EA, we need to have strong community norms that people who commit wire fraud, securities fraud and money laundering have no place in any type of financial role in organisations that make up this community.
I get that you have personal ties, and I can understand wanting to act from a position of forgiveness towards a friend and uphold norms of redemption. From an outside perspective, though, these same personal ties can be perceived as more of the same mixing of professional and personal lives that infamously happened at FTX.
I, too, believe people can redeem themselves and, after completing their sentence, should be able to rejoin society. And I also think that the EA community can only ever gain a positive public image if they beat the accusations of fraud and favouritism through an abundance of care about these things and strict professional norms. Background checks for financial roles that exclude people with felony convictions for financial crimes are, in my opinion, justified.
After researching this a little more, I'm quite taken aback that apparently you still didn't return the 500.000$ FTX investment, and instead let it go to litigation. So the Trust that is making the victims whole is currently suing you (Manifold for Charity) for that Money, while you hire one of the perpetrators.
Surely, even though you may not consider these facts related, you must understand how this looks from the outside. Let me spell it out: It looks like Caroline is continuing to benefit from the fraud by being paid by an organisation that kept the money she helped steal.
I think I can share that the $500k was a grant (not investment) from the Future Fund, to fund a program where successful Manifold traders could choose which charities would receive donations: https://forum.effectivealtruism.org/posts/mbBfFHKEDBTwTSSJX/predicting-for-good-charity-prediction-markets
Manifund ran this program for ~2 years and distributed most of this funding to charities & charitable projects, with the top 3 being Givewell (~$61k), LTFF (~$38k), Rethink Priorities (~$27k). We offered to return remaining funds to the estate; we are still in litigation. This case has been going on for years, and may continue for months at least; litigation takes a while. I do hope to write a retro on this overall program someday.
For reference, Lightcone received ~$4.2m from FTX Future Fund and eventually returned ~$1.7m (and then paid some more in legal fees, maybe ~$0.6m): https://www.lesswrong.com/posts/5n2ZQcbc7r4R8mvqc/the-lightcone-is-nothing-without-its-people
(Unfortunately, it's tricky for me to comment on active legal proceedings, but I intend to check to see what our lawyer thinks is reasonable for me to say here. Please follow up if I haven't said anything in 2 weeks.)
I care for non-optics reasons, and would appreciate a follow up when you find the time.
I think I concur. It seems like a bad call to put someone who committed massive financial crimes into a grantmaking platform development/research role, especially one in the EA/AI safety community. I don't disagree that redemption is possible and that people can change, but I think the conditions for hiring someone in these kinds of cases (e.g. time since the crime occurred and weight of evidence that the person has changed) need to be a function of the sensitivity of the role and the magnitude of the crime. And I don't think that bar is anywhere close to having been met here.
If every decision made by any organization under the EA umbrella can make you reconsider associating with the brand, are there any other brands you associate with that manage to maintain the standards you look for?
Every discussion I've seen makes me think that people within EA overwhelmingly think this is a bad idea, and many of them plan to interact differently with Manifund going forward; for a community without formal standards for who "belongs", that seems like as much as you could reasonably ask for (aside from even more overwhelming condemnation, I suppose).
Caveat: Our differing instincts might be informed by a different understanding of where Manifund sits within EA (I think of them as a fairly minor organization, but EA is a loose and chaotic group of orgs, and I only see certain parts of the elephant).
I'm happy that people overwhelmingly think that this is a bad idea. When I posted the comment, this wasn't clear to me. I posted this because all I had seen at that point was a stream of positive comments on substack which all celebrated that Caroline was given a second chance in this way. I wanted there to at least be one comment expressing why this is bad.
I may have overestimated Manifunds importance since it was regularly recommended to me as where I should apply to fund a side project of mine, and I seriously considered it.
So no, I don't reconsider my involvement after every bad action by any org, only when something seems to me like one of the worst moves, while seeing people I respect celebrating it, with little to no pushback (which now is clearly happening).
Many orgs are affiliated with Manifund one way or another by virtue of fundraising.
I wish this weren't the case, for what it's worth. I have some aspiration of Manifund being a neutral utility or infrastructure, similar to Twitter or Substack or Stripe, where it's understood that people and orgs of very different backgrounds will still use it for funding.
There's some evidence of this. I believe Manifund is the only platform that has hosted projects receiving donations from people as disparate as Marc Andreessen and Beth Barnes.
Hey! Thanks for your comments. As mentioned, Caroline doesn't plan on replying, but I am happy to jot some quick thoughts in response:
>FWIW I did send the CEA community health team a draft of this announcement.
Since you mention my team and you emailed me an FYI about 16 hours before this announcement went up, here's my opinion: don't hire someone with a fraud conviction for a finance or philanthropy role.
Thank you for weighing in. And I appreciate that this announcement, as timed and as stated, probably makes your job (and the job of others at CEA, not to mention the rest of EA) somewhat harder. Please let me know if there are things you believe I should do moving forward to mitigate this impact (including, renouncing EA. I've written elsewhere, but I'm considering holding a plebiscite on whether we should be cast out).
I am sorry for not having provided more advance notice; for what it's worth, we decided and pulled together this announcement on a very short timeline overall. I think we decided to announce on Tuesday (pacific time), finished the writeup Wednesday, and started forwarding to people on Wed and Thursday. (I believe we emailed you more like 24h before the announcement, but I agree that this is still very low, and nitpick-y.)
Two reasons we decided to announce on Friday were that 1) Caroline was visiting in-person through the week and 2) my son is due to be born later this week, and I wanted this announced before paternity leave.
I think the heads up was optional; thanks for doing it at all. But it felt weird that you included it in your comment, because a heads up to me doesn't really make a difference on the overall situation.
It took the Catholics 2000 years to get to the point where they could systematically protect and enable paedophiles and still survive the blowback. It should be quite obvious why EA's reputation is far more brittle, especially when it comes to funding organisations.
I think you have every right to hire any cofounder you like if you run a startup, whatever their history, but then it shouldn't be a 501c associated in such a big way with Effective Altruism.
From the perspective of someone who spent years in tedious discussions about being extremely careful with public outreach to not damage the perception of EA as a brand when we were building EA Germany, this feels like a slap in the face.
It took the Catholics 2000 years to get to the point where they could systematically protect and enable paedophiles and still survive the blowback.
This seems both irrelevant and false to me.
Look, Austin made the comparison
I wish that the public would see "EA" as something like, idk, "Catholic", where one bad or disagreeable act doesn't make a particular statement about others.
I may have been more short tempered and aggressive than necessary, and arguing the specifics of what harm the Catholic Church has done is indeed beside the point. What I was gesturing at was: Wishing that EA were the same as a 2000 year old world-spanning religion in terms of public perception when scandals happen has some obvious problems.
I don’t think for-profit and 501c are so different here. Different non-profits have different mission statements and beliefs about what is best for EA.
Sometimes people will do things that harm a brand you share with them, and while they gonna do what they gonna do, it’s natural to be angry or disappointed. I’ve been going through this a lot lately, still figuring out what to do about it.
I don't think "The EA name and brand" is that tricky to reason about really. Also what we "wish" the public could do is unfortunately not reality. I think there are a number of reasonable takes and good arguments for and against focusing on brand, which have been discussed much on the forum. These 2 might be the most obvious
1) "Don't worry about PR it hurts epistemics and decision making. We should openly discuss any topic even if the public find it revolting or outside the overton window. This will help us truly do what has the highest EV, and achieve the most good - public perception be darned"
2) " EA being in good standing towards most people helps EA's do more good. PR is important for attracting people to the movement and makes community building easier. It helps It also helps donors outside EA feel more warm towards EA ideas and spend their money more cost-effectively. If we are not pariahs, or even better seen as good by most people, that will help us redirect more thought, talent and resouces towards the movement.
And everything in between, and probably some orthoganal takes too. There are arguments for and against these. But I don't think its tricky to reason about as you state here.
From my perspective when we call ourselves EAs, or EA adjacents or even just vaguely part of the community, then we do have responsibility to others and the movement for the consequences of actions like hiring someone like Caroline Ellison. You've taken some of that responsibility which is great by posting here and having a discussion.
That said my take (FWIW) I understand your reasons for hiring here, but its probably not wise. I do have a STRONG bent towards second chances though, but I feel it might have been wiser for PR reasons at least to put her in a position which had nothing at all to do with finance. Also you are opening yourself up to a lot of risk if anything bad happens with Manifund finances, even if she had nothing to do it.
"'The EA name & brand' is kind of a tricky thing to reason about."
I don't think it's unreasonable to say that we should be willing to pay a lot to preserve EA's image, and it seems likely that hiring Ellison will cause significant negative backlash. It could be valuable to look at the EA community's historical willingness to pay to improve its image, so here are some proxies:
I lack the information to determine if this hiring decision is net negative or net positive, but I don't think it's impossible to make a reasonable guess for how much we should be willing to pay to avoid bad PR. I hope Manifund receives a lot of surplus benefits from hiring her.
The situation is quite different when it comes to the term "Catholic," as the Catholic Church is effectively an organization with clearly defined decision-making rules; it is clear who is authorized to speak for the Church and who decides on—and is responsible for—imposing sanctions when church officials or sub-organizations behave inappropriately. Perhaps the term "Christian" serves as a better point of comparison. However, when considering the impact on reputation, one should focus on a specific religion and put oneself in the shoes of people who know very little about that religion and are now receiving a few additional pieces of information about it.
I don’t think you should make decisions like this based on “what’s good for EA reputation.” I am not swayed by those arguments here.
I do think — unless you think Caroline was wrongfully convicted or convicted under a bogus law and you can say that — this seems a shockingly naïve decision.
We’ve seen hubris and in-group biased naïveté before, the kind that treats EAs and EA orgs as if we’re somehow above boring, straight-up sensible, standard safeguards within a business because we’re too smart and too morally evolved for all that or something, or too rational. This attitude caused some of the FTX failures. Now you’re here telling us that you’re ignoring boring, straight-up sensible standard safeguards within a business like “don’t hire someone with a finance-related felony conviction into a finance position.” And only 4 years after the crime was committed. What reasons do you have to ignore that standard?
I can be sympathetic and even forgiving in my heart of Caroline as a person. I don’t need to turn that feeling into a finance job for her. I’d be less concerned if an org were hiring her in a comms role based on her writings or something and could assure everyone that she’d have nothing to do with finances. Still controversial, but not so out of touch.
This is not smart or wise. It’s the kind of willful, wide-eyed foolishness, while fooling oneself into thinking it’s good, that we’ve seen before. It does not bode well.
For context, Caroline Ellison has been recently convicted for financial fraud amounting to billions of dollars. Manifund has just hired her for a finance role. They couldn't find a single qualified person that hadn't committed billions of dollars worth of financial fraud?
Nobody has to be diplomatic or mince words here, or couch this in terms of "reputation": this decision is rank incompetence, plainly obvious to anyone with a whit of common sense. Nobody should trust Manifund after this.
To add further context: The Manifund team currently consists of just two employees: CEO Austin Chen and "Carol N", the pseudonym for Caroline Ellison. Literally 50% of the employees in the organization are convicted financial fraudsters.
Now when people have their funds approved, they will know that decision was made by a convicted fraudster. The article recruiting new hires was written by a convicted fraudster (who was hiding it at the time). Irrespective of her actual role, the fact that she makes up a large percentage of the employee base gives her a significant power in the organization: it's crazy that she is apparently the first hire here.
This is a terrible decision on every dimension you can look at it. It's certainly a brave decision: that does not make it a sane or moral one.
It's hard to believe this is real. When you read it, it sounds like a joke. This is a shockingly terrible decision, truly beyond the pale.
On Substack and also a bit on here, people don't seem to draw a sufficiently complex, nuanced distinction between the ideas of forgiveness and accountability.
Can we show compassion, mercy, and even forgiveness to people have done wrong? Yes, absolutely!
When someone has badly abused a position of power, should they be given a similar position of power again soon after? No, absolutely not!
(And that's not even addressing the conflict of interest or potential corruption in this case.)
We can think of a hundred analogous hypotheticals to illustrate this point. Let's say a bartender was convicted of poisoning his patrons' drinks. This is a terrible crime. Can we still show him compassion and mercy? Could we even forgive him? I'd like to believe so, even in the case of such a heinous crime.
But let's say he gets out of prison in a few years. Would it be the right decision for a restaurant to hire him as a line cook? Would that be safe, ethical, and responsible? Hell no!
There are dozens of other jobs he could have that don't involve the risk of poisoning — a customer support agent, a cashier at H&M, or a landscaper, and on and on. Why on Earth put him in a position where he could poison people again?
You could imagine many such scenarios. If a security guard is convicted of assaulting women on the job, should he be hired as a bouncer at a club after he gets out of prison? If a teacher is convicted of abusing children, should she be hired to run a daycare centre upon release? This is not about whether we can forgive these people in a spiritual sense; it's about accountability, or, on an even more basic level, safety.
You could even think about animals. You can hold that animals have absolutely no moral responsibility for their actions; forgiveness is automatic or just not required. But you do not let the fox into the hen house.
Something similar needs to be said about the values of bravery and honesty. In their common use and meaning, bravery means something more nuanced and complex than just doing something scary, and honesty more than just disclosing information. The 9/11 hijackers did something scary, but we don't call what they did "brave". Hitler was honest about his opinion on the Jewish people; do we say Hitler was an honest man? We reserve the word 'brave' for daring actions that are independently good and the word 'honest' for patterns of actions that represent trustworthiness and ethicality.
(It should also be noted in this instance that it was going to leak that Caroline Ellison was hired and this was one of the stated reasons for the disclosure. The information was deliberately kept secret initially.)
Similarly, although we must have the liberality to make room for contrarian and oddball views, the "costliness" of someone's disclosure that they believe aliens control the government does not help my assessment of their epistemic judgment. Nor does it help my assessment of their moral judgment that it's costly for them to disclose they think slavery should be re-implemented.
(Also, how quickly sometimes supposedly costly choices become lauded and rewarded, turning everything upside-down...)
I have tried, at times brutally hard, in my life to live according to compassion and forgiveness, sometimes even at such a dear personal cost that I regret bearing it. It pains me to see the value of forgiveness misused to justify such a reckless, thoughtless decision. Forgiveness does not mean you let the fox back into the hen house. It doesn't mean the absence of accountability. It doesn't mean the absence of safety.
Further reading: emotions researcher Brené Brown on shame vs. guilt, and shaming vs. accountability.
Some quick thoughts on this, cross-posted from a chat group, largely because I'm very confused by people's and organizations strong reactions to this announcement, and usually when I disagree with everyone in the EA community I find out I'm missing some important context.
On object-level concerns: Several comments have indeed stated such concerns. I also think that orgs with poor judgement in one area often exhibit poor judgement in other areas, particularly in smaller orgs. It seems reasonable to be concerned that someone who thought it was a good idea to hire someone recently released from prison for financial crimes for a financial/philanthropy role might also not have the foresight to establish safeguards/controls.
On the value of reputation: I argued why I believe reputation matters in a previous comment. Many AI safety orgs’ path to impact entails convincing policymakers to enact certain legislative changes. This theory of change assumes that the org can actually secure meetings with key staff. The org’s core work (research, expertise, policy recs) matters, but they also need to build credibility and trust.
On how reputation is formed: I would love to live in a world where people looked through and carefully weighed the evidence before drawing conclusions. Unfortunately, that's not how most people outside of EA operate.
Here is one non-EA example: There is controversy over the extent to which the racist, far-right Israeli Minister Ben Gvir represents Israeli policy or society. His party only holds 6 of 120 seats and polling shows he's unpopular. But it's reasonable that outsiders think he is representative because the Prime Minister appointed him to a senior post and continues to sit with him.
Bringing it back to EA: I understand the argument that Manifund and Austin do not represent most of the EA community. But it's reasonable that outsiders might think they do if EA orgs don't take steps to distance themselves. I'm glad to see CEA doing so.
As an aside: I am not sure I agree with the characterization of Ellison's role or Manifund's role as inconsequential. I do not know if Ellison is "low-paid" (which is subjective anyway) --- or what her counterfactual job opportunities would be at this point (I doubt Jane Street would re-hire her). As others have pointed out, she is (according to Manifund's website) now one of just two employees at an organization that, while certainly smaller than CG, has directed millions of dollars to hundreds of projects.
At any rate, Manifund being small may limit the damage, but that's a separate question from whether the decision was defensible.
Meta note: In many ways, EA entails doing math for good. Naturally, it attracts a lot of quantitative-minded people some of whom are less qualitatively inclined. IMO, this sometimes leads people to miss the ways in which PR can be impact-relevant.
This is not really directly relevant, but I feel somewhat confused by considering statements made during a trial as strong evidence of someone taking seriously the harm they caused (to be clear, you didn't express this directly, but I've seen other supporters of this decision say this, and Caroline's message suggests I should take her statements in the legal proceedings as evidence). Caroline was directly incentivized to both cooperate to make creditors whole, and to express regret and wrongdoing, because she would spend more time in prison if she did not do these things. I think it would be far more meaningful evidence if she had, for example, come forward and admitted to wrongdoing and helped right things when she did not have an incentive to do so (e.g. whistleblown before things blew up).
I don't really think individual organizations have an obligation to protect the brand of EA as a whole, and ideally they just improve the brand of EA by doing good things themselves. But I'm a utilitarian, and I aggregate. I hope that you're right that she's an incredible hire, and the marginal value Manifund produces by doing this offsets the obviously very large costs the ecosystem will bear due to your decision.
As most commenters write, hiring Caroline for a finance role does not strike me as the best decision. One thing I find missing in this conversation is putting ourselves in Austin or Caroline's shoes.
Most comments are expressing amazement that Austin would hire Caroline when it's so bad for Manifund's reputation. If anything, this strengthens my view that Austin is doing something costly--much more expensive than the $500k FTX investment Manifund is trying to keep--because he believes it's the right thing to do. We should be encouraging people to do what they believe is right even if it's unpopular. Dragging Austin through the mud for doing what he believes is right does not seem like the ideal way to express disagreement. (On the FTX clawback, that legal dispute is several years old and doesn't strike me as relevant to the recent hiring decision.)
For Caroline, imagine you're an EA who made a catastrophic moral error. You'd feel horrible about it, you'd spend years reflecting on it, and then you'd hope you can do something useful and constructive with the rest of your life. Presumably you'd want a job where you can leverage your existing skillset to do something good.
Some other commenters give me the impression that they believe Caroline is a particularly bad person. When we look at historical atrocities, slavery, the fact that most people sleep perfectly well at night contributing to factory farming, etc, the main lesson we should draw is that most people do terrible things when their surroundings excuse it, and show far less regret than Caroline has.
In general, I believe people should have a concrete rule for when they forgive others. For myself, I need to believe that everyone has a path to redemption, no matter the magnitude of their crimes. So my personal rule for forgiveness is that I need to believe the person wouldn't commit the same crime again if they were in the same position. From Caroline's statements, it seems likely to me that she sincerely regrets her actions and wouldn't do it again, so while I wouldn't hire her as a finance professional, I do forgive her on a personal level.
It'd be constructive if we spent more time thinking about what the path should look like for someone who wants to contribute to the EA project but has committed catastrophic moral errors in the past. At present, hiring this person for a finance role in an org with a fiduciary duty to donors strikes me as premature. Still, to me, anyone who's sincerely repented deserves to be able to make use of the rest of their life to make the world a better place.
“the main lesson we should draw is that most people do terrible things when their surroundings excuse it, and show far less regret than Caroline has.”
Hiring Caroline for a finance position within 6 months of her getting out of jail for billions of dollars of fraud is exactly her surroundings excusing it.
Thank you for writing this comment.
hiring Caroline for a finance role does not strike me as the best decision
Optics aside, I do not personally find the decision objectionable. When someone has been found guilty of violating a norm, it is not immediately obvious whether they should be considered more or less likely to violate it again. On the one hand, the specific violation is evidence of a general disposition toward that kind of transgression. On the other hand, being caught and held accountable can leave an indelible mark, and prompt serious self-reflection and self-improvement. On priors, I’m not sure which effect dominates. But in Caroline’s case, it seems reasonably clear to me—given my knowledge of her background, court transcripts, and existing incentives—that she is very, very unlikely to engage in anything remotely resembling financial fraud ever again.
I agree with your approach to reasoning about the chance of recidivism, and had been mulling it over much the same way when I wrote my above comment. My uninformed prior for the average ex-con recently released from prison would be cautious, just because my understanding of the literature on recidivism rates tells me that for the average person, the tendency to violate further seems to be stronger than the mark of having been held accountable.
Of course, every individual is different. If you know Caroline well enough, have done deeper research into her case, and feel you're able to be objective about the matter, it might be completely reasonable for you to be fine with hiring her for a finance role. Given that I don't know Caroline personally, nor have I dived deep into the particulars of her situation or her public statements, I currently lean towards greater caution. (In my personal experience, I've been burned by people enough times that I'm sadly in general less trusting than I was, which might play a part in this too.)
Over the next few years, if Caroline continues on a better path, I am hopeful that she will earn our trust once again.
If anything, this strengthens my view that Austin is doing something costly--much more expensive than the $500k FTX investment Manifund is trying to keep--because he believes it's the right thing to do.
No, it's because Caroline plays with his 2-year-old daughter. He explicitly said this
More generally, jumping from "this is costly" to "it's a signal of moral goodness and conviction" is a silly line of reasoning that's common in EA circles.
Thank you for saying this.
To tie things to current events: it's plausible to me that some frontier lab employees working on AI capabilities, may be grappling with situations that rhymes with Caroline's at FTX. I think Jacob Coxon (and others) are acting admirably in this regard. (I may try to write out more thoughts on this later.)
I also worry about the converse: because various AI safety people are genuinely well-intentioned, some people assume that their work must be good for the world.
Sadly, good people do indeed sometimes do bad things, and we are well to remember that fact.
Reasonable, thank you for flagging! @richard_ngo has been writing a series on this, how AI safety-motivated people, inside and outside of labs, may have contributed significantly to speedup. And he argues that even orgs that many people admire, like METR, are not immune to this -- I think he has a quote like "the METR graph has significantly contributed to race dynamics"
I don't have a settled thought on whether I agree overall, but I certainly appreciate his speaking up. I believe his stance is also that we should give up on "EA", which, I currently disagree with. (But, perhaps "EA" will give up on me...)
t's plausible to me that some frontier lab employees working on AI capabilities, may be grappling with situations that rhymes with Caroline's at FTX
I agree with this and thought about a similar connection when I read your OP, but I feel like you are badly mis-analyzing the situation. I think my other comment (which I know you replied to, thanks!) is super relevant here.
In that comment, I articulate the idea that your worldview strongly emphasizes incentivzing and valuing ambition and risk-taking, and I contrast this with a view that incorporates "red lines". The relevance of this to the AI situation is two-fold:
Many AI employees who may be considering leaving AI labs probably didn't violate any common-sense morality red lines. Notably red lines that derive from "common-sense morality" are not necesarily 1-1 with expected harm, which I think is a fact that EAs/rationalist don't seem to have entirely internalized in the discussions around AI.
A huge fucking reason why people joined the labs in the first place and continue to join or work at them is the exact ambition-based mentality you seem so enamored with. Just take a look at some of the Greg Brockman documents that came out of the litigation with Musk, or observe that its Sillicon Valley, not some other culture, where these labs are coming out of. Bro, the call is coming from inside the house!!!!
100%. Arguably worse on the frontier lab employees’ part given they’re endangering all of our lives.
This answers one of my questions, thank you. I expect you can’t say so directly without making your advisors nervous, but I would gather from this that you may think that FTX was working on a financial frontier where things were moving fast, and that poor internal systems and culture at FTX were all wrapped up into a very complex mess where even a talented and typically quite ethical person could find themselves in a morass and be unsure how to get out.
Fwiw, if I’m close to right on that front, I agree with you! That is not far from my view. And, I think some of those people very clearly should have trained stronger intuitions around redlines they simply don’t cross for the EV when making decisions.
I think you should still be very discerning and careful, to Ben’s point, with the human tendency to assume the best of our peers and take risky action on that basis. I don’t think you’re wrong for assuming Caroline is a smart, empathetic person who can do good work despite her conviction. I think the decision to put her in a core position in your org is wrong, because it disregards some clear “just don’t do that” principles from accumulated deontological wisdom that should really give you more pause. Even in a rapidly changing world, I think we and you should have a much higher bar for ignoring that wisdom.
Most comments are expressing amazement that Austin would hire Caroline when it's so bad for Manifund's reputation. If anything, this strengthens my view that Austin is doing something costly--much more expensive than the $500k FTX investment Manifund is trying to keep--because he believes it's the right thing to do. We should be encouraging people to do what they believe is right even if it's unpopular. Dragging Austin through the mud for doing what he believes is right does not seem like the ideal way to express disagreement. (On the FTX clawback, that legal dispute is several years old and doesn't strike me as relevant to the recent hiring decision.)
It seems to me like you're trying to have it both ways here. Effectively: People who think Austin is very wrong shouldn't criticise him too much, because then people won't do things they think will be unpopular even when they think they're right. But those people criticizing have their convictions too. Are they to not act on it because clearly Austin's is stronger ? What should they do instead ? Do you think everyone should email them (private), or what ?
It’s completely fine to criticize him, but I think it’s wrong to shame him. To your point, Austin’s critics have their sincere convictions, and I would find it equally wrong for Austin to shame them.
I think it’s virtually always a bad idea to shame people for standing up for their convictions, even if you disagree with those convictions. Shaming people alienates them and entrenches them in their positions. In contrast, civil debate improves community epistemics and is far more likely to change the person’s mind.
For an example, due to rejecting person-affecting views (PAV), I don’t think there’s much of a moral difference between the work of population-reducing EA charities and, well, killing people. A few years ago, I publicly critiqued these charities for this reason, and I ended up having some civil conversations with the charity founders, who endorse PAV and sincerely care about helping people. We’re on good terms and are all still members of the EA community. I don’t think anything positive would have come out of me shaming these founders, and I’m glad I didn’t.
Similarly, my presumption is that Austin is hiring Caroline because he thinks she’s very unlikely to reoffend and he believes empathy to her as an individual is more important than the reputational damage that will result from this. I think the object-level debate on these points in the comments section is great, but shaming him for holding this perspective would be neither kind nor helpful.
Personal notes: I've had friendly interactions with Austin and spent some time in the Mox coworking space. I've never met Caroline, though I liked her Tumblr and hope she finds ways to do good moving forward. The FTX collapse cost me thousands of dollars, destroyed a video game I loved, made my job much harder for the next year, and damaged a community I love.
Thoughts on the situation, as someone who cares a lot about EA's reputation and also thinks it's sometimes good to make unusual decisions based on controversial ethical principles:
Perspective-taking: Ariel's comment is really good. Read that first if you haven't.
Competence: Having read Going Infinite and a bunch of news stories, I don't feel qualified to distinguish between "Caroline is bad at operations/finance/judging ideas" and "Caroline is good at those things — after all, FTX/Alameda had lots of early success — but she got overwhelmed by the complexities of an org with billions of dollars in assets while struggling with interpersonal entanglements". If Austin thinks her abilities are a good fit, I'm not all that inclined to doubt him.
Personal ethics: My ethical qualms are with Austin, not Caroline. I don't think her ethics matter much for this role: she is unlikely to end up in a situation where the pressures on her, and decisions available to her, even vaguely resemble her situation at FTX. I'd still feel safe using Manifund's platform while she's involved.
Is this a good decision (impact)? Seems terrible from the standpoint of furthering Manifund's goals. It's also a small ding on EA's reputation as a whole, with whatever damage that implies. But I think Austin understood those things, and impact wasn't his primary focus.
I wouldn't have made this decision in Austin's shoes, given the chance that it could undo years of work to build Manifund, but I respect that EA contains lots of people with unusual perspectives and that they'll sometimes do things I wouldn't. That said, I'll reserve my donations for people whose perspectives are closer to mine.
Is this a good decision (ethics)? I don't think it's unethical to hire people with criminal backgrounds, and the weak "finance" connection here doesn't change my view (see "personal ethics"). But I agree with others' concerns about paying someone with money they helped steal. If Manifund doesn't pay back the FTX money, that would breach my ethical standards; I'd hope that any org self-labeling as "EA" would do better.
Using loyalty and indebtedness as hiring criteria strikes me as unwise, but not unethical, as long as Austin is honest with his donors about his motives.
What does this say about Manifund? If I wanted to predict Manifund's actions, I'd care more about the years of activity they've documented than this particular hire. If you thought they were a good grantmaker before, it's reasonable not to update much. However:
EA's reputation: Overall, this is small potatoes. FTX is famous, but the fame is fading. Caroline is much less famous than SBF. Manifund is an obscure org. From my recent experience, EA's reputation seems to hinge more on AI safety (and the age-old GiveWell/ETG stuff) than FTX. If Caroline were broadly welcomed back, that would be unusual, but the most common reactions being either severe skepticism or outright condemnation is... pretty much what you'd see elsewhere, for better or for worse.
Should Manifund be "organizatio non grata" in EA? This is up to the loose collection of orgs and people that comprise "EA", not any single entity. I respect anyone's decision to update on Manifund as they see fit. If I ran EA Global or made grants, and I had to decide whether to invite/fund the org, I'd consider it (assuming they paid back the FTX money). But I would expect to end on "nope, this crosses too many lines even if I like Manifund's work and see Austin's perspective".
I agree with most of your points except "this is small potatoes". Caroline is the protagonist of The Altruists coming out in November, which will likely get lots of eyes on what she's doing now. If the series completely flops, I'd agree.
I think Nick Bostrom left a reasonable impression on a subset of people who are actually pretty relevant to the project of effective altruism. Friends whom I'd put in the general category of 'informed readers of the New York Times' still say things to me like, 'What about that Bostrom guy? Seems pretty racist...'. It's the same with FTX, the EA castle, blah blah.
And then people I've spoken with who work with ultra-high-net-worth individuals say they have to be very careful about associating with EA because it has a terrible reputation amongst a large proportion of these individuals, particularly in the US, largely because of FTX.
(FWIW, I think Austin's decision is a bad one in and of itself - reputation stuff put to one side. My reading of Caroline's court transcripts, Going Infinite, etc., suggests to me she's a smart, hardworking, well-intentioned individual who is vulnerable to doing things she disagrees with when encouraged to do them by a sufficiently 'charismatic' individual. In other words, not someone who should be in a high-leverage role).
I don't agree with your argument when you put aside the reputation stuff (that one is pretty correct, I feel). People aren't static. The definition of Caroline as "smart, hardworking, well-intentioned individual who is vulnerable to doing things she disagrees with when encouraged to do them by a sufficiently 'charismatic' individual" is a snapshot of her at the time of FTX. I'd make the guess that her experiences have taught her a lot since then ("Zeus set mortals on the path to wisdom, establishing as a law that through suffering comes learning"). While the first three traits likely haven't changed much, her surrounding psychological situation definitely has. This is not an excuse of what she did, but if the question is whether her behaviour at Alameda gives us good reason to think she is currently unsuitable for a high-leverage role, I would in fact make the opposite prediction, and be willing to bet on this against pretty unfavorable odds.
I agree she's now likely to be less vulnerable than she was - I assume she's learned something from her experience. However, I think she's still more likely to be vulnerable in this way than someone who has no track record, or has a positive track record. People aren't static, but they're also far from being perfectly fluid.
Fair. Neither of us has access to detailed information, so for the last part, we just have to trust our instincts and our mental models of people. I'd still say the opposite: precisely because of what she's been through, my guess is that she's probably less vulnerable to fall again into anything resembling the past, and to overcompensate in the opposite direction, i.e., adopt strict deontological behaviors and never be willing to engage or condone even very mildly greyish-white stuff.
I think if she really was overcompensating she wouldn't go for this role because a) the ethics of hiring her are clearly contestable (check out the number of comments on this post) and b) Manifund has made contestable decisions in the recent past.
Perhaps my wording was too broad. What I meant by “strict deontological behaviours and never be willing to engage or condone even very mildly greyish-white stuff” was specifically in reference to the failure modes that brought her to her current situation. I would expect her now to be exceptionally reluctant to lie, conceal material facts, cross clear legal or fiduciary boundaries, let consequentialist reasoning talk her into something she independently thinks is wrong, or defer to a charismatic authority figure against her own judgement.
I can understand why many EAs would be extremely wary of the reputational consequences of having her work in anything associated with EA. But from her point of view, assuming she is a well-intentioned person who wants both to do as much good as she can and, perhaps, compensate in some measure for the enormous harm she helped cause, I don't think it would make much sense to adopt a rule of avoiding any high-impact work for which she is unusually well suited merely because her involvement will itself be controversial. And, as this thread illustrates, her options for that kind of work are presumably much narrower than they otherwise would be.
I also don't think the Manifest example is very probative here. EA isn't ideologically homogeneous. There is, at least in my mental model, a substantial divide between a more left-oriented tendency that places greater weight on movement growth, reputational considerations, socially acceptable causes and “Classic EA™”, and a more Rationalist-influenced tendency that places greater weight on radical truth-seeking, willingness to explore weird or unpopular ideas and interventions, quantitative arguments even when their conclusions are socially uncomfortable, and comparatively more attention to AI and longtermism.
You can certainly disagree with the latter tendency, and particular decisions made under that banner can of course be bad. But merely inviting heterodox or objectionable people to a conference is not, to my mind, evidence of the kind of ethical laxity that would make me worry about Caroline repeating her Alameda failure mode. “Works for a company that makes controversial judgement calls about whom to platform” and “is willing to lie, commit fraud, or override serious moral reservations because a charismatic superior has produced a consequentialist justification” are very different things!
Hiring because of "loyalty and indebtedness", where those terms largely refer to a 501c3 donation, is illegal (to the best of my understanding, I'm not a lawyer but I've spent a great deal of time understanding and dealing with 501c3 rules)
When I plugged this statement into Opus, it mostly disagreed outside of direct quid pro quo cases or scenarios where the donor gets more than they gave. I could see this scenario being a legal gray area, but I generally don't think it's unethical to make private hiring decisions based on whatever criteria you want. (Though it gets more complicated when you bring in issues like racial preferences or hiring people incompetent enough to cause harm to third parties, and I understand why a lot of people put Manifund's choice in the latter category.)
I do think charities have some obligation not to "betray" their donors by using their money for things the donors would be appalled by. If some of Manifund's donors don't like the thought of their money paying for Caroline's salary, I hope they'll have some recourse (though of course it's complicated to figure out whose money pays for what within a charity).
Thank you for weighing in, Aaron. I'll note that Manifund is unusually, primarily "bootstrapped"; which is to say, we have received comparatively few direct donations for our operating expenses -- perhaps $100-300k in total over 3 years, primarily from SFF rounds? Instead, we earn our operating expenses on a 5% fiscal sponsorship + operating fee, taken on large donations made through the platform, probably north of $500k in total. We've also earned some money via treasury operations and other arrangements, including, at one point, a loan to Lightcone.
Of course, it's possible that some of our past donors will be unhappy with their 5% fee being used in this way; but I would argue that this is a bit more like paying a 2.9% fee to Stripe and then Stripe hiring someone you don't like.
You’re asking us to believe that Caroline can not only out-contribute the next best available candidate, but out-contribute that PLUS the negative externalities she brings to the project and everything associated with it. I urge you to set aside your personal feelings and consider how many projects this affects.
Yes! Surprised how little at-the-margin thinking is on display at Manifund and in the rest of the comments.
I note that in this post Austin doesn't actually directly acknowledge that FTX misused customer funds, instead just saying that he's "conflicted," and that FTX "did wrong" and its "collapse harmed users". I'm particularly confused what there is to be "conflicted" about. For avoidance of doubt: Austin, do you think that SBF and Caroline acted unethically and illegally in misusing customer funds, and do you think it is right that both were given criminal sentences? I think it would be good to clarify this.
It’s strange because Caroline’s message (especially the linked doc) implies that she believes she acted unethically and illegally. It would be weird for Austin to hire Caroline while disagreeing about this.
As Tobias writes, I would encourage you to read the linked doc excerpted from Caroline's public court transcripts.
(I'm being relatively circumspect about my characterization of this event for now, on the advice of our lawyer.)
Note: "You" = Austin in this comment
The sense I get from reading this is that Ellison's history with FTX was a significant positive reason in your mind for hiring her, whereas people might have generally expected this to be a negative factor. This reminded me of your talk with Elizabeth Van Nostrand on the topic of FTX. There, you expressed similar conflicted feeling around the events of FTX. One of the things you expressed was feelings of concern around the community reaction in regard to a sense of loyalty, that the reaction created an impression that people might not stand by someone if things went badly. I feel like there is some tension with the idea that people from the EA community are engaging in backstabbing in terms of their reaction to the FTX fiasco, while presumably you don't view testifying against SBF as similarly implicating the concern about loyalty.
To me, this reminds me of a attitude that I associate with Silicon Vally VC culture and see coming through strongly in the sentiments around this issue. It seems to me like the feeling/pirnciple you are invoke here is more like downside protection than loyalty. I think there is a feeling prevalent in SV that entrenched interests are often the opponents of change and innovation, and that process and rules primarily serve those entrenched interests. Thus, brave innovators need to be willing to challenge and sometimes even break rules in order to change the world for the better. I think this is the idea you get at with your weak doge/buff shiba comment. A follow on from this that seems to have caught on among people of this subculture is that people who engage in these brave risk-taking effors deserve praise and high status, and ought to be protected and admired even if they fail.
You can try to cast that as being about protecting people from the mob (and this is explicitly brought up in the conversation), but to me that doesn't really seem to be the core value being served. Yes innovators and founders may get unfairly attacked by a public that doesn't really understand the underlying issues or a bureaucracy that is controlled by legacy players, but from what I can tell the core "ask" of this SV subculture is to support founders mostly regardless of whether evidence that those things are occuring is present. We are kind of meant to assume that of course that must be happening if someone is critizing a founder/ambitious innovator. The core value here is ambition, not loyalty.
In the talk, You and Elizabeth explore the tensions between your "winning" frame and her "truthseeking" one. I think the analysis I give above fits squarely within that, but I would offer a something of a synthesis that I think you two miss, and that is generally underappreciated in the wider rationality/EA ecosystem:
I believe your "winning" frame is well-modeled by the description I give above, but what of the "truthseeking" frame? Later in the talk you two consider the question of whether "truthseeking" often cause people/orgs to need to slow down. I think this does identify a core problem with "truthseeking" as it is often conceptualized. If I'm trying to make a new cure for cancer, and I'm 95% confident it is safe and effective, am I duty-bound for truthseeking reasons to never let anyone use it until I'm 99.999999% certain? "Truthseeking" sounds great in theory when you are just reading posts about meta-honesty or whatever, but when it comes to application it seems to really struggle with managing tradeoffs. You end up with a situation where people who are doing there best to navigate tough choices can too easily get called out for being "insufficiently truthseeking" for not meeting the arbitrary standards of someone else.
I think there is a reasonable synthesis of these that is actually fairly commonly held outside of EA/rationality, which is that you should try to win, according to your own definition of winning, while treating certain ethical contraints like truthfulness/honesty (in contrast to "truthseeking") as red lines that you need to stay on the correct side of. This solves the problem with truthseeking in that ambitious people have a safe harbor if they stay on the right side of those lines, will still reigning in bad behavior by unscrupulous innovators.
Game theory gets brought up in the talk as well. Within my interpretation of your framework, it makes sense to hire Ellison on these grounds. She was in a sense a victim of the powers that be because she was an ambitious person and the system failed to provide downside protection. You can provide that by giving her a job. Under this view, it is very important to do this in order to send the signal that innovation and ambitition are valued and people will still support you if you fail.
The trouble with this within the "truthfulness" framework that I articulate here is that it fails to disincentivize crossing red lines, and arguably even incentivizes doing so. There have been several incidences of fraud or related conduct in SV VC-funded startups in recent history, suggesting that this may a phenomenon that is genuinely playing out in practice.
(Without yet taking a stance on agreement or disagreement, I've strong upvoted this comment; I think it is well researched and engages with some of the tricky questions of ethics and "doing good", which I am myself always trying to understand better.
I want to be clear that I don't have all the answers, and am often wrong. I appreciate you, and everyone else commenting, who are contributing to our shared state of this understanding.)
I think it's good to give people second chances and I think Caroline deserves a second chance from society. I think it's extremely bad for that second chance to come from an organization that received money that she and others misappropriated from customers.
It is concerning to me that this wasn't obviously disqualifying for this particular position.
To single out one specific point … The sentiment around feeling indebted to FTX and by proxy people associated with it seems like a deeply worrying and flawed viewpoint?
If the argument was purely “she’s smart and can likely do good work, let’s give her a chance”, I’d be far less concerned.
I'm co-director of Effective Altruism Netherlands, writing in a personal capacity. I think this decision is clearly wrong.
Hiring someone with a recent fraud conviction into a finance role at a grantmaking organisation is what ordinary safeguards exist to prevent. Justifying the bypassing of ordinary safeguards because the people involved are smart and well-intentioned is a fair summary of how FTX happened.
This is obviously going to be a very controversial post and action. I'll start by disclosing that I have always been very sympathetic to Caroline, and even with all that's happened, I think any exploration in depth of the whole FTX-Alameda fiasco will still show her to be 1) extremely talented, 2) hard-working (these two should be uncontroversial) and 3) morally serious and conscientious (even though she participated in fraud and made catastrophic mistakes in her life). For argumentative purposes, I think premise 3 is not needed, but I think it is true.
If one wanted to speculate about the possible consequences of Caroline's hire by Manifund, I think it makes sense to consider two levels: the one that affects Manifund and the one that affects EA as a whole.
For the first, I think one can make a case that hiring Caroline is positive expected value for the company. Given premises 1 and 2 and the fact that her actions under SBF have effectively made her unemployable and (I presume) a pariah for most of the EA community, Austin may be getting access to an unusually valuable employee whom much of the labor market is unwilling to hire because of reputational risk. I know lots of you would dispute premise 3 -I have no personal knowledge of Ms. Ellison, but from everything I've read from/about her, I think it is inconsistent not to consider her a deeply moral even if flawed person (and aren't we all?). But even if you're skeptic here, there is no rational incentive for her to be less than extremely, scrupulously honest in the future for the second chance she gets. And I am willing to bet that it will pay out (so direct message me if you want to place a bet). The worst downside for Manifund I can envisage is that donors will refuse to collaborate with them. Will this be a big issue? I don't know. I do feel that there was a subset of possible donors who were already unlikely to donate to the anyway, given that Manifund is, I think, an offshoot of Manifold. And this connects to what I perceive as a battle for the soul of EA that has been taking place for some time, with those who favor maximizing outcomes through making EA more mainstream, more aligned with left values and organizations and more publicly palatable EA causes versus those closer to Longtermism, Rationalism and maximizing outcomes through exploring riskier, unpopular but numerically/theoretically backed actions and interventions, and Manifund would clearly align with the latter.
For the second case, I think it is likely that in the short run, having Ms. Ellison working in a charity that seems at least to some degree aligned to EA will likely be pretty terrible PR for EA. Perhaps in the mid-term too. Then again, given that I think Caroline satisfies premises 1, 2 and 3, I can also imagine her doing a lot of good, impactful work. In fact, my rough forecast for the next couple of years would be something like this:
I see some people seem to find it troubling that Caroline would be specifically landing a a 'finance job', but to my limited knowledge, the functions she's going to be doing (technical infrastructure, operations, customer support, and the Manifund newsletter, research on how philanthropic money should be invested) do not sound like a typical 'finance' job to me. Definitely not like executive ones, or implying she's going to be personally investing people's money.
The first time I saw SBF in a newsletter from 80k and felt skeptical, I self-censored. Even as things unfolded, I talked very sycophantically and did not manage to speak out my doubts.
I don't want this to happen again, and I'm afraid it's happening again, with people playing mind games similar to the ones that convinced them that SBF was living frugally and definitely trustworthy.
In doubt, I'll leave this comment for the record, and will happilly look at it full of shame if need be:
1-I do not trust Caroline and reading the post and the discussion so far does not give me enough signal to trust her more. No hard feelings, but that's just how things are for me and part of my surroundings. If you think she is trustworthy, it means there is probably a way to make me update? It'd probably need to be a very hard-to-fake signal. Trust has to correlate to evidence.
2-Hoo boy, my friends at the EA table in university already had a hard time. It's gonna get even harder for them.
3-I'm afraid this will feed even more of the absolutely pointless EA vs LW war. Will not expand on that.
(2) For what it's worth, I don't think this particular news is likely to reach the people your friends are talking to at their university table.
You could spend years engaging with EA and never hear about Manifund, and if you did, you'd probably hear about the conference they run rather than the decision to hire the second-most-famous person involved in a financial scandal that happened when the class of 2030 were 14-year-olds.
If someone does hear about the decision, and worries that Manifest represents something bad at the heart of EA, you might show them the comment thread on this post — I think it's a good representation of the community as a whole (some people biting bullets, many people pointing out various ethical concerns).
And on (3), I don't see this feeding into any war much: it seems like ~90% of EA people and ~90% of LW people (maybe 95?) think this is a bad decision.
People won't specifically know about Manifund, but I put a high probability that half the reference class that knew about FTX (which happens to correlate, for me, with influential elites) will say something such as "Oh I heard you hired back SBF's criminal girlfriend or something", often from a line read half-attentively in a newspaper or seen online. I've had rumors of this shape around this aplenty in my time, the worse part being that some of those people did not want to talk to us or discuss any of this afterwards (which makes showing this post and subsequent reactions quite hard). The shadowban is the worst part. And this is setting aside pre-existing quarrels where people within the university tried to attack us.
To give you an idea, some of my surroundings were asked in private if SBF were their "boss". I had people enjoy our philosophical discussions, only to walk back and leave as soon as we told them we were from the EA club. It's hard to just live this on repeat mode.
I'm sorry to hear about the issues your university group had — I worked in EA comms during that period, and can imagine how hard it would have been when FTX was headline news. I'm glad that EA was largely unknown when I was starting my school's group.
I still expect this story to be much smaller than the original FTX collapse. SBF has moved from one of the most famous people in the country to an occasional curiosity (e.g. stories about his prison life). Crimes are much more interesting than what the criminals do years later. Outside of tiny crypto sites, I've only seen this story get a couple of blurbs in the business press. I predict that the median university group will hear about it zero times over the course of its recruiting season this year.
As others have noted in this thread, remember The Altruists will come out in November, which will lead to more media attention to both Caroline personally and her connection to EA as a whole.
I disagree with you on (2). I'm staying with friends at the moment. One of them is working in an EA-adjacent organisation but has never been to an EAG or anything like that. She'd already heard yesterday about 'some EA org hiring one of the convicted FTX people' and brought it up with me. She's not a student; she's just online.
On point 2, I think this extrapolates to the whole community and its adjacents, which is why I think this decision is bonkers and potentially extremely harmful for the EA/effective giving space.
I see an opinion on these forums that seems something like, 'We shouldn't care what people think of us.' I heartily disagree. Reputation does a huge amount of work in relationship building and trust. Reputational damage has real consequences (SBF etc etc).
This sort of decision makes speaking to people about the value of EA ideas much more difficult. We can't keep shooting ourselves in the foot like this.
This is why people don't like EA. Astonishingly, monumentally bad judgement.
This is one person's bad decision at one org as far as I can tell, that the vast majority of EAs seem to disagree with. Don't think we should be doing too much self-criticism over it.
You are missing two points:
1. The fact that a single person can make such an impactful decision despite the rest of the community being against it is a sign of poor governance.
2. People outside the EA community will not see it this way.
On (1), on a practical level, how would you propose a community govern the hiring decisions of all affiliated orgs? At first impression, seems like only highly centralized governance could accomplish this, which would worry me more than the harm it could prevent.
I might agree that maybe not much can be done in advance to prevent a leader of an EA organization like Manifund from going rogue, but now that he has gone rogue, what will you do?
Let's say a leader of an EA organization stood in the middle of Fifth Avenue and shot someone. What would you do then?
For reasons given here, I don’t think this case is deserving of shaming the way murder would be.
I'm definitely not missing the second point, since I agree with it and its one of the reasons I think it's a bad decision. But that doesn't mean they'll be correct to see it as something "EAs" are responsible for.
On the first point, I agree with Ariel, I don't really see how the community can have multiple self-governing orgs and also prevent any of them from making bad hires. I don't think Austin would have responded to external pressure on this. And I'm not sure how much prior endorsement from big EA orgs Manifund had anyway.
There are straightforward steps that EA organizations and individuals in EA can take now. Here are a few of them:
The primary goal now is not to influence Austin's actions. The primary goal now is to make it very clear whether effective altruism rewards and endorses financial crimes. Austin's actions reward and endorse Caroline Ellison's crimes and give her a job as repayment for Caroline giving Austin's organization stolen money. Is this the morality that effective altruism stands for? Or not?
If not, it is straightforward to take steps to make that clear. All EA organizations and all prominent individuals in EA or even non-prominent individuals should do that now.
I deleted my Manifold account after the Manifest racism scandal. I have even more reason to avoid Manifold, Manifund, and Manifest now. I strongly condemn this decision.
Effective Ventures, the Centre for Effective Altruism, 80,000 Hours, Giving What We Can, and other EA orgs should make statements. It could be something like this:
Our organization strongly disagrees with Austin Chen's decision to hire Caroline Ellison, who was convicted of financial crimes in relation to FTX, in a financial role at Manifund. We will not work with Manifund or Austin's other organizations in the future, or with Austin. While we support rehabilitation, this is not the way to do it. We strongly condemn the crimes committed at FTX and any attempt to reward or endorse them. Neither crime nor actions that celebrate or incentivize crime are welcome in the effective altruist community.
To be clear, the primary goal of such statements would not be to change Austin's mind, but to discourage criminality and corruption in effective altruism.
And if the EA can't do that, what good is EA? No good.
A first step would be to establish and strongly promote norms for governance structures that need to be in place for affiliation or accepting donations from an individual or organisation. The fact of the matter is these issues have never been prioritised by major community orgs and are rarely discussed until another scandal comes along.
After some reflection, I realized what may be the worst part of this decision.
Austin Chen has decided to reward and endorse Caroline Ellison's crimes at FTX by giving her a job in exchange for the stolen money that FTX gave to Manifund. Austin explicitly said that this decision is out of "debt" to Caroline for the ill-gotten money FTX gave to Manifund. Austin's explicitly stated reasoning is: commit crimes that benefit me and I'll reward you.
Previously, Austin harshly criticized the EA community for its supposed disloyalty to Sam Bankman-Fried in the wake of the revelations of FTX's fraud.
In November 2022, Austin wrote of people in EA who denounced or dissociated themselves from Sam Bankman-Fried:
But from EA folks, this behavior strikes me as cowardly, coldhearted, opportunistic, bandwagon-y, two-faced and distasteful.
In April 2025, Austin said:
I think if you abandon people who have what I viewed as earnestly try to support you and your movement. If you just turn tail on them, be like, "oh yeah, no, actually SBF he was not acting according to our principles and we do not endorse this" and we like give up on all of the stuff that he did. Then when some future billionaire is looking at your movement, what will they think?
And:
...I think we should free SBF and put him to work.
This is a corrupt way to think. This is putting money above ethics.
If someone gives you $500,000 they stole and because of this (not in spite of it!) you give them a job in return, what else is this than corruption? What else is this than a reward for the crime? And an endorsement of the crime?
Nobody can control Austin's decisions and maybe nobody can change his mind. But EA organizations and individual members of the EA community can decide whether you can encourage criminality and engage in corruption and still be a part of the EA community. I think Austin and Manifund should be thrown out, along with Austin's other projects, Manifold and Manifest.
Enough is enough. The line has to be drawn here.
If you're wondering what it would mean to throw Austin and Manifund out of the EA community, here are some steps that could be taken:
Only a few people have the ability to ban people from EA conferences or the EA Forum. But there are some steps anyone can take:
The EA community has the power to decide who it includes and who it excludes. It therefore has the moral responsibility for those decisions. Criminality and corruption should not be tolerated in the EA community.
I understand why some EAs might be skeptical about the importance of communications. After all, lots of ineffective organizations have amazing comms. While good comms does not necessarily imply good work, bad comms often does indeed imply a real judgement issue, which one might reasonably expect would affect the core work as well.
Even though I understand part of the reasoning behind this decision, and I sincerely wish Caroline Ellison well, I feel very uncomfortable with it. I'm particularly uneasy about the personal reasons given as part of the justification.
I think this was overall a poor decision, and it makes me question what kind of governance and decision-making process Manifund has, and whether anyone besides Austin was meaningfully involved.
I weakly think that Austin can hire who he likes.
I moderately think that EA could do with caring a less about reputation and more about good work. Does Caroline do good work? Seems like the org will internalise that, so it's probably up to donors and other orgs to decide.
I agree with both points here. A few general thoughts, echoing something I wrote in 2022.
That said, I think this paragraph is kind of notable:
I felt a keen debt to the FTX Future Fund. They provided seed funding for Manifold. They funded the retreat which drew me into the EA community, and the conference where I met my wife. Much of Manifund’s work today is directly inspired by the Future Fund’s approach.
I also feel a debt to the Future Fund, they gave me my first grant for the work I now do. But I don't feel much debt towards Caroline there. Plus, perhaps, if i am to forgive her her debts, perhaps that should also cancel out benefits?
I believe the entire EA Bahamas Fellowship was Caroline's idea? (But to be clear, Joel Becker was the one who took over and organized most of it.)
One kind-of-funny detail in all this: Caroline herself interviewed, then rejected Manifold initially in Dec 2021. (I doubt she remembers this; I'd forgotten until this week.) It was a later Future Fund regrantor who got us into that fellowship.
Anyways: I agree that the Future Fund team definitely deserves more of the credit than FTX -- and also, FTX's creditors deserve a lot of that credit rather than FTX management. I've offered at times to support folks who worked on the Future Fund or FTX Foundation; happily I think they are all now off doing amazing things.
I guess I am curious if the debt you feel brought her to your attention or changed your decision. I think I weakly endorse the former and weakly to moderately unendorse the latter.
I also think it's brave of Austin to do this, and in general I like bravery, even if it causes people do things I don't like. Doesn't seem like a huge or secret kind of bravery either, which are sometimes time bad kinds.
Adds additional context to https://revive.blog/b/worldoptimization on Manifold's new Blog Revival Project, with Austin pledging towards reviving his then-anonymous coworker's blog.
(Just found this interesting and mildly funny, not saying the pledging or project is bad. Though I agree with others that handling finances at a tiny org is very clearly a bad role for someone convicted of financial fraud )
Thanks for highlighting - to be clear, that was kind of a joke, and a bit of misdirection. (While, also, making a serious statement that I liked Caroline's blogging and hope to see more of it). I'm glad you saw the humor in it!
We never intended to follow through on having Caroline take any donation from me, of course.
Wait, so pledges from you personally on the blog revival project site can just be retroactively declared a joke with no intention of paying out?
I believe I mentioned this verbally with Caroline before making the pledge. I haven't done this for any other other bloggers and have no intention for doing so.
We're in a bit of a pitchforks mood, but I don't think whether Austin and Caroline would have transferred this particular bit of money is a good target.
Caroline presumably would just pay back?
As I read this comment section, the story my mind generates is a people want to express 'this is bad and I want people to see that I think it's bad'. Is that how people who are writing the negative comments feel?
Or do you feel like you could be convinced this is fine/none of your business?
Cos personally I think I could be convinced this is a bad idea, or that Manifund should not be considered an org in good standing[1]. I don't think it would destroy me to come to that conclusion.
I probably do think that Manifund is not an easy safe org for your sweet friend who is new to EA, though I guess I think that of CEA and CG and Nonlinear too
Yes, partly. I want it visible that I think this is bad. A community with no formal membership has very little else. There's no board that can sanction Manifund and no membership to revoke, so what people say in public, under their own names, is close to the whole enforcement mechanism for community norms.
I certainly hope I could be convinced this is fine/none of my business!
For example, if the media covers this and don't draw connections with EA, that would update me towards 'none of my business' (right now I think there is a reasonably strong connection, but if informed outside observers disagree with me on this I'd become less certain). Or if someone could present me with case studies of individuals who were convicted of fraud and then went on to have successful finance-y careers without further misconduct, that would update me towards 'this is fine'.
case studies of individuals who were convicted of fraud and then went on to have successful finance-y careers without further misconduct
Claude says, with various caveats: Michael Milken, Steve Madden, Marc Rich, Dennis Kozlowski, Andrew Fastow.
Thanks!
I don’t follow your question. Can you re-state it differently?
It would not destroy me to come to a different conclusion.
I don’t think this answers your question, but I can easily sympathize with how someone in Austin’s shoes could find reasons to make this call that he sincerely believes are correct, while being a smart and compassionate person. I still strongly disagree with his decision here.
Glad to hear it. I am curious if that is common here, or not (though I guess you can't answer that).
I’m struggling to understand why this had to be announced, given the harms that specifically come from publicising it.
We chose to announce it today because we figured we weren't going to be able to keep it under wraps forever; we didn't want to anyways, per Manifund's spirit of transparency; she was visiting town this week and in-person discussion/collaboration made the announcement easier; and my wife is due to give birth ~5 days and I didn't want to worry about the announcement while on paternity leave.
One hypothesis is that someone else was going to announce it, so it was decided it would be better if he went ahead and did it.
I'm worried this means that my org could now be taking on an unacceptable degree of counterparty, governance, and reputational risk.
This could potentially affect our funding if there's any evidence of a relationship; good governance and risk management practices are a documented condition of some of our larger grants.
Without commenting on this specific case, I think society in general is bad at dealing with people who have made large mistakes, especially former criminals.
I'm sad that PR concerns and risk aversion are legitimate reasons not to do (much) better.
To be clear: I don't condone crime, and FTX's leadership committed serious fraud.
My original comment was a bit unkind—wrote something else after calming down a bit
For me, this comes down to trust.
FTX collapsed because of fraud. Customers lost money they had trusted the exchange to hold, and the people responsible, including Caroline, were rightly held accountable.
I also believe in second chances and the possibility of redemption. I briefly managed cG's criminal justice reform program, and I deeply believe it's a moral good to give people a path back to participating in society after they've done wrong.
But I also believe that trust – especially trust from a community someone harmed – has to be earned, not simply extended. Going from prison for financial crimes and causing harm with philanthropy to a role with real influence over finances and philanthropy on an extremely short timeline is a leap I do not believe has been earned.
Organizations that ask donors to trust them with money should hold themselves to a higher standard. A recent financial fraud conviction would disqualify someone from a finance role at CEA, regardless of any reputational considerations. I am disappointed with the decision itself, not just its effect on our work.
I saw some of the harm Caroline and her colleagues caused up close. When I took over as CEO of Effective Ventures US to lead EV through the FTX crisis, I worked with core EA institutions who incurred significant damage from the trust they had placed in Caroline and her colleagues when they had claimed to be doing good. Tens of millions of dollars and years of people’s work were lost, as was a level of public and community trust that has taken years to even partially rebuild. One of the lessons I took from that period is that we, as a community, extended trust too easily and too fast. I worry Manifund's decision repeats that mistake.
Caroline hasn't done the work to earn that trust back. Moreover, her willingness to take on a role she should have known would cause harm to others makes me concerned that she is not on track to earn that trust back anytime soon. And Manifund hasn't earned the trust that it will be a responsible steward of the community's trust on her behalf. This was a unilateral call by Austin and Caroline, and I think it traded down our collective trust.
I’m writing this message in my capacity as CEO of CEA. It’s important to remember that nobody runs EA, including CEA, and Manifund has the ability to make hiring decisions on its own. But I think it's fair for people and institutions in the community to speak up when they believe an organization’s actions are out of step with the norms and values that hold this ecosystem together. For our part, CEA will be refraining from giving Manifund a platform through our programs for the foreseeable future, such as recruiting booths at our events.
To be clear, this isn't about writing Caroline off as a person. I believe people can change. I also hope Caroline finds good ways to use her skills. But I think it is wrong for Austin and Caroline to make a decision that affects so many of us given I don’t believe that change has been demonstrated, and I don’t believe diving into finance or philanthropy is the right way to attempt to earn the necessary trust.
Thank you, Zach. I appreciate you speaking up in public on behalf of CEA; CEA and your leadership is particularly important at times of high stress and uncertainty. I think the actions CEA are taking are entirely reasonable.
I also want to note for the general public, that Manifund has been but a minor player within the larger EA ecosystem, on many dimensions. (Quick estimates: Manifund moved ~$10m in a year when EA moved $1-10B; has 2 FTE in a year when EA has 1000-10,000 FTE. I think we were more impressive as a share of seed-stage AI safety projects funded, but, still not even the biggest funder in that space.) We did not expect this hiring decision to represent all of EA, and I appreciate anyone who pushes back on that narrative.
I hope that someday, I, Caroline, and/or Manifund will be able to regain CEA's trust through our actions. Until then, I wish you the best with your work, and apologize for making your lives harder.
Thank you, Zachary. I admire the integrity of this eloquent and incisive comment, and I admire even more that it comes with a concrete action attached. Hallelujah.
There is an additional consideration beyond what you mentioned: Austin Chen received $1.5 million in stolen cash from Caroline Ellison, Sam Bankman-Fried, and others at FTX. Austin gave Caroline Ellison a job at Manifund as a reward, a repayment for this stolen cash — a repayment for the debt he feels he owes to her, as he put it. I'm not speculating on his motive; this is what Austin said, openly.
Austin is currently being sued by the FTX Recovery Trust (which represents FTX's creditors) because they want that $1.5 million back. Unlike others in Austin's position, he decided he wanted to keep that stolen cash. And he decided he wanted to reward and thank one of the people who stole it for stealing it for him. His words:
This is just straight-up corruption.
Austin has repeatedly defended FTX executives generally and Sam Bankman-Fried in particular over the last 4 years. As recently as April 2025, Austin said:
What a brazen embrace of criminality. And he put his money where his mouth is when he hired Caroline.
It's a fantastic first step to ban Manifund booths from events run by the Centre for Effective Altruism. Thank you for that. Can I suggest two further steps?
One, ban Austin and Caroline from attending these events (even if they're not setting up a booth). Two, ban Austin and Caroline from the EA Forum. (Yes, she has an account.)
No single entity controls the entire EA ecosystem, and there's only so much even the CEO of the Centre for Effective Altruism can do. But presumably you can do this.
I don't know what else you might be doing behind the scenes, but if you haven't considered it already, you could consider talking to leaders of other organizations to encourage them to take more steps to dissociate effective altruism from Manifund, Manifold, Austin, and Caroline. This moment is a time to show whether the EA community meant any of the things it said in the wake of FTX's collapse, or if it was all talk.