There are many ways in which EA could have handled it better and I agree with your headline: "EA isn't immune to money, status and power".
At the same time, I really want to push back against the simplistic narrative that Wytham Abbey was obviously a silly and ineffective thing to buy[1]. Lots of people were skeptical that £14.9 million pounds could possibly be well spent buying a historic building when it could have saved like 4000 lives based on GiveWell figures. I think it should be quite clear today that this was way too dismissive.
EA correctly called AI as one of the largest issues of our time early and, by taking this gamble, has managed to achieve dramatic influence over the way this is playing out. This grant was a bet on purchasing a nice venue for retreats could allow EA ideas to become more influential. Given how influential EA ideas have become subsequently, it feels plausible that this kind of bet could have worked out. There's definitely a part of me that views this way of influencing the world as shallow, but, at the end of the day, the world is how it is, and you can have a lot of impact if you can bring the right people together.
Now, it may turn out that the influence of EA on AI is actually net-negative. I put a decent amount of weight on this possibility. At the same time, I mostly don't think the folks criticising the castle should get to claim this as a victory[2]. On the contrary, I consider the whole castle brouhaha to have been a distraction from more substantial issues in terms of integrity.
Many people didn't necessarily object to the castle in and of itself, but more as a PR risk. I think Will MacAskill does a great job of explaining why the "PR mindset" was likely a mistake: "Post-FTX, I think core EA adopted a “PR mentality” that (i) has been a failure on its own terms and (ii) is corrosive to EA’s soul".
It wasn't obvious at the time, but it seems pretty clear to me now that a lot of EA's post-FTX reputational issues were actually the result of EA-on-EA fire and then various folks or groups being unwilling to sufficiently back themselves (if you're not willing to back yourself, why would anyone else back you?) rather than anything that happened. Honestly, I think that a lot of the infighting that occurred after FTX was low integrity behaviour, in particular, people taking advantage of the moment to litigate their grievances. Now if this is true, and I think it is, it creates a bit of a bind. On one hand, criticising the motives of critics most typically ends up sliding into a group becoming more insular and closed-minded. On the other hand, giving bad faith critics free reign without ever calling out their bullshit can be disasterous too, as the near-collapse of EA demonstrated. After all, who wants to be part of a community if there's an active effort to tar the community's reputation, the community itself is full of drama and almost no-one is sticking up for people who are fighting their hardest to make the world a better place?
Just to be clear, there are extremely strong reasons be wary of pushing back against criticism. It's very common for this to start off reasonably and then escalate. At the same time, reversed stupidity is not intelligence. Just because the default is for communities to mess up their epistemics by being overly reactive against critics, doesn't mean that you can swing all the way to the opposite end and everything will be fine and gandy. For a long time, it worked rather well, but then the community obtained money and power and the wrong people flooded in and then when things blew up, they took the opportunity to litigate their petty grievances and the EA community that had previously been able to operate on an assumption of good faith was mostly caught flatfooted and let things play out by default, when we needed to be defending ourselves. (Lucky for us most of the people with the wrong motivations left shortly after).
You linked to your comment here as an example of EA doing poorly on conflicts of interest. Honestly, I think a) you're wrong and that Claire had an extremely reasonable explanation b) your criticism focused on prioritised non-mandatory process over the deeper principles at stake c) I honestly think you should apologise to her and admit you were wrong d) maybe there's enough uncertainty that an apology wouldn't be justified, but I still think it's at least somewhat arrogant for you to be acting as though you were clearly in the right here.
Just to be clear, I'm not trying to put you in the crowd of "wrong people" or "bad faith critics", you seem pretty good faith in this post and I can't remember if I've read any of your other comments or posts so I'm going off this post.
But from what I've read, I suspect that you want the community to focus a bit too much on process over real virtue or integrity. Just to be clear, I'm not trying to dismiss the importance of rules, you can follow almost all the rules, but then let one slide and create major legal trouble for yourself and your organisation. Additionally, there are certain norms that are important, not so much because of legal reasons, but because not following them would be a serious breach of trust[3].
My position is simply that I don't think we should take this so far that we let processes colonise our minds as to what true integrity looks like. If money, status and power draw the wrong people to the community then adding just a tiny bit of extra process around the margins isn't going to save you (but it may distract you).
Don't get me wrong, I think what you're doing here is great (honorable even)!
Accordingly, I am deliberately selecting Board members with a specific brief to be ethical watchdogs within the organisation. I have approached people I believe to be unusually high integrity, and unusually willing to challenge or confront me if necessary.
Second, I am asking some people to become personal ethics advisors to me, completely separate from the Board. This is because I think the bar for someone to approach a Board member with feedback is quite high. I think that external ethics advisors might be able to receive more feedback, including “epistemically rigorous gossip”, than charity directors. They might also be perceived as more impartial.
So where do I disagree:
a) "These are easier to mitigate, because we can choose to change our own behaviours more easily than we can gatekeep the community" — maybe we should avoid solutions closer to gatekeeping because they would be infeasible or they would backfire, but I certainly wouldn't make a decision here merely on the basis of one path being "easier".
b) "If you prefer to appoint people you trust personally and who share EA values to positions of responsibility, they will be conflicted or appear to be conflicted more often than in bigger communities" — We should avoid these conflicts when we can; own it when we can't or when the cost would be too high. Again, we need to comply with all relevant laws, mistakes here can be very costly, but it's worth understanding that laws are designed for a low trust environment (ie. all of society). We can't let this completely colonise our mindset. Some people want us to shift much further towards low trust norms, I feel this is defeatist and so I oppose.
- ^
It may have been a bad investment if it were underutilised or if it didn't deliver significant value over hiring external venues.
- ^
I said "mostly" because this depends on the specifics of what they said.
- ^
I haven't thought deeply about this yet, but I wonder whether thinking about whether an action would be a "breach of trust" with the public would be a healthier mindset than PR mindset but I haven't thought deeply about it. Arguably, the recommended PR response to many situations would be at least a minor breach of trust because you're optimising your interaction with the person to obtain an outcome rather than genuinely engaging with them.
("Jack Lewars is the founder of Ultra Philanthropy, an independent advisory that helps major donors give for maximum impact, and is the fund manager of its Mid-Stage Global Health Fund. He advises donors giving up to nine figures a year, and is Chair of Trustees at High Impact Athletes.")
vs.
("aconcretemoth is unemployed, disgraced, disabled, has been nearly homeless, though has 8 years of college education, and has tried to be the best person he could on EA grounds, a more than reasonable amount of the time.")
(I'm sure this will be called virtue signaling but I really don't care actually; sometimes there are meanings in expressivism. I believe this post is on theme with the Mr. Lewars's sentiments. I am researching AI in general for literacy reasons--I was reading the Pope's encyclical and thought of you--so am probably just visiting).
I am a senior member of the effective altruist community, though new to the forum. I was exposed to EA ideas in 2012 and structured my life around them.
I gave a kidney to a stranger in 2014 and saved the lives of 8 people through the Mayo Clinic.
I aspired to give a portion of my liver but it is unlikely given a mental illness background which came upon me in my 20s.
I donated enough money--mostly gained as a working class or sub-working class individual, who has never made over 60k per year--to be invited as a major donor to TheLifeYouCanSave large donor events.
I studied Derek Parfit and other principles of utilitarianism on my own. I felt that was sufficient to get a move on.
I took in 3 homeless men off the street at various times.
I went off after undergrad into the world informed by but not determined by 80k hours (whose worldview I feel is incomplete) with the goal of becoming a nurse anesthetist. I did the corporal works of mercy.
That career collapsed, due to extreme systemic racism (I could tell you stories) and mental illness.
My sense has been that I may no longer be seen as successful or representative of this community, not being a philosopher, board member, finance type, or AI researcher, that I have nothing to offer it intellectually or in spirit, because I have no access to money or power or prestige or a subtle background in utilitarian problems, nor am I interested (or qualified) in giving out advice or proving the feasibility of a take or idea, and I have no substack to advertise.
I no longer have the power or money to embody EA principles.
But I have lived my life according to some of EA's precepts as a donor and recommender of a certain kind of life, at least to a reasonable extent (less, now). And I think about utilitarianism from time to time. In fact, at the moment, my income is $0 and I have a Class 1 Disability (though I do not qualify for government assistance of any kind nationally or through my state because of how it is designed), and the world has treated me like a dog, in general. I am that race and class of person now whom ordinary people photograph with flash in stores to upload to neighborhood watch sites while I am shopping or getting a coffee. (I am in fact stably housed but certainly downwardly mobile.)
I fell in love with the idea of EA because of a dream of a life lived heroically, frankly-- I see a suffering person and THAT PERSON, RIGHT THERE, is a lens to ANOTHER, SINGLE, INDIVIDUAL person, like myself -- and wanting to help that OTHER person, because I could not help the person in front of me, though I tried to in my career. I knew that person had a name, and I didn't understand their life, so I tried (and it took me too long) to learn a bit about what it might be like, from a radical humility stance. EA seemed to me to be a way to humanize those far away, to be less insular, as a powerful lens on the world, and to redeem something about the world, to enrich my own life spiritually.
It did not seem to be about numbers or computers or philosophical problems. It seemed like a way of empathizing, combined with radical optimism that impressive things could be accomplished, even in a single person's life.
I believe it was an orientation toward power, money, prestige, that make me no longer representative of EA (which would also decline to fund the interventions that saved my life, which is a hard thing to think about); but I recall EA being about a child drowning, once. You should do everything you can to avoid looking like a stooge of the rich and powerful to launder their reputations with charity-washing, and maintain a laser focus that you do what you do because you care about individuals, not numbers or theory.
I mean, a co-temporaneous post is a guy complaining that he should make at least as much as 250k a year for working in AI safety. Well... ok. That seems like a lot of money. I've never had any savings, personally.