I came here after you did and don't have an answer, but I wanted to comment on this:
One story, the most flattering to EA, goes like this:
"EA is unusually good at 'epistemics' / thinking about things, because of its culture and/or who it selects for; and also the community isn't corrupted too badly by random founder effects and information cascades; and so the best ideas gradually won out among those who were well-known for being reasonable, and who spent tons of time thinking about the ideas. (E.g. Toby Ord convincing Will MacAskill, and a bit later Holden Karnofsky joining them.)"
-
Can anyone give any outside-view reason to think EA is "unusually good at 'epistemics' / thinking about things", or that "the community isn't corrupted too badly by random founder effects and information cascades"?
-
Pet peeve: "spent tons of time thinking about X" is a phrase I encounter often in EA, and for some reason it's taken to mean "have reached conclusions which are more likely to be true than those of relevant outside experts". I think time spent thinking about something is very much not indicative of being right about it. MacAskill and Ord, in my view, get some credit for their ideas as they are actual philosophers with the right qualifications for this job - not because they spent lots of time on it.
I'm not writing this as criticism of OP, as the story was given as a maximally charitable take on EA. What I'm saying is I think that story is extremely unrealistic.
https://www.openphilanthropy.org/research/three-key-issues-ive-changed-my-mind-about/
Came here to cite the same thing! :)
Note that Dustin Moskovitz says he's not a longtermist, and "Holden isn't even much of a longtermist."
So my intuition is that the two main important updates EA has undergone are "it's not that implausible that par-human AI is coming in the next couple of decades" and "the world is in fact dropping the ball on this quite badly, in the sense that maybe alignment isn't super hard, but to a first approximation no one in the field has checked."
(Which is both an effect and a cause of updates like "maybe we can figure stuff out in spaces where the data is more indirect and hard-to-interpret", "EA should be weirder", "EA should focus more on research and intellectual work and technical work", etc.)
But I work in AI x-risk and naturally pay more attention to that stuff, so maybe I'm missing other similarly-deep updates that have occurred. Like, maybe there was a big update at some point about the importance of biosecurity? My uninformed guess is that if we'd surveyed future EA leaders in 2007, they already would have been on board with making biosecurity a top global priority (if there are tractable ways to influence it), whereas I think this is a lot less true for AI alignment.