Comments
EA Forum Prize: Winners for January 2021
8 min read · Apr 2, 2021
Meta: I've fallen a bit behind in writing these reports, but we're in the process of catching up.
CEA is pleased to announce the winners of the January 2021 EA Forum Prize!
*Because Ajeya works for Open Philanthropy, a major funder of CEA, she won't receive the $300 prize for second place. Instead, we've distributed that money evenly between the third, fourth, and fifth-place winners (who now receive $300 instead of $200).
The following users were each awarded a Comment Prize ($75):
See here for a list of all prize announcements and winning posts.
Certain posts and comments exemplify the kind of content we most want to see on the EA Forum. They are well-researched and well-organized; they care about informing readers, not just persuading them.
The Prize is an incentive to create content like this. But more importantly, we see it as an opportunity to showcase excellent work as an example and inspiration to the Forum's users.
Note: I write this section in first person based on my own thoughts, rather than by attempting to summarize the views of the other judges.
“Giving Green’s evaluation process involves substantial evidence collection and qualitative evaluation, but eschews quantitative modelling, in favour of a combination of metrics which do not have a simple relationship to cost-effectiveness [...] in every case where I investigated an original recommendation made by Giving Green, I was concerned by the analysis to the point where I could not agree with the recommendation.”
(I left feedback on several drafts of this post before it was published.)
This is one of my favorite Forum posts of the year, perhaps of all time. The author read an organization’s work, saw something that surprised him, and decided to write up his findings. This led to an extremely informative public conversation and substantial changes from the organization in question — and it’s unclear whether any of this would have happened without the post.
A few of the many things I like about the post:
I can’t really summarize this post, since the topics were (of course) highly varied. Instead, I’ll link to some of my favorite answers:
One common feature of Ajeya’s answers: When she encounters someone whose beliefs are different from hers, she always seems to ask about how the person’s models/definitions/values differ from hers in ways that could explain their beliefs, rather than assuming they must be wrong about something. This isn’t uncommon in Forum posts, but I think Ajeya does this more explicitly than most people, and I found it really valuable to see her think out loud.
“After we noticed a couple instances of people who had barely been accepted to the fellowship becoming extremely engaged with the group, we decided to do an analysis of our scoring of applications and eventual engagement. We found no correlation.
“We think this shows the possibility that some of the people we have rejected in the past could have become extremely engaged members, which seems like a lot of missed value.”
When the leadership of Yale EA found that their fellowship selection criteria hadn’t achieved what they’d hoped for, they didn’t just change the criteria. They also took the time to rescind their previous advice in public (so that other groups wouldn’t make the same assumptions), and to explain their methods in enough detail that other groups could easily replicate them.
I think that posts which do this tend to be among the Forum’s most valuable — people are more likely to take action when you explain exactly what they’ll have to do.
I also like that the authors took the time to lay out their past rationale, and didn’t completely abandon it: “We still think these are good and important reasons for keeping the fellowship smaller. However, we are currently thinking that the possibility of rejecting an applicant who would have become really involved outweighs these concerns.”
Emphasis mine on that last point, because I think the best posts are generally those which:
“Recently, I have been trying to figure out what to do with my career, and came across this 80,000 Hours post that mentioned AI hardware. I figured I might be able to work in this area, so I’ve spent a little time (~100 hours) looking into this topic. This post is a summary of my initial takeaways from exploring this, as well as an open invitation to comment/critique/collaborate on my personal career plans.”
I really like the approach Christopher took for this post — he noticed that an organization had some speculative thoughts on a particular area, and decided to see what he could learn about that area, not only for the sake of his own career but to help others who might go down the same path.
(If you’re looking for something to write, consider taking another topic from that post and following in Christopher’s path.)
I don’t have much to say past that — he took a good idea and executed well, creating a well-organized post that clearly emerged from a mountain of research.
...actually, one more thing I really liked was the fifth section, where he not only speculates on potential career paths in AI hardware but also seeks out “role models”, people who have actually taken those paths. In my experience, a lot of theory and supposition is often less valuable than having real-world examples of what something actually looks like, because reality has a surprising amount of detail.
“I came away from the above investigation feeling pretty confused about the nature of cause areas. Given just a description of reality, it didn't seem obvious to me to carve things out into "cause areas" and to take "cause area" as the basic unit of analysis/prioritization.”
Like another recent post on prioritization, this post digs into assumptions about EA work so fundamental that we often forget they are assumptions.
In general, Issa’s concerns about the many meanings of “cause area” seemed highly relevant to what I often see people do on the Forum and elsewhere — throwing around the term in a bunch of different ways that make it difficult to compare “cause areas”, and make questions like “is X a good cause area to work in?” hard to answer.
I also liked this section, in which Issa shares an additional concern about the widespread use of a hard-to-define concept:
“In terms of public discourse, people are actually using the concept of "cause area" to do further thinking. If the idea of a cause area is not a reliable one, then all of this further thinking is done on a shaky foundation, which seems worrying.”
Finally, I appreciated the way Issa approached his question with genuine curiosity (using the format of a question rather than a standard post, and asking for links to prior discussions). I didn’t get the sense that he was dedicated to some alternative definition — just that he was trying to explore the territory around a term.
I won’t write up an analysis of each comment. Instead, here are my thoughts on selecting comments for the prize.
The current prize judges are:
All posts published in the titular month qualified for voting, save for those in the following categories:
Voters recused themselves from voting on posts written by themselves or their colleagues. Otherwise, they used their own individual criteria for choosing posts, though they broadly agree with the goals outlined above.
Judges each had ten votes to distribute between the month’s posts. They also had a number of “extra” votes equal to [10 - the number of votes made last month]. For example, a judge who cast 7 votes last month would have 13 this month. No judge could cast more than three votes for any single post.
The winning comments were chosen by Aaron Gertler, though other judges had the chance to nominate and veto comments before this post was published.
If the Prize has changed the way you read or write on the Forum, or you have an idea for how we could improve it, please leave a comment or contact me.
