So much to say in response to this. First of all, thank you for caring, and for writing this appeal.
I want to start by reassuring you that I agree. Not necessarily with all of your prescriptions (though they are all worth considering) but with the diagnosis. I agree that the Forum has been marginally too focused on 'growth'.
As Sarah writes in another comment, CEA, or a lot of CEA work is indeed focused on community growth. We are proposing an alternative goal for the Forum - roughly 'effectiveness for engaged EAs'. In practice (I'm working on finalising metrics today) this means measuring some proxy metrics - like % of people in "EA" jobs who visit the Forum at least monthly (relevance), number of words in comments (loose proxy for quality of discussion, especially if tempered by karma and ignoring AI), and some measure of ultimate impact, probably surveys of engaged EAs to find out when posts change their donation or career decisions. We've been testing this new theory of change out over the last few months.
Unfortunately, since we've started experimenting with the new ToC, we've had a lot of capacity issues - Sarah left, Agnes is on Maternity, I had to take two months of unscheduled leave for family reasons etc... the bottom line is that right now we are one dev, and one me (who has just got back to work). Despite this we have been able to make some moves in the direction of this ToC:
The cluelessness critiques competition is not an event we would have run for engagement reasons - I was running it because it highlights an important crux for engaged EAs.
The featured page is (the first draft of) an attempt to create future-proofed infrastructure to highlight the best posts on the Forum as EA undergoes growth. I appreciate that its current instantiation has some issues, which I hope to get to this quarter.
My plans for Giving Season (to be announced tomorrow, I hope) are focused almost entirely on causing high quality conversations on important cruxes for engaged EAs.
This new direction for the Forum came from me thinking about two things you mentioned.
"I’m a bit concerned that the EA Forum is going to die a slow death." - This keeps me up at night fairly often - I don't want the Forum to die full stop, and definitely not on my watch.
And this: "To me, the EA Forum was the core intellectual center of EA in the past. It was a place where there was reliably extremely high-quality discussion about difficult ideas. I think that the best version of EA maintains this, and getting the Forum to that place again is pretty important for the future of EA."
That second point is what I called in some memos the 'social reproduction of EA'. We could easily grow an EA movement that is overly attached to the current institutions and beliefs of EAs - a movement that takes current 'cause areas' as fixed, and gets a lot of people into great jobs. This would be very impactful in the short term. But if we want there to be an EA movement existing into the future (i.e. in the next decade) that is capable of coming up with new ideas, and pivoting to the new most impactful cause areas when that's what the world needs - we need to continually recreate EA as an intellectual community, as well as a practical one. This isn't a unique problem to our time, it's in the natural life cycle of a highly committed EA to be excited by a range of causes and ideas, then over time make more commitments such that it is harder, emotionally and likely fiscally, to change direction.
I'm not sure whether the Forum has been successful in the social reproduction of EA in the past - there are some examples of people who become contributing EAs through engagement just with the Forum, but I'd guess that more people become EAs through in-person communities in concert with the Forum, and without the Forum, 'EA ideas' will by default come from orgs which have constrained charitable purposes, and are therefore more sticky and less able to pivot than individuals.
Much more to say but the point is I agree, and I'm very interested in making and keeping the Forum as the intellectual core of EA.
Quickfire on some of your suggestions.
Substack crossposting: This was a very interesting point to read, I'll be thinking about it more. My current strategy with Substack has been to crosspost the best of what I see - with the ultimate aim of ensuring that an engaged EA would not need to check both the Forum and Substack. I agree that this has costs, especially in terms of having to accommodate the worse epistemics that are the norm on Substack. Your comment makes me reconsider whether we should eat that cost - I like the idea of having some way to link-post that doesn't take up the space of a full post. Perhaps the easiest test here is a weekly links and discussion thread.
CCBY: This was a decision made before my time that has only been mentioned to me once or twice as an issue. If it's low cost for us to switch to a more flexible regime, and it would lead to more posts, even just from you, it might well be worth it. I'll check it out.
Prizes and contests: These can be hit or miss, but we have long considered bringing back Forum comment prizes (Though Aaron did discontinue them for a reason, this reason may not hold anymore). I was pleased with how the cluelessness critiques week turned out, and I'd definitely consider running more such competitions (organisations can reach out to me if they'd like to propose sponsoring one, as Macroscopic did for that week).
I do also think that theme weeks and debate weeks have pretty great ROI in the same way as competitions, and as we get more capacity I plan to run more regular events. In the mean time, collaborative events can be easier to run, so if you are an individual or an org who would like to run an event with the Forum to encourage discussion of a cruxy issue for engaged EAs, message me.
AI generated content: This is part of a broader thing we want to do when we have more mod capacity. LessWrong has a rejected content feature which lets them be more opinionated about what they want on the site. We've long planned to implement this and have been constrained by capacity (both dev and mod). The Featured Page is working somewhat to do the opposite (the carrot not the stick) but it isn't quite enough for the most engaged users (it only gets around 1 post a day). I'm keen to do something here - probably not outright banning AI content though, because I don't think that is the future-proof option.
Ask people to apply to join the Forum: I've been thinking about this recently, especially with recent waves of time-consuming bots signing up (you guys hopefully never see this because they can't post until they are approved, but a lot of behind the scenes work, mostly from @Dane Valerie goes into checking the legitimacy of new posters). Facebook groups have that little box where you have to explain why you want to join and an admin approves you - I think something like this might work great for the Forum. I'll consider it further.
Overall I'm probably a bit less keen on gate-keeping than you, but also I agree more than I disagree. The Forum, as I see it, should not be positioned as a 'top of funnel' product. However I do think that it can be helpful for people who are learning how to think like EAs and I don't want it to be totally inaccessible to them.
Thanks again for writing it, and let me know if you (or other commenters) want to find a time to chat about the Forum on a call. I'm especially keen to hear more ideas, like these, for achieving the vision of the Forum that I think we share.
Caveat here that I'm representing only my views, as EA Forum Product Lead, and not the considered views of CEA the organisation.
Thanks so much Toby, and for everything you all do!
This sounds very good to me — I think the contests and debate weeks, etc. seem like they've been really productive for spurring more discussion. I also think metrics more focused on how the Forum serves engaged people seems really good (though I see the tension with CEA's strategy that Sarah mentions)
RE the CCBY - I think this is very much my pet peeve, and might not apply to other people. It would cause me to post some things I haven't, but no idea if it matters to anyone else.
RE gatekeeping - I think I'd be pretty hesitant to see the Forum not be a public one (though there are some advantages to this), even if posting is invite only - this might be a bit weird, but could help by giving people the ability to read the content still? Or applying to make unreviewed top-level posts. I think I like rate limiting best of these ideas personally, because it has the lowest downside risk, but I actually don't have a great sense on how it would change post/comment volume.
On Substack — I feel pretty confused about this. There are clearly many things posted to Substack that should be on the Forum too and are worth discussing here. But I also am maybe acutely feeling that as Substack grows, it is much more rapidly getting lower quality on average, and having the Substack crossposts seems like it's bringing some of that over. The Forum team cross-posted ones I've seen are often great and relevant, but then I also post my kinda-relevant-but-really-only-here-for-more-eyes stuff.
Agreed that it's worth trying to improve the EA Forum. Most of your suggestions are about how to screen out low-quality posts. What I really care about is how to get more high-quality posts and comments.
Why aren't there more high-quality posts?
Writing high-quality posts is hard in general.
Maybe people who used to write good posts are now doing other important work, and don't have time to write.
Maybe some high-quality posts have moved off the EA Forum and onto other places.
Why aren't there more high-quality comments?
Engaging with other people's work is hard, and usually you don't get any benefit from it.
? (LessWrong gets a lot of high-quality comments, even though writing comments is hard. How can EAF comments be more like LW?)
"Get people to write more good content" is sort of a hard problem in general—there is no "good content dial" that you can turn. One answer that comes to mind is that grantmakers should pay more people to write, and especially to write comments / engage with other people's work. I don't know if anyone in history has ever gotten a grant solely for the purpose of writing forum comments, but it seems like the sort of thing that's totally worth funding under the right circumstances.
Or there could be weekly comment prizes for the top 3 comments of the week, or something like that.
Inkhaven is an attempt at getting people to write more. Few Inkhaven residents post on EAF. Why is that?
One point against the "the best posters are now busy" argument is that LessWrong seems to still get large amounts of engagement from extremely busy people (e.g. execs of AI safety orgs, lab employees, etc). So I suspect relevance of the Forum to their day-to-day work is a more important factor for busy people engaging than how busy they are, or something like that.
Hmm, I think a factor here is that AI safety orgs have more of a culture of writing a lot, and a lot of them have grievances against the EA community which is why they don't post on EAF. I think their grievances are largely justified in the sense that they can correctly point to prominent EAs who have acted badly, but I disagree that "stop engaging with the EA community" is the correct response. EA is the only community that's dedicated to cause-neutrally doing good; if EA dies, there will be zero such communities. If you care about cause-neutrally doing good, then I think the move is to engage with the community and try to be a model EA.
This is a hard problem to fix because there's a network effect. If AI safety people mainly post on LessWrong and not EAF, then other AI safety people don't have much reason to post on EAF—although I'm not sure that's really true because cross-posting is easy.
There's also a question of why AI safety people write a lot. I don't know the answer to that one.
This is a good point. I guess one question is why (at least from my perspective) was there previously a lot more high quality engagement? I guess people might have been less busy, but I also think that the standard for making a post was just higher, and so people were more likely to find something useful in it.
One thing I noticed is that early in their launch, Forethought was doing a ton of public engagement on the Forum (and their own staff were leaving comments on the Forum on each others' work). This seemed pretty useful and could be something organizations encourage more? Forethought seemed to stop doing this for whatever reason (maybe because others didn't engage as much).
You mention that people might be less busy, but also I imagine (aka speculate without evidence) that some of the people doing these effort posts/effort comments were doing so with the desire to get hired to an EA role.
Once that happened, they transferred that energy to their new role and/or have a position where it doesn't make sense for them to be writing publicly on the EA forum.
Not that this is a perfect comparison, but this happens fairly often in the NBA draft community. The best hobby scouts, those writing detailed evaluations or developing new analytics, end up getting hired by teams to do it professionally and as a result the average insightfulness of public content degrades over time.
I think many of the people I'm thinking of (though definitely not all) already worked in EA roles at the time, so I'm not sure! But it wouldn't surprise me if that was a motivation at times.
Thanks so much for writing this. I broadly agree with your post, and I've been concerned about this ever since I took over the Forum team a little over 2 years ago. I still believe that the most important thing the Forum team should do is proactive/intentional community building, i.e. cultivating a community around a specific group of people and culture that will generate valuable discussions, which could involve many of the specific interventions in your list. Measure progress based on the value of all the discussions rather than the number of people participating.
Based on my experience as team lead I'm not that optimistic about things turning around while the Forum is still at CEA, especially while CEA is focused on growth and brand. With Rory and Amy leaving, it feels like there are fewer and fewer people in CEA leadership who "get" the Forum. I seriously considered spinning the Forum out of CEA — I left before anything came of that but there's maybe a small chance that still happens. I think it's plausible that's the only real way to preserve the intellectual community version (although who knows, maybe CEA will hire someone in a year or two who can turn things around).
@Toby Tremlett🔹 and I worked closely on Forum strategy and I trust him to care about this as well. However, he is at a significant disadvantage relative to when I was team lead (ex. he basically has to do 3 jobs, no one was hired to backfill any loss of Forum capacity and there are no open JDs for the project) so I think it will be an uphill battle.
Thanks for sharing this! Yeah, I think that the Forum team is in a really hard position RE navigating this, and I can imagine that CEA's current goals could be in direct conflict with (what I think) is good for the Forum, though I'd argue that also having the Forum do what I'm imagining here would be very good for retention and keeping EA attractive to the most promising people.
Nod. For what it’s worth, here’s a copy-paste of something I wrote internally around 18 months ago (context: I’m a Forum moderator). Along with Sarah’s comment above,[1] it might shed some light on what’s gone on behind the scenes.
When I look at CEA’s strategy, I see the following four goals:
Growing the EA community
Improving the EA brand
Diversifying EA funding
Strengthening CEA
The Forum doesn’t obviously fit into any of those four goals. (The Forum is probably closest to the first one, ‘growing the EA community,’ although the Forum’s theory of change is definitely not just about growing raw numbers, and indeed has a bunch of nuance as explored in Lizka’s ‘Vision / models / principles for the Forum’ doc.)
So, if your / the Online team’s performance is being measured according to just ‘growing the EA community’ (or, worse still, some amalgamation of all four of those goals)[2], then it seems to me that the Forum is being pressured away from its theory of change, and toward something more legible but less valuable.
(In fact, if it were my job to think, from first principles, of a way to leverage 5 or so people—including 2 to 3 software engineers; i.e., the current Online team—to optimize for one or more of CEA’s four stated goals, then what I’d come up with would probably not look anything like ‘run an online forum for the EA community.’ And so I worry that there’s a fundamental tension between the Forum and CEA’s new strategy, and that the Forum will gradually get pressured out of existence.)
E.g., most versions of the Forum changing in order to achieve ‘improving the EA brand’ seem actively pretty terrible to me. IMO, the Forum being more appealing to outsiders would likely come at the cost of truthseekingness and willingness to engage in thinking that is deep, weird, and sometimes controversial (i.e., the kind of thinking that’s needed to make intellectual progress toward doing the most good).
My experience is that people often don't post for the mundane reason that they didn't really think about it.[1] Contests are a good way of counteracting this, but the monetary reward is usually not very motivating, it's just that it makes "posting about X" become a Thing with a Deadline etc.
An implication of this is that anyone (even you, dear reader) can solve this problem with a couple days of work:
Message a few people that authors would value feedback from, say "hey, if I got people to write about X, would you commit to replying?"
Message a few prospective authors, say "hey, I've gotten these people to commit to giving feedback, would you be willing to post something?"
Once you've got 5-10 people to agree, post that it's happening
Follow up a few times with reminders because people are disorganized
This is basically all I did for the AI Pause Debate, for example, and that seemed to go fairly well.
Because I like you and like your writing and you included yourself and you sort of paid me a reverse compliment with your subsequent bullet point, I am magnanimously choosing not to be offended by you calling my "more than 90% human-written" post "half-AI generated".
But yes, I kind of agree with your diagnosis of the problem.
I would also note that the incentives are still there to post on the forum even if you get no engagement or comments or karma. So even if nothing I wrote on my Substack ever generated any useful engagement here, there are still reasons to do it for GEO and a few referrals per post.
I would also note for the record that my Substack is free, so it doesn't directly affect my bottom line, but obviously traffic and cross-referrals help in other ways, and so this incentive is still there.
I haven't thought too much about your proposed solutions, but some sort of gatekeeping or rate limiting seems like a good idea. The issue is, as you say, rewarding bright new young thinkers sufficiently that they can gain a lot of karma and a following.
I would personally be fine with a world where it was somewhat hard to get something published on the forum, which would force me to create specific posts that cleared a bar, and completely discourage unedited cross-posting.
I agree that was too far! I updated the text. I debated not including specific posts, but then decided to include posts from people who I very much want to be active contributors to the EA Forum because it felt like it was the highest-risk-to-myself way for me to be specific. And, this might be a self-tell, but I think when I posted what I view as useful-but-below-EA-Forum-bar things on the Forum from my Substack, I was partially motivated that I like it when people subscribe to my Substack (despite it also not being monetized). Sorry if it landed rudely to you or other people I linked.
On lab donor facing stuff specifically, I think one worry I have is that part of the reason that lab donors read the EA Forum (or engaged with EA) was due to the vibrant intellectual culture and availability of high-quality content, so it having less of that and more Substack cross-posts, etc. makes them less likely to be here, and less likely to engage with high-quality EA ideas!
I think that running things like the EA Forum prizes, contests, and other events usually significantly improve post quality. The Forum could go back to doing way more of this!
I have really enjoyed the debate weeks, and I think the forum would benefit from having them >3x more frequently.
There seems to be a problem with who is willing to pay the search costs to read and evaluate EA forum posts in the time that they would naturally be on the front page. People are naturally incentivized to free-ride on the efforts of previous readers who upvote or comment on the posts. But the initial evaluators would be spending time on less interesting/valuable posts on average. When you have a high enough readership population, you will probably get enough people who are interested to occasionally evaluate new posts, which provides enough signal to the rest of the readership to provide further evaluation, and creates virtuous cycles. But without sufficient readership, there likely will not be enough people engaging with posts that are not easily legible (and accessible and popular). Potential writers of EA forum posts then notice that it is unlikely that their forum posts will be read during the time that they are generally viewable (on the first page or two), and then either may decline to generate the writings or share it on the forum.
I notice that I have been less incentivized on the margin to do EA forum posts, simply because I find it unlikely that people will read it during the front page period where it would be generally viewable.
One solution would be to have people dedicated to performing that initial evaluation of posts function, either in a paid or volunteer capacity. That initial signal could facilitate follow on reading and engagement from the community by paying the initial discovery costs that are not adequately incentivized with our current level of readership.
1) I agree people should be posting when they have something to say rather than just to post. Perhaps I should have qualified that. I had in mind people who have things to say but who sit on their posts for a long time.
2) I also agree that I don't want to see the EA forum filled with marketing-esque nonsense from other platforms.
3) I think the core problem for the EA forum is that interesting high-quality novel posts are inherently rare and likely to stay that way because writing a very good post is effortful and not compensated in any kind of first-order way. Four potential solutions:
pay people for good posts
encourage more low-quality posts to have more content
have fewer posts and maybe give impression that forum is dying
encourage people to post more quality stuff by giving them effusive praise and karma so they get a dopamine rush
I think part of the reason I like some level of gate-keeping is it makes what I see as the risk of lowering the bar for posting lower. Basically, I'm a lot more excited to read the low effort posts from Seth Ariel Green then I am from someone brand new to the Forum, usually.
"It's possible that the death of the EA Forum is downstream from other community dynamics (like a massive shift to AI safety from previously highly engaged people)."
I discovered the EA movement and specifically this forum thanks to my growing interest in AI Safety that lead me here, so my case was the other way around. Maybe this compensates the trend you described.
Anyway, your points sound quite reasonable and hope most of them land within the forum managers! I might not know much of the forum history, but most members I have read and talked with seem great. You surely are an open-minded, well intended and welcoming community. That is rare nowadays on the internet and is especially what attracted me to enter this place.
The link does not provide any argument or evidence that EAF is a trash fire? It's just a comment by Buck saying that EAF is a trash fire. This is also a very non-specific and unhelpful sort of criticism.
My attempt at interpreting "trash fire" is something like
EAF regulars are insufficiently ASI-pilled, do not take misalignment risks seriously enough, and don't pay enough attention to discussions of AI risk
EAF regulars are too deferent to EA leaders, who are importantly wrong about a ton of stuff (mostly AI-related stuff)
EAF is not sufficiently oriented around truth-seeking
People on EAF care too much about PR and power-seeking
Mostly these are criticisms I see people make of "EA", not the EA Forum specifically, so I'm trying to extrapolate.
With the AI windfall, mental health may be taken increasingly seriously by mainstream EA. There’s increasingly room to explore the cause area and answer some of the biggest uncertainties; at the same time, costs of the most effective interventions are continuing to fall. StrongMinds is now treating for ~$35, about a third of GiveWell’s best guess from a few years ago, and is expected to...
TL;DR
The animal movement works hard on two fronts: changing minds (e.g., outreach, investigations, campaigns) and changing supply (e.g., alternative proteins, vegan labeling). There is a third front that seems much less explored: changing the craving itself. The desire for meat is not only a belief. It is partly or mainly, I assume mainly, biological, and biology and humans already change what we feel like eating: weight loss shots that reduce food cravin...
I’m a bit concerned that the EA Forum is going to die a slow death. I don’t want this to happen as it has long been, in my opinion, the best place on the internet. I'd like it to stay that way. I personally have found myself engaging less, because the content is less interesting and relevant to me.
I also think some of the trends I highlight below are due to CEA investing less in the Forum (e.g., my impression is the Forum team is smaller than it used to be). I think a lot of what I critique below is downstream of community dynamics, rather than the Forum itself. But I also think injecting the EA Forum with a vibrant intellectual culture will be good for EA as a whole.
The point of this post is to open a discussion, and give my own ideas for what I think might help. I welcome people to disagree, share their own takes on what the EA Forum should be, and the purpose it serves.
EA Forum moderators — I think you all do an admirable job. My personal view is that there should be way more of you doing way more to keep the community vibrant. To the extent this is a critique of your work, it's coming from a place of thinking that you are doing an essential community service that I want more of.
It's possible that the death of the EA Forum is downstream from other community dynamics (like a massive shift to AI safety from previously highly engaged people). But the EA Forum could have been (and maybe still could be) a place where these ideas were discussed. My guess is that a strong EA Forum is actually a fundamental part of keeping EA thriving, as long as EA is going to be a global movement, and working actively to keep it strong is essential to the future of EA.
Is the EA Forum dying?
I think so. Here's 10 years of data on EA Forum engagement:
My interpretation of these data is that the number of users and top-level posts on the Forum has steadily increased, with a massive spike then decline around FTX, but otherwise the Forum just continues to grow. But until the post-FTX decline, other important metrics, like comments from high-karma users, highly-upvoted posts, and comments generally were also increasing. Post-FTX, these metrics have all declined precipitously. Comments per post, which I think is the most important EA Forum success metric (if we want to Goodhart anything), have declined across this entire period. I think this is especially bad — it means that more and more, the Forum is being filled with posts that readers don't find to be worth talking about!
I think the ideal version of the Forum is fewer, higher quality posts, and way more comments. Ideally, those comments are from highly engaged people, who are having useful discourse about disagreements and cruxes. These trends suggest the opposite: there are more posts from more people, but these posts aren't heavily engaged with (suggesting that they don't say anything useful?), and aren't engaged with by the highest context people.
What’s the value of the Forum?
I used to think the EA Forum was mainly fun and distracting, and didn't think it was that valuable. But I've realized in seeing it decline that it was actually core to EA succeeding as an intellectual movement, and meaningfully increased the quality of the community. I was wrong about it being a distraction — it was serving some important functions:
It was a central conversation ground for the EA community.
It provided a good way to disseminate information to EAs / share research that might be relevant to people.
It was a place where you can be somewhat certain that ~most highly engaged EAs will see at least the title of your post, if not read it.
It kept globally dispersed people engaged with the ideas of EA, and kept active intellectual discourse alive.
Currently, I think the weight is shifting:
There isn't really a central conversation place for EAs — discussion seems to happen in disjointed private events, at EA Globals, or on Substack (though I think the discussion quality on Substack is much worse, even though many posts are good).
I don't think many professional EAs read the Forum regularly anymore.
The Forum seems to have a lot more people who are new to EA, and it is filled with content that seems to rehash old discussions, which doesn't get much engagement.
To me, the EA Forum was the core intellectual center of EA in the past. It was a place where there was reliably extremely high-quality discussion about difficult ideas. I think that the best version of EA maintains this, and getting the Forum to that place again is pretty important for the future of EA.
Ideas for saving the Forum
A lot of my thinking here is informed by LessWrong. I typically don't find LessWrong content as relevant to me as good EA Forum content, but LessWrong seems to have been much more successful at keeping their intellectual culture alive. It has much heavier moderation than the EA Forum, and they create bigger walls around new users posting. I think this post in particular highlights a philosophy that has kept LessWrong successful while the Forum has declined.
Here are a bunch of ideas that I think would help the Forum do a better job at keeping its own culture alive.
Stop the posting of Substack slop.
Substack pushes people to post a lot, which is good for their bottom line. But posting a lot drives down quality, because authors feel like they have to put something up even when they don't have much to say. As a result, most posts on Substack are worse than a good EA Forum piece, and authors cross-posting to the Forum are porting that bad outcome here.
I'm am one of the people guilty of this. Many of these authors are great researchers or thinkers who have written thoughtful things in the past. They should save those pieces for the Forum, and stop using the Forum as a way to generate subscriptions on Substack. I might be in favor of fully moderated cross-posts just to prevent this.
Note that Substack posts often are good and contain good ideas! I am calling them slop here because they don't really advance the conversations that are essential to EA, aren't interesting to discuss, and just flood the Forum with boring and obvious points in order to get Anthropic donors' eyes on them, or to generate subscriptions.
Examples of Substack posts I don't consider to meet the bar I want to hold the EA Forum to (including my own because I'm naming names):
I've purposely selected authors who regularly write content far above the bar for the Forum, to illustrate that it is not author quality that causes this dynamic, but post-frequency pressures or a cultural shift or something else. Substack rewards posting all the time, but the EA Forum shouldn't — it should reward posting really good stuff.
Relatedly, we don't need a marginal millionth piece on how Anthropic donors should engage with philanthropic advisors or think about their giving.
Generally discourage cross-posting
I think that cross-posted things are sometimes useful, but I've noticed that most cross-posted things get little engagement, and just bury the Forum in less relevant content. Maybe the Forum should have a sidebar where people can submit relevant links that are voted on or commented on (more like Hacker News) that aren't primary posts? This could also help with the Substack slop issue — those posts can go there, and be voted on based on relevance.
Generally don't post links to the EA Forum on Substack (to prevent random people from engaging without an understanding of the context).
People shouldn't do this stuff — it just causes brigading / increases in low-quality accounts and comments. Advertising this post on Substack does nothing for the EA community, and degrades the quality of the Forum.
Obviously there are times where linking to the Forum is useful, and this is mainly a cultural norm, not something the Forum team can enforce. But I think a stronger norm of being thoughtful about audiences on the Forum versus elsewhere would be good.
Rate limit new posters until the acquire some amount of karma via comments.
I think part of what makes the Forum great is that the people you engage with are good faith, say thoughtful things, and have a high degree of reasoning transparency. People are rewarded for doing this well via karma and upvotes. I think it is fine to rate-limit people who do this poorly, or haven't yet demonstrated that they can do this (e.g., new users) until they reach certain karma thresholds.
LessWrong has better policies on this, and the EA Forum should do the same.
Heavily down-weight or ban AI-generated content
I think LessWrong's relatively strict LLM policing is much better than the Forum's. As time goes on, the Forum has gotten more low-quality AI-generated posts. They get labelled as such, but are still bad. Forcing that content into separate, labelled blocks within posts, and moderating out violations seems good for keeping the Forum high quality.
Do more prizes, contests, and events.
I think that running things like the EA Forum prizes, contests, and other events usually significantly improve post quality. The Forum could go back to doing way more of this!
Addressing my personal pet peeve: let users choose how their content is licensed.
Currently, all content posted on the EA Forum is licensed under a CC-BY license. That means it can be used commercially by anyone as long as there is attribution. I am free to, for example, sell and profit off a book that takes your posts and repackages them without your permission, as long as I attribute the authorship to you.
I generally like Creative Commons licenses, but this specifically does cause me to post fewer things on the Forum, because I sometimes don't want to give people that ability! If this is true for other people, I think that either authors choosing their own license, or changing the default to CC-BY Non-Commercial would be better.
Additionally, in past roles, this sometimes led to issues (e.g. if a contract funds me to write something, and the contract-holder owns the copyright, even if they are okay with me sharing the post, they might not want me to allow it to be used by others commercially). LessWrong just allows users to own their posted work and license it how they please, which seems much cleaner.
One of the most obvious objections to what I'm saying here is that it is creating a gate-kept version of EA where newcomers don't have any way to get involved. But I think the EA Forum should not be a tool for community growth, and therefore shouldn't be optimized for that purpose. There need to be places for people new to EA to learn and talk about these ideas, but I think it is okay for the Forum to not be that, and instead be a place where highly-engaged people can push these ideas forward.
I think the Forum works best when everyone has some baseline of shared knowledge, context, and vocabulary. That means it shouldn't be a place where people brand new to EA share their ideas without historic context on how they've been discussed.
The EA community has tons of introductory reading materials, fellowships, and ways for newcomers to get involved. The Forum should cater to insiders and more heavily engaged people. Things like the Featured page push the other direction.
If this is right, there are a variety of adjustments that could be made to prioritize discussion between relative experts, rather than introductory content.
Make the Forum invite only — give existing users, maybe based on karma, the ability to invite new people, and don't let people freely register (you can also give fellowship organizers, student organizers, core organizations, etc. the ability to invite people freely, to ensure there are a diversity of pathways in).
Have people apply to get accounts, and discuss their engagement with EA in that application.
If the Forum doesn't make registration invite-only, I think it could consider having introductory sequences for people to read through when they register. Often, new users will post ideas that have been discussed extensively before, and would benefit from seeing big hits and discussion from the past before posting.
A second objection might be that more content is better, and more content drives engagement more than quality. For example, Seth Ariel Green recently called for a lower bar to posting, because they feel that their community is letting the perfect be the enemy of the good.
The question is, what is growth and engagement for? If community building, see above. But if idea generating and refining, then I disagree -- high quality posts do this a lot better than high volume. I don't think that should mean a strong conceptual piece sits in drafts for ever because it's not stylistically polished. But I do mean: post when you have something interesting and important to say, and you've thought about it a lot!
So much to say in response to this. First of all, thank you for caring, and for writing this appeal.
I want to start by reassuring you that I agree. Not necessarily with all of your prescriptions (though they are all worth considering) but with the diagnosis. I agree that the Forum has been marginally too focused on 'growth'.
As Sarah writes in another comment, CEA, or a lot of CEA work is indeed focused on community growth. We are proposing an alternative goal for the Forum - roughly 'effectiveness for engaged EAs'. In practice (I'm working on finalising metrics today) this means measuring some proxy metrics - like % of people in "EA" jobs who visit the Forum at least monthly (relevance), number of words in comments (loose proxy for quality of discussion, especially if tempered by karma and ignoring AI), and some measure of ultimate impact, probably surveys of engaged EAs to find out when posts change their donation or career decisions. We've been testing this new theory of change out over the last few months.
Unfortunately, since we've started experimenting with the new ToC, we've had a lot of capacity issues - Sarah left, Agnes is on Maternity, I had to take two months of unscheduled leave for family reasons etc... the bottom line is that right now we are one dev, and one me (who has just got back to work). Despite this we have been able to make some moves in the direction of this ToC:
This new direction for the Forum came from me thinking about two things you mentioned.
That second point is what I called in some memos the 'social reproduction of EA'. We could easily grow an EA movement that is overly attached to the current institutions and beliefs of EAs - a movement that takes current 'cause areas' as fixed, and gets a lot of people into great jobs. This would be very impactful in the short term. But if we want there to be an EA movement existing into the future (i.e. in the next decade) that is capable of coming up with new ideas, and pivoting to the new most impactful cause areas when that's what the world needs - we need to continually recreate EA as an intellectual community, as well as a practical one. This isn't a unique problem to our time, it's in the natural life cycle of a highly committed EA to be excited by a range of causes and ideas, then over time make more commitments such that it is harder, emotionally and likely fiscally, to change direction.
I'm not sure whether the Forum has been successful in the social reproduction of EA in the past - there are some examples of people who become contributing EAs through engagement just with the Forum, but I'd guess that more people become EAs through in-person communities in concert with the Forum, and without the Forum, 'EA ideas' will by default come from orgs which have constrained charitable purposes, and are therefore more sticky and less able to pivot than individuals.
Much more to say but the point is I agree, and I'm very interested in making and keeping the Forum as the intellectual core of EA.
Quickfire on some of your suggestions.
Thanks again for writing it, and let me know if you (or other commenters) want to find a time to chat about the Forum on a call. I'm especially keen to hear more ideas, like these, for achieving the vision of the Forum that I think we share.
Caveat here that I'm representing only my views, as EA Forum Product Lead, and not the considered views of CEA the organisation.
Thanks so much Toby, and for everything you all do!
This sounds very good to me — I think the contests and debate weeks, etc. seem like they've been really productive for spurring more discussion. I also think metrics more focused on how the Forum serves engaged people seems really good (though I see the tension with CEA's strategy that Sarah mentions)
RE the CCBY - I think this is very much my pet peeve, and might not apply to other people. It would cause me to post some things I haven't, but no idea if it matters to anyone else.
RE gatekeeping - I think I'd be pretty hesitant to see the Forum not be a public one (though there are some advantages to this), even if posting is invite only - this might be a bit weird, but could help by giving people the ability to read the content still? Or applying to make unreviewed top-level posts. I think I like rate limiting best of these ideas personally, because it has the lowest downside risk, but I actually don't have a great sense on how it would change post/comment volume.
On Substack — I feel pretty confused about this. There are clearly many things posted to Substack that should be on the Forum too and are worth discussing here. But I also am maybe acutely feeling that as Substack grows, it is much more rapidly getting lower quality on average, and having the Substack crossposts seems like it's bringing some of that over. The Forum team cross-posted ones I've seen are often great and relevant, but then I also post my kinda-relevant-but-really-only-here-for-more-eyes stuff.
Always happy to chat about this!