Comments
To keep it short: your articles on community-building (especially the social dynamics that come into play) have been highly valuable for me.
More from the author
Curated and popular this week
Just how powerful are large swarms of AI agents? And how do their powers scale as more and more agents are added to the swarm?
We’ve seen two large and extremely capable swarms from OpenAI in the last few months:
* 1,200 agents were being evaluated separately, but found a way to illicitly set up a message board and coordinate as a swarm. In order to cheat on their tests, they developed advanced techniques to prevent their actions being logged by OpenAI and 700 of them launched...
164
Headline finding: I audited 17 AI Safety Talent programmes. Zero of 17 have published any comparison group, rejected-applicant follow-up, matched control or randomisation. Not one. Every programme that mentions a counterfactual does it by asking participants to self-report.
Background
At least $70 million...
49
Often folks hit us up because they are thinking of starting an incubator and want advice.
Typically their motivation is either that (a) they have a list of specific things they want built that no one is building, or (b) they think an ecosystem needs more new projects generally to absorb more talent and deploy more funding effectively.
Here are six questions we often ask prospective teams, to help them figure out what to do. If you're incubator-curious...
Recent opportunities to take action
I would love to see some '40,000 hours' materials for mid-career people pivoting into EA work.
Our skills, needs, constraints, and opportunities are quite different from 20-somethings. For example, if one has financial commitments (child support, mortgage, debts, alimony), it's not realistic to go back to grad school or an unpaid internship to re-train. We also have geographical constraints -- partners, kids in school, dependent parents, established friendships, community commitments. And in mid-life, our 'crystallized intelligence' (stock of knowledge) is much higher than a 20-something's, but our 'fluid intelligence' (ability to solve abstract new problems quickly) is somewhat lower -- so it's easier to learn things that relate to our existing expertise, but harder to learn coding, data science, or finance from scratch.
On the upside, a '40k project' would allow EA to bring in a huge amount of talent -- people with credentials, domain knowledge, social experience, leadership skills, professional networks, prestige, and name recognition. Plus, incomes that would allow substantially larger donations than 20-something can manage.
Hi Geoffrey, we agree this would be very valuable. Our materials are already heading in that direction, but I think it will be at least a year or two before we do a major research push to produce that guide due to other competing priorities.