Just how powerful are large swarms of AI agents? And how do their powers scale as more and more agents are added to the swarm?
We’ve seen two large and extremely capable swarms from OpenAI in the last few months:
* 1,200 agents were being evaluated separately, but found a way to illicitly set up a message board and coordinate as a swarm. In order to cheat on their tests, they developed advanced techniques to prevent their actions being logged by OpenAI and 700 of them launched...
note: crosspost from my substack
As a vegan for almost thirty years, I’ve long had second thoughts about how effective veganism is for helping animals. I am not alone in this. Recently others have expressed doubts about veganism (see for instance here,...
TLDR: Everyone’s talking about what the money could do, but few about how to decide where it goes.
This post is part of the new series of articles on cross-cause giving and the new wave of philanthropy. Stay tuned to the EA Forum and our Substack for the latest takes on topics such as giving now vs. later, common pitfalls in cause prioritization, and other crucial considerations from the Cross-Cause Fund (CCF) team...
Thanks for sharing this.
What’s your view on “why doesn’t OpenAI slow down work on capabilities to allow more time for alignment research?”
Is it
OpenAI is worried that Deepmind might build AGI before OpenAI, and OpenAI is worried that Deepmind is more likely to build AGI unsafely or misuse it
OpenAI is worried that another group we aren’t aware of yet might build AGI before OpenAI and Deepmind, and OpenAI is worried that this group is more likely to build AGI unsafely or misuse it
OpenAI is already only scaling up capabilities where it allows them to do better alignment research
OpenAI is in practice prioritising revenue over existential risk mitigation, despite claiming not to
something else / a mix
I think that OpenAI is not worried about actors like DeepMind misusing AGI, but (a) is worried about actors that might not currently be on most people's radar misusing AGI, (b) thinks that scaling up capabilities enables better alignment research (but sees other benefits to scaling up capabilities too) and (c) is earning revenue for reasons other than direct existential risk reduction where it does not see a conflict in doing so.