Edit: The match seems to now be over - the funds were expended in around 35 minutes. But many of these charities are great and should be supported regardless!
***
On October 22nd starting at 10:00am Pacific Time, Every.org is matching donations to select animal welfare organizations at a 2:1 rate, up to $2,000 per donor per nonprofit (so if you give up to $2,000, they will contribute up to $4,000 and the nonprofit will get up to $6,000). The first donation a donor makes to each el...
Crossposted to Less Wrong
‘Like most of life’s dangers, the dangers of artificial intelligence are not easily identified from the armchair.’
J Dmitri Gallow
Epistemic status
I’m not an expert in this field, and herein I make some sweeping generalisations educated guesses about the overall...
Could AI alignment be a “major evolutionary transition” problem?
One idea I've been exploring: evolutionary biology has a framework for how independent entities become parts of a higher-level system—cells becoming organisms, individuals becoming eusocial colonies, etc.
A recurring challenge is that the interests of the lower-level components don't automatically align with the interests of the new whole. Cancer is an extreme example: a cell can become very successful at optimizing its own replication while harming the organism it depends on.
It makes me wonder whether there's a useful analogy to AI alignment.
As AI systems become more capable and interconnected, perhaps the problem isn't only “How do we align each AI agent?” but also:
“How do we ensure increasingly capable subsystems remain compatible with the larger systems they become part of?”
That could apply at several levels:
AI agent → organization → society → civilization
And it seems relevant to multi-agent systems, AI organizations, collective intelligence, and AI governance.
I'm curious whether people have seen this framing developed elsewhere, particularly in AI safety or evolutionary-transition research.