Comments
More from the author
Curated and popular this week
58
...
78
Crossposted to Less Wrong
‘Like most of life’s dangers, the dangers of artificial intelligence are not easily identified from the armchair.’
J Dmitri Gallow
Epistemic status
I’m not an expert in this field, and herein I make some sweeping generalisations educated guesses about the overall...
51
TL;DR: EA has traditionally deprioritized climate change as a cause area. But a new report from Rethink Priorities, an EA research institute, suggests that specific Earth systems risks driven by climate change could have mortality impacts comparable to major global health burdens, on top of the known damages of climate change.
The report finds that research and governance work on ‘Earth Systems Stabilization’ to establish whether safe options to address th...
Recent opportunities to take action
Thanks for sharing this.
What’s your view on “why doesn’t OpenAI slow down work on capabilities to allow more time for alignment research?”
Is it
OpenAI is worried that Deepmind might build AGI before OpenAI, and OpenAI is worried that Deepmind is more likely to build AGI unsafely or misuse it
OpenAI is worried that another group we aren’t aware of yet might build AGI before OpenAI and Deepmind, and OpenAI is worried that this group is more likely to build AGI unsafely or misuse it
OpenAI is already only scaling up capabilities where it allows them to do better alignment research
OpenAI is in practice prioritising revenue over existential risk mitigation, despite claiming not to
something else / a mix
I think that OpenAI is not worried about actors like DeepMind misusing AGI, but (a) is worried about actors that might not currently be on most people's radar misusing AGI, (b) thinks that scaling up capabilities enables better alignment research (but sees other benefits to scaling up capabilities too) and (c) is earning revenue for reasons other than direct existential risk reduction where it does not see a conflict in doing so.