2 min read 2

9

Paleontological study of extinctions supports AI as a existential threat to humanity


One way to approach issues with large uncertainties is to use historical perspectives to test hypotheses developed through bottom-up or theoretical approaches. This method can provide valuable insights into the risks posed by emerging technologies, such as artificial intelligence (AI). By examining past extinctions, we can gain a better understanding of the potential threats that super-intelligent AI may pose to humanity. In this post, I'll explore how applying a historical perspective can help us to better assess the risks associated with AI.

1. Extinctions are possible. 

Let’s start by proving an assumption everyone reading this likely already believes, to establish a solid foundation for our discussion of AI risk. In the 18th century, there was a great deal of debate over whether extinction was possible at all. Georges Cuvier, a prominent anatomist of his time, used paleontological evidence to demonstrate that extinction was indeed possible. Cuvier's work with mammoth fossils provided conclusive proof of extinction, ending the debate over whether it was possible and ushering in a new era of exploration into the nature of extinction itself [1]. By establishing the reality of extinction, Cuvier paved the way for further study of the causes and consequences of this phenomenon. 

2. Intelligent agents can cause extinctions

Although humans are the only clearly intelligent agents we know of, we can use the historical record to better understand the risks posed by super-intelligent AI. Humans have caused extinctions on every continent they have inhabited, and the scientific consensus is that these extinctions closely coincide with human arrival [2]. While there are alternative explanations, such as disease and climate change, the evidence does not support these hypotheses as the primary causes of extinction. For example, while global climate change is coincident with human arrival in the Americas at the Pleistocene-Holocene boundary, organisms in the Americas had survived many similar changes with no major losses. Furthermore, extinctions across Polynesian islands, Australia, and Eurasia all support the human-arrival linked extinctions. These findings suggest that intelligent agents, such as humans or super-intelligent AI, can outcompete non-intelligent agents and cause significant extinctions. 

3. Direct competition appears to increase risk. 

The paleontological record indicates that when humans arrived on new continents, extinctions occurred suddenly and with little delay [2]. This rapid extinction rate is difficult to estimate precisely due to the nature of the geological records, but it appears to have been concentrated in large mammals that would have been direct or indirect competition for humans [3]. These findings highlight the importance of considering power differentials when assessing the risks posed by emerging technologies like AI. Additionally, the rapidity of extinction should give us pause. 

4. What organisms are resistant to human extinction? 

Let’s end on a hopeful note. In Africa, where megafauna evolved alongside humans, the extinctions were minimal compared to other continents, indicating that co-evolution can reduce extinction risks [4]. This suggests that as we continue to evolve with emerging technologies like AI, we can also develop ways to reduce the risks posed by these technologies. Additionally, there are organisms like dogs that we have formed close partnerships with, creating a mutually beneficial relationship. Similarly, as we develop and work with AIs, the possibility that we can create a healthy relationship is an important goal. 

[1] https://ucmp.berkeley.edu/history/cuvier.html

[2] http://arachnid.biosci.utexas.edu/courses/thoc/readings/Burney_Flannery2006.pdf

3] https://www.evolutionary-ecology.com/abstracts/v06/1499.html

[4] https://ourworldindata.org/quaternary-megafauna-extinction

Comments4


Sorted by Click to highlight new comments since:

kpurens -- nice post. I agree that it's worth remembering some lessons learned from paleobiology that were not at all obvious until the last couple of centuries of scientific research on extinctions.

It's also worth noting that, even among bipedal, highly social human-ish species, which have included maybe a dozen or so species over the last several million years, we are the last bipedal hominid standing. We out-competed, displaced, and extinguished every other species of highly social ape with a brain size above about 400 ccs that has evolved since we split from the chimp/bonobo lineage about 7 million years ago. (Yes, some human populations managed to poach some useful genes from Neanderthals before we drove them extinct too, but Neanderthals aren't exactly thriving as autonomous life-forms. We just carry their ghosts around in our chromosomes, so to speak.)

So, in terms of AI risk, we like to imagine that this 7-million-year legacy of human competitive success will continue. But odds are, we'll end up suffering the same fate as Ardipithecus or Paranthropus or Homo habilis, if advanced AI becomes ecologically competitive with us.

 

The emergence of humans - Understanding Evolution

Really great point about a curious trend!

Human cultural evolution has replaced gene evolution of the main way humans are advancing themselves, and you certainly point at the trend that ties them together. 

One reason I didn't dig into the anthropology record is that it is so fragmented, and I am not an expert in it--very little cross-communication between the fields, excepting in a few sub-disciplines such as taphonomy. 

[comment deleted]6
0
0
Existential riskShow more
Curated and popular this week
Sam Anschell
 ·  · 6m read
 · 
*Disclaimer* I am writing this post in a personal capacity; the opinions I express are my own and do not represent my employer. I think that more people and orgs (especially nonprofits) should consider negotiating the cost of sizable expenses. In my experience, there is usually nothing to lose by respectfully asking to pay less, and doing so can sometimes save thousands or tens of thousands of dollars per hour. This is because negotiating doesn’t take very much time[1], savings can persist across multiple years, and counterparties can be surprisingly generous with discounts. Here are a few examples of expenses that may be negotiable: For organizations * Software or news subscriptions * Of 35 corporate software and news providers I’ve negotiated with, 30 have been willing to provide discounts. These discounts range from 10% to 80%, with an average of around 40%. * Leases * A friend was able to negotiate a 22% reduction in the price per square foot on a corporate lease and secured a couple months of free rent. This led to >$480,000 in savings for their nonprofit. Other negotiable parameters include: * Square footage counted towards rent costs * Lease length * A tenant improvement allowance * Certain physical goods (e.g., smart TVs) * Buying in bulk can be a great lever for negotiating smaller items like covid tests, and can reduce costs by 50% or more. * Event/retreat venues (both venue price and smaller items like food and AV) * Hotel blocks * A quick email with the rates of comparable but more affordable hotel blocks can often save ~10%. * Professional service contracts with large for-profit firms (e.g., IT contracts, office internet coverage) * Insurance premiums (though I am less confident that this is negotiable) For many products and services, a nonprofit can qualify for a discount simply by providing their IRS determination letter or getting verified on platforms like TechSoup. In my experience, most vendors and companies
jackva
 ·  · 3m read
 · 
 [Edits on March 10th for clarity, two sub-sections added] Watching what is happening in the world -- with lots of renegotiation of institutional norms within Western democracies and a parallel fracturing of the post-WW2 institutional order -- I do think we, as a community, should more seriously question our priors on the relative value of surgical/targeted and broad system-level interventions. Speaking somewhat roughly, with EA as a movement coming of age in an era where democratic institutions and the rule-based international order were not fundamentally questioned, it seems easy to underestimate how much the world is currently changing and how much riskier a world of stronger institutional and democratic backsliding and weakened international norms might be. Of course, working on these issues might be intractable and possibly there's nothing highly effective for EAs to do on the margin given much attention to these issues from society at large. So, I am not here to confidently state we should be working on these issues more. But I do think in a situation of more downside risk with regards to broad system-level changes and significantly more fluidity, it seems at least worth rigorously asking whether we should shift more attention to work that is less surgical (working on specific risks) and more systemic (working on institutional quality, indirect risk factors, etc.). While there have been many posts along those lines over the past months and there are of course some EA organizations working on these issues, it stil appears like a niche focus in the community and none of the major EA and EA-adjacent orgs (including the one I work for, though I am writing this in a personal capacity) seem to have taken it up as a serious focus and I worry it might be due to baked-in assumptions about the relative value of such work that are outdated in a time where the importance of systemic work has changed in the face of greater threat and fluidity. When the world seems to
 ·  · 4m read
 · 
Forethought[1] is a new AI macrostrategy research group cofounded by Max Dalton, Will MacAskill, Tom Davidson, and Amrit Sidhu-Brar. We are trying to figure out how to navigate the (potentially rapid) transition to a world with superintelligent AI systems. We aim to tackle the most important questions we can find, unrestricted by the current Overton window. More details on our website. Why we exist We think that AGI might come soon (say, modal timelines to mostly-automated AI R&D in the next 2-8 years), and might significantly accelerate technological progress, leading to many different challenges. We don’t yet have a good understanding of what this change might look like or how to navigate it. Society is not prepared. Moreover, we want the world to not just avoid catastrophe: we want to reach a really great future. We think about what this might be like (incorporating moral uncertainty), and what we can do, now, to build towards a good future. Like all projects, this started out with a plethora of Google docs. We ran a series of seminars to explore the ideas further, and that cascaded into an organization. This area of work feels to us like the early days of EA: we’re exploring unusual, neglected ideas, and finding research progress surprisingly tractable. And while we start out with (literally) galaxy-brained schemes, they often ground out into fairly specific and concrete ideas about what should happen next. Of course, we’re bringing principles like scope sensitivity, impartiality, etc to our thinking, and we think that these issues urgently need more morally dedicated and thoughtful people working on them. Research Research agendas We are currently pursuing the following perspectives: * Preparing for the intelligence explosion: If AI drives explosive growth there will be an enormous number of challenges we have to face. In addition to misalignment risk and biorisk, this potentially includes: how to govern the development of new weapons of mass destr