Strategic Perspectives on Transformative AI Governance: Introduction

MMMaas

Strategic Perspectives on Transformative AI Governance: Introduction

Comments 18

Sorted by

New & upvoted

Looking back at this post, I realize that I originally approached it by asking myself "which perspectives are true," but a more useful approach is to try to inhabit each perspective and within the perspective generate ideas, considerations, interventions, affordances, etc.

Rohin Shah

I'm curious where the plan "convey an accurate assessment of misalignment risks to everyone, expect that they act sensibly based on that, which leads to low x-risk" fits here.

(I'm not saying I endorse this plan.)

HaydnBelfield

Probably "environment-shaping", but I imagine future posts will discuss each perspective in more detail.

MMMaas

(apologies for very delayed reply)

Broadly, I'd see this as:

'anticipatory' if it is directly tied to a specific policy proposal or project we want to implement ('we need to persuade everyone of the risk, so they understand the need to implement this specific governance solution'),
'environment-shaping' (aimed at shaping key actors' norms and/or perceptions), if we do not have a strong sense of what policy we want to see adopted, but we would like to inform these actors to come up with the right choices themselves, once convinced.

Zach Stein-Perlman

Good post!

I appreciate that these are the perspectives' "(oversimplified) slogan form," but still, I identify with 10 of these perspectives, and I strongly believe that this is basically correct. There are several different kinds of ways to make the future go better, and we should do all of them, pursuing whatever opportunities arise and adapting based on changing facts (e.g., about polarity) and possibilities (e.g., for coordination). So I'm skeptical of thinking in terms of these perspectives; I would think in terms of ways-to-make-the-future-go-better. A quick list corresponding directly to your perspectives:

Do macrostrategy
Enable a safe pivotal act
Promote alignment & safety
Increase lead times and benevolence/wisdom/etc. of leader
Coordinate (at the AI-lab level) to slow capability gains
Improve governance for TAI (make good policies)
Gain influence around AI
Improve institutions/coordination/civilization/etc. for TAI
Improve governance for TAI (set good precedent)
Improve governance for TAI (increase flexibility)
Coordinate (at a high level) to slow capability gains
Improve institutions/coordination/civilization/etc. generally
Gain influence generally
Do non-AI good stuff
X

We should more or less do all of these!

tamgent

Agree on aggregate it's good for a collection of people to pursue many different strategies, but would you personally/individually weight all of these equally? If so, maybe you're just uncertain? My guess is that you don't weight all of these equally. Maybe another framing is to put probabilities on each and then dedicate the appropriate proportion of resources accordingly. This is a very top down approach though and in reality people will do what they will! I guess it seems hard to span more than two beliefs next to each other on any axis as an individual to me. And when I look at my work and my beliefs personally, that checks out.

Zach Stein-Perlman

Of course they're not equal in either expected value relative to status quo or appropriate level of resources to spend
I don't think you can "put probabilities on each" -- probabilities of what?

tamgent

Sorry more like a finite budget and proportions, not probabilities.

Zach Stein-Perlman

Sure, of course. I just don’t think that looks like adopting a particular perspective.

MMMaas

Thanks for these points! I like the rephrasing of it as 'levers' or pathways, thosea re also good.

A downside of the term 'strategic perspective' is certainly that it implies that you need to 'pick one', that a categorical choice needs to be made amongst them. However:

-it is clearly possible to combine and work across a number of these perspectives simultaneously, so they're not mutually exclusive in terms of interventions; -in fact, under existing uncertainty over TAI timelines and governance conditions (i.e. parameters), it is probably preferable to pursue such a portfolio approach, rather than adopt any one perspective as the 'consensus one'.

still, as tamgent notes, this mostly owes to our current uncertainty: once you start to take stronger positions on (or assign certain probabilities to) particular scenarios, not all of these pathways are an equally good investment of resources -indeed, some of these approaches will likely entail actions that will stand in tension to one another's interventions (e.g. Anticipatory perspectives would recommend talking explicitly about AGI to policymakers; some versions of Path-setting, Network-building, or Pivotal Engineering would prefer to avoid that (for different reasons). A partisan perspective would prefer actions that might align the community with one actor; that might stand in tension to actions taken by a Coalitional (or multilateral Path-setting) perspectives; etc.).

I do agree that the 'Perspectives' framing may be too suggestive of an exclusive, coherent position that people in this space must take, when what I mean is more a loosely coherent cluster of views.

@tamgent "it seems hard to span more than two beliefs next to each other on any axis as an individual to me" could you clarify what you meant by this?

technicalities

Which are you?

MMMaas

To some extend, I'd prefer not yet to anchor people too much, before finishing the entire sequence. I'll aim to circle around later and have more deep reflection on my own commitments. In fact, one reason why I'm doing this project is that I notice I have rather large uncertainties over these different theories myself, and want to think through their assumptions and tradeoffs.

Still, while going into more detail on it later, I think it's fair that I provide some disclaimers about my own preferences, for those who wish to know them before going in:

[preferences below break]

... ... ... ...

TLDR: my currently (weakly held) perspective is something like '(a) as default, pursue portfolio approach consisting of interventions from Exploratory, Prosaic Engineering, Path-setting, Adaptation-enabling, Network-building, and Environment-shaping perspectives: (b) under extremely short timelines and reasonably good alignment chances, switch to Anticipatory and Pivotal Engineering; (c) under extremely low alignment success probability, switch to Containing;"

This seems grounded in a set of predispositions / biases / heuristics that are something like:

Given I've quite a lot of uncertainty about key (technical and governance) parameters, I'm hesitant to commit to any one perspective and prefer portfolio approaches. --That means I lean towards strategic perspectives that are more information-providing (Exploratory), more robustly compatible with- and supportive of many others (Network-building, Environment-shaping), and/or more option-preserving and flexible (Adaptation-enabling); --conversely, for these reasons I may have less affinity for perspectives that potentially recommend far-reaching, hard-to-reverse actions under limited information conditions (Pivotal Engineering, Containing, Anticipatory);
My academic and research background (governance; international law) probably gives me a bias towards the more explicitly 'regulatory' perspectives (Anticipatory, Path-setting, Adaptation-enabling), especially in multilateral version (Coalitional); and a bias against perspectives that are more exclusively focused on the technical side alone (eg both Engineering perspectives), pursue more unilateral actions (Pivotal Engineering, Partisan), or which seek to completely break or go beyond existing systems (System-changing)
There are some perspectives (Adaptation-enabling, Containing) that have remained relatively underexplored within our community. While I personally am not yet convinced that there's enough ground to adopt these as major pillars for direct action, from an Exploratory meta-perspective I am eager to see these options studied in more detail.
I am aware that under very short timelines, many of these perspectives fall away or begin looking less actionable;

[ED: I probably ended up being more explicit here than I intended to; I'd be happy to discuss these predispositions, but also would prefer to keep discussion of specific approaches concentrated in the perspective-specific posts (coming soon).

Mo Putera

Hi @MMMaas, will you be continuing this sequence? I found it helpful and was looking forward to the next few posts, but it seems like you stopped after the second one.

MMMaas

I will! Though likely in the form of a long form report that's still in draft, planning to write it out in the next months. Can share a (very rough) working draft if you PM me.

Sam Clarke

A potentially useful subsection for each perspective could be: evidence that should change your mind about how plausible this perspective is (including things you might observe over the coming years/decades). This would be kinda like the future-looking version of the "historical analogies" subsection.

MMMaas

That's a great suggestion, I will aim to add that for each!

james.lucassen

This seems great! I really like the list of perspectives, it gave me good labels for some rough concepts I had floating around, and listed plenty of approaches I hadn't given much thought. Two bits of feedback:

Editing nitpick: I think the perspective called "adaptation-enabling" in the list is instead called "capability-scalable" in the table.
The table format worries me. It frames the content as something like "if you have X level of tech optimism and Y level of gov optimism, perspective Z is the strategic view implied by those beliefs". I don't think this is what you mean to communicate?
- It seems like the implication goes the other way. Given X and Y, there are plenty of valid Z, but a certain Z does tell you a lot about the person's X and Y.
- Identifying a unique optimal strategy for various sets of views seems like it would require Way more dimensions.
- Easy edit that makes it more obvious that they're not supposed to be unique - do a scatterplot, AKA a "political compass" type thing. That way a certain strategy doesn't crowd out the possibility of other strategies near it.

Excited for the rest of this sequence :)

MMMaas

Thanks for the catch on the table, I've corrected it!

And yeah, there's a lot of drawbacks to the table format -- and a scatterplot would be much better (though unfortunately I'm not so good with editing tools, would appreciate recommendations for any). In the meantime, I'll add in your disclaimer for the table.

I'm aiming to restart posting on the sequence later this month, would appreciate feedback and comments.

Comments

MMMaas

Still, while going into more detail on it later, I think it's fair that I provide some disclaimers about my own preferences, for those who wish to know them before going in:

[preferences below break]

... ... ... ...

This seems grounded in a set of predispositions / biases / heuristics that are something like:

Given I've quite a lot of uncertainty about key (technical and governance) parameters, I'm hesitant to commit to any one perspective and prefer portfolio approaches. --That means I lean towards strategic perspectives that are more information-providing (Exploratory), more robustly compatible with- and supportive of many others (Network-building, Environment-shaping), and/or more option-preserving and flexible (Adaptation-enabling); --conversely, for these reasons I may have less affinity for perspectives that potentially recommend far-reaching, hard-to-reverse actions under limited information conditions (Pivotal Engineering, Containing, Anticipatory);
My academic and research background (governance; international law) probably gives me a bias towards the more explicitly 'regulatory' perspectives (Anticipatory, Path-setting, Adaptation-enabling), especially in multilateral version (Coalitional); and a bias against perspectives that are more exclusively focused on the technical side alone (eg both Engineering perspectives), pursue more unilateral actions (Pivotal Engineering, Partisan), or which seek to completely break or go beyond existing systems (System-changing)
There are some perspectives (Adaptation-enabling, Containing) that have remained relatively underexplored within our community. While I personally am not yet convinced that there's enough ground to adopt these as major pillars for direct action, from an Exploratory meta-perspective I am eager to see these options studied in more detail.
I am aware that under very short timelines, many of these perspectives fall away or begin looking less actionable;

Perspective	In (oversimplified) slogan form
Exploratory	We remain too uncertain to meaningfully or safely act; conduct high-quality research to achieve strategic clarity and guide actions
Pivotal Engineering	Prepare for a one-shot technical ‘final exam’ to align the first AGI; followed by a pivotal act to mitigate risks from any unsafe systems
Prosaic Engineering	Develop and refine alignment tools in existing systems, disseminate them to the world, and promote AI lab risk mitigation
Partisan	Pick a champion to support in the race, to help them develop TAI/AGI first in a safe way, and/or in the service of good values
Coalitional	Create a joint TAI/AGI program to support, to avert races and share benefits
Anticipatory	Regulate by establishing forward-looking policies today, which are explicitly tailored to future TAI
Path-setting	Regulate by establishing policies and principles for today's AI, which set good precedent to govern future TAI
Adaptation-enabling	Regulate by ensuring flexibility of any AI governance institutions established in the near-term, to avoid suboptimal lock-in and enable their future adaptation to governing TAI
Network-building	Nurture a large, talented and influential community, and prepare to advise key TAI decision-makers at a future 'crunch time'
Environment-shaping	Improve civilizational competence, specific institutions, norms, regulatory target surface, cooperativeness, or tools, to indirectly improve conditions for later good TAI decisions
Containing	Coordinate to ensure TAI/AGI is delayed or never built
System-changing	Pursue fundamental changes or realignment in the world as precondition to any good outcomes
Skeptical	Just wait-and-see, because TAI is not possible, long-term impacts should not take ethical priority, and/or the future is too uncertain to be reliably shaped
Prioritarian	Other existential risks are far more certain, pressing or actionable, and should gain priority
‘Perspective X’	[something entirely different, that I am not thinking of]

Strategic Perspectives on Transformative AI Governance: Introduction

Strategic Perspectives on Transformative AI Governance: Introduction

Primer

Project Roadmap

Summary of perspectives

Acknowledgements