Some AI Governance Research Ideas

MarkusAnderljung; ac

Some AI Governance Research Ideas

MarkusAnderljung,

Comments 5

Sorted by

New & upvoted

MichaelA🔸

Thanks for compiling this! I like the way you've approached this (e.g., the google form you've linked to), and most of these ideas do seem interesting and important to me.

I'd be interested to hear later on how many people filled in the form and how much good stuff came from that.

Also, I've now added this to my central directory for open research questions (in the section for non-technical AI focused stuff), to hopefully make it a little more likely people looking for research projects in future can find it.

MarkusAnderljung

Thanks Michael! Yeah, I hope it ends up being helpful.

MaxRa

Thanks, I enjoyed reading the ideas and get a rough overview about what you think is interesting and useful.

One part I stumbled upon and would be interested in thoughts:

Ultimately, you should aim for this research to be able to inform questions like: If you were in control of e.g. Google, what corporate self-governance mechanisms would you put in place in order to ensure the company behaves in a socially responsible way in the face of radical technological change?

I was wondering if it makes sense to frame this as „social responsibility“, especially when it is about radical technological change. Social responsibility is already used for companies to do additional socially beneficial things, and doesn‘t communicate how radical the impact might be and how much it will shape our future and how much care/security mindset might be required if say Google would be first do develop transformative AI systems.

MarkusAnderljung

Thanks! I agree that using a term like "socially beneficial" might be better. On the other hand, it might be helpful to couch self-governance proposals in terms of corporate social responsibility, as it is a term already in wide use.

MaxRa

Yeah. What I thought is that one might want to somehow use a term that also emphasizes the potentially transformative impact AI companies will have, as in „We think your AI research might fit into the reference class of the Manhattan Project“. And „socially beneficial“ doesn‘t really capture this either for me. Maybe something in the direction of „risk-aware“, „risk-sensitive“, „farsighted“, „robustly beneficial“, „socially cautious“…

Edit: Just stumbled upon the word word „stewardship“ in the most recent EconTalk episode from a lecturer wanting to kindle a sense of stewardship over nuclear weapons in military personnel.

Comments

Some AI Governance Research Ideas

Some AI Governance Research Ideas

Other Sources