Hide table of contents

Background and Some Comments:

  • The UN High Level Advisory Body on AI launched their interim report which was open for feedback.
  • My general approach to this was trying to target points which might have been overlooked by other organizations in the space and mostly focusing on a variety of ideas rather than honing in on one(which seemed the most apt given the 3,000 character limit on each section).
  • The report is focused on many aspects of AI Governance apart from safety, which is my focus - I chose to ignore the other aspects when brainstorming.
  • Do note that there were 2-3 other sections that I didn't respond to, and I used AI tools to make my ideas as concise as possible due to hard character limitations. In hindsight, I think a couple of them could have benefitted from pointing out comparable models where the approach has been successful. 
  • I am sharing this with the intention of getting general feedback and perhaps inspiring others to also respond to Public Voice Opportunities.

Opportunities and Enablers:

1. Global Compute Supply Chain and Algorithmic Oversight

Short Summary: 

  • Monitoring the global compute supply chain is essential for ensuring equitable access to computational resources necessary for AGI development. 
  • Simultaneously, oversight of algorithmic advancements is critical, as these can significantly boost AGI capabilities and potentially alter the balance of technological power.
  • Establish a dedicated global authority to oversee the compute supply chain and algorithmic advancements. This body would track developments in computational resources and algorithmic efficiency, regulate access to prevent monopolization and ensure that breakthroughs are ethically aligned and equitably distributed. Its mandate would include developing guidelines to manage the proliferation of advanced algorithms that could accelerate AGI capabilities, ensuring a balanced and responsible approach to technological progress.

2. Global Cooperative Framework for AGI Development and Rapid Response Dialogue

Short Summary: 

  • A global cooperative framework that facilitates rapid dialogue and collaboration among international stakeholders is vital for addressing the challenges and leveraging the opportunities presented by AGI advancements. This approach emphasizes the importance of fostering international cooperation, sharing research and innovations, and establishing mechanisms for fast-tracking responses to emerging AGI technologies and incidents.
  • Implement a Global Cooperative Framework for AGI Development that encourages collaborative innovation and the sharing of research findings and best practices.
  • Establish protocols for accelerated international dialogue and cooperation on AGI governance, including the development of rapid response mechanisms to AGI advancements and incidents. This framework should aim to reduce geopolitical tensions, promote a unified approach to AGI governance, and ensure a timely and coordinated global response to the multifaceted challenges posed by AGI technologies.

Institutional Functions that an international governance regime for AI should carry out:

1. Mandatory AGI System Deactivation Protocols

Short Summary: 

The inclusion of reliable "off-switch" protocols in AGI systems is fundamental for immediate deactivation in case of risks, ensuring human control over AGI under all circumstances.

Introduce legislation requiring AGI systems to incorporate independently verified, fail-safe deactivation mechanisms as a standard safety feature.

2. Independent AGI Auditing Framework

Short Summary:

  • Independent audits of AGI systems for ethical, safety, and compliance standards are necessary to ensure accountability and adherence to global norms.

Recommended Action: 

  • Implement a global framework mandating the regular auditing of AGI systems by accredited bodies, focusing on ethical adherence, safety standards, and compliance with international norms.

3.AGI Deceptive Alignment Certification

Short Summary: 

  • Addressing deceptive alignment in AGI systems through rigorous testing and certification is essential to verify genuine alignment with ethical guidelines and societal values.
  • Create a certification process for AGI systems, including stringent testing scenarios to evaluate ethical alignment, with certification required for deployment.

4. High-risk AGI Application Licensing

Short Summary: 

  • A licensing regime for high-risk AGI applications will ensure thorough scrutiny based on safety, security, and ethical assessments before deployment.
  • Enact a global licensing regime that subjects high-risk AGI applications to comprehensive evaluations, ensuring they meet established global standards for safety and ethics.

5. Global AGI Incident Reporting System

Short Summary: 

  • A system for global reporting of AGI incidents, including near-misses, is essential for shared learning and proactive risk management.
  • Create a system for the global reporting of AGI incidents to support early identification of risks and coordinate international responses to AGI-related incidents.

 

Any other feedback on the Interim Report:

1. The Problem of Using Interoperability in Human Rights Protections

Issue: 

The push for AI systems to be interoperable—able to work across various jurisdictions and organizations—risks prioritizing technical compatibility over human rights protections.

Consequence: 

Stakeholders might adopt the lowest level of protection, creating a "race to the bottom" scenario where fundamental human rights are undermined.

Solution:

 Establish international norms setting high standards for human rights protections to ensure interoperability does not compromise fundamental rights.

2. Acknowledge AI as a Potential Existential Risk

Acknowledgement: Recognizing AI as a potential existential risk is crucial, highlighting concerns that AI advancements could surpass human control and pose threats to humanity's survival.

Policy Response: Implement stringent safety standards, continuously monitor AI developments, and foster global consensus on limiting hazardous AI technologies.

Objective: Prevent scenarios where AI could cause irreversible harm, promoting a proactive and precautionary policy-making approach.

3. Recognizing the Role of Youth

Future Stakeholders: Youth represent not just the inheritors of tomorrow but active stakeholders in shaping the future landscape of AI. Their perspectives, innovative ideas, and unique insights into digital technology make them invaluable to the process of AI policy development.

Direct Impact: As the generation that will live with the long-term outcomes and consequences of today’s AI policies, young people have a vested interest in ensuring these frameworks are robust, equitable, and aligned with future societal needs.

Proposed Approach for Inclusion

  • Policy Co-creation: Engage youth in AI policy development through forums, consultations, and think tanks that specifically aim to gather their insights and proposals.
  • Capacity Building: Invest in educational and training programs focused on AI ethics, governance, and policy to equip young people with the necessary knowledge to contribute effectively.
  • Global Representation: Ensure diverse representation from young individuals across different regions, cultures, and socioeconomic backgrounds to capture a wide range of perspectives and solutions.
Comments1


Sorted by Click to highlight new comments since:

Executive summary: The author provides feedback to the UN Advisory Body on AI, focusing on AI safety and governance, including recommendations for monitoring the compute supply chain, establishing a global cooperative framework, implementing safety protocols, and recognizing AI as a potential existential risk.

Key points:

  1. Monitor the global compute supply chain and algorithmic advancements to ensure equitable access and prevent monopolization.
  2. Establish a global cooperative framework for AGI development, facilitating rapid dialogue, collaboration, and response to emerging technologies and incidents.
  3. Implement mandatory AGI system deactivation protocols, independent auditing, deceptive alignment certification, high-risk application licensing, and a global incident reporting system.
  4. Ensure interoperability in AI systems does not compromise human rights protections by setting high international standards.
  5. Acknowledge AI as a potential existential risk and implement stringent safety standards and monitoring.
  6. Engage youth in AI policy development, capacity building, and global representation to include their perspectives and insights.

 

 

This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, and contact us if you have feedback.

Curated and popular this week
Echo Huang
 ·  · 6m read
 · 
Summary Reading full research (with a complete reference list) This article examines how voluntary governance frameworks in Corporate Social Responsibility (CSR) and AI domains can complement each other to create more effective AI governance systems. By comparing ISO 26000 and NIST AI RMF, I identify: Key findings: * Current AI governance lacks standardized reporting mechanisms that exist in CSR * Framework effectiveness depends on ecosystem integration rather than isolated implementation * The CSR ecosystem model offers valuable lessons for AI governance Main issues identified: 1. Communication barriers between governance and technical implementation 2. Rapid AI advancement outpacing policy development 3. Lack of standardized metrics for AI risk assessment Recommendations: 1. Develop standardized AI risk reporting metrics comparable to GRI standards 2. Create sector-specific implementation modules while maintaining baseline comparability 3. Establish clear accountability mechanisms and verification protocols 4. Build cross-border compliance integration  Understanding ISO 26000: A Model for Effective Policy Ecosystems The Foundation and Evolution of ISO 26000 ISO 26000, established in 2010, represents one of the most comprehensive attempts at creating a global framework for social responsibility. Its development involved experts from over 90 countries and 40 international organizations, creating a global standard. Unlike narrower technical frameworks, ISO 26000 takes a holistic approach to organizational accountability, recognizing that an organization's social and environmental impact directly affects its operational effectiveness. What makes ISO 26000 particularly interesting is its ecosystem integration. The framework doesn't operate alone - it's part of a sophisticated web of interconnected standards, reporting mechanisms, and regulatory requirements. This integration isn't accidental; it's a deliberate response to the limitations of volunt
Omnizoid
 ·  · 9m read
 · 
Crossposted from my blog which many people are saying you should check out!    Imagine that you came across an injured deer on the road. She was in immense pain, perhaps having been mauled by a bear or seriously injured in some other way. Two things are obvious: 1. If you could greatly help her at small cost, you should do so. 2. Her suffering is bad. In such a case, it would be callous to say that the deer’s suffering doesn’t matter because it’s natural. Things can both be natural and bad—malaria certainly is. Crucially, I think in this case we’d see something deeply wrong with a person who thinks that it’s not their problem in any way, that helping the deer is of no value. Intuitively, we recognize that wild animals matter! But if we recognize that wild animals matter, then we have a problem. Because the amount of suffering in nature is absolutely staggering. Richard Dawkins put it well: > The total amount of suffering per year in the natural world is beyond all decent contemplation. During the minute that it takes me to compose this sentence, thousands of animals are being eaten alive, many others are running for their lives, whimpering with fear, others are slowly being devoured from within by rasping parasites, thousands of all kinds are dying of starvation, thirst, and disease. It must be so. If there ever is a time of plenty, this very fact will automatically lead to an increase in the population until the natural state of starvation and misery is restored. In fact, this is a considerable underestimate. Brian Tomasik a while ago estimated the number of wild animals in existence. While there are about 10^10 humans, wild animals are far more numerous. There are around 10 times that many birds, between 10 and 100 times as many mammals, and up to 10,000 times as many both of reptiles and amphibians. Beyond that lie the fish who are shockingly numerous! There are likely around a quadrillion fish—at least thousands, and potentially hundreds of thousands o
 ·  · 1m read
 · 
This piece, from @Garrison, @Lauren Gilbert and @tomwein, is really great quick summary of the US foreign aid pause, focused on PEPFAR (the US funded AIDs reduction effort).  The most affecting aspect of the piece, for me, was the prognoses for people who would no longer receive drugs from the programme: > Perhaps those in the most immediate danger are the children of HIV-positive mothers. PEPFAR currently supports around 680,000 pregnant women with ARV treatment—without access to these drugs, some 20-40 percent of them will transmit HIV to their babies. Without ARV treatment, about half of those infants will die within their first two years of life, most within the first few months. We could very well return to the world of the mid-2000s, where AIDS is once again a death sentence for a large percentage of those infected with HIV. > > Nor would the consequences of ending PEPFAR stay in Africa. In up to 20 percent of individuals who inconsistently take ARVs, HIV becomes drug-resistant. It would not be long before drug-resistant HIV reached the United States, which could undermine decades of progress in HIV prevention and treatment domestically. I say this is the "most shareable" piece I've seen because it succeeds (as much as possible) in being non-partisan. The subtitle mentions US "soft power", and the title "Trump Has Put George W. Bush’s Lifesaving Legacy in Danger" gives some kudos to Bush. This is the best piece I've seen to send to a sceptical/ republican relative. This issue is extremely important and, therefore, very emotive, so it's easy to fall into writing polemic about it. I really appreciate this piece for maintaining an objective tone without being whataboutist.