UN Summit of the Future: A Critical Moment for Global AI Governance

Medlir Mema
Justin Bullock
Commentary
AI Governance
Published
20
September 2024
minute read

Representatives and leaders from national and local governments, civil society, private sector, and other segments of the society will convene at the UN Summit of the Future held between September 22-23, 2024 in New York to adopt the Pact for the Future. An ‘action-oriented outcome’ document, which will include an equally ambitious Global Digital Compact and a Declaration on Future Generations as annexes, the Pact for the Future is expected to be endorsed by UN member states at the conclusion of the Summit.

Building upon UN Secretary General Antonio Guterres’ 2021 Common Agenda report, and expanded upon in various UN General Assembly decisions and resolutions, the Pact for the Future acknowledges the inadequacy of our existing global governance framework. Governance institutions of the present have proven inadequate for addressing the ambitious goals that the UN and its member states have set out. Principal among these are unlocking the opportunities and mitigating the risks that emerging technologies pose for development, security, and human rights, as well as the indispensability of making the necessary changes to enable concerted and decisive action to address shared challenges.

In recent years, Artificial Intelligence (AI) has seen immense improvements in capabilities and reach across every aspect of human activity. AI can be used to greatly improve the world or cause irreparable harm to it. Leading experts from across the world expect these capabilities to continue to improve, with some expressing serious concern about the systemic risks they pose for humanity and to the planet. As these advancements progress, the urgency of developing effective global frameworks for AI governance becomes increasingly clear.

As a result, it is essential that as leaders, academics, and activists from around the world meet in New York, that one of their main priorities should be the adoption of a comprehensive global compact for the governance of AI systems that establishes clear international standards, prioritizes safety, ethics, and transparency, and ensures equitable access to AI technologies across all regions.

There are some positive signs in this regard. The US- and China-sponsored UN General Assembly resolutions calling for ‘safe, secure, and trustworthy’ AI passed with overwhelming support in the UN earlier this year, underscoring the global support for such standards, not to mention the proliferation of dozens of regional, national, and local AI regulations and legislation already signed into law.

However, in light of well-documented and deeply concerning cases of algorithmic and systemic bias, violations of human rights, and the weaponization of AI, it is important that Summit participants negotiate and agree on the creation of an international regulatory body to oversee the development and deployment of AI systems, ensuring compliance with ethical guidelines, addressing risks such as bias, privacy violations, weaponization, and preventing the monopolization of AI power by a few countries and tech companies. Such a body must also promote transparency, ensuring  especially the developers of such AI systems can be held accountable.

A coordinated effort to develop AI safety measures, including research into robust and aligned AI systems that are controllable, interpretable, and aligned with human values, is necessary to mitigate the potential risks posed by increasingly autonomous technologies. The so-called ‘AI alignment problem,’ implies that there is a real possibility for a mismatch between human values and machine goals. As some have pointed out, this also means that any well-intentioned regulatory efforts may be subject to similar value misalignment vulnerabilities. This is why any regulatory attempts must take place alongside rigorous scientific research to prevent socially and institutionally undesirable outcomes.

One of the main drivers behind the Common Agenda, and indeed of the Summit, is the realization that UN member states have fallen woefully short of the benchmarks outlined in the UN Sustainable Development Goals (SDGs). While AI does have the potential to help overcome this lag in progress, AI that is weaponized, controlled by a handful of actors, or not properly aligned with human values risks not only halting progress on these goals but decimating the progress that has been made.

AI may not only increase inequality both across the Global North and Global South, but also within countries. Numerous studies have shown that the adoption of emerging technologies can be disruptive to both economies, and political stability. While in the Global North such disruption may be offset by potential efficiency gains and relatively stable political institutions, the picture across the developing world appears more complicated, possibly leading to increases both in social and economic inequalities and government oppression and instability.

It is important, therefore, that advanced economies commit at the UN Summit to share the benefits of new and emerging technologies with developing countries, fostering collaboration, capacity building, and knowledge transfer to reduce global disparities in technological advancement. In this regard, AI could potentially be harnessed to advance SDGs. Aspirations expressed in UN General Assembly resolutions must translate into real action plans that ensure that developing nations are not left behind in the digital divide, and provide necessary infrastructure, resources, and expertise.

Such efforts should prioritize sustainable development, empowering these countries to harness technological advances for economic growth, social progress, and addressing critical challenges like public health and climate change. Such prioritization requires an inclusive dialogue between governments, civil society, and private industry to ensure that the voices of diverse communities, including marginalized and underrepresented populations, are central in shaping the future of AI governance.

AI Governance

AI, Sustainable Development and the Future of Education: A Governance Imperative

ai-sustainable-development-and-the-future-of-education-a-governance-imperative

Commentary

Global Education

August 17, 2026

Financing Syria's Recovery: The EU and a Fragile Economic Opening

financing-syrias-recovery-the-eu-and-a-fragile-economic-opening

Briefing

Global Economy

August 12, 2026

European Defence: The European Union Framework as a Dead End

european-defence-the-european-union-framework-as-a-dead-end

Briefing

Peace and Security

July 22, 2026

The New Development Bank Joins the Shift Towards Nuclear Energy Financing

the-new-development-bank-joins-the-shift-towards-nuclear-energy-financing

Commentary

Global Economy

July 13, 2026

An Issue Area Approach to Defending Global Governance

an-issue-area-approach-to-defending-global-governance

Briefing

Peace and Security

July 2, 2026

Europe’s Defence Supply Chains Need Africa and the Global South

europes-defence-supply-chains-need-africa-and-the-global-south

Commentary

Global Economy

June 12, 2026

Retrenchment as Policy Failure: Aid Cuts, the Post-UNITAMS Vacuum, and Sudan's Civilian Crisis

retrenchment-as-policy-failure-aid-cuts-the-post-unitams-vacuum-and-sudans-civilian-crisis

Briefing

Peace and Security

May 28, 2026

The Illusion of AI Sovereignty: Mapping the Five-Layer AI Stack

the-illusion-of-ai-sovereignty-mapping-the-five-layer-ai-stack

Commentary

AI Governance

May 15, 2026

Towards a Science for Diplomacy? The U7+ Alliance and the Strategic Repositioning of Universities in Global Governance

towards-a-science-for-diplomacy-the-u-7-alliance-and-the-strategic-repositioning-of-universities-in-global-governance

Commentary

Global Education

April 27, 2026

The Capability Overhang: Cognition and Labor in the Age of AI

the-capability-overhang-cognition-and-labor-in-the-age-of-ai

Commentary

AI Governance

April 9, 2026

The UN80 Initiative as a Productive Failure: Between Geopolitical Disruptions and Organizational Path Dependency

the-un80-initiative-as-a-productive-failure-between-geopolitical-disruptions-and-organizational-path-dependency

Analysis

Peace and Security

March 31, 2026

Higher Education at a Crossroads: Why Europe’s Universities Must Lead, Not Merely Comply

higher-education-at-a-crossroads-why-europes-universities-must-lead-not-merely-comply

Commentary

Global Education

February 23, 2026

What Comes After the US-Israel Strikes on the Islamic Republic?

what-comes-after-the-us-israel-strikes-on-the-islamic-republic

Commentary

Peace and Security

December 19, 2025

Do You Know What’s in Your Skies? Emerging Challenges for Civil Aviation Governance

do-you-know-whats-in-your-skies-emerging-challenges-for-civil-aviation-governance

Commentary

AI Governance

December 18, 2025

Knowledge creation in times of scarce resources in higher education

knowledge-creation-in-times-of-scarce-resources-in-higher-education

Commentary

Global Education

November 10, 2025

Justice-Ready Digital Public Infrastructure: Building a Third Layer of Trust for Democratic Resilience

justice-ready-digital-public-infrastructure-building-a-third-layer-of-trust-for-democratic-resilience

Briefing

AI Governance

October 23, 2025

Is a Greener Future for AI Possible?

is-a-greener-future-for-ai-possible

Commentary

AI Governance

October 20, 2025

Silencing Dissent: How the Tech Backlash Threatens Transitional Justice

silencing-dissent-how-the-tech-backlash-threatens-transitional-justice

Commentary

AI Governance

October 2, 2025

Holding NATO Together and Keeping the US Engaged: Strategic Implications of the Hague Summit

holding-nato-together-and-keeping-the-us-engaged-strategic-implications-of-the-hague-summit

Analysis

Peace and Security

September 9, 2025

Reforming the UN during a financial crisis: a foreseeable failure to align money, mandates, and majorities?

reforming-the-un-during-a-financial-crisis-a-foreseeable-failure-to-align-money-mandates-and-majorities

Briefing

Peace and Security

July 9, 2025

How do we measure the quality of education?

how-do-we-measure-the-quality-of-education

Commentary

Global Education

April 28, 2025

Bound to Fail? The Limits of Diplomacy in the Russia–Ukraine War and the Future of European Security

bound-to-fail-the-limits-of-diplomacy-in-the-russia-ukraine-war-and-the-future-of-european-security

Commentary

Peace and Security

April 8, 2025

A major shift in global higher education is underway: why collective leadership and governance are more important than ever

a-major-shift-in-global-higher-education-is-underway-why-collective-leadership-and-governance-are-more-important-than-ever

Commentary

Global Education

March 26, 2025

AI's Fast-Forward Button: Can We Harness Innovation Without Sacrificing Safety?

ais-fast-forward-button-can-we-harness-innovation-without-sacrificing-safety

Commentary

AI Governance

March 10, 2025

Parliaments in the EU enlargement process: Strengthening capacities of accession country parliaments under the evolving enlargement methodology

parliaments-in-the-eu-enlargement-process-strengthening-capacities-of-accession-country-parliaments-under-the-evolving-enlargement-methodology

Report

Democracy and Human Rights

January 30, 2025

Synthetic Biology and the Future of Global Environmental Governance

synthetic-biology-and-the-future-of-global-environmental-governance

Analysis

Global Environmental Governance

January 28, 2025

Towards a Global Agency for Governing Artificial General Intelligence: Challenges and Perspectives

towards-a-global-agency-for-governing-artificial-general-intelligence-challenges-and-perspectives

Report

AI Governance

January 14, 2025

Normalizing Russia can become Trump’s biggest mistake, but it’s not too late to prevent it

normalizing-russia-can-become-trumps-biggest-mistake-but-its-not-too-late-to-prevent-it

Commentary

Peace and Security

January 13, 2025

Stabilizing Europe’s Security Architecture after the Russo-Ukraine War? The Future of Conventional Arms Control in Europe

stabilizing-europes-security-architecture-after-the-russo-ukraine-war-the-future-of-conventional-arms-control-in-europe

Briefing

Peace and Security

November 20, 2024

INTERPOL: Challenges and Opportunities for the New Secretary General

interpol-challenges-and-opportunities-for-the-new-secretary-general

Commentary

Peace and Security

November 7, 2024

A Fork in the Road? The Kazan Summit of the BRICS

a-fork-in-the-road-the-kazan-summit-of-the-brics

Briefing

Peace and Security

October 30, 2024

UN Summit of the Future and Development: The Way Forward

un-summit-of-the-future-and-development-the-way-forward

Briefing

AI Governance

October 24, 2024

ECOWAS after the ‘Triple Withdrawal’ and the creation of the Alliance of Sahel States

ecowas-after-the-triple-withdrawal-and-the-creation-of-the-alliance-of-sahel-states-challenges-and-ways-ahead-for-regional-security-governance

Analysis

Peace and Security

October 7, 2024

Rushing to Peace, Racing to War: The Challenge of a Just Settlement

rushing-to-peace-racing-to-war-the-challenge-of-a-just-settlement

Commentary

Peace and Security

September 30, 2024

UN Summit of the Future: A Critical Moment for Global AI Governance

un-summit-of-the-future-a-critical-moment-for-global-ai-governance

Commentary

AI Governance

September 20, 2024

Shattered Security: Gender And Coups In Guinea, Mali, And Burkina Faso

shattered-security-gender-and-coups-in-guinea-mali-and-burkina-faso

Briefing

Peace and Security

June 26, 2024

Before the Peace Summit: Testing Multilateralism and Ukrainian Diplomacy

before-the-peace-summit-testing-multilateralism-and-ukrainian-diplomacy

Commentary

Peace and Security

June 14, 2024

The On-Going Quest for Teaching Excellence

the-on-going-quest-for-teaching-excellence

Commentary

Global Education

June 11, 2024

Deepening EU-Japan-US Cooperation on Critical and Emerging Technologies

deepening-eu-japan-us-cooperation-on-critical-and-emerging-technologies

Commentary

AI Governance

May 7, 2024

UNRWA’s Funding Freeze was Unjustified and Undermined Good Governance

unrwas-funding-freeze-was-unjustified-and-undermined-good-governance

Briefing

Democracy and Human Rights

April 25, 2024

Israel’s Non-implementation of the ICJ’s Provisional Measures: International Law Must Be Upheld

israels-non-implementation-of-the-icjs-provisional-measures-international-law-must-be-upheld

Briefing

Democracy and Human Rights

April 2, 2024

The EU AI Act: two steps forward, one step back

the-eu-ai-act-two-steps-forward-one-step-back

Briefing

AI Governance

March 19, 2024

The Council of Europe’s draft AI Treaty: balancing national security, innovation and human rights?

the-council-of-europes-draft-ai-treaty-balancing-national-security-innovation-and-human-rights

Commentary

AI Governance

March 18, 2024

The Ukrainian Peace Formula: content, evolution and diplomatic outreach

the-ukrainian-peace-formula-content-evolution-and-diplomatic-outreach

Analysis

Peace and Security

February 26, 2024

What developments in AI tell us about the future of governance models

what-developments-in-ai-tell-us-about-the-future-of-governance-models

Commentary

AI Governance

February 21, 2024

Whither the Global Governance of Protecting Civilians? An Initial Assessment of the ICJ’s Decision on South Africa v. Israel of 26 January 2024

whither-the-global-governance-of-protecting-civilians-an-initial-assessment-of-the-icjs-decision-on-south-africa-v-israel-of-26-january-2024

Analysis

Democracy and Human Rights

February 14, 2024

How Ukraine uses AI to fight Russian information operations

how-ukraine-uses-ai-to-fight-russian-information-operations

Commentary

AI Governance

February 12, 2024

Got trust? Global governance of emerging technologies

got-trust-global-governance-of-emerging-technologies

Commentary

AI Governance

November 28, 2023

Last minute national objections to the EU’s AI Act are a mistake. Here’s why

rolling-back-the-ai-act-is-a-mistake-heres-why

Commentary

AI Governance

November 27, 2023

Contributions of Latin America and the Caribbean to UN Peace Operations and Recommendations to Increase this Participation

new-ggi-advice-report-latin-american-and-caribbean-countries-contributions-to-un-peacekeeping

Report

Peace and Security

October 12, 2023

Armed Conflict in Nagorno-Karabakh: Crisis, Exodus, and Ethnic Cleansing

armed-conflict-in-nagorno-karabakh-crisis-exodus-and-ethnic-cleansing

Briefing

Peace and Security

October 9, 2023

Thinking of Eloho – One Year On

thinking-of-eloho-one-year-on

Commentary

Peace and Security

August 12, 2023

The Strategic Compass and the EU's Security & Defence Partnerships

the-strategic-compass-implementing-the-partnership-dimension-in-the-area-of-security-and-defence

Report

Peace and Security

July 23, 2023

Franco-German Perspectives: Europe's Moment of Geopolitics

franco-german-perspectives-europes-moment-of-geopolitics

Commentary

Peace and Security

June 2, 2023

A Comprehensive Mapping of National Higher Education Teaching Qualification schemes, Requirements and Provisions for the Promotion and Reward of Teaching Excellence

a-comprehensive-mapping-of-national-higher-education-teaching-qualification-schemes-requirements-and-provisions-for-the-promotion-and-reward-of-teaching-excellence

Report

Global Education

June 1, 2023

Stefaan de Rynck 'Inside the deal: How the EU got Brexit Done'

stefaan-de-ryncks-inside-the-deal-how-the-eu-got-brexit-done

Commentary

Global Education

April 5, 2023

NATO Allies and the Protection of Civilians

nato-allies-and-the-protection-of-civilians

Analysis

Peace and Security

January 11, 2023

Why Jettison Erasmus? The negative consequences for the UK of walking away

why-jettison-erasmus

Commentary

Global Education

January 1, 2021

Doing less with more? The difficult return of Western troop contributing countries to UN Peacekeeping

doing-less-with-more

Analysis

Peace and Security

November 2, 2020

The European Union's Role in International Economic Fora – Paper 4: The IMF

the-european-unions-role-in-international-economic-fora-paper-4-the-imf

Report

Global Economy

September 1, 2015

Civil Society Reforms in Uzbekistan: More than Government Chicanery?

civil-society-reforms-in-uzbekistan-more-than-government-chicanery

Briefing

Peace and Security

January 1, 2014

Assessing the EU’s Joint Communication on the Comprehensive Approach: Implications for EU Crisis Response and Conflict Prevention

assessing-the-eus-joint-communication-on-the-comprehensive-approach

Briefing

Peace and Security

December 15, 2013

The EU Foreign Policy of My Dreams: Ten Wishes

the-eu-foreign-policy-of-my-dreams-ten-wishes

Views from Practice

Peace and Security

December 12, 2013

The Middle East as weapons of mass destruction free zone: A proposal to overcome the deadlock

the-middle-east-as-weapons-of-mass-destruction-free-zone-a-proposal-to-overcome-the-deadlock

Views from Practice

Peace and Security

October 15, 2013

From a Militarized to a Humanized Responsibility to Protect

from-a-militarized-to-a-humanized-responsibility-to-protect-integrating-the-red-cross-and-red-crescent-into-rtop-to-respond-to-natural-disasters-and-global-climate-change

Analysis

Global Environmental Governance

June 1, 2013

Leading the Peacebuilding Commission: An Institutional History in the Making

leading-the-peacebuilding-commission-an-institutional-history-in-the-making

Views from Practice

Peace and Security

March 1, 2013

Anticipating the “Final” Arms Trade Treaty Conference: Eight Concrete Proposals

anticipating-the-final-arms-trade-treaty-conference-eight-concrete-proposals

Analysis

Peace and Security

February 1, 2013

Report for the Inquiry into the European External Action Service – EU sub-committee on External Affairs of the House Of Lords

report-for-the-inquiry-into-the-european-external-action-service---eu-sub-committee-on-external-affairs-of-the-house-of-lords

Briefing

Peace and Security

December 1, 2012

Government and the Process of Governance in Africa

government-and-the-process-of-governance-in-africa

Analysis

Peace and Security

November 1, 2012

The Responsibility to Protect and the Responsibility while Protecting: Friends or Foes?

the-responsibility-to-protect-and-the-responsibility-while-protecting-friends-or-foes

Analysis

Democracy and Human Rights

September 15, 2012

Montenegro’s Accession To The EU: Taking Stock And Suggesting Areas For Progress

montenegros-accession-to-the-eu-taking-stock-and-suggesting-areas-for-progress

Briefing

Democracy and Human Rights

August 1, 2012

Electing Freedom? Key Challenges For Libya After The 7 July 2012 Election

electing-freedom-key-challenges-for-libya-after-the-7-july-2012-election

Briefing

Peace and Security

August 1, 2012

The Somali Crisis and the EU: Moving Onshore and Committing to Somalia

the-somali-crisis-and-the-eu-moving-onshore-and-committing-to-somalia

Analysis

Peace and Security

July 1, 2012

United Nations - European Union Cooperation in the Field of Peacekeeping: Challenges and Prospects

united-nations-european-union-cooperation-in-the-field-of-peacekeeping-challenges-and-prospects

Analysis

Peace and Security

June 1, 2012

Widening The Huntress’s Reach: Legal And Strategic Aspects Of A New Atalanta Mandate

legal-and-strategic-aspects-of-a-new-atalanta-mandate

Briefing

Democracy and Human Rights

April 15, 2012

The Biological Weapons Convention, Bioterrorism And The Life Sciences

the-biological-weapons-convention-bioterrorism-and-the-life-sciences

Briefing

Peace and Security

April 1, 2012

A Democratic Justification for Military and Non-military Humanitarian Intervention

a-democratic-justification-for-military-and-non-military-humanitarian-interventions

Analysis

Democracy and Human Rights

April 1, 2012

Climate Change and Security: Adapting the Discussion to the Evidence

climate-change-and-security

Briefing

Global Environmental Governance

March 15, 2012

The United Nations Entity for Gender Equality and the Empowerment of Women (UN Women)

the-united-nations-entity-for-gender-equality-and-the-empowerment-of-women-un-women

Backgrounder

Peace and Security

September 1, 2011

The International Criminal Court and Kenya’s Post-election Violence

the-international-criminal-court-and-kenyas-post-election-violence

Analysis

Democracy and Human Rights

July 15, 2011

The United Nations Peacebuilding Architecture: Background Note

the-united-nations-peacebuilding-architecture-background-note

Briefing

Peace and Security

March 1, 2011

European Civilian Crisis Management Capacities: Bridging The Resources Gap?

european-civilian-crisis-management-capacities-bridging-the-resources-gap

Briefing

Peace and Security

January 15, 2011

The Changing Constellation of Power and Resistance in the Global Debate over Agrofuels

the-changing-constellation-of-power-and-resistance-in-the-global-debate-over-agrofuels

Analysis

Global Environmental Governance

January 1, 2011