This report argues that there are significant plausible benefits to creating an Open Agency type Artificial General Intelligence (AGI) and having a Global AGI Agency as its primary controller, but that there are also immense challenges to these significant benefits. After a brief exploration of the history of digital computation and global governance, the paper begins with an examination of two AGI types: Unitary Agent and Open Agency. Then, it provides a selected literature review of approaches to AI and AGI governance. The AGI governance literature is sparse, but a few AGI governance proposals are discussed. Next, it examines a proposed scenario in which the world has created a single AGI and that AGI is governed, in large part, by a Global AGI Agency.
The Global AGI Agency which has four proposed core elements: (1) an institutional framework involving joint support from the UN and IEEE and from a coalition of national governments and private sector companies, (2) global collaboration and integration across key AI powers and companies, (3) the Open Agency AGI model itself, organized around principles of structured transparency, and (4) mechanisms for democratic accountability and access.
Following the discussion of the Global AGI Agency proposal, the paper describes 10 challenges for this proposal. These 10 challenges include: international cooperation, centralization of power, innovation and competition concerns, private sector resistance, representation and fairness, complexity of governance, technical challenges of the Open Agency AGI model, democratic accountability limitations, security and information risks, and adaptability and future-proofing concerns. In the conclusion the author reconsiders the key points from the report and reminds the reader of the important challenge of good AGI governance.
