Event Summaries

We are looking for an Executive Assistant to GovAI’s Director to help him prioritise correctly and to leverage his time most effectively.

Some experts are concerned that AI chatbots could pose biological risks. But AI-enabled “biological tools” may pose greater risks and will likely require a distinct policy response.

The Centre for the Governance of AI's Annual Report 2023 + Q1 2024.

Summer and Winter Fellowships provide an opportunity for early-career individuals or individuals new to the field of AI governance to work on a research project and learn about the field.

If policymakers could foresee how AI will impact labour markets, they could make better policy decisions. The nascent science of “automation evaluations” aims to provide this foresight.

AI agents could pose novel risks. Information about their activity in the real world could help us manage these risks.

We’re proud to highlight what our 2024 Winter Fellows have been working on.

A critical AI safety goal is understanding how new AI systems will behave in the real world. We can assess our understanding by trying to predict the results of model evaluations before running them.

The second AI Safety Summit is an opportunity to reinforce the world’s commitment to an ambitious summit series.

In January 2024, Paul Scharre (CNAS) joined GovAI's Head of Policy Markus Anderljung for a live webinar discussion on 'Power in the Age of Artificial Intelligence'. You can watch the recording here...

Falling development costs allow more and more groups to reproduce existing AI capabilities. But falling costs also benefit large compute investors, helping them maintain their leads by pushing...

Recent AI progress has largely been driven by increases in the amount of computing power used to train new models. Governing compute could be an effective way to achieve AI policy goals...

This post aims to give policymakers an overview of available methods for preventing the misuse of general-purpose AI systems, as well as the limitations of these methods.

We’re proud to highlight what our 2023 Summer Fellows have been working on.

In October 2023, Daron Acemoglu joined GovAI's Economics of AI Lead Anton Korinek for a discussion on Daron's book Power and Progress: Our 1000-Year Struggle Over Technology & Prosperity.

Developed countries shouldn't underestimate the value of including the Global South in international AI governance discussions.

A new report proposes creating an international body that can certify compliance with international standards on civilian AI.

Risks from the misuse of AI will continue to grow. While there are multiple ways to reduce misuse risks, restricting access to some AI capabilities will likely become increasingly necessary.

Voluntary commitments secured by the White House from leading AI labs are significant, but they also raise a number of questions.

In July 2023, GovAI hosted a webinar focused on a whitepaper: “Frontier AI Regulation: Managing Emerging Risks to Public Safety.”

The summit could produce a range of valuable outcomes. It may also be a critical and fleeting opportunity to bring China into global AI governance.

The next generation of foundation models could threaten public safety. We explore the challenges of regulating frontier AI models and the building blocks of a potential regulatory regime.

We propose an information-sharing regime between leading AI labs and the UK Office for Artificial Intelligence. This regime could support anticipatory policymaking and reduce risks.

Chinese policymakers are becoming interested in general AI, but see compute as a major challenge.

Our survey of 51 leading experts from AGI labs, academia, and civil society found overwhelming support for many AGI safety and governance practices.

Our 2023 Winter Fellowship recently ended, and we’re proud to highlight what our Winter Fellows have been up to!

In April 2023, GovAI was joined for an online discussion by Lauren Kahn from the Council on Foreign Relations. GovAI's International Governance Lead Robert Trager hosted the discussion.

The Centre for the Governance of AI's Annual Report 2022.

In March 2023, we hosted a presentation by Tom Davidson (Open Philanthropy) about his draft paper "What a Compute-Centric Framework Says About Takeoff Speeds". GovAI's Acting Director Ben Garfinkel..

Preliminary findings from a survey with over 13,000 people in 11 countries show that an overwhelming majority in Europe and the US there is a need for careful management of AI.

The GovAI Policy Program (GAPP) is a part-time program that allows talented graduate students and professionals to deepen their expertise, expand their network, and build a technically informed...

The AI governance space needs more rigorous work on what influential actors (e.g. governments and AI labs) should do in the next few years to prepare the world for advanced AI. We're setting up a...

Numerous parties are calling for “the democratisation of AI”. But the phrase seems to refer to a variety of goals—which sometimes conflict.

Research Assistants help members of the GovAI research community with their ongoing research projects. These roles provide an opportunity to contribute to an AI governance research project, learn abou

In October 2022, we hosted a discussion with Anton Korinek and Megan Juelfs about Preparing for the (Non-Existent?) Future of Work.

As our 2022 Summer Fellowship comes to a close, we’re proud to highlight what our Summer Fellows have been up to!

In April 2022, we hosted a discussion with Paul Scharre and Helen Toner about AI Capabilities and the Nature of Warfare...

The US National AI Research Resource should provide structured access to models, not just data and compute

GovAI's Economics and AI Lead, Anton Korinek, released a MOOC on the Economics of AI.

In this seminar, Sam Altman and William G. Gale discussed Sam's blog post 'Moore's Law for Everything' and taxation solutions for advanced AI.

There is a trend within AI research towards building large models that have a broad range of capabilities. Labs building such models face a dilemma when deciding how to share them.

2021 was a year of big changes for GovAI. Most significantly, we spun out from the University of Oxford and adopted a new non-profit structure. At the same time, after five years within the...

The Centre for the Governance of AI (GovAI) has relaunched as a nonprofit organisation. Our mission remains the same: We are building a global research community, dedicated to helping humanity...

Problems of cooperation—in which agents have opportunities to improve their joint welfare but are not easily able to do so—are ubiquitous and important.

2020 saw many continued developments in AI governance. It is heartening to see how rapidly this field continues to grow, and exciting to be part of that growth. This report provides a summary of ou...

2019 saw many continued developments in AI governance. It is heartening to see how rapidly this field continues to grow, and exciting to be part of that growth. This report provides a summary of ou...

2018 saw many continued developments in AI governance. It is heartening to see how rapidly this field continues to grow, and exciting to be part of that growth. This report provides a summary of ou...

AI poses a risk of automating and degrading jobs around the world, creating harmful effects to vulnerable workers’ livelihoods and well-being. How can we deliberately account for the impacts on wor...

Over the next decades, AI will dramatically change the economic landscape. It may also magnify inequality, both within and across countries. Joseph E. Stiglitz, Nobel Laureate in Economics, joined ...

Following the 2014 Sunflower Movement protests, Audrey Tang—a prominent member of the civic social movement g0v—was headhunted by Taiwanese President Tsai Ing-wen’s administration to become the...

In the spring of 2018, MIT President L. Rafael Reif commissioned the MIT Task Force on the Work of the Future. He tasked them with understanding the relationships between emerging technologies and ...

While artificial intelligence provides the backbone for many tools people use around the world, recent work has brought attention to the potential biases that may be baked into these algorithms. Wh...

How will economic growth evolve in the long run? This session explored the wide range of plausible scenarios. Aghion, Jones & Jones 2017 analyze how artificial intelligence may super-charge the gro...

In September 2019, Facebook announced that it was establishing an independent Facebook Oversight Board, with the power to make binding decisions on content moderation. Noah Feldman, one of the Boar...

The twentieth century witnessed the triumph of democratic capitalism in the industrialized West, with widespread popular support for both free markets and representative elections. Today, that poli...

This event focussed on questions such as: Will COVID-19 cause automation to increase? A decline in labour share of income? A rise of superstar companies? What does COVID-19 teach us about policy re...

Autonomy on the battlefield represents one possible usage of narrow AI by militaries around the world. Research and development on autonomous weapon systems (AWS) by major powers, middle powers, an...

Computer security is no longer about data; it’s about life and property. This change makes an enormous difference, and will inevitably disrupt technology industries. Firstly, data authentication an...