IGF 2025 WS #469 AI Safety Institutes 2.0? A New Wave of AI Governance

    Organizer 1: Civil Society, Latin American and Caribbean Group (GRULAC)
    Organizer 2: Civil Society, Latin American and Caribbean Group (GRULAC)
    Organizer 3: Civil Society, Latin American and Caribbean Group (GRULAC)
    Speaker 1: Carolina Aguerre, Civil Society, Latin American and Caribbean Group (GRULAC)
    Speaker 2: Jhalak Mrignayani Kakkar, Civil Society, Asia-Pacific Group
    Speaker 3: David Bedard, Government, Western European and Others Group (WEOG)
    Format
    Roundtable
    Duration (minutes): 60
    Format description: The rapid evolution of AI governance demands a dynamic and participatory discussion format, making a 60-minute roundtable the ideal choice for this session. Given the growing urgency to move beyond risk mitigation and design AI institutions that also foster innovation, economic growth, and sustainability, this interactive format allows participants to challenge existing models, exchange global insights, and propose actionable solutions in real time. This approach directly supports our expected outcomes. By fostering an open exchange, the session will generate insights that will inform the creation of a prototype for an AI Safety & Opportunity Institute in Brazil, ensuring that lessons from the first wave of AI Safety Institutes are critically assessed. The roundtable structure also allows for meaningful engagement with our policy questions, particularly on governance models and Global South leadership in AI regulation. Ultimately, this setup ensures that the discussion remains dynamic, inclusive, and action-oriented.
    Policy Question(s)
    1. What lessons can be drawn from the first wave of AI Safety Institutes (AISIs), and how can they inform the design of AI governance institutions that balance safety with innovation and economic opportunity? 2. What governance models ensure that AI institutions remain independent, transparent, and inclusive while addressing both risk mitigation and AI-driven opportunities? 3. How can developing countries, particularly in the Global South, design AI governance frameworks that reflect their own policy priorities rather than simply adapting models established by leading tech nations?
    What will participants gain from attending this session? Participants in this session will gain a deeper understanding of the evolving landscape of AI governance, particularly the transition from risk-centric AI Safety Institutes to a more balanced model that also prioritizes opportunity creation. Through an in-depth discussion on the proposed AI Safety & Opportunity Institute for Brazil, attendees will explore how AI governance can move beyond regulatory compliance to actively foster innovation, economic growth, and sustainable development. The session will provide valuable insights into the strengths and limitations of first-wave AISIs, offering a comparative perspective on how different countries are approaching AI policy. Participants will also engage with a multistakeholder governance model that ensures transparency, inclusivity, and accountability. By the end of the discussion, they will leave with new perspectives on how AI institutions can be designed to align with national and regional priorities, as well as practical ideas for shaping AI governance in diverse political and economic contexts.
    Description:

    The first wave of AI Safety Institutes (AISIs) emerged as a response to global concerns over AI risks, focusing primarily on technical evaluations, ethical standards, and international cooperation. However, as highlighted at the AI Action Summit in Paris, the global conversation is shifting. Countries are increasingly recognizing the need to balance AI safety with economic competitiveness, sustainability, and public interest-driven innovation. This session will explore the prototype for a second-generation institution called “AI Safety & Opportunity Institute (AISO)”, a new model of governance that goes beyond the risk-centered approach of existing AISIs to integrate opportunity creation, multistakeholder governance, and AI’s role in sustainable development. Using Brazil as a starting point, the discussion will examine how a second wave of AI governance institutions could better align AI policy with national and regional development goals in the Global South. The session will reflect on the limitations of first-wave AISIs and the lessons learned from their implementation, while proposing a framework that ensures AI safety is pursued alongside strategies for fostering innovation. Particular attention will be given to how a multistakeholder approach can guarantee transparency, inclusivity, and accountability, as well as how an AISO could position Brazil as a regional and global leader in AI governance. Bringing together policymakers, researchers, civil society, and industry leaders, this interactive roundtable will challenge participants to rethink AI governance beyond risk mitigation. Rather than merely adapting regulatory frameworks designed by leading tech nations, the session will explore how countries like Brazil can develop a governance model that is responsive to both the challenges and opportunities posed by AI. By shifting the debate from risk to opportunity, the discussion will emphasize how a well-designed AISO could help nations harness AI’s potential in a responsible and equitable way.
    Expected Outcomes
    This session aims to generate concrete insights on how AI governance institutions can evolve beyond risk mitigation to also foster innovation, economic growth, and sustainability. By examining lessons learned from the first wave of AI Safety Institutes (AISIs), participants will contribute to a deeper understanding of how governance models can ensure independence, transparency, and multistakeholder collaboration while balancing safety and opportunity. A key outcome of the session will be direct input towards a more structured AI Safety & Opportunity Institute (AISO) prototype. ITS Rio is currently drafting an initial proposal for how an AISO could be implemented in Brazil, and feedback from this discussion will be incorporated into it, which can then be used to spark similar conversations in other countries of the Global South. The session’s contributions will also help shape future multistakeholder discussions on AI governance, fostering collaboration between different actors to explore new institutional models.
    Hybrid Format: With a track record of hosting three hybrid sessions at IGF since 2020, ITS Rio understands that an engaging discussion depends on seamless interaction between onsite and online participants. The moderator will alternate between onsite and online participants to encourage direct exchanges. A dedicated online moderator will monitor the chat, selecting and elevating remote interventions in real time, while the onsite moderator will actively incorporate those perspectives into the discussion. To maximize interaction, our invited speakers will collectively speak for no more than 15 minutes, setting the stage for a dynamic roundtable discussion. The remaining time will be dedicated to participant engagement, using a guided discussion format where attendees respond to specific prompts. We will use Padlet as a collaborative notepad, allowing all participants—especially those joining remotely—to contribute key takeaways and policy recommendations in real time.