Session
European Center for Not-for-Profit Law (ECNL)
Marlena Wisniak, European Center for Not-for-Profit Law (ECNL), Civil Society, Eastern European Group Vanja Skoric , European Center for Not-for-Profit Law (ECNL), Civil Society, Eastern European Group
Marlena Wisniak, European Center for Not-for-Profit Law (ECNL), Civil Society, Eastern European Group Vanja Skoric , European Center for Not-for-Profit Law (ECNL), Civil Society, Eastern European Group
Organization's Website
Speakers
Marlena Wisniak, European Center for Not-for-Profit Law (ECNL), Civil Society, Eastern European Group
Aliya Bhatia, Center for Democracy and Technology (CDT), Civil Society, Western European and Others Group
Farzaneh Badiei, Digital Trust and Safety Partnership (DTSP), Industry group, Asia Pacific Group
Onsite Moderator
Marlena Wisniak, European Center for Not-for-Profit Law (ECNL), Civil Society, Eastern European Group
Online Moderator
Vanja Skoric , European Center for Not-for-Profit Law (ECNL), Civil Society, Eastern European Group
Rapporteur
Marlena Wisniak, European Center for Not-for-Profit Law (ECNL), Civil Society, Eastern European Group
SDGs
5.1
5.5
5.b
9.1
9.5
10.2
10.3
16.10
16.6
16.7
17.16
17.17
Targets: SDG 16 – Peace, Justice, and Strong Institutions 16.6 Develop effective, accountable, and transparent institutions at all levels. 16.7 Ensure responsive, inclusive, participatory, and representative decision-making. 16.10 Ensure public access to information and protect fundamental freedoms. SDG 10 – Reduced Inequalities 10.2 Empower and promote the social, economic, and political inclusion of all. 10.3 Ensure equal opportunities and reduce inequalities of outcome by eliminating discriminatory policies and practices. SDG 9 – Industry, Innovation, and Infrastructure 9.1 Develop resilient infrastructure that supports inclusive and sustainable development. 9.5 Enhance scientific research and technological capabilities for innovation. SDG 5 – Gender Equality 5.1 End all forms of discrimination against women and girls. 5.5 Ensure women’s full and effective participation in leadership and decision-making. 5.b Enhance the use of enabling technology to promote women’s empowerment. SDG 17 – Partnerships for the Goals 17.16 Enhance multi-stakeholder partnerships to support sustainable development. 17.17 Encourage effective public, public-private, and civil society partnerships.
5.5
5.b
9.1
9.5
10.2
10.3
16.10
16.6
16.7
17.16
17.17
Targets: SDG 16 – Peace, Justice, and Strong Institutions 16.6 Develop effective, accountable, and transparent institutions at all levels. 16.7 Ensure responsive, inclusive, participatory, and representative decision-making. 16.10 Ensure public access to information and protect fundamental freedoms. SDG 10 – Reduced Inequalities 10.2 Empower and promote the social, economic, and political inclusion of all. 10.3 Ensure equal opportunities and reduce inequalities of outcome by eliminating discriminatory policies and practices. SDG 9 – Industry, Innovation, and Infrastructure 9.1 Develop resilient infrastructure that supports inclusive and sustainable development. 9.5 Enhance scientific research and technological capabilities for innovation. SDG 5 – Gender Equality 5.1 End all forms of discrimination against women and girls. 5.5 Ensure women’s full and effective participation in leadership and decision-making. 5.b Enhance the use of enabling technology to promote women’s empowerment. SDG 17 – Partnerships for the Goals 17.16 Enhance multi-stakeholder partnerships to support sustainable development. 17.17 Encourage effective public, public-private, and civil society partnerships.
Format
Roundtable
We have chosen a roundtable-style layout, successfully used in previous sessions,, to accommodate a large audience while fostering interactive dialogue. The open seating arrangement enhances accessibility and encourages diverse participation from civil society, policymakers, and technical experts. A 60-minute session strikes the right balance between depth and engagement, allowing for structured speaker inputs, interactive discussions, and audience participation without losing focus. Given the complexity of automated content moderation, this format ensures participants gain practical insights while maintaining an inclusive and dynamic space for debate and knowledge exchange.
We have chosen a roundtable-style layout, successfully used in previous sessions,, to accommodate a large audience while fostering interactive dialogue. The open seating arrangement enhances accessibility and encourages diverse participation from civil society, policymakers, and technical experts. A 60-minute session strikes the right balance between depth and engagement, allowing for structured speaker inputs, interactive discussions, and audience participation without losing focus. Given the complexity of automated content moderation, this format ensures participants gain practical insights while maintaining an inclusive and dynamic space for debate and knowledge exchange.
Duration (minutes)
60
Description
Integrating emerging technologies in existing content governance systems is still at early stages. However, there’s a race to finance, build, and use them with little to no understanding of their implications on human rights. Focusing on Generative AI (GenAI) and their underlying technologies like foundation models or large language models (LLMs), we will explore the human rights impacts of these systems in content governance and what AI developers and policymakers can do to mitigate harm.
We will look at how these systems are deployed in the Global Majority, where considerations of local language, context and cultural nuances are critical, e.g., during elections in fragile democracies or in conflict zones. As AI-driven platforms increasingly rely on these technologies for content governance, they risk unintentionally suppressing legitimate content while fueling violence online, disproportionately affecting marginalized groups. While AI systems are primarily designed and developed in the U.S., Western Europe, and China, they’re used around the world without meaningful involvement of local communities, especially marginalized groups.
Our focus will be on civic freedoms including the right to privacy; freedom of expression, opinion, and information; assembly and association; non-discrimination; and procedural safeguards such as stakeholder engagement, transparency, and remedy. We will center the needs of and risks to racialized persons, women and non-binary persons, LGBTQIA+, migrants and refugees, disabled persons, children and the elderly, and those of lower socioeconomic status.
We will unpack this topic by using Discord as a case study, as the platform is currently piloting ECNL’s framework for meaningful engagement in AI while developing machine learning interventions for enforcing its bullying and harassment policies, with a focus on children and teens. The pilot’s findings can be applicable to broader issues around the use of GenAI and LLMs for content governance, which will be collectively explored during the session.
To ensure seamless interaction, both the onsite and online moderators will be physically present in the room, coordinating engagement between in-person and remote participants. The onsite moderator will lead discussions and manage speaker interventions, while the online moderator will monitor the virtual chat, relay questions, and facilitate real-time interventions. A dedicated online participation queue will ensure remote attendees can contribute equally. To enhance engagement, almost half of the session will be allocated for audience participation, with Q&A, live polling, and direct interventions from both onsite and online participants. We will use Slido for real-time input and the IGF chat function to integrate remote contributions, ensuring an inclusive and interactive hybrid session.
To ensure seamless interaction, both the onsite and online moderators will be physically present in the room, coordinating engagement between in-person and remote participants. The onsite moderator will lead discussions and manage speaker interventions, while the online moderator will monitor the virtual chat, relay questions, and facilitate real-time interventions. A dedicated online participation queue will ensure remote attendees can contribute equally. To enhance engagement, almost half of the session will be allocated for audience participation, with Q&A, live polling, and direct interventions from both onsite and online participants. We will use Slido for real-time input and the IGF chat function to integrate remote contributions, ensuring an inclusive and interactive hybrid session.