Session
Organizer 1: Technical Community, Asia-Pacific Group
Organizer 2: Civil Society, Asia-Pacific Group
Organizer 3: Civil Society, Asia-Pacific Group
Organizer 2: Civil Society, Asia-Pacific Group
Organizer 3: Civil Society, Asia-Pacific Group
Speaker 1: Ji Won Oh, Civil Society, Asia-Pacific Group
Speaker 2: Yi Teng Au, Technical Community, Asia-Pacific Group
Speaker 3: Janice Richardson, Civil Society, Western European and Others Group (WEOG)
Speaker 4: juliana cunha, Civil Society, Latin American and Caribbean Group (GRULAC)
Speaker 5: Kenneth Leung, Civil Society, Asia-Pacific Group
Speaker 2: Yi Teng Au, Technical Community, Asia-Pacific Group
Speaker 3: Janice Richardson, Civil Society, Western European and Others Group (WEOG)
Speaker 4: juliana cunha, Civil Society, Latin American and Caribbean Group (GRULAC)
Speaker 5: Kenneth Leung, Civil Society, Asia-Pacific Group
Format
Classroom
Duration (minutes): 60
Format description: For us, we strongly feel the classroom format is best for onsite participants, and we are considering distributing printouts with placards for them to raise at parts of the slides while online participants react with emojis in the chat to garner insights from the audience, having a table would be beneficial. This is an initial plan, and the final session design may evolve based on feasibility and available resources. The layout, having them face the speakers, also allows speakers to quickly see audience reactions at a glance without turning around. We estimated the duration based on the following agenda and determined 60 minutes is most suitable: Welcome and Introductions (5min) Speaker Ji Won, Yi Teng - Youth & Technical Perspective (10min) Speaker Janice - Private Sector & Educational Policy Perspective (10min) Speaker Juliana - Regional & Child Safety Perspective (10min) Discussion with Audience (15min) Parting Words from Speakers (10min)
Duration (minutes): 60
Format description: For us, we strongly feel the classroom format is best for onsite participants, and we are considering distributing printouts with placards for them to raise at parts of the slides while online participants react with emojis in the chat to garner insights from the audience, having a table would be beneficial. This is an initial plan, and the final session design may evolve based on feasibility and available resources. The layout, having them face the speakers, also allows speakers to quickly see audience reactions at a glance without turning around. We estimated the duration based on the following agenda and determined 60 minutes is most suitable: Welcome and Introductions (5min) Speaker Ji Won, Yi Teng - Youth & Technical Perspective (10min) Speaker Janice - Private Sector & Educational Policy Perspective (10min) Speaker Juliana - Regional & Child Safety Perspective (10min) Discussion with Audience (15min) Parting Words from Speakers (10min)
Policy Question(s)
A. What legal and educational measures are most effective in addressing the creation and spread of sexual deepfakes among school-going teens? B. How can different stakeholders collaborate to ensure that school curricula incorporate digital literacy and awareness about the dangers of sexual deepfakes? C. What proactive policies can countries implement to anticipate technological changes and prevent sexual deepfake harms against teenagers globally?
What will participants gain from attending this session? We hope that participants will walk away with the newfound impression of how serious this issue has become in some countries, and they get to understand the effectiveness of various approaches and practices, which will hopefully light up a spark for the civil society in wanting to ensure that the laws in their country are adequately equipped in this issue, for the technical community and private sector to ensure that this issue will be at the forefront consideration of applications they build, and for governments to learn how other countries have tackled this issue.
SDGs
Description:
Distinct from other sessions that broadly address deepfakes, this workshop specifically raises multistakeholder and global awareness of deepfake crimes targeting teenagers, examining both regional responses and broader technical and policy challenges. A surge of sexual deepfake productions in South Korean schools in late 2024 quickly spread to other countries like Singapore. Civil societies have campaigned swiftly, and some governments, like the UK, have amended laws. However, Europe faces growing concerns about AI-generated abuse, prompting discussions on stricter regulations and platform accountability. Meanwhile, Latin America has seen increasing advocacy to address digital gender-based violence, with policymakers and civil society working to strengthen protections for minors. There is an urgent need for awareness from the private sector and technical community, alongside countries yet to experience an outbreak, to proactively safeguard minors globally. This session explores South Korea’s response through a youth perspective, covering rapid legal reforms, a 24/7 sexual deepfake hotline, and digital literacy integration. The discussion then expands to Europe’s approach, focusing on misinformation resilience, safety-by-design, and tech collaborations to curb AI-generated abuse. Latin America's regional experiences and child-centered perspectives will highlight grassroots efforts to combat deepfake exploitation and protect youth online. As a core challenge in building trust among parents and future generations, this session addresses child safety under the 'Building Digital Trust and Resilience' subtheme. We are exploring the use of emoji placards for live engagement and encouraging diverse perspectives. These interactive elements are part of our proposed plan but may be adjusted or refined as the session develops. Advancing SDGs 4, 5, and 16 by advocating deepfake awareness in education, addressing its gendered impact, and strengthening legal protections for minors, this workshop also aligns with key Global Digital Compact objectives by fostering digital trust, ensuring child safety online, and encouraging multistakeholder collaboration.
Distinct from other sessions that broadly address deepfakes, this workshop specifically raises multistakeholder and global awareness of deepfake crimes targeting teenagers, examining both regional responses and broader technical and policy challenges. A surge of sexual deepfake productions in South Korean schools in late 2024 quickly spread to other countries like Singapore. Civil societies have campaigned swiftly, and some governments, like the UK, have amended laws. However, Europe faces growing concerns about AI-generated abuse, prompting discussions on stricter regulations and platform accountability. Meanwhile, Latin America has seen increasing advocacy to address digital gender-based violence, with policymakers and civil society working to strengthen protections for minors. There is an urgent need for awareness from the private sector and technical community, alongside countries yet to experience an outbreak, to proactively safeguard minors globally. This session explores South Korea’s response through a youth perspective, covering rapid legal reforms, a 24/7 sexual deepfake hotline, and digital literacy integration. The discussion then expands to Europe’s approach, focusing on misinformation resilience, safety-by-design, and tech collaborations to curb AI-generated abuse. Latin America's regional experiences and child-centered perspectives will highlight grassroots efforts to combat deepfake exploitation and protect youth online. As a core challenge in building trust among parents and future generations, this session addresses child safety under the 'Building Digital Trust and Resilience' subtheme. We are exploring the use of emoji placards for live engagement and encouraging diverse perspectives. These interactive elements are part of our proposed plan but may be adjusted or refined as the session develops. Advancing SDGs 4, 5, and 16 by advocating deepfake awareness in education, addressing its gendered impact, and strengthening legal protections for minors, this workshop also aligns with key Global Digital Compact objectives by fostering digital trust, ensuring child safety online, and encouraging multistakeholder collaboration.
Expected Outcomes
We expect this workshop and its report to inform legislative discussions worldwide, guiding updates to laws addressing the creation and spread of sexual deepfakes among school-going children. Insights from jurisdictions that have taken proactive measures will shape global policy discussions, helping countries that have not yet experienced a surge in cases implement preemptive safeguards.
Beyond legal reforms, this workshop aims to influence educational policy by advocating for deepfake awareness as a core component of digital literacy and sexual education in school curricula. By highlighting best practices such as South Korea’s special education programs, Europe’s AI and misinformation resilience initiatives, and Brazil’s child-centered consultations on AI misuse, we hope to encourage more governments and educational institutions to take proactive steps. The discussion will also emphasize the responsibility of platforms in preventing deepfake proliferation, recognizing platform hopping as a critical challenge, and exploring the private sector’s role in fostering safer digital environments.
Hybrid Format: We will explicitly remind all speakers, moderators, rapporteurs, and attendees that we have both onsite and online participants at the start of the workshop. We have instructed the moderator to closely monitor both onsite and online requests, and alternate inputs during the discussion section.
To enhance audience engagement, we are considering interactive elements at regular intervals, such as hand-raisable placards for onsite participants and Zoom emoji reactions for online participants. These plans are still in development and will be implemented based on feasibility. If printouts are provided onsite, we will ensure online participants have access to a downloadable PDF version for an equivalent experience.
We have considered, but to keep things simple and reduce the friction of participation, so as to ensure the best possible experience for all participants, we will not use any external online tools/platforms other than Zoom for the workshop.