IGF 2025 Lightning Talk #5 Protecting Consumer Trust in Generative AI Systems

    Digital Governance Asia
    Seth Hays, Digital Governance Asia, APAC GATES LLC, Non-government Organization, Asia Region
    Speakers
    Seth Hays, Digital Governance Asia, APAC GATES LLC, Non-government Organization, Asia Region
    Onsite Moderator
    Seth Hays
    Rapporteur
    Seth Hays
    SDGs
    8.3
    12.8
    16.4
    16.6


    Targets: 1. SDG 8 – Decent Work and Economic Growth Sub-Goal 8.3 Strengthening brand protection and tackling illicit trade safeguards legitimate businesses, and supports innovation and entrepreneurship, in particular from MSMEs and social enterprises. Clear enforcement against counterfeit goods can level the playing field, encouraging formal economic activity and job growth. 2. SDG 16 – Peace, Justice and Strong Institutions Sub-Goal 16.4 Counterfeiting and IP infringement involve organized criminal networks. Robust anti-illicit trade measures in AI align with efforts to combat these networks, thereby fostering legitimate trade channels. Brand red-teaming and proactive enforcement strategies can uncover and deter illegal cross-border supply chains. Sub-Goal 16.6 Building LLMs that support the rule of law and do not encourage or promote illicit trade will build stronger governance mechanisms across society uphold accountability in digital marketplaces and the internet. SDG 12.8 – Responsible Consumption and Production “By 2030, ensure that people everywhere have the relevant information and awareness for sustainable development…” Fighting illicit trade in these new platforms via LLMs will help consumer be able to accurately make choices about responsible consumption - as transparent labeling, consumer education, and trustworthy marketplaces support informed consumption, curbing the demand side of counterfeit and illicit products.
    Format
    This will be a 20 minute discussion format with 10 minutes of visual presentation and 10 minutes of audience discussion and interaction.
    Duration (minutes)
    20
    Description
    The commercialization of generative AI tools may take the form of ad-supported LLMs with sponsored content, or may take the form of prioritized purchasing by AI agents in a shopping setting, among countless other new channels for consumers to access goods and services. With the continued rise of illicit trade in counterfeit goods, and other forms of illicit trade, AI models may be susceptible to various threats to consumer safety. This discussion will examine how a rapidly evolving digital ecosystem—driven by artificial intelligence and cross-border e-commerce—heightens the need for robust brand protection and consumer protections through novel approaches such as brand red-teaming of new AI models. The session will introduce brand red-teaming as a measure for identifying vulnerabilities in commercial AI systems, and will demonstrate how these tactics can promote broader AI related safety, reliability and accountability solutions that implicate anti-illicit trade, privacy, misinformation/disinformation, deepfake-related harms, and other intellectual property (IP) rights violations, such as rights of publicity, and moral rights. The conversation will highlight emerging policies and private-sector solutions specifically from Asia—often at the nexus of emerging trade and technology issues —that may serve as global best practices. Such initiatives include Digital Governance Asia's AI Harm Remedy Network, which seeks to monitor instances of AI harm and policies to help prevent and address these harms while supporting innovation in the AI industry. We also share the work of the Global AI Consumer and Brand Protection Red-Teaming Initiative. Links and References: Digital Governance Asia AI Harm Remedy Network: https://digitalgovernance.asia/asia-pacific-ai-remedy Seth Hays, AI Training and Copyright Infringement: Solutions from Asia, Tech Policy Press: https://www.techpolicy.press/ai-training-and-copyright-infringement-sol…

    We will create visual materials so that attendees can access the material in a multi-modal format. We hope to encourage debate and discussion about how in the commercial context, brand red-teaming of LLMs plays an important role in building new commercial platforms and channels that support the UN's SDGs and build a stronger, resilient and trustworthy internet.