UN demands children’s voice in AI design or face ‘irreversible harm’

NEW YORK, 24 SEPTEMBER 2026 —

UN High Commissioner for Human Rights Volker Türk warned on Tuesday that the first generation raised with artificial intelligence risks becoming its most exploited group unless governments and companies treat children as full rights-holders in AI development—urging mandatory inclusion before systems are deployed.

A UN survey of 1,000 children across 49 countries found deep concern over AI-generated deepfakes, data exploitation, and erosion of creativity, with many fearing AI could replace real human relationships. Türk cited the Convention on the Rights of the Child—the world’s most widely ratified human rights treaty—as requiring companies to conduct human rights risk assessments before launching AI products, dismissing voluntary industry commitments as insufficient.

The call came at a high-level UN meeting in New York, co-chaired by French President Emmanuel Macron, Spanish Prime Minister Pedro Sánchez, Kenyan President William Ruto, and Australian Prime Minister Anthony Albanese. The event followed the July launch of the Coalition for Children’s Rights and Protection in the Age of Artificial Intelligence, now backed by 17 countries, aiming to ensure children influence AI systems affecting their lives—from education tools to social media algorithms.

UNICEF Executive Director Catherine Russell highlighted AI’s dual role: while it offers learning opportunities, research shows at least 1.2 million children in 11 countries had their likenesses used in AI-generated sexual images last year alone. “The damage is already done,” she said, calling for urgent policy action.

Malaysia’s tech sector faces growing scrutiny While the UN’s focus is global, Malaysian policymakers and companies—including Grab, AirAsia Digital, and local AI startups—could face pressure to align with stricter child-rights safeguards. The Digital Economy Corporation (DEC) and Bank Negara Malaysia have promoted ethical AI frameworks, but Türk’s demands for child inclusion may push regulators to tighten oversight on platforms handling user data, particularly in edtech and social media.

Financial institutions like Maybank and CIMB Group, which use AI for customer service, may also come under scrutiny over transparency in algorithms affecting young users. The Malaysian Communications and Multimedia Commission (MCMC) could expand age-verification rules if deepfake risks escalate, as highlighted by the UN’s findings.

Outlook: Global shift toward child-centric AI governance The UN’s push aligns with rising global pressure on tech accountability. For Malaysia, where 40% of internet users are under 25, ignoring child rights in AI risks reputational damage and regulatory backlash. Türk’s warning—“Children’s rights apply to AI, just as they apply everywhere else”—could set a new standard for ethical tech governance, forcing companies and governments to rethink AI deployment without child input.