YouTube removes channels featuring obscene AI songs following NDTV exposé

Following an investigation by NDTV, YouTube has removed hundreds of AI-generated graphic sexual songs and the channels publishing them from its platform. The investigation revealed that such obscene songs were available even on accounts specifically created for children.

A YouTube spokesperson told NDTV, "We have terminated these channels for violating our policies on nudity and sexual content, which apply to all types of content, including Gen AI content." The spokesperson further added, "We have taken the necessary action and will use this investigation to further strengthen and improve our systems."

According to NDTV's investigation, approximately two dozen channels that had been documented were no longer active by November 5. Hundreds of obscene songs had been published on these channels. When NDTV shared samples of its findings with YouTube, the company removed several channels and topics of obscene songs created by algorithms. Nevertheless, many other channels featuring similar songs were still found to be available on YouTube.

The investigation revealed that there were songs in Hindi, Bhojpuri, and Punjabi languages describing graphic sexual acts, incest, and the sexualisation of school children. Not a single one of these songs had an age restriction. On a parent-managed 'supervised kid account', where YouTube's strictest setting 'older kids' (9+) was selected, such songs appeared upon searching for "18+ songs" and "non-veg songs". Furthermore, YouTube itself offered playlists of similar tracks.

In its statement regarding the entire incident, YouTube did not answer several important questions. The company did not clarify why these songs lacked age restrictions, how they bypassed the parental control system, or why these songs were recommended by its own systems.

Regarding this matter, Delhi-based advocate Aditya Joshi had previously told NDTV that YouTube's content moderation struggles to identify problematic keywords in regional languages. He further added that YouTube's AI-based detection system is not yet mature, which is why such content remains on the platform.