Google Faces Pressure to Ban So-Called “AI Slop” Videos for Kids on YouTube

Fairplay, a U.S.-based children’s advocacy group, alongside 200 experts, is calling on Google to ban AI-generated content for children on YouTube. Leading authors, teachers, researchers, pediatricians, and the American Federation of Teachers are urging the company to curb the spread of what they describe as “AI slop.”

The push comes as Google expands its investment in AI-generated children’s content. Just last month, the company announced a $1 million investment in Animaj, a studio focused on producing AI-powered videos for young audiences.

Critics argue that the rise of AI-generated content could flood platforms with low-quality, high-volume videos designed to capture attention rather than support healthy child development.

How YouTube’s Algorithm is Flooding Kids with AI-Content 

In a letter addressed to Sundar Pichai, CEO of Google, and Neal Mohan, CEO of YouTube, experts are demanding that the platform prioritize children’s well-being over profit. 

The market for children’s videos on YouTube is massive, and those creating content know it. Four out of the five most-viewed videos on YouTube are videos targeted towards young children, each with billions of views. Cocomelon Nursery Rhymes ranks among the largest, with over 200 million subscribers and more than 220 billion views. What’s more concerning is what comes next: around 40% of content recommended after preschool shows like Cocomelon is AI-generated.

“Pushing AI slop onto young children is just another testament to how YouTube and YouTube Kids are designed to maximize children’s time online,” said Rachel Franz, Director of Fairplay’s Young Children Thrive Offline program. 

Related post: 10 YouTube Tech Influencers You Should Know

The AI Slop Epidemic

Many online have begun referring to AI-generated videos as “AI slop,” a term referring to their low-quality, often nonsensical nature and mass production.  This type of content can be produced quickly, often with little regard for factual accuracy, yet it is still popular. The most-subscribed channel dedicated entirely to AI-generated videos targets children and has amassed over 5 million subscribers.

Adults only correctly identify AI-generated content about half of the time; that number drops even further for children.

Children are far less likely to distinguish between human-made and AI-generated content, especially when both are animated. At an impressionable age, prolonged exposure to AI-generated videos can potentially distort a child’s sense of reality, impacting how children understand the world around them.

AI-generated videos are particularly mesmerizing. Creators driven by profit optimize for what captures children’s attention: vivid colors, rapid movement, and quick cuts. Research shows that, over time, children’s content has been getting faster and faster, resulting in nervous system dysregulation. 

The number of children watching online videos every day has more than doubled. The increased screen time is resulting in tantrums, sensory processing issues, and poorer mental health. Parents, teachers, and medical professionals warn that seemingly harmless entertainment poses a real threat to child development, and are calling for change.

Related post: Google Unveils AI Edge Eloquent, an Offline Dictation App Powered by AI

The Socioeconomic Divide 

Research shows that socioeconomic status strongly influences children’s screen time. Children from lower-income households spend more time on screens, while those from higher-income families use nearly two hours less screen media per day.

While wealthier families may be able to enroll their children in after-school activities, lower-income families often rely on screens as a practical solution while they work. “Screens become, for many of us, a necessary stand-in to keep children occupied and safe while we provide for them,” said Richard Ramos, founder of Parents on a Mission. 

Beyond income, disparities also emerge along racial lines. “Compared to their White and Latinx peers, Black children are more likely to interact with internet videos and use YouTube for learning, nursery rhymes, and daily material. Because of this, their safety on online sites is crucial rather than discretionary,” said Dr. Leah Austin, President and CEO of the National Black Child Development Institute.  

As a result, the risks associated with AI-generated content do not affect all children equally. While many parents view online video as a safe and convenient tool, the rise of AI-generated “slop” means more children are being exposed to low-quality, potentially harmful content. 

Related post: Two Black-led Educational Companies Benefit From Google’s $25M AI Fund

Policy Change for a Safer Online Environment for Children 

As AI adoption grows, and creators rely on AI to generate content for children, regulation needs to catch up. The letter urges Google to implement several changes to its platform: 

1. Clearly label all AI-generated content on YouTube.
2. Prohibit AI-generated content on YouTube Kids.
3. Remove AI-generated videos marked “Made for Kids” from the main YouTube platform.
4. Stop recommending AI-generated content to users under 18.
5. Introduce a parental control toggle that blocks AI-generated content by default.
6. Halt investment in AI-generated videos for children.

Social media platforms now face growing accountability. In a landmark lawsuit last month, YouTube was found guilty of fostering addiction in young children with the very design of its platform. Now, with more than 200 experts calling for tighter regulations on YouTube Kids, change is imminent. 

Platforms that host content for children must prioritize children’s well-being and safety without fail.