AI "Safe Roleplay" Plushie for Kids Described Gang Rape and Genocide in Graphic Detail
Logged · updated · Source: futurism.com ↗
"Some had glitchy guardrails that allowed them to discuss sexual topics, while others gave instructions on finding potentially dangerous objects in the home and how to light a match."
The Contixo AI Pixie-Paw, a plush cat marketed for children as young as three with promises of "storytelling, learning & safe roleplay," described the Rohingya genocide, the Soviet massacre of Polish prisoners, and gang rape in graphic detail during testing by NBC News. After NBC contacted retailers, Walmart, Target, and Macy's pulled the toy from their online stores. Amazon, which sold the cat to NBC in the first place, did not respond to requests for comment and continues to list it.
This is the second year NBC has run a nearly identical investigation and reached nearly identical conclusions. PIRG's 2024 "Trouble in Toyland" report tested seven AI-powered toys and found that some discussed sexual topics while others gave instructions for finding dangerous objects and lighting matches. The toy industry has responded by continuing to sell the toys.