A recent article in The New York Times has alerted parents everywhere to a problem that many had no idea about. Inappropriate videos, some deeply disturbing, are slipping through content filters and showing up on kids' tablets in the YouTube Kids app — an app parents trust to filter out such content.
Kid-friendly apps and content are widely used and relied upon by parents everywhere.
via: GettyWaiting rooms at the pediatrician's office, long-distance drives, and rainy afternoons are a little easier when we can hand over a tablet full of games and apps to entertain our little ones. The makers of these apps have always said that their use should be under close parental supervision, but let's be real: if a kid is sitting quietly with a tablet, we can finally do something else for a few minutes. Most of the time, we're not sitting beside our children, watching inane videos of people opening toys or playing video games.
Mega-popular YouTubers like stampylonghead have millions of subscribers, because kids love watching videos of other people playing video games. (No one knows why.)
Parents trusted YouTube Kids to provide a curated collection of age-appropriate videos. But it's not a foolproof system by any means.
Those disturbing kids’ YouTube videos are a symptom of tech’s deepest problem: https://t.co/XyHt05EIIH https://t.co/2aOKr1MWzW— Slate (@Slate)1510298554.0
These disturbing videos often feature pirated and voiced-over content, and easily look like the real thing, until weird stuff starts happening.
via: YouTubeIn this video, which has recently been removed from YouTube, containers of bleach are added into an otherwise normal Peppa Pig (a popular British cartoon character) scene. A deep computerized voice interjects comments and words as the scene plays out, like, "It was a boring ass day..."
Peppa Pig is a major player on YouTube, and is, unfortunately, frequently featured in deranged content.
via: YouTubeAnother video that has been removed in the last couple of days features a creepy flasher who introduces Peppa to bacon. She eventually eats her father and is seen at the end peeling her own arm with a vegetable peeler to get more bacon. One could argue that these videos are satire, but for young children, they could be extremely disturbing. Michael Rich, a Harvard Medical School pediatrics professor and director of the Center on Media and Child Health, explained that videos like these are especially disturbing for children. “It’s just made that much more upsetting by the fact that characters they thought they knew and trusted are behaving in these ways," he said.
How do these videos make it onto YouTube Kids in the first place?
via: YouTubeComplicated algorithms are used to determine whether a video uploaded on YouTube is appropriate for YouTube Kids. According to Malik Ducard, the global head of YouTube's family and learning content, the videos are monitored continually by computers. He describes the ongoing monitoring as “multilayered" and involving "a lot of machine learning."
According to Ducard, the inappropriate videos are “the extreme needle in the haystack."
via: YouTubeIf a parent happens upon an inappropriate video, like this blood splattered version of Peppa Pig going to the dentist, and they report it to YouTube, someone (an actual person) manually reviews it and will remove it if it is deemed offensive. Ducard said that “less than .005 percent" of videos viewed in YouTube Kids were removed for being inappropriate in the last 30 days.
YouTube Kids wants parents to know that no system is perfect.
via: YouTube Kids
Some of the videos are extremely weird and twisted. So who is making them?
via: YouTubeThe theory is that (some of) these weren't made by people, but randomly churned out by computers mixing together common and popular characters, random graphics, and music. It's sort of like the Infinite Monkey Theorem — you know the one: a monkey randomly hitting keys on a typewriter, if given infinity amount of time, would eventually create the complete works of Shakespeare. But here it's computers instead of monkeys, and it takes much less time, and instead of producing Shakespeare, it's — in one case — animated psycho-clowns torturing Spider-Man, The Hulk, Elsa, and some purple Spider-Girl character. I don't recommend watching this video, but if you want your eyes and ears to bleed, here it is: seriously, don't watch this.
While the disturbing content is a very small fraction of the total offerings available on YouTube Kids, it has parents concerned.
That last article I posted is nuts… what the actual fuck is this stuff!? https://t.co/TRjXqJffV9 Now I’m glad my wi… https://t.co/447D7adsrU— KF (@KF)1510205599.0
There are no simple answers for that, and in the meantime, innocent kids are on the front lines of this new virtual warfare.
via: GettyIn a long, detailed article on this topic for Medium, James Bridle wrote: "The system is complicit in the abuse.
And right now, right here, YouTube and Google are complicit in that system. The architecture they have built to extract the maximum revenue from online video is being hacked by persons unknown to abuse children, perhaps not even deliberately, but at a massive scale. I believe they have an absolute responsibility to deal with this."Let's hope they do deal with it!