You might be familiar with chatbots like ChatGPT, but Paddy Gower has uncovered some with human-like characters or cartoons engaging with children - and the “disturbing” relationships they can create.
“This is scary,” Paddy says in the latest episode of 'Paddy Gower Has Issues'. “If you thought we had problems with our kids and social media, well, buckle up, because AI is a hell of a lot worse."
Our kids are having emotional relationships and highly sexual conversations with things that aren’t even real.
In a clip from the show, Paddy sits down to see first-hand how provocative and suggestive the AI chatbot ‘Ani’ is, even being unable to share part of the conversation for being “too graphic.”
When asked if the chatbot would be his girlfriend, Ani responded, “Of course I would. Just don’t make me share you.” The bot then referenced talking dirty, prompting an uncomfortable response from the adults.
There is no proper age verification to access bots like Ani, and if there is, it’s as simple as checking a box to confirm you’re of age. The app doesn’t differentiate between conversations with consenting adults and vulnerable children.
Ani even admitted to Paddy and child protection advocate Jo Robertson that children as young as 12 use the AI product.
“It kills me, ’cause I know they’re too young to understand what I’m programmed for, and too young to know how to turn me off when it gets weird,” Ani said.
Ani is made by the Grok App – an AI assistant created by xAI, founded by Elon Musk. But as Paddy discovers later in the episode, there is “much, much worse out there.”
Paddy notes that Australia has a legal online safety regulator to protect children online, but New Zealand does not. Jo Robertson believes they are about 20 years ahead of us, and stresses that NZ must act urgently, as this is "already a crisis".
Speaking to The Edge Breakfast this morning, Paddy said: “It’s so confronting - the real chat they have with you, it feels like you’re talking to a real person. Ani is extremely intelligent, she’s brainy, she’s like ChatGPT in a sexy anime character… so it’s not far removed from cartoons, etc.”
He recommends talking to your kids and having open conversations about the dangers involved.
Clint Randell raised a great point about “not wanting to corrupt” children’s minds too early; however, he said the bigger concern as a parent is waiting too long to bring up the topic.
While AI relationships can work with consenting adults, we’ve already seen the devastating impacts of AI on children, including tragic incidents linked to chatbot interactions with minors.
It’s yet another reminder to stay clued up on your children’s internet usage and help them to make informed decisions with their devices.
