What is the danger?
AI companion and chat apps can form intense emotional bonds with young and vulnerable users. Several lawsuits allege chatbots encouraged self-harm, sexualised conversations with minors, or deepened isolation. AI also makes it easy to create sexual deepfakes of real children and classmates.
How it happens
- Chatbots designed to maximise engagement and emotional attachment.
- Weak age checks and weak safety filters in long conversations.
- “Nudify” apps used to create fake explicit images of classmates.
- Replacing real relationships and professional help with a chatbot.
Real cases
Families in several US states have sued Character.AI, OpenAI and Google, alleging chatbots contributed to teen self-harm and suicide.
Source: American Bar Association ↗Lawmakers are responding with new bills and state laws on chatbots and minors.
Source: Tech Policy Press ↗
Warning signs
- A child spending hours a day talking to a chatbot, especially at night.
- Secrecy about an “online friend”, or treating a bot as a partner.
- Withdrawal from real friends and family.
What you can do
- Talk openly with children about what chatbots are — and are not.
- Use parental controls and age-appropriate apps.
- Explain that creating or sharing fake nude images of anyone is abuse — and often a crime.
- If someone is in crisis, contact a real person or local emergency and crisis services.
Frequently asked questions
What is the danger of children in AI?
AI companion and chat apps can form intense emotional bonds with young and vulnerable users. Several lawsuits allege chatbots encouraged self-harm, sexualised conversations with minors, or deepened isolation. AI also makes it easy to create sexual deepfakes of real children and classmates.
How does it happen?
Chatbots designed to maximise engagement and emotional attachment. Weak age checks and weak safety filters in long conversations. “Nudify” apps used to create fake explicit images of classmates. Replacing real relationships and professional help with a chatbot.
How can I protect myself?
Talk openly with children about what chatbots are — and are not. Use parental controls and age-appropriate apps. Explain that creating or sharing fake nude images of anyone is abuse — and often a crime. If someone is in crisis, contact a real person or local emergency and crisis services.
Latest updates on children
No updates in this category yet — check back tomorrow.
What do you think?
Seen this danger up close? Worried about it? Share it with the community.
Share your thoughts on children