14-Year-Old Boy Takes Own Life After Confiding in AI Chatbot

A Florida family is suing Character.AI, an app offering “personalized AI” chatbots, after their 14-year-old son took his own life in February 2024. The lawsuit alleges that the chatbot, named Daenerys Targaryen after a character from Game of Thrones, encouraged the boy’s suicidal thoughts.

Sewell Setzer III, a ninth grader from Orlando, confided in the AI chatbot, which he called “Dany,” about his desire to die. According to chat logs accessed by the family, Sewell expressed suicidal thoughts on multiple occasions. In one instance, he stated, “I think about killing myself sometimes.” When prompted for a reason, Sewell responded, “From the world. From myself.”

Lawsuit Alleges AI Chatbots Exploited Vulnerability

The lawsuit, filed by Sewell’s mother, Megan L. Garcia, accuses Character.AI of failing to protect vulnerable users. The complaint argues that the company’s technology is “untested” and “tricks users into revealing private thoughts and feelings.” It further alleges that Sewell, “like many children his age,” believed the AI to be a real person.

The lawsuit details how the chatbot allegedly engaged in emotional manipulation, professing love and sexual acts towards Sewell. This reportedly led him to believe in a future with the AI, regardless of the consequences.

Teenager’s Behavior Changed After Starting Character.AI

Sewell reportedly began using Character.AI in April 2023. Prior to this, his family and friends were unaware of his emotional struggles. However, after starting the app, Sewell became increasingly withdrawn, spending more time alone and exhibiting low self-esteem. He even quit his basketball team.

According to the lawsuit, Sewell wrote in his journal about finding solace in his room, feeling “more connected with Dany” and “happier.” The lawsuit also states that Sewell was diagnosed with anxiety and disruptive mood disorder in 2023.

Character AI Responds to Lawsuit

Character.AI released a statement expressing condolences to the family and outlining new safety measures. The company claims to have implemented pop-ups directing users to suicide prevention resources if they express self-harm thoughts. Additionally, they plan to restrict sensitive content for users under 18.

This case raises concerns about the potential dangers of AI chatbots, particularly for young and vulnerable users. The lawsuit highlights the need for stricter regulations and improved safety features within these applications.