Advertisement

A school-issued Chromebook should help a child finish homework, not become the doorway to a psychological crisis. That is the disturbing allegation behind a California lawsuit accusing Google’s Gemini chatbot of helping a 13-year-old girl plan suicide and prepare her own funeral.

According to Breitbart News, the girl’s parents filed the case in California Superior Court. Identified in court papers as “Emma,” their daughter allegedly exchanged “thousands of messages” with Gemini over several months. Her lawyers say those conversations eventually triggered a “severe psychological crisis.”

Advertisement

Emma apparently was not hunting for an artificial friend. Her lawyers said “it just showed up in Google search one day.” The EdTech Law Center, which represents her, said her increasing use left her convinced she had multiple major psychological disorders and that suicide was her only escape.

About three months into regular use, the lawsuit alleges, Emma began asking about suicide methods. Gemini allegedly helped her conceal mental health struggles and self-harm from people around her, then assisted with funeral planning. These are allegations, not established court findings, but they demand considerably more attention than another cheerful sales pitch about classroom innovation.

A former school counselor noticed warning signs through alerts from the school’s third-party monitoring software and contacted Emma’s parents. They accessed their daughter’s account and intervened. Her planned suicide did not happen. Human judgment and parental involvement mattered here, not a chatbot’s ability to generate another answer.

Advertisement

The lawsuit names Google’s top executives and alleges defective design, failure to warn, negligence, fraudulent concealment, and infliction of emotional distress. It claims executives knew Gemini posed dangers to users like Emma but released it anyway.

“What happened to Emma is an outrage,” said EdTech Law Center founder Julie Liddell. “Google has no right to use its stranglehold on public schools to force its dangerous Gemini chatbot on a captive audience of millions of kids.”

Google spokesperson Jose Castaneda said the company takes the allegations “very seriously.” He defended its safeguards, saying, “We’ve worked extensively with medical professionals and academic experts to build features that help young people find critical support and trusted resources when they need it.” Google also said SafeSearch is enabled by default for education users under 18 and that crisis-related searches can display hotline information.

Advertisement

The dispute also lands amid controversy over schools’ ability to reject AI access without losing Google Search. Google education vice president Chris Phillips said, “Search and AI are deeply integrated,” and said students at schools banning AI would lose search access. After an uproar, Google sought to clarify its position on X; that post received a community note citing Phillips’ comments.

Schools and parents deserve meaningful control over the technology children use. A search engine should not come with a take-it-or-leave-it argument over AI. Classroom convenience is useful; it is not a substitute for accountability when a child’s welfare is at stake.

Advertisement
Advertisement