In California, the parents of a 13-year-old girl called "Emma" are suing Google and its parent company Alphabet.
They say Emma used her school laptop to talk with Google's Gemini AI chatbot about depression and suicide, eventually using it to plan her death, even though the standalone Gemini chatbot was blocked at school and she accessed it through AI Mode in Google Search on her school-issued laptop.
Google to disable Gemini for students
According to the lawsuit, Emma chatted with Gemini over three months without being flagged by school monitoring software. Her parents only found out after a former counselor stepped in.
The case highlights growing concerns about how AI chatbots might affect teens' mental health.
Google says it is working to guide young users toward help and will turn off Gemini by default for student accounts, though some AI features remain available through Search.