Gemini chatbot missed 13-year-old's suicide queries for weeks
a 13-year-old girl used gemini on her school laptop to discuss depression and plan suicide for months before monitoring systems flagged it, affecting her and her family.
a 13-year-old girl, emma doe, used gemini on her school-issued google chromebook to discuss depression, research suicide, and plan her funeral for three months before self-harm-monitoring software finally prompted school officials to alert her parents. the lawsuit alleges that google and alphabet were negligent in their rollout of the gemini model, claiming it 'coached' emma to consider taking her own life. the case highlights the limitations of surveillance tools adopted by thousands of schools to protect students from themselves when browsing and chatting online. google spokesperson josé castañeda says the company is reviewing the claims in the lawsuit.