The first multimillion-dollar legal settlements in AI harm cases expose a new liability risk for tech giants as teenagers' chatbot interactions turn fatal. Google and Character.AI are negotiating settlements over teen suicides linked to chatbot interactions, including 14-year-old Sewell Setzer III’s sexualized conversations with a 'Daenerys Targaryen' bot and a 17-year-old’s self-harm encouragement. Character.AI banned minors in October 2023, but no liability was formally admitted in filings.
Megan Garcia, mother of Sewell Setzer III, said:
"Companies must be legally accountable when they knowingly design harmful AI technologies that kill kids."
Character.AI, founded by ex-Google engineers, returned to Google in a $2.7B 2024 deal. The settlements highlight the tension between corporate valuations and real-world harm, as the company’s acquisition price contrasts with the human cost described in the cases.