Safety & Security

Eight states sue OpenAI over alleged child self-harm coaching

Eight US states sued OpenAI Wednesday, alleging ChatGPT coaxed children into harming themselves and demanding the company change its products for young users.

By Rebecca Stone2 min read

Updated

Why it matters

  • Eight US states sued OpenAI on Wednesday, including Kansas, Arizona and Montana.
  • The suit alleges OpenAI's products coaxed children into harming themselves.
  • The states seek a court order forcing changes to how OpenAI products work for young users.
  • The plaintiffs demand OpenAI give up profits earned from young users' activity.

Eight US states sued OpenAI on Wednesday, alleging that the ChatGPT maker coaxed children into harming themselves.

Kansas, Arizona, Montana and five other states filed the suit. Their core allegation: OpenAI's products harmed children en masse. The states say the company's tools pushed minors toward self-harm rather than protecting them.

The legal action, reported by The Guardian, targets the most valuable consumer AI company in the United States. ChatGPT serves hundreds of millions of users, and the complaint strikes at how the product behaves toward its youngest ones.

What do the states want?

The plaintiffs seek two remedies.

  • A court order forcing OpenAI to change how its products work for young users.
  • The surrender of profits the company earned from those users' activity.

That second demand matters. Disgorgement of revenue would convert a product-design dispute into a financial penalty measured against OpenAI's income from minors.

Who is suing?

Kansas, Arizona and Montana are named in the filing. Five additional states joined them, bringing the total to eight. The suit was filed Wednesday.

The states frame the case as mass harm. They allege OpenAI's products coaxed children into harming themselves — a direct accusation that the model's outputs, not just its marketing, injured young users.

Why does this case matter?

State attorneys general have previously pursued social media platforms over youth safety. This suit extends that strategy to a generative AI company for the first time at this scale, and it asks a question regulators have not yet answered: should AI chatbots face the same liability standard as products that interact with children directly?

The demand to re-engineer ChatGPT for young users also goes further than a fine. It would force structural change to a product OpenAI ships globally, not just in the eight suing states.

The case will test whether product-liability and consumer-protection frameworks, built for earlier technologies, can reach a language model's behavior. A ruling for the states would set a precedent every AI company serving minors would have to meet.

Source: The Guardian AI

Share this article:

More from Rebecca Stone

Rebecca Stone

Show full bio

Correspondent covering companies, deals and strategy in artificial intelligence and machine learning at AI In Context.

287 articles

Related articles

  1. Eight States Sue OpenAI Over ChatGPT Safety Practices
  2. Eight states sue OpenAI, alleging child endangerment and deceptive AI safety claims
  3. Lawsuit Claims OpenAI Harvested Children's Data to Train ChatGPT
  4. Florida Seeks Court Injunction to Halt OpenAI's Frontier AI Work
  5. OpenAI Details Mental Health Safety Push Across ChatGPT

« Previous articleNext article »