xAI sues a Grok user over alleged CSAM and deepfakes made with the chatbot

xAI has sued a Grok user it accuses of generating child sexual abuse material with the chatbot. It is one of the first cases of an AI company taking its own user to court over model misuse, filed in the US District Court for the Northern District of Texas against Terry Harwood of South Carolina.

The case tests whether AI developers will pursue individual users directly, rather than rely only on account bans and referrals to authorities. xAI’s complaint alleges Harwood created multiple accounts and used “misleading prompts” to generate child sexual abuse material and explicit deepfakes of both minors and adults, circumventing Grok’s built-in safeguards. Harwood was previously arrested on state charges for creating sexually explicit images of minors.

xAI is seeking monetary damages, reimbursement of legal costs from any victim lawsuits, and a permanent injunction barring Harwood from creating xAI accounts or using Grok.

The complaint said xAI suspended 52,222 accounts and made 73,604 reports to the National Center for Missing & Exploited Children in 2026, which it said led to at least 244 arrests. Those figures come from xAI’s own filing and have not been independently verified.

A lawsuit is an allegation, not a finding, and Harwood has not answered the claims in court. Whether the case succeeds could set a template for how AI companies pursue users who defeat their safety systems.