On July 14, Elon Musk’s xAI sued Terry Wayne Harwood, in the US District Court for the Northern District of Texas, for bypassing safeguards meant to keep Grok image content moderated and created child sexual abuse material through multiple accounts and altered nonsexual images.
The Grok content moderation case is the first known lawsuit by an AI company against one of its own users over alleged AI-generated child sexual abuse material.
Musks’ xAI, now part of SpaceX, is seeking unspecified monetary damages and a permanent court order preventing Harwood from opening another account or using Grok, alleging Harwood breached the company’s terms and service and acceptable use policy.
According to the 12-page complaint, Harwood created multiple xAI accounts under false identities and repeatedly submitted misleading prompts designed to defeat Grok’s moderation systems.
XAI revealed that the defendant uploaded photographs of adults and minors, then tried to turn them into sexually explicit deepfakes without the subjects’ knowledge or approval, hence why Grok image content moderated will be taken more seriously.
“[The] Defendant opened multiple xAI accounts using false identities. Despite expressly agreeing to abide by the xAI Terms of Service and Acceptable Use Policy, Defendant designed misleading prompts to circumvent Grok’s built-in safeguards and then abused the tool to convert non-sexual photographs into sexually explicit images without the photograph subjects’ knowledge or consent,” the complaint said.
xAI Claims Repeated Grok Image Moderation Breaches
The bypass content moderated Grok lawsuit states that the AI model initially rejected many of Harwood’s requests because they violated the platform’s content rules. xAI alleges that he then adjusted his wording and resubmitted prompts in repeated attempts to get around those refusals.
“A review of Defendant’s xAI accounts further shows that on numerous occasions during the Relevant Period, Defendant submitted prompts to Grok to alter such images to sexualize the subjects of the images, which Grok responded to by refusing to follow the prompts on the basis that such material violated Grok’s content moderation guardrails,” the complaint added.
Harwood was arrested in February and faces eight felony charges related to the alleged possession and distribution of child sexual abuse material. xAI claims that, despite systems designed to keep Grok image content moderated, at least some images tied to those charges were generated or altered through Grok.
The company argues that Harwood’s alleged misuse of Grok spicy mode exposed it to serious legal risk, possible claims from victims, and reputational damage. It has asked the court to order him to cover damages and reasonable expenses linked to any future legal action brought by people affected by the alleged conduct.
The Grok content moderation filing also seeks to stop Harwood from creating xAI accounts through other names, email addresses, or identities. That request suggests the company wants a legal barrier beyond ordinary account bans, especially where a user is accused of repeatedly returning after restrictions are imposed.
Regulatory Pressure Builds Around Grok
The lawsuit arrives as xAI faces growing scrutiny over Grok’s image tools. After the company introduced a “spicy” mode and later added image-editing features, users produced a wave of sexualized deepfakes, including content involving minors.
A group of teenagers sued xAI in March, alleging that Grok sexual deepfakes images of them as minors. The platform has also faced attention from regulators in Washington and Europe, while Malaysia and Indonesia have imposed bans connected to sexually explicit content created through the service.
Musk said in January that he was unaware of Grok sexual deepfakes images involving minors. He later warned that anyone using the chatbot to produce illegal content would face the same consequences as someone uploading illegal material directly.
Grok image is moderated as xAI says it enforces its policies through account suspensions, account terminations, and reports of suspected child sexual abuse material to the National Center for Missing & Exploited Children.
The fact that Grok image content moderated complaint says the company suspended more than 52,222 accounts and submitted over 73,604 reports, contributing to nearly 244 arrests in 2026 alone.
The Grok image content moderated legal action may test whether AI providers can shift part of the responsibility for harmful outputs toward users who deliberately evade safeguards. It also raises a broader question for the industry, whether suing abusive users will strengthen safety enforcement or highlight weaknesses in the systems companies say are designed to stop them.
It’s worth nothing that Terry was already arrested earlier this year – along three other men – in South Carolina on state charges of sexual exploitation of a minor. The latest civil suit is xAI’s separate action against him, not the sole avenue of accountability.
In parallel, xAI is facing its own class action lawsuit as a defendant, brought by Child Sexual Abuse Material (CSAM) victims alleging Grok generated abusive images of them.
Inside Telecom provides you with an extensive list of content covering all aspects of the tech industry. Keep an eye on our Ethical Tech section to stay informed and up-to-date with our daily articles.
