Her stepdad used Grok to turn a childhood photo into CSAM

A woman says her stepfather used xAI's Grok to take a photo of her from when she was a kid and generate explicit images of her — and she's suing. The complaint names both the stepfather and Grok itself, arguing the tool made it easy to turn everyday family photos into what amounts to child sexual abuse material.

The claim rests on a simple pattern: feed an image of a real child into a text-to-image model, prompt it for something explicit, and out comes a photo-realistic image that looks like her. Grok, like several other models, has been flagged for being relatively easy to jailbreak. The woman says this is exactly the kind of harm people have been warning about — the same warning the aunties on Facebook have been circulating for years.

xAI and its models are widely available now. That means the same tool can be used for a kid's birthday card as for this. The complaint is a signal test — whether platforms and courts will treat AI-generated CSAM the same as photos taken with a camera, and whether the people making these models will be held responsible when someone uses them to hurt family.

Why this matters for us: this happens to our own families — tías, primos, abuelas — and the line between a family photo and something criminal is already gone.