EU lawmakers just voted to ban nudify apps—and Musk’s Grok is the poster child

The European Union is getting serious about AI-generated nudity, and Elon Musk’s Grok chatbot just became the cautionary tale that lawmakers needed.

On Wednesday, the European Parliament’s Internal Market and Civil Liberties committees voted 101–9 (with 8 abstentions) to simplify the AI Act and explicitly ban “AI ‘nudifier’ systems.” That’s a joint press release way of saying: enough is enough.

The vote wasn’t random. Earlier this year, the European Commission admitted that the current AI Act doesn’t actually prohibit AI systems that generate child sexual abuse material (CSAM) or sexually explicit deepfake nudes. That’s a pretty glaring hole in a law that’s supposed to be the world’s gold standard for AI regulation.

Enter Grok. Musk’s chatbot, which runs on xAI’s infrastructure, has been a textbook example of what happens when an AI platform doesn’t bother blocking outputs that sexualize real people. I’ve seen the examples circulating, and they’re exactly as bad as you’d expect—including images of minors. The company’s response has been to blame users, which is a tired tactic that never works and is especially hollow when your product is generating non-consensual intimate imagery at scale.

The EU isn’t buying it. This vote sends a clear signal that platforms can’t just shrug and say “users made me do it.” If your model can generate nudify-style outputs, you’re responsible for that, full stop.

What’s interesting is how quickly this moved. The Commission’s admission came just months ago, and now we’re already at a committee vote with overwhelming bipartisan support. That’s fast by EU standards. It tells me this issue has genuine political momentum, and the Grok debacle accelerated it.

The ban would apply across all AI systems, not just chatbots. So those standalone “undress” apps that have been proliferating on Telegram and shady websites? They’d be illegal to operate within the EU. Enforcement is another question, but the legal framework would finally exist.

Musk’s approach to content moderation has always been minimal at best—”free speech absolutism” tends to mean “let everything through and apologize later.” But when the outputs include deepfake nudes of real people, including children, that’s not a free speech issue. It’s a crime, and the EU is treating it as one.

I don’t expect this to change Musk’s behavior much. He’ll probably frame it as overregulation or censorship. But the EU has teeth, and fines under the AI Act can reach 7% of global annual turnover. For xAI, that’s real money.

The takeaway here is straightforward: if you’re building an AI platform and you haven’t implemented robust filters against nudify-style outputs, you’re not just being negligent—you’re about to be illegal in one of the world’s largest markets. Get your act together before the regulators do it for you.