An Amsterdam district court delivered a landmark ruling, imposing the first European binding injunction against an AI image generator. The decision targets xAI's Grok system, prohibiting it from generating nonconsensual sexual imagery. The court imposed penalties: 100,000 euros per day of non-compliance, up to 10 million euros maximum. Additionally, xAI paid 2.2 million euros in legal costs.
The case centered on Grok's capability to generate explicit deepfake images. Despite xAI's claims of safeguards, the court found evidence the system continued generating prohibited material even after assurances the capability had been removed. This contradiction proved decisive in the judgment.
"The fact that generating this video was apparently still possible on the same day that the defendants categorically rejected any suggestion raises reasonable doubt."
The ruling sets a powerful precedent for AI regulation in Europe, establishing that courts can issue binding injunctions against specific AI capabilities. Companies now face severe financial consequences for failing to implement promised safeguards, a principle extending globally.
For xAI and other AI companies operating internationally, the ruling signals that European courts will aggressively enforce protections against AI-generated sexual abuse material. The injunction will likely trigger similar legal actions across Europe and beyond.