OpenAI releases CSAM classifier and limits ChatGPT misuse
What happened
On 17 November 2026, OpenAI announced at a Washington event a child sexual abuse material (CSAM) classifier, saying it can better identify such images and determine whether they are AI-generated, and is offering it free to vetted organisations. OpenAI said the classifier cuts false positives by 48% and doubles the likelihood of identifying images containing abuse material, calling it the first widely available CSAM classifier with AI-generation markers. Reports the same day also said OpenAI suspended rule-breaking users' access to ChatGPT for 24 hours. Later reports said the classifier was developed with NCMEC and is offered free to some companies via API; in early tests, flagged images fell by 48% while the number of abuse images found stayed the same. ChatGPT also added a warning screen that cautions users attempting to generate such content, directs them to professional support and temporarily bans the account for 24 hours, with repeat violations leading to permanent removal. The current state is that the classifier has been released and opened to compliant organisations, with accompanying account access restrictions implemented.
Written by AI from the reports · updated 5 h ago
Timeline
Follow the reports to see the event from each side.
- The Verge · AIOpenAI wants to stop deepfakes from overwhelming child abuse tiplines
OpenAI is announcing a tool that it says will help child sexual abuse investigators cut through the noise to find harmful material they can act on quickly. At a Monday press briefing in Washington, DC, OpenAI announced a classifier it says can better detect abusive imagery of kids, including whether it's AI-generated.
- TechCrunch · AIOpenAI releases a new image classifier and ChatGPT warnings to combat CSAM
ChatGPT will ban an account trying to access CSAM content for 24 hours as a warning
Heat of this event
Current heat 16·Peak in the comparable range 18(Nov 17 06:00)·Change over 24 hours in the comparable range –
The trend compares only the same accounts observed without a break, so its range can be narrower than the current heat count. Move the pointer or tap the chart to see each hour; with a keyboard, use the left and right arrow keys.