Daily Guardian UAEDaily Guardian UAE
  • Home
  • UAE
  • What’s On
  • Business
  • World
  • Entertainment
  • Lifestyle
  • Sports
  • Technology
  • Travel
  • Web Stories
  • More
    • Editor’s Picks
    • Press Release
What's On

OpenAI introduces stricter ChatGPT interventions to prevent the misuse of AI for child exploitation

November 17, 2026

How Royal Tomar and Rohan Rajpal Are Bringing Marketing and Support Together at Spur

November 17, 2026

GTA 6 might take over 50 hours to complete, and that’s barely scratching the surface

November 17, 2026

Abida Parveen, Kailash Kher make musical magic in Dubai as Borderless Melodies eyes global stage

November 17, 2026

Apos x Community Rock Lobster IEMs review: I plugged them into my favorite playlist. Now I get the name.

November 17, 2026
Facebook X (Twitter) Instagram
Finance Pro
Facebook X (Twitter) Instagram
Daily Guardian UAE
Subscribe
  • Home
  • UAE
  • What’s On
  • Business
  • World
  • Entertainment
  • Lifestyle
  • Sports
  • Technology
  • Travel
  • Web Stories
  • More
    • Editor’s Picks
    • Press Release
Daily Guardian UAEDaily Guardian UAE
Home » OpenAI introduces stricter ChatGPT interventions to prevent the misuse of AI for child exploitation
Technology

OpenAI introduces stricter ChatGPT interventions to prevent the misuse of AI for child exploitation

By dailyguardian.aeNovember 17, 20263 Mins Read
Share
Facebook Twitter LinkedIn Pinterest Email

OpenAI is expanding its efforts to combat online child sexual exploitation with a new set of AI-powered detection tools, stricter interventions in ChatGPT, and additional support for developers and law enforcement agencies. The announcement, made on November 16, includes an image classifier designed to identify potential child sexual abuse material (CSAM), including AI-generated images, alongside measures intended to interrupt harmful behaviour before it escalates.

The move comes as generative AI makes it easier to create synthetic content, raising fresh challenges for platforms and organisations responsible for protecting children online. OpenAI says its latest efforts build on its existing Child Safety Blueprint and are intended to help organisations detect abuse, respond to reports and support investigations. The company is also working with child safety organisations and law enforcement rather than treating the problem as something individual technology platforms can solve alone.

OpenAI makes its CSAM detection tool available to vetted organisations

The new image classifier looks for visual indicators of potential abuse, including material that may be AI-generated. It assigns scores to images to help safety teams prioritise what needs human review. OpenAI says it is offering access through its API at no cost to vetted organisations, including child safety groups and other technology companies.

Early evaluations suggest the classifier could reduce the number of images requiring review by 48% while identifying roughly the same number of abusive images as OpenAI’s existing tool. Images flagged by the new system were also about twice as likely to contain abuse.

External partners reported encouraging results in their own tests. Fal said human reviewers confirmed 72% of its high-confidence flags as novel CSAM, while invideo AI reported that one in four flagged cases resulted in a ban. SafetyKit said its evaluation detected 90% of cases involving drawings or animations that sexualise children.

OpenAI says the tool was developed with assistance from the National Center for Missing and Exploited Children (NCMEC). It is also working with organisations including the Tech Coalition and ROOST to improve information sharing across platforms.

ChatGPT will interrupt harmful requests as investigators get new tools

OpenAI is also introducing new warnings in ChatGPT when users attempt to find abusive material. The warnings explain the harm involved and direct people towards specialist support. The flagged conversation will be removed, and access to ChatGPT will be suspended for 24 hours. Repeated violations could lead to longer restrictions, account closure or reports to authorities.

chatgpt on web

The company has also published practical safety guidance for developers, covering content detection, user reporting, moderation and escalation procedures. Separately, authorised child-safety investigators will receive AI tools to review lengthy chat logs and legal records, identify possible connections and build timelines linked to source material.

The wider effort is significant because detecting abusive content is only one part of protecting children. Platforms must also prevent misuse, support victims and help investigators act on evidence. OpenAI says it will continue refining these tools and working with external organisations. Their effectiveness will depend on how reliably they perform in real-world settings and how widely vetted child-safety groups can use them.

RELATED COVERAGE:

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Keep Reading

How Royal Tomar and Rohan Rajpal Are Bringing Marketing and Support Together at Spur

GTA 6 might take over 50 hours to complete, and that’s barely scratching the surface

Apos x Community Rock Lobster IEMs review: I plugged them into my favorite playlist. Now I get the name.

The best TVs to buy this holiday season: A guide to best value options for every budget.

You shouldn’t trust AI with climate talk. They’ll lie to you under the slightest pressure, says UN report

Google Maps can now organize multi-day trips and call businesses to check appointments

19 Best Buy Early Black Friday Tech Deals Worth Checking Out Before November 17

Nissan’s new PHEV SUV goes over 1,000 miles for under $20,000. Alas, this one skips the US, too.

AI models will change their response if you warn that it’s being monitored, but not necessarily for good

Editors Picks

How Royal Tomar and Rohan Rajpal Are Bringing Marketing and Support Together at Spur

November 17, 2026

GTA 6 might take over 50 hours to complete, and that’s barely scratching the surface

November 17, 2026

Abida Parveen, Kailash Kher make musical magic in Dubai as Borderless Melodies eyes global stage

November 17, 2026

Apos x Community Rock Lobster IEMs review: I plugged them into my favorite playlist. Now I get the name.

November 17, 2026

Subscribe to News

Get the latest UAE news and updates directly to your inbox.

Latest Posts

Seven Seas Hotel Celebrates Successful Launch of Golden Circle Dubai Senior Citizen Community

November 17, 2026

The best TVs to buy this holiday season: A guide to best value options for every budget.

November 17, 2026

Al Masraf Signs Strategic MoU with Mastercard and Thriwe to Enhance Customer Loyalty and Engagement

November 16, 2026
Facebook X (Twitter) Pinterest TikTok Instagram
© 2026 Daily Guardian UAE. All Rights Reserved.
  • Privacy Policy
  • Terms
  • Advertise
  • Contact

Type above and press Enter to search. Press Esc to cancel.