OpenAI · Training

GPTBot is OpenAI's training crawler.

Crawls content that may be used to train OpenAI's generative AI foundation models.

Source: OpenAI: Overview of OpenAI crawlers
Facts
Vendor
OpenAI
Type
Training. Collects pages to train AI models.
User agent contains
GPTBot
robots.txt token
GPTBot
robots.txt

Disallowing GPTBot tells OpenAI the site's content should not be used in training. OpenAI says each of its robots.txt settings is independent of the others, so blocking GPTBot does not take a site out of ChatGPT search.

To block GPTBot:

User-agent: GPTBot
Disallow: /

To allow it explicitly:

User-agent: GPTBot
Allow: /
Verify a hit

Is that request really GPTBot?

  1. Take the client IP from your server or CDN log, not from a header the client can set.
  2. Check it against OpenAI's published range listed above, or paste it into the AI bot IP verifier.
  3. A GPTBot user agent from an address that fails these checks is someone else using the name.

From Renown's bot list, updated 10 November 2026. See all 169

What next

AI crawler checker

See what AI bots get from your site

Enter a URL and see, bot by bot, whether robots.txt lets it in, whether a firewall turns it away, and how much of the page it can read without running JavaScript.

AI visibility

Find out whether AI recommends you

Being readable is only the start. The free AI visibility check asks AI the questions your customers ask, shows the answers word for word, and tells you whether you were named.

FAQ

Questions people ask

What is GPTBot?

GPTBot is OpenAI's training crawler. Crawls content that may be used to train OpenAI's generative AI foundation models.

Does GPTBot follow robots.txt?

Disallowing GPTBot tells OpenAI the site's content should not be used in training. OpenAI says each of its robots.txt settings is independent of the others, so blocking GPTBot does not take a site out of ChatGPT search.

How do I check a GPTBot request is real?

Check the request's IP against OpenAI's published ranges.