Ai2 · Training

AI2Bot is Ai2's training crawler.

The Allen Institute for AI's crawler. It explores certain domains to find web content used to train open language models.

Source: Ai2 crawler
Facts
Vendor
Ai2
Type
Training. Collects pages to train AI models.
User agent contains
AI2Bot
robots.txt token
AI2Bot
Published IP ranges
None published

Note from our list: Also matches AI2Bot-DeepResearchEval unless that entry comes first.

robots.txt

Ai2's documentation for AI2Bot doesn't say how it treats robots.txt.

To block AI2Bot:

User-agent: AI2Bot
Disallow: /

To allow it explicitly:

User-agent: AI2Bot
Allow: /
Verify a hit

Is that request really AI2Bot?

Ai2 publishes no IP ranges or reverse-DNS check for AI2Bot in the sources our list uses. A request with this user agent can't be told apart from a scraper borrowing it. If the traffic is a problem, a firewall rule on the user agent is the only lever, and it will catch impostors too.

From Renown's bot list, updated 10 November 2026. See all 169

What next

AI crawler checker

See what AI bots get from your site

Enter a URL and see, bot by bot, whether robots.txt lets it in, whether a firewall turns it away, and how much of the page it can read without running JavaScript.

AI visibility

Find out whether AI recommends you

Being readable is only the start. The free AI visibility check asks AI the questions your customers ask, shows the answers word for word, and tells you whether you were named.

FAQ

Questions people ask

What is AI2Bot?

AI2Bot is Ai2's training crawler. The Allen Institute for AI's crawler. It explores certain domains to find web content used to train open language models.

How do I check a AI2Bot request is real?

You can't, from the outside. Ai2 publishes no IP ranges or reverse-DNS check for AI2Bot in the sources our list uses, so a request with this user agent may come from anyone.