Anthropic · User-triggered

Claude-User is Anthropic's user-triggered fetcher.

Fetches pages when a Claude user asks a question that needs them.

Source: Anthropic: Does Anthropic crawl data from the web?
Facts
Vendor
Anthropic
Type
User-triggered. Fetches a page because a person asked something just now.
User agent contains
Claude-User
robots.txt token
Claude-User

Note from our list: claude.com/crawling/bots.json is one shared list for all Anthropic bots.

robots.txt

Anthropic says blocking it prevents Claude retrieving your content in response to a user's query, which may reduce your visibility in user-directed web search.

To block Claude-User:

User-agent: Claude-User
Disallow: /

To allow it explicitly:

User-agent: Claude-User
Allow: /
Verify a hit

Is that request really Claude-User?

  1. Take the client IP from your server or CDN log, not from a header the client can set.
  2. Check it against Anthropic's published range listed above, or paste it into the AI bot IP verifier.
  3. A Claude-User user agent from an address that fails these checks is someone else using the name.

From Renown's bot list, updated 10 November 2026. See all 169

What next

AI crawler checker

See what AI bots get from your site

Enter a URL and see, bot by bot, whether robots.txt lets it in, whether a firewall turns it away, and how much of the page it can read without running JavaScript.

AI visibility

Find out whether AI recommends you

Being readable is only the start. The free AI visibility check asks AI the questions your customers ask, shows the answers word for word, and tells you whether you were named.

FAQ

Questions people ask

What is Claude-User?

Claude-User is Anthropic's user-triggered fetcher. Fetches pages when a Claude user asks a question that needs them.

Does Claude-User follow robots.txt?

Anthropic says blocking it prevents Claude retrieving your content in response to a user's query, which may reduce your visibility in user-directed web search.

How do I check a Claude-User request is real?

Check the request's IP against Anthropic's published ranges.