Crawler policy · FIELD GUIDE
Map Claude crawler names to access decisions
Different Claude crawler names have different uses. Map the intended access policy to the correct agent.
What the evidence can establish
Anthropic documents ClaudeBot, Claude-User and Claude-SearchBot separately. The access decision and the request-identity verification are also separate tasks.
The saved public source does not include a per-bot identity breakdown. This guide therefore provides a verification workflow, not a measured classification or a claim that a named platform visited. The dated monitoring source establishes the collection scope and its limitations.
The saved evidence used here
Own-site observation from 2026-10-31T15:00:00+00:00 to 2026-11-01T16:09:23+00:00 (UTC). Scope: selected public paths on Future InTech. Our own verification requests may be included.
This workflow uses the collection scope and evidence cutoff. It does not add a numeric outcome or an invented platform measurement.
AI answer visibility: Not measured. No original platform answers or verified citation records were collected for this guide. A request count is not an audience, ranking or citation count.
What to do next
- Record the owner’s intended policy for each documented use.
- Locate the applicable robots group and edge rule for the public path.
- Keep a dated before-and-after record of any authorized change.
- Check subsequent access with verification status; measure answer visibility separately.
How to check the result
The change request identifies the agent, purpose, affected paths and independent acceptance check.
Limits of this conclusion
Agent descriptions may change. This is not a complete census of Claude requests or a guarantee of retrieval.
This is a saved, dated edition. The linked research report can advance to a newer source window; the evidence table and download here retain this article's original observations.
Sources and publication checks
Automated checks validate source availability, supported fields, duplicate wording, numeric figures and page configuration. They are not an expert review or a search-performance guarantee.
Obtained: 2026-11-01T16:09:23+00:00
Location: bots
Saved source fingerprint
54a7b1645b80ae3466689f04be544208ae7cba23239d2b80199317616123f92aObtained: 2026-11-01T17:17:25.166971+00:00
Location: Bot, Use and access controls table
Saved source fingerprint
1c1b7bb84ea1114ac07c95ea063181fc61c388ce393c5ec0a42c52c2ecc9c085