Future InTech
Language · English

Crawler policy · FIELD GUIDE

Map Claude crawler names to access decisions

Different Claude crawler names have different uses. Map the intended access policy to the correct agent.

By Future InTech · Published
Evidence cutoff: 2026-11-01T16:09:23+00:00 · UTC

What the evidence can establish

Anthropic documents ClaudeBot, Claude-User and Claude-SearchBot separately. The access decision and the request-identity verification are also separate tasks.

The saved public source does not include a per-bot identity breakdown. This guide therefore provides a verification workflow, not a measured classification or a claim that a named platform visited. The dated monitoring source establishes the collection scope and its limitations.

Read official purposes; Map exact rules; Preserve dated changes; Measure the correct layer
Original explanatory workflow. Numeric callouts reproduce dated own-site evidence; they are not an AI platform test.

The saved evidence used here

Own-site observation from 2026-10-31T15:00:00+00:00 to 2026-11-01T16:09:23+00:00 (UTC). Scope: selected public paths on Future InTech. Our own verification requests may be included.

This workflow uses the collection scope and evidence cutoff. It does not add a numeric outcome or an invented platform measurement.

AI answer visibility: Not measured. No original platform answers or verified citation records were collected for this guide. A request count is not an audience, ranking or citation count.

What to do next

  1. Record the owner’s intended policy for each documented use.
  2. Locate the applicable robots group and edge rule for the public path.
  3. Keep a dated before-and-after record of any authorized change.
  4. Check subsequent access with verification status; measure answer visibility separately.

How to check the result

The change request identifies the agent, purpose, affected paths and independent acceptance check.

Limits of this conclusion

Agent descriptions may change. This is not a complete census of Claude requests or a guarantee of retrieval.

This is a saved, dated edition. The linked research report can advance to a newer source window; the evidence table and download here retain this article's original observations.

Sources and publication checks

Automated checks validate source availability, supported fields, duplicate wording, numeric figures and page configuration. They are not an expert review or a search-performance guarantee.

Saved own-site monitoring evidence

Obtained: 2026-11-01T16:09:23+00:00
Location: bots

Saved source fingerprint54a7b1645b80ae3466689f04be544208ae7cba23239d2b80199317616123f92a
Anthropic crawler controls

Obtained: 2026-11-01T17:17:25.166971+00:00
Location: Bot, Use and access controls table

Saved source fingerprint1c1b7bb84ea1114ac07c95ea063181fc61c388ce393c5ec0a42c52c2ecc9c085

Download this edition's evidence and action record (JSON)