Auth required Checked 3d ago

AI Crawler Checker — Robots.txt Policy for Six Bots

io.github.kriton-dev/ai-crawler-access-check

Check declared robots.txt permissions for six AI crawlers at URL paths

Latest observation

Status overview

Current statusAuth requiredThe endpoint is reachable but requires credentials for complete testing.

Latency189 msEnd-to-end protocol check

Protocol2026-07-28Modern flow

Tools discovered—Safe tools/list discovery only

Reliability

Auth-required and unknown checks are excluded.

Last 24 hours—Collecting comparable data

Last 7 days—Collecting comparable data

Last 30 days—Collecting comparable data

OperationalDegradedDownExcludedNewest on the left

Transparent checks

Network reachability

HTTPS endpoint and response timing.

Passed

MCP handshake

Modern discovery or legacy initialization.

Passed

Tools/list

Capability discovery without invoking any tool.

Failed

Events

No incidents recorded

An incident opens only after consecutive confirmed failures.

Keep exploring