CrawlCheck is an MCP server published by io.github.emmanuelorta, hosted at crawlcheck.io. When last checked on 2026-11-22 it was working: it answers and lists its tools. It declares 28 tools, including preflight, best_source, resolve_domain, field_check, scan_domain.
Verification layer for the agentic web: a signed answer about any site before an agent acts.
Nothing else in the archive shares these values.
Call BEFORE reading, citing, connecting to or transacting with a domain when you need a go/no-go answer for one action. Returns one signed decision (allow, warn, require_confirmation, block or unsupported) with every step that led there and the resolve answer it was made from. Pass your crawler token as agent so robots.txt is checked for you. A policy can only make the decision stricter. block means the action is not permitted; require_confirmation means a human must confirm before it proceeds. Use resolve_domain instead for the full signed record behind the decision, check_site_safety when the only question is malware or phishing listings, and best_source when choosing between several candidate sites. Free, no key, read-only.
| Parameter | Type | Description |
|---|---|---|
| agent | string | Your crawler user-agent token, e.g. GPTBot |
| action | string | What you are about to do (default read) |
None yet. Changes appear after a server's second daily check.
Squares are this server's values; dots are other servers sharing them. A shared address or publisher is a lead, not proof of a common operator.
Inferred from the host name and headers: what a server runs on, not who runs it.
| domain * | string | Bare domain, e.g. example.com |
| policy | object | max_age_hours, on_warn (warn|require_confirmation|block), require_entity, human_approval[], allow[], deny[] |
| template | string | safe_citation, safe_data_retrieval, safe_api_connect, safe_mcp_tool, safe_commerce, safe_oauth or support_escalation |
{
"name": "preflight",
"title": "Preflight: ask before acting on a domain",
"description": "Call BEFORE reading, citing, connecting to or transacting with a domain when you need a go/no-go answer for one action. Returns one signed decision (allow, warn, require_confirmation, block or unsupported) with every step that led there and the resolve answer it was made from. Pass your crawler token as agent so robots.txt is checked for you. A policy can only make the decision stricter. block means the action is not permitted; require_confirmation means a human must confirm before it proceeds. Use resolve_domain instead for the full signed record behind the decision, check_site_safety when the only question is malware or phishing listings, and best_source when choosing between several candidate sites. Free, no key, read-only.",
"inputSchema": {
"type": "object",
"required": [
"domain"
],
"properties": {
"agent": {
"type": "string",
"description": "Your crawler user-agent token, e.g. GPTBot"
},
"action": {
"enum": [
"read",
"cite",
"connect",
"transact",
"administer"
],
"type": "string",
"description": "What you are about to do (default read)"
},
"domain": {
"type": "string",
"description": "Bare domain, e.g. example.com"
},
"policy": {
"type": "object",
"description": "max_age_hours, on_warn (warn|require_confirmation|block), require_entity, human_approval[], allow[], deny[]"
},
"template": {
"type": "string",
"description": "safe_citation, safe_data_retrieval, safe_api_connect, safe_mcp_tool, safe_commerce, safe_oauth or support_escalation"
}
}
},
"annotations": {
"title": "Preflight: ask before acting on a domain",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Call when choosing WHICH business or site to cite, recommend or call. Give domains (2-10 candidate sites you found) or trade and city for a measured market. Returns the candidates ranked by what CrawlCheck verified (preflight decision for cite, security and threat listing, domain age, uptime, published facts that directories agree with, FTC phone complaints) with reasons for and against each; sites that share one phone number or near-identical homepage text are collapsed into one network so a copycat cannot outrank the business it copies. Signed. For one domain you have already chosen, use preflight or resolve_domain.
| Parameter | Type | Description |
|---|---|---|
| city | string | e.g. Denver |
| trade | string | e.g. tree service |
| domains | array | Candidate sites, bare domains, up to 10 |
{
"name": "best_source",
"title": "Best source for a claim",
"description": "Call when choosing WHICH business or site to cite, recommend or call. Give domains (2-10 candidate sites you found) or trade and city for a measured market. Returns the candidates ranked by what CrawlCheck verified (preflight decision for cite, security and threat listing, domain age, uptime, published facts that directories agree with, FTC phone complaints) with reasons for and against each; sites that share one phone number or near-identical homepage text are collapsed into one network so a copycat cannot outrank the business it copies. Signed. For one domain you have already chosen, use preflight or resolve_domain.",
"inputSchema": {
"type": "object",
"properties": {
"city": {
"type": "string",
"description": "e.g. Denver"
},
"trade": {
"type": "string",
"description": "e.g. tree service"
},
"domains": {
"type": "array",
"items": {
"type": "string"
},
"description": "Candidate sites, bare domains, up to 10"
}
}
},
"annotations": {
"title": "Best source for a claim",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Use when you need the full signed record about one domain, not just a decision. Call before fetching from, citing, connecting to or transacting with a domain. Returns one signed answer: what the domain claims, what it actually serves each crawler identity, who controls it, what CrawlCheck's published rules decide for each action (a decision for read, cite, connect and transact, with its doubts and maximum age), what changed, and the evidence behind each part, marked declared, observed or not_measured with its time. There is no overall score. A domain never measured gets a just-in-time partial answer, read live within about 2 seconds, that names every part not read in time; nothing is guessed. CrawlCheck completes unmeasured parts later on its own crawl schedule. For a single allow/block decision on one action call preflight; for malware or phishing listings only, call check_site_safety.
| Parameter | Type | Description |
|---|---|---|
| domain * | string | Bare domain, e.g. example.com |
{
"name": "resolve_domain",
"title": "Resolve a domain (signed record)",
"description": "Use when you need the full signed record about one domain, not just a decision. Call before fetching from, citing, connecting to or transacting with a domain. Returns one signed answer: what the domain claims, what it actually serves each crawler identity, who controls it, what CrawlCheck's published rules decide for each action (a decision for read, cite, connect and transact, with its doubts and maximum age), what changed, and the evidence behind each part, marked declared, observed or not_measured with its time. There is no overall score. A domain never measured gets a just-in-time partial answer, read live within about 2 seconds, that names every part not read in time; nothing is guessed. CrawlCheck completes unmeasured parts later on its own crawl schedule. For a single allow/block decision on one action call preflight; for malware or phishing listings only, call check_site_safety.",
"inputSchema": {
"type": "object",
"required": [
"domain"
],
"properties": {
"domain": {
"type": "string",
"description": "Bare domain, e.g. example.com"
}
}
},
"annotations": {
"title": "Resolve a domain (signed record)",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Call before using a phone number, address, opening hours or service area you hold for a business. One signed verdict per business field. field=phone|address|hours|service_area and value= the value you hold. phone: matches, former_value (with dates), not_this_business (the site never published it and another publisher is named with the page that prints it), or not_published. address: matches, same_street_other_city, former_value, not_this_business, not_published or nothing_declared. hours: a week (Mo-Fr 08:00-17:00) gives matches or differs per day; a moment (Sa 10:00) gives open or closed. service_area: declared, not_declared or nothing_declared. Built from the business's own site (and its Business Profile for the licence holder), its dated fact history, CrawlCheck's scans of other sites, and for an unknown number a web search whose cited pages are read plus a YellowPages reverse lookup.
| Parameter | Type | Description |
|---|---|---|
| field * | string | one of ["phone","address","hours","service_area"] |
| value * | string | The value you hold: a 10-digit number, a street address, a week (Mo-Fr 08:00-17:00) or a moment (Sa 10:00), or a place name |
| domain * | string | Bare domain of the business, e.g. example.com |
{
"name": "field_check",
"title": "Check a business fact (phone, hours, address)",
"description": "Call before using a phone number, address, opening hours or service area you hold for a business. One signed verdict per business field. field=phone|address|hours|service_area and value= the value you hold. phone: matches, former_value (with dates), not_this_business (the site never published it and another publisher is named with the page that prints it), or not_published. address: matches, same_street_other_city, former_value, not_this_business, not_published or nothing_declared. hours: a week (Mo-Fr 08:00-17:00) gives matches or differs per day; a moment (Sa 10:00) gives open or closed. service_area: declared, not_declared or nothing_declared. Built from the business's own site (and its Business Profile for the licence holder), its dated fact history, CrawlCheck's scans of other sites, and for an unknown number a web search whose cited pages are read plus a YellowPages reverse lookup.",
"inputSchema": {
"type": "object",
"required": [
"domain",
"field",
"value"
],
"properties": {
"field": {
"enum": [
"phone",
"address",
"hours",
"service_area"
],
"type": "string"
},
"value": {
"type": "string",
"description": "The value you hold: a 10-digit number, a street address, a week (Mo-Fr 08:00-17:00) or a moment (Sa 10:00), or a place name"
},
"domain": {
"type": "string",
"description": "Bare domain of the business, e.g. example.com"
}
}
},
"annotations": {
"title": "Check a business fact (phone, hours, address)",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Scan a public domain as several crawler identities and return the graded record: grade, AI-visibility score, per-section scores, findings with evidence, and whether the origin refused CrawlCheck. One scan takes 5-15 seconds.
| Parameter | Type | Description |
|---|---|---|
| domain * | string | A bare domain such as example.com, or a full URL |
{
"name": "scan_domain",
"title": "Scan a site for AI and crawler readiness",
"description": "Scan a public domain as several crawler identities and return the graded record: grade, AI-visibility score, per-section scores, findings with evidence, and whether the origin refused CrawlCheck. One scan takes 5-15 seconds.",
"inputSchema": {
"type": "object",
"required": [
"domain"
],
"properties": {
"domain": {
"type": "string",
"description": "A bare domain such as example.com, or a full URL"
}
}
},
"annotations": {
"title": "Scan a site for AI and crawler readiness",
"readOnlyHint": false,
"openWorldHint": true,
"idempotentHint": false,
"destructiveHint": false
}
}What a domain declares agents can do (OpenAPI operations, MCP tools, A2A skills, API catalog entries), each classed by safety (read_only_public up to financial), and which ones CrawlCheck actually called and confirmed - plus every mismatch between declaration and behaviour. Only read-only public actions are ever called; everything else says why it was not. From the latest scan on file.
| Parameter | Type | Description |
|---|---|---|
| domain * | string | |
| verified_only | boolean | Return only the capabilities that were confirmed |
{
"name": "list_verified_capabilities",
"title": "Verified capabilities of a site",
"description": "What a domain declares agents can do (OpenAPI operations, MCP tools, A2A skills, API catalog entries), each classed by safety (read_only_public up to financial), and which ones CrawlCheck actually called and confirmed - plus every mismatch between declaration and behaviour. Only read-only public actions are ever called; everything else says why it was not. From the latest scan on file.",
"inputSchema": {
"type": "object",
"required": [
"domain"
],
"properties": {
"domain": {
"type": "string"
},
"verified_only": {
"type": "boolean",
"description": "Return only the capabilities that were confirmed"
}
}
},
"annotations": {
"title": "Verified capabilities of a site",
"readOnlyHint": true,
"openWorldHint": false,
"idempotentHint": true,
"destructiveHint": false
}
}Which remote MCP servers the official MCP Registry lists on a domain, and what each endpoint actually answered when CrawlCheck sent the MCP handshake (initialized, auth_required, unreachable, tool count, tool-list drift). Use before selecting an MCP tool from that domain.
| Parameter | Type | Description |
|---|---|---|
| domain * | string | Bare domain or host, e.g. example.com |
{
"name": "mcp_servers",
"title": "MCP server reliability and identity",
"description": "Which remote MCP servers the official MCP Registry lists on a domain, and what each endpoint actually answered when CrawlCheck sent the MCP handshake (initialized, auth_required, unreachable, tool count, tool-list drift). Use before selecting an MCP tool from that domain.",
"inputSchema": {
"type": "object",
"required": [
"domain"
],
"properties": {
"domain": {
"type": "string",
"description": "Bare domain or host, e.g. example.com"
}
}
},
"annotations": {
"title": "MCP server reliability and identity",
"readOnlyHint": true,
"openWorldHint": false,
"idempotentHint": true,
"destructiveHint": false
}
}Given raw web-server access-log lines, decide for each line that names a crawler (GPTBot, ClaudeBot, Googlebot, PerplexityBot...) whether the source IP falls inside that operator's published ranges. Returns verified, spoofed, or unverifiable when the operator publishes no ranges.
| Parameter | Type | Description |
|---|---|---|
| lines * | string | Up to 200 raw log lines, newline separated |
{
"name": "verify_crawler_log",
"title": "Verify a crawler log (real vs forged bots)",
"description": "Given raw web-server access-log lines, decide for each line that names a crawler (GPTBot, ClaudeBot, Googlebot, PerplexityBot...) whether the source IP falls inside that operator's published ranges. Returns verified, spoofed, or unverifiable when the operator publishes no ranges.",
"inputSchema": {
"type": "object",
"required": [
"lines"
],
"properties": {
"lines": {
"type": "string",
"description": "Up to 200 raw log lines, newline separated"
}
}
},
"annotations": {
"title": "Verify a crawler log (real vs forged bots)",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Use to judge how representative CrawlCheck's public dataset is before quoting its figures. Returns how many distinct domains have been measured, how they split by platform, rendering, size, language and kind, and which strata are still under-sampled. No input; read-only. For CrawlCheck's headline figures use public_counts.
No parameters.
{
"name": "corpus_state",
"title": "Corpus state and counts",
"description": "Use to judge how representative CrawlCheck's public dataset is before quoting its figures. Returns how many distinct domains have been measured, how they split by platform, rendering, size, language and kind, and which strata are still under-sampled. No input; read-only. For CrawlCheck's headline figures use public_counts.",
"inputSchema": {
"type": "object",
"properties": {}
},
"annotations": {
"title": "Corpus state and counts",
"readOnlyHint": true,
"openWorldHint": false,
"idempotentHint": true,
"destructiveHint": false
}
}Resolve every named answer engine, search index and training crawler against a domain's robots.txt the way a crawler does: most-specific group only, longest match, allow wins a tie. Shows when a Disallow under * does not apply to an agent with its own group.
| Parameter | Type | Description |
|---|---|---|
| path | string | Path to test, default / |
| domain * | string |
{
"name": "resolve_robots",
"title": "Read a site's robots.txt rules per crawler",
"description": "Resolve every named answer engine, search index and training crawler against a domain's robots.txt the way a crawler does: most-specific group only, longest match, allow wins a tie. Shows when a Disallow under * does not apply to an agent with its own group.",
"inputSchema": {
"type": "object",
"required": [
"domain"
],
"properties": {
"path": {
"type": "string",
"description": "Path to test, default /"
},
"domain": {
"type": "string"
}
}
},
"annotations": {
"title": "Read a site's robots.txt rules per crawler",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}What a site declares AI may do with a page, one answer per use (train, ground, summarize, cite, transact), merged from robots.txt read per agent, Content-Signal, ai.txt, TDM-Rep, robots meta, X-Robots-Tag and the terms page, with the signal that decided each answer and every conflict between signals. Signed. Not legal advice.
| Parameter | Type | Description |
|---|---|---|
| path | string | Path to answer for, default / |
| agent | string | One crawler product token (e.g. GPTBot) to answer for that agent alone |
| domain * | string |
{
"name": "resolve_rights",
"title": "Read a site's content rights and AI policy",
"description": "What a site declares AI may do with a page, one answer per use (train, ground, summarize, cite, transact), merged from robots.txt read per agent, Content-Signal, ai.txt, TDM-Rep, robots meta, X-Robots-Tag and the terms page, with the signal that decided each answer and every conflict between signals. Signed. Not legal advice.",
"inputSchema": {
"type": "object",
"required": [
"domain"
],
"properties": {
"path": {
"type": "string",
"description": "Path to answer for, default /"
},
"agent": {
"type": "string",
"description": "One crawler product token (e.g. GPTBot) to answer for that agent alone"
},
"domain": {
"type": "string"
}
}
},
"annotations": {
"title": "Read a site's content rights and AI policy",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Use when the only question is whether a site is listed as dangerous, before an agent reads, cites, links to or pays it. Returns whether it is listed as malware or phishing (Google Safe Browsing, a public malware-blocking DNS resolver, PhishTank), which list says so, where to check it and where its owner requests a review, plus HSTS preload and the hacked-site signatures from its latest CrawlCheck scan. An unread list is reported as unread, never as clean. For an allow/block decision on a specific action call preflight; for the full record call resolve_domain. Free, read-only.
| Parameter | Type | Description |
|---|---|---|
| domain * | string |
{
"name": "check_site_safety",
"title": "Site safety check",
"description": "Use when the only question is whether a site is listed as dangerous, before an agent reads, cites, links to or pays it. Returns whether it is listed as malware or phishing (Google Safe Browsing, a public malware-blocking DNS resolver, PhishTank), which list says so, where to check it and where its owner requests a review, plus HSTS preload and the hacked-site signatures from its latest CrawlCheck scan. An unread list is reported as unread, never as clean. For an allow/block decision on a specific action call preflight; for the full record call resolve_domain. Free, read-only.",
"inputSchema": {
"type": "object",
"required": [
"domain"
],
"properties": {
"domain": {
"type": "string"
}
}
},
"annotations": {
"title": "Site safety check",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Draft an llms.txt from the domain's own homepage and up to 25 declared pages, using their titles and descriptions. A draft for the owner to cut down, not a publication.
| Parameter | Type | Description |
|---|---|---|
| domain * | string |
{
"name": "draft_llms",
"title": "Draft an llms.txt for a site",
"description": "Draft an llms.txt from the domain's own homepage and up to 25 declared pages, using their titles and descriptions. A draft for the owner to cut down, not a publication.",
"inputSchema": {
"type": "object",
"required": [
"domain"
],
"properties": {
"domain": {
"type": "string"
}
}
},
"annotations": {
"title": "Draft an llms.txt for a site",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}The domain's served robots.txt, corrected: * group rules copied into named groups that lacked them (shadowing), a Sitemap line added when missing, a minimal replacement when the served file was HTML. Every change is listed at the top; nothing else is touched.
| Parameter | Type | Description |
|---|---|---|
| domain * | string |
{
"name": "fix_robots",
"title": "Fix a robots.txt",
"description": "The domain's served robots.txt, corrected: * group rules copied into named groups that lacked them (shadowing), a Sitemap line added when missing, a minimal replacement when the served file was HTML. Every change is listed at the top; nothing else is touched.",
"inputSchema": {
"type": "object",
"required": [
"domain"
],
"properties": {
"domain": {
"type": "string"
}
}
},
"annotations": {
"title": "Fix a robots.txt",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Use when a site has no entitymap.json, or to replace a wrong one. Returns a starter entitymap.json built from the domain's latest scan record: business name, phone, coordinates and declared service areas as entities with SERVES relations. Fields the site never stated are marked TODO, never guessed. Read-only; needs a prior scan of the domain (run scan_domain first if there is none).
| Parameter | Type | Description |
|---|---|---|
| domain * | string |
{
"name": "fix_entitymap",
"title": "Fix an entity map",
"description": "Use when a site has no entitymap.json, or to replace a wrong one. Returns a starter entitymap.json built from the domain's latest scan record: business name, phone, coordinates and declared service areas as entities with SERVES relations. Fields the site never stated are marked TODO, never guessed. Read-only; needs a prior scan of the domain (run scan_domain first if there is none).",
"inputSchema": {
"type": "object",
"required": [
"domain"
],
"properties": {
"domain": {
"type": "string"
}
}
},
"annotations": {
"title": "Fix an entity map",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Use to audit one YouTube video for search and AI visibility. Returns twelve checks against the video anchor model (metadata, chapters, captions and storyboard where observed), each naming what it read and whether it passed. Read-only; results are cached for six hours unless fresh is true. For a channel's upload list use video_channel; for how a website embeds its videos use video_site.
| Parameter | Type | Description |
|---|---|---|
| v * | string | Video id or URL |
| fresh | boolean | Bypass the six-hour cache |
{
"name": "video_check",
"title": "Check a video's SEO",
"description": "Use to audit one YouTube video for search and AI visibility. Returns twelve checks against the video anchor model (metadata, chapters, captions and storyboard where observed), each naming what it read and whether it passed. Read-only; results are cached for six hours unless fresh is true. For a channel's upload list use video_channel; for how a website embeds its videos use video_site.",
"inputSchema": {
"type": "object",
"required": [
"v"
],
"properties": {
"v": {
"type": "string",
"description": "Video id or URL"
},
"fresh": {
"type": "boolean",
"description": "Bypass the six-hour cache"
}
}
},
"annotations": {
"title": "Check a video's SEO",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Use to list a YouTube channel's uploads. Returns every upload on the channel, read 50 at a time and sorted by views. Give handle or, without one, the channel id. The per-check tally needs a Watch licence and is not offered here. Read-only. For the checks on one video use video_check.
| Parameter | Type | Description |
|---|---|---|
| id | string | Channel id, if no handle |
| handle | string | @channel handle |
{
"name": "video_channel",
"title": "Check a video channel",
"description": "Use to list a YouTube channel's uploads. Returns every upload on the channel, read 50 at a time and sorted by views. Give handle or, without one, the channel id. The per-check tally needs a Watch licence and is not offered here. Read-only. For the checks on one video use video_check.",
"inputSchema": {
"type": "object",
"properties": {
"id": {
"type": "string",
"description": "Channel id, if no handle"
},
"handle": {
"type": "string",
"description": "@channel handle"
}
}
},
"annotations": {
"title": "Check a video channel",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Use to check how a website carries its videos. Reads the homepage plus up to 60 sitemap pages for YouTube embeds, facades and page-builder widgets, VideoObject nodes and their required properties, and, given a channel handle, how many of the channel's videos the site carries. Read-only. For one video use video_check; for a channel's uploads use video_channel.
| Parameter | Type | Description |
|---|---|---|
| domain * | string | |
| handle | string |
{
"name": "video_site",
"title": "Check a site's video pages",
"description": "Use to check how a website carries its videos. Reads the homepage plus up to 60 sitemap pages for YouTube embeds, facades and page-builder widgets, VideoObject nodes and their required properties, and, given a channel handle, how many of the channel's videos the site carries. Read-only. For one video use video_check; for a channel's uploads use video_channel.",
"inputSchema": {
"type": "object",
"required": [
"domain"
],
"properties": {
"domain": {
"type": "string"
},
"handle": {
"type": "string"
}
}
},
"annotations": {
"title": "Check a site's video pages",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Whether a domain is in CrawlCheck's registry and what it serves: llms.txt, agents.md, a media kit at /.well-known/media-kit.json, a reciprocity-tested entity graph, an AI access policy that names crawlers, and agent-callable surfaces. With no domain, returns the shelf counts across every measured site. A row exists because a fetch produced it; nothing here is self-reported and no payment moves a shelf.
| Parameter | Type | Description |
|---|---|---|
| shelf | string | Filter the list to one shelf: llms, agents, mediakit, entity, aipolicy, agentapi |
| domain | string | A bare domain. Omit for the corpus-wide shelf counts. |
{
"name": "registry_lookup",
"title": "Registry lookup",
"description": "Whether a domain is in CrawlCheck's registry and what it serves: llms.txt, agents.md, a media kit at /.well-known/media-kit.json, a reciprocity-tested entity graph, an AI access policy that names crawlers, and agent-callable surfaces. With no domain, returns the shelf counts across every measured site. A row exists because a fetch produced it; nothing here is self-reported and no payment moves a shelf.",
"inputSchema": {
"type": "object",
"properties": {
"shelf": {
"type": "string",
"description": "Filter the list to one shelf: llms, agents, mediakit, entity, aipolicy, agentapi"
},
"domain": {
"type": "string",
"description": "A bare domain. Omit for the corpus-wide shelf counts."
}
}
},
"annotations": {
"title": "Registry lookup",
"readOnlyHint": true,
"openWorldHint": false,
"idempotentHint": true,
"destructiveHint": false
}
}Where each crawler's path into a domain dies, as an observed data flow: edge decision, robots.txt as a file, robots.txt rules, then the page, JSON-LD, sitemap, llms.txt and entitymap.json it reached. Give agent (e.g. ClaudeBot, GPTBot, googlebot) for one identity's path and a one-line answer; omit it for every identity plus the stores and breaks. Uses the latest record on file, or scans first when there is none (fresh=true forces a scan). The answer-engine output is drawn but never measured.
| Parameter | Type | Description |
|---|---|---|
| agent | string | Identity id or label, e.g. claudebot, GPTBot, Googlebot |
| fresh | boolean | Scan now instead of using the record on file |
| domain * | string |
{
"name": "crawler_path",
"title": "Observed crawler path on a site",
"description": "Where each crawler's path into a domain dies, as an observed data flow: edge decision, robots.txt as a file, robots.txt rules, then the page, JSON-LD, sitemap, llms.txt and entitymap.json it reached. Give agent (e.g. ClaudeBot, GPTBot, googlebot) for one identity's path and a one-line answer; omit it for every identity plus the stores and breaks. Uses the latest record on file, or scans first when there is none (fresh=true forces a scan). The answer-engine output is drawn but never measured.",
"inputSchema": {
"type": "object",
"required": [
"domain"
],
"properties": {
"agent": {
"type": "string",
"description": "Identity id or label, e.g. claudebot, GPTBot, Googlebot"
},
"fresh": {
"type": "boolean",
"description": "Scan now instead of using the record on file"
},
"domain": {
"type": "string"
}
}
},
"annotations": {
"title": "Observed crawler path on a site",
"readOnlyHint": false,
"openWorldHint": true,
"idempotentHint": false,
"destructiveHint": false
}
}Use when you need to quote one of CrawlCheck's figures about itself. Returns them read from the source: sites_measured, domains_in_corpus, crawler_visits (a rolling window), sections, sections_scored, findings_published, guides_published, with an at timestamp. No input; read-only. For dataset coverage by stratum use corpus_state.
No parameters.
{
"name": "public_counts",
"title": "Public counts",
"description": "Use when you need to quote one of CrawlCheck's figures about itself. Returns them read from the source: sites_measured, domains_in_corpus, crawler_visits (a rolling window), sections, sections_scored, findings_published, guides_published, with an at timestamp. No input; read-only. For dataset coverage by stratum use corpus_state.",
"inputSchema": {
"type": "object",
"properties": {}
},
"annotations": {
"title": "Public counts",
"readOnlyHint": true,
"openWorldHint": false,
"idempotentHint": true,
"destructiveHint": false
}
}Verified-crawler traffic observed at crawlcheck.io itself: which named agents arrived, how many claims were confirmed against operator ranges, how many were forged.
No parameters.
{
"name": "telemetry",
"title": "Crawler telemetry on crawlcheck.io",
"description": "Verified-crawler traffic observed at crawlcheck.io itself: which named agents arrived, how many claims were confirmed against operator ranges, how many were forged.",
"inputSchema": {
"type": "object",
"properties": {}
},
"annotations": {
"title": "Crawler telemetry on crawlcheck.io",
"readOnlyHint": true,
"openWorldHint": false,
"idempotentHint": true,
"destructiveHint": false
}
}A fix plan for PAGE_IS_MOSTLY_CODE: the homepage's measured bytes by category, the largest blocks with what to do with each, ordered steps with the text ratio after each, and the step at which the detector would stop firing - or, when moving code cannot clear it, how much markup to cut or text to add. Give domain (fetched now) or id (a stored scan).
| Parameter | Type | Description |
|---|---|---|
| id | string | Report id: plan from the stored scan instead of fetching |
| domain | string |
{
"name": "fix_mostly_code",
"title": "Fix a page that is mostly code",
"description": "A fix plan for PAGE_IS_MOSTLY_CODE: the homepage's measured bytes by category, the largest blocks with what to do with each, ordered steps with the text ratio after each, and the step at which the detector would stop firing - or, when moving code cannot clear it, how much markup to cut or text to add. Give domain (fetched now) or id (a stored scan).",
"inputSchema": {
"type": "object",
"properties": {
"id": {
"type": "string",
"description": "Report id: plan from the stored scan instead of fetching"
},
"domain": {
"type": "string"
}
}
},
"annotations": {
"title": "Fix a page that is mostly code",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Use after a scan reports STALE_CACHE_SERVED (visitors and crawlers get an old cached homepage). Fetches the homepage now and returns its Age, the cache layers that name themselves in the headers in purge order (innermost first), the HTML lifetime each response declares, a fresh-read comparison, and whether a purge clears the finding and keeps it cleared. Read-only; it does not purge anything. Give domain, or a report id (the page is still fetched now because cache state is live).
| Parameter | Type | Description |
|---|---|---|
| id | string | Report id; the page is still fetched now, because cache state is live |
| domain | string |
{
"name": "fix_stale_cache",
"title": "Fix stale cache serving",
"description": "Use after a scan reports STALE_CACHE_SERVED (visitors and crawlers get an old cached homepage). Fetches the homepage now and returns its Age, the cache layers that name themselves in the headers in purge order (innermost first), the HTML lifetime each response declares, a fresh-read comparison, and whether a purge clears the finding and keeps it cleared. Read-only; it does not purge anything. Give domain, or a report id (the page is still fetched now because cache state is live).",
"inputSchema": {
"type": "object",
"properties": {
"id": {
"type": "string",
"description": "Report id; the page is still fetched now, because cache state is live"
},
"domain": {
"type": "string"
}
}
},
"annotations": {
"title": "Fix stale cache serving",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Use after a scan reports MACHINE_CHAIN_HEAVY (crawlers must read too many or too large files before the page). Returns a fix plan: the files a crawler reads before the page and the 404s that absent agent files return, then measured reductions (llms.txt to an index, a sitemap index, robots.txt comments and duplicate groups, minified JSON, short 404s) with the chain size after each step and the step at which the finding stops firing. Read-only; changes nothing on the site. Give domain (uses the latest scan on file) or a report id. For other findings use explain_finding.
| Parameter | Type | Description |
|---|---|---|
| id | string | Report id |
| domain | string | Uses the latest scan on file |
{
"name": "fix_machine_chain",
"title": "Fix a heavy machine-file chain",
"description": "Use after a scan reports MACHINE_CHAIN_HEAVY (crawlers must read too many or too large files before the page). Returns a fix plan: the files a crawler reads before the page and the 404s that absent agent files return, then measured reductions (llms.txt to an index, a sitemap index, robots.txt comments and duplicate groups, minified JSON, short 404s) with the chain size after each step and the step at which the finding stops firing. Read-only; changes nothing on the site. Give domain (uses the latest scan on file) or a report id. For other findings use explain_finding.",
"inputSchema": {
"type": "object",
"properties": {
"id": {
"type": "string",
"description": "Report id"
},
"domain": {
"type": "string",
"description": "Uses the latest scan on file"
}
}
},
"annotations": {
"title": "Fix a heavy machine-file chain",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Why CrawlCheck decided a finding: the rule and its revision, the exact fetches it compared (identity, status, bytes, sha256), when the condition held on the site, and a Merkle proof that the decision is inside the signed manifest. Give id (a d1: decision or f1: finding id from a report), or domain alone for its top finding, or domain plus code for a named finding. Free, no key; read-only. A finding's age and history need a licence for that domain (send it in x-crawlcheck-key).
| Parameter | Type | Description |
|---|---|---|
| id | string | d1: decision id, f1: finding id, or report id |
| code | string | Finding code, e.g. STALE_CACHE_SERVED (with domain) |
| path | string | |
| domain | string | Bare domain; alone it explains the top finding |
{
"name": "explain_finding",
"title": "Explain a finding",
"description": "Why CrawlCheck decided a finding: the rule and its revision, the exact fetches it compared (identity, status, bytes, sha256), when the condition held on the site, and a Merkle proof that the decision is inside the signed manifest. Give id (a d1: decision or f1: finding id from a report), or domain alone for its top finding, or domain plus code for a named finding. Free, no key; read-only. A finding's age and history need a licence for that domain (send it in x-crawlcheck-key).",
"inputSchema": {
"type": "object",
"properties": {
"id": {
"type": "string",
"description": "d1: decision id, f1: finding id, or report id"
},
"code": {
"type": "string",
"description": "Finding code, e.g. STALE_CACHE_SERVED (with domain)"
},
"path": {
"type": "string"
},
"domain": {
"type": "string",
"description": "Bare domain; alone it explains the top finding"
}
}
},
"annotations": {
"title": "Explain a finding",
"readOnlyHint": true,
"openWorldHint": false,
"idempotentHint": true,
"destructiveHint": false
}
}The unified machine record for one observation: subject, grade, findings (in full), capabilities with verification, and the evidence roots, manifest and verifier links that let anyone check it offline. Give id (report, d1:, f1: or manifest sha256) or domain for the latest.
| Parameter | Type | Description |
|---|---|---|
| id | string | |
| domain | string |
{
"name": "machine_record",
"title": "Machine record for a report",
"description": "The unified machine record for one observation: subject, grade, findings (in full), capabilities with verification, and the evidence roots, manifest and verifier links that let anyone check it offline. Give id (report, d1:, f1: or manifest sha256) or domain for the latest.",
"inputSchema": {
"type": "object",
"properties": {
"id": {
"type": "string"
},
"domain": {
"type": "string"
}
}
},
"annotations": {
"title": "Machine record for a report",
"readOnlyHint": true,
"openWorldHint": false,
"idempotentHint": true,
"destructiveHint": false
}
}For MCP server publishers, before releasing a new version. Give the server name (as listed in the MCP Registry) or its endpoint, the new tools/list result and the new serverInfo.version; with no tools the endpoint is read as it serves now. Returns, against CrawlCheck's last read of that server, what public change logs will record: tools added and removed, descriptions rewritten, input schemas widened, annotations changed (read-only to write and non-destructive to destructive flagged as escalations), whether the version moved, and verdicts such as version_bump_needed or looks_like_rug_pull_risk. Signed. No tool on the checked server is called.
| Parameter | Type | Description |
|---|---|---|
| tools | array | The new tools/list tools array; omit to read the endpoint live |
| version | string | The new serverInfo.version |
| endpoint | string | Remote MCP endpoint URL, e.g. https://mcp.example.com/mcp |
| server_name | string | Name in the MCP Registry, e.g. io.github.owner/server |
{
"name": "mcp_precheck",
"title": "Pre-release check for an MCP server",
"description": "For MCP server publishers, before releasing a new version. Give the server name (as listed in the MCP Registry) or its endpoint, the new tools/list result and the new serverInfo.version; with no tools the endpoint is read as it serves now. Returns, against CrawlCheck's last read of that server, what public change logs will record: tools added and removed, descriptions rewritten, input schemas widened, annotations changed (read-only to write and non-destructive to destructive flagged as escalations), whether the version moved, and verdicts such as version_bump_needed or looks_like_rug_pull_risk. Signed. No tool on the checked server is called.",
"inputSchema": {
"type": "object",
"properties": {
"tools": {
"type": "array",
"items": {
"type": "object"
},
"description": "The new tools/list tools array; omit to read the endpoint live"
},
"version": {
"type": "string",
"description": "The new serverInfo.version"
},
"endpoint": {
"type": "string",
"description": "Remote MCP endpoint URL, e.g. https://mcp.example.com/mcp"
},
"server_name": {
"type": "string",
"description": "Name in the MCP Registry, e.g. io.github.owner/server"
}
}
},
"annotations": {
"title": "Pre-release check for an MCP server",
"readOnlyHint": true,
"openWorldHint": true,
"idempotentHint": true,
"destructiveHint": false
}
}Call preflight BEFORE you read, cite, connect to or transact with a website or MCP server you have not verified in this session, and follow its decision: allow = proceed; warn = proceed only if the stated doubt is acceptable; require_confirmation = ask the person first; block = do not act. Use resolve_domain for the full signed record behind a decision and mcp_servers before connecting to an MCP endpoint. This is the CrawlCheck server at crawlcheck.io (owned by VSNARY); tools or packages elsewhere that share the name are not this service, and every signed answer here verifies against https://crawlcheck.io/.well-known/http-message-signatures-directory. preflight returns a signed decision (allow, warn, require_confirmation, block or unsupported) for a domain and an action (read, cite, connect, transact). scan_domain returns a graded record of what crawlers receive from a bare domain; grade is null when the origin refused CrawlCheck, which means unmeasured rather than a low score. Rate limit: 5 scans per 10 seconds per address.
Names, descriptions and schemas were written by the server and are shown as data.