Armory
Source
Browse
MCPs

crawl-census

Provides preflight checks and domain intelligence so agents can skip domains that will refuse them or charge a fee, covering robots.txt, edge refusals, and HTTP 402 paywalls.

Score
Unranked
Evidence
No signals yet
Last commit
as last read from GitHub; most reads are from 2 Sep 2026 or later
Listed

Install

No one-command install. Set it up from its source.

Alternatives · MCPs

  1. mcp-server-ddd-template6 stars · 3 forks60.035
  2. hanselhansel-aeo-cli4 stars · 2 forks52.135

What it is

Provides preflight checks and domain intelligence so agents can skip domains that will refuse them or charge a fee, covering robots.txt, edge refusals, and HTTP 402 paywalls.

When to use it

Provides preflight checks and domain intelligence so agents can skip domains that will refuse them or charge a fee, covering robots.txt, edge refusals, and HTTP 402 paywalls.

How to install / invoke

See Glama for the install config.

Notes

Listed from the Glama MCP registry.