open-crawler-mcp-server
Enables web crawling and content extraction from web pages, supporting multiple output formats like text, markdown, XML, and JSON, with robots.txt compliance and rate limiting.
- Score
- Unranked
- Evidence
- No signals yet
- Last commit
- Not known
- Listed
Install
No one-command install. Set it up from its source.
Alternatives · MCPs
- firecrawl-mcp7,515 stars · 895 forks · passed install test99.852
- zcaceres-markdownify2,998 stars · 255 forks98.615
- webclaw2,360 stars · 233 forks98.493
What it is
Enables web crawling and content extraction from web pages, supporting multiple output formats like text, markdown, XML, and JSON, with robots.txt compliance and rate limiting.
When to use it
Enables web crawling and content extraction from web pages, supporting multiple output formats like text, markdown, XML, and JSON, with robots.txt compliance and rate limiting.
How to install / invoke
See Glama for the install config.
Notes
Listed from the Glama MCP registry.