Armory
Source
Browse
MCPs

manchittlab-the-crawler

Universal web scraper returning LLM-ready markdown with RAG chunking and PDF/DOCX support.

Score
32.2231 signal
Evidence
2 stars
Last commit
as last read from GitHub; most reads are from 2 Sep 2026 or later
Listed

Install

No one-command install. Set it up from its source.

Alternatives · MCPs

  1. us-crw907 stars · 63 forks97.248
  2. mineru-document-explorer628 stars · 72 forks96.986
  3. vivekvells-mcp-pandoc579 stars · 60 forks96.736

What it is

MCP server The Crawler, catalogued on PulseMCP. Universal web scraper returning LLM-ready markdown with RAG chunking and PDF/DOCX support.

When to use it

Universal web scraper returning LLM-ready markdown with RAG chunking and PDF/DOCX support.

Notes

Listed from the PulseMCP registry. The registry does not state a license. Check it before production use.