deeppath-ai-crew-risk
Evaluates websites for crawling compliance and safety by analyzing robots.txt files, detecting anti-crawling mechanisms, identifying sensitive data, checking copyright restrictions, and scanning for exposed endpoints to provide three-tier risk ratings with specific recommendations for compliant web scraping strategies.
- Score
- 44.2562 signals
- Evidence
- 3 stars · 1 fork
- Last commit
- as last read from GitHub; most reads are from 2 Sep 2026 or later
- Listed
Install
No one-command install. Set it up from its source.
Alternatives · MCPs
- just-every-read-website-fast161 stars · 26 forks93.326
- thedaviddias-llms-txt-explorer77 stars · 13 forks89.269
- thewebscrapingclub-ai-cursor-scraping-assistant55 stars · 17 forks88.041
What it is
MCP server Crew Risk, catalogued on PulseMCP. Evaluates websites for crawling compliance and safety by analyzing robots.txt files, detecting anti-crawling mechanisms, identifying sensitive data, checking copyright restrictions, and scanning for exposed endpoints to provide three-tier risk ratings with specific recommendations for compliant web scraping strategies.
When to use it
Evaluates websites for crawling compliance and safety by analyzing robots.txt files, detecting anti-crawling mechanisms, identifying sensitive data, checking copyright restrictions, and scanning for exposed endpoints to provide three-tier risk ratings with specific recommendations for compliant web scraping strategies.
Notes
Listed from the PulseMCP registry. The registry does not state a license. Check it before production use.