Loading MCP server directory, please wait...
Lint your robots.txt and see which AI crawlers it really blocks. Free, no key, nothing to install.
npx @getmcp/cli add dev.workers.pathwren.www/robots-policy-lintRequires Node.js 18+. Community-contributed server. Review source before installing.
Config file: ~/Library/Application Support/Claude/claude_desktop_config.json
{
"mcpServers": {
"dev.workers.pathwren.www/robots-policy-lint": {
"url": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots",
"transport": "streamable-http"
}
}
}