4 boosters for "crawler" — AI-graded, open source, ready to install
Hyperbrowser MCP Server enables Claude to perform web scraping, crawling, and content extraction through the Model Context Protocol. Developers building AI applications that need to interact with web content will find this particularly valuable.
An MCP server that integrates Crawlbase API for web scraping capabilities into AI agents and code editors like Claude, Cursor, and Windsurf. Developers building AI applications needing reliable web data extraction benefit from this seamless integration.
ReviewWeb.site is an AI-powered website scanner that analyzes web content to provide actionable feedback on SEO, security, mobile-friendliness, and overall quality. It benefits web developers, digital marketers, and website owners who want to improve their online presence.
Driflyte MCP Server is a web-crawler integration for Claude that enables AI models to fetch and process web content through the Model Context Protocol. It's useful for developers building RAG systems, AI agents, and LLM applications that need real-time web data access.