Description
AI-Cursor-Scraping-Assistant combines Cursor AI with MCP tools to streamline web scraper development for e-commerce sites. Developed by The Web Scraping Club, this implementation provides a structured workflow for website analysis, detection of anti-bot protections, and automated generation of Scrapy or Camoufox scrapers. The server component offers tools for fetching page content, stripping CSS, generating XPath selectors, and creating complete scrapers from templates, while the rule system guides Cursor through the process of analyzing website structure and implementing appropriate scraping strategies for different page types.
Server Details
Added
April 21, 2025
