Simplescraper MCP

extract_urlsreads a site's sitemap and returns every page URL without using any credits. It's a natural first step - map a site, then pointsmart_extractor a recipe at the pages that matter.
- Open Claude Desktop settings
- Navigate to Settings (bottom-left) → Integrations
- Click "Add MCP Server"
- Enter these details:

- Name: Simplescraper

- URL:https://mcp.simplescraper.io/mcp

Integrations are currently available on the Max plan, with broader availability coming soon.

Cursor supports MCP with OAuth authentication. When you add the server, Cursor will open a browser window for you to log in with your Simplescraper account.
- Create~/.cursor/mcp.jsonin your home directory
- Add this configuration:

{ "mcpServers": { "simplescraper": { "url": "https://mcp.simplescraper.io/mcp" } } }

- When you toggle the server on in Cursor, it will prompt you to authenticate with your Simplescraper account

For tools specific to a project, create a.cursor/mcp.json file in your project directory:
- Create.cursor/mcp.jsonin your project root
- Use the same JSON configuration as above
- The server will only be available in that project
- Open Cursor Settings (Ctrl/Cmd +,)
- Navigate to MCP in the sidebar
- Click "Add Server"
- Enter:

- Name: Simplescraper

- URL:https://mcp.simplescraper.io/mcp

Do not add an Authorization header manually

Cursor handles authentication automatically through OAuth. Adding"headers": {"Authorization": "Bearer ..."}with your API key will prevent the login flow from working. Use the config above with just the URL.

Most AI applications that support MCP will have a similar setup process. Look for MCP or "Tools" settings and add our server URL:https://mcp.simplescraper.io/mcp

Simplescraper exposes 13 tools your LLM can call to scrape sites and manage your recipes.

"Find all product pages on example.com/shop, add them to my product scraper recipe, and run the scrape."

Claude will parse the sitemap, filter URLs to match your description (e.g. paths containing/product/), update the batch URL list, and execute the recipe.

"Check my Amazon price tracker recipe. If prices have changed by more than 10% since the last run, create a summary report of the changes."

"Find all recipes that haven't run in the last week, run them, and summarize any that return errors."

"Get the latest results from my job listings scraper and format them as a markdown table sorted by salary."

Enable AI agents to get structured data from unstructured web with AgentQL.

Easy web data access. Simplified retrieval of information from websites and online sources.

Turn websites into datasets with Scrapezy

Scrapfly MCP Server gives AI agents a simple, unified way to scrape live web data with built-in anti-bot handling.

Interact with WebScraping.AI for web data extraction and scraping.

Retrieve structured data through natural language conversations

CrawlForge MCP is a production-ready MCP server with 18 web scraping tools for AI agents. It gives Claude, Cursor, and any MCP-compatible client the ability to fetch URLs, extract structured data with CSS/XPath selectors, run deep multi-step research, bypass anti-bot detection with TLS fingerprint randomization, process documents, monitor page changes, and more. Credit-based pricing with a free tier (1,000 credits/month, no credit card required).

A high-performance x402 intelligence gateway providing 20+ social and web endpoints. Powered by 6-stage routing logic—including cloud-rendered JS fetches, residential IP rotation, and automatic settlement refunds for blocked hosts. Built for AI Agents that require reliable, pay-per-request access to LinkedIn, Reddit, Instagram, and beyond without API key management