MCP LLMS.txt Explorer
Explore and analyze websites that have implemented the llms.txt standard.
Directory
Explore and analyze websites that have implemented the llms.txt standard.
Official Octoparse MCP server for AI-powered web scraping workflows.
Enables LLMs to interact with web pages through cloud-based browser automation for navigation, screenshot capture, element interaction, and JavaScript…
Automate browser interactions in the cloud (e.g. web navigation, data extraction, form filling, and more)
MCP tools build using selenium to automate web testing or scraping
MCP server for Firecrawl Simple — a web scraping and site mapping tool enabling LLMs to access and process web content
Fetches and caches RSS feeds using a SQLite database for use with LLMs via the MCP protocol.
AI-powered native browser with built-in MCP server. 7 tools for browser automation — navigate, click, fill forms, extract data, run pipelines. ~30 tokens per…
A high-performance x402 intelligence gateway providing 20+ social and web endpoints. Powered by 6-stage routing logic—including cloud-rendered JS fetches…
Spider MCP server: crawl, scrape, search, and automate browsers at scale
Unofficial agentic MCP server for Infomaniak, the Swiss sovereign cloud. 54 tools across web hosting, mail, kDrive, domains, DNS and AI.
Provides browser automation capabilities using Puppeteer and Steel, configurable for local or cloud instances.
SSRF-safe MCP server for fetching URLs — resolves once, validates the IP, and pins the connection so it can't be tricked into hitting cloud metadata or…
Leverage Notte Web AI agents & cloud browser sessions for scalable browser automation & scraping workflows
Multi-session browser MCP for AI agents — stealth mode, session pooling, humanization, 10x fewer tokens than Playwright
<h1 align="center">Crawl4AI RAG MCP Server</h1> <p align="center"> <em>Web Crawling and RAG Capabilities for AI Agents and AI Coding Assistants</em> </p> A…
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
Browser automation capabilities using Puppeteer. This server enables LLMs to interact with web pages through structured accessibility snapshots, bypassing the…
Integrates Jina.ai's Reader API with LLMs for efficient and structured web content extraction, optimized for documentation and web content analysis.
A MCP server providing realistic browser-like HTTP request capabilities with accurate TLS/JA3/JA4 fingerprints for bypassing anti-bot measures. It also…
This MCP server provides tools for interacting with Cloudflare Browser Rendering, allowing you to fetch and process web content for use as context in LLMs…
# Mention MCP Server A Model Context Protocol (MCP) server for integrating with Mention's brand monitoring API. This server enables LLMs to create alerts…
Automate web browsers on Linux using Puppeteer. Enables LLMs to interact with web pages, take screenshots, and execute JavaScript.
Fetches web content from a URL and converts it from HTML to markdown for easier consumption by LLMs.