Intercept
About
Give your AI the ability to read the web. Fetches URLs as clean markdown with 9 fallback strategies. Handles tweets, YouTube, arXiv, PDFs, and regular pages.
Details
- Author
- bighippoman
- Downloads
- 301
- Categories
- Web Scraping, Other, AI
Jump to
- No API keys required.
- Handles tweets, YouTube, arXiv, PDFs, and regular web pages.
- Automatic fallback up to 8 retry strategies.
- Single command install.
- Works with multiple MCP clients.
- Gives AI the ability to read web content.
Setting up with Highlight
This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:
- Download and install Highlight from highlightai.com/download
- Navigate to the plugins tab and select "Add Custom Plugin"
-
Configure the plugin with the settings below
Plugin Name
InterceptCommand (node, npx, python, etc.)Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
- Enable "Start Automatically" if you want the plugin to start when Highlight launches
From the repository
Install with one command: npx -y intercept-mcp. After installation, the AI can read web content automatically when prompted. If the first reading strategy fails, Intercept automatically tries up to eight more strategies before giving up.
fetch
Fetch a URL and return its content as clean markdown. Handles Twitter/X tweets, YouTube videos (with transcripts), arXiv papers, PDFs, Wikipedia articles, and GitHub repos/files/issues/PRs/releases directly. Direct image URLs (png/jpeg/gif/webp) are returned as an image block for vision. Otherwise checks a shared cache, then falls back through a multi-tier chain: Jina Reader, web archives (Wayback, archive.ph, Arquivo.pt), raw fetch, RSS, CrossRef, Semantic Scholar, HackerNews, Reddit, OG meta. Long pages are truncated at maxLength characters — paginate with startIndex. Results are cached for the session; pass noCache to force a live fetch.
fetch_batch
Fetch up to 10 URLs in parallel and return each as clean markdown. Same handler/fallback chain as the fetch tool, with a smaller per-URL length budget. Use after a search to pull several sources in one call.
research
Search the web and fetch the content of the top results in one call. Returns the full content of each result as markdown, ready to summarize or compare. Use this instead of separate search + fetch calls when researching a topic.
search
Search the web and return results. Uses Brave Search API if BRAVE_API_KEY is set, otherwise falls back to SearXNG and then DuckDuckGo. Supports domain filtering (site), freshness, and pagination (page).
extract
Extract specific values from a web page as JSON instead of markdown prose. Provide CSS selectors to pull named fields (text or an attribute, first match or all), and/or set tables:true to convert every HTML table to arrays of row objects. Use this when you need particular data (prices, lists, specs, tabular data) rather than the whole page. Honors per-domain auth and proxies.
Claude Desktop / Cursor
Paste into your MCP client config file to install this server.
{
"mcpServers": {
"intercept": {
"intercept": {
"command": "npx",
"args": [
"-y",
"intercept-mcp"
]
}
}
}
}McpServers
{
"intercept": {
"command": "npx",
"args": [
"-y",
"intercept-mcp"
]
}
}Per-domain authentication (INTERCEPT_AUTH)
It's a JSON object mapping a domain to a header map. A domain also matches its subdomains:
Security model — read this before using it
For reliable search, self-host SearXNG with Docker. A config is included in the](https://github.com/3proxy/3proxy)repo:
git clone https://github.com/bighippoman/intercept-mcp.git cd intercept-mcp/searxng && docker compose up -d
Then setSEARXNG_URL=http://localhost:8888. No rate limits, no CAPTCHAs, aggregates Google + Bing + DuckDuckGo + Wikipedia + Brave.
Or use any existing SearXNG instance — just setSEARXNG_URLto its URL.
Incoming URLs are automatically cleaned:
- Strips 60+ tracking params (UTM, click IDs, analytics, A/B testing, etc.)
- Removes hash fragments
- Upgrades to HTTPS
- Cleans AMP artifacts
- Preserves functional params (ref,format,page,offset,limit)
Agents pass URLs taken from untrusted web content, so the fetch tools refuse anything pointing at local or internal infrastructure: loopback and private IPv4/IPv6 ranges, link-local addresses (including the169.254.169.254cloud metadata endpoint), CGNAT, multicast/reserved ranges, and local hostnames (localhost,.local,.internal,*.home.arpa). Literal IPs are checked, including alternate notations (decimal, hex) normalized by the URL parser; DNS is not resolved, so public hostnames pointing at private IPs are not caught.
Each fetcher result is scored for quality. Automatic fail on:
- CAPTCHA / Cloudflare challenges
- Login walls
- HTTP error pages in body
- Content under 200 characters
- Node.js >= 20
- No API keys required for basic use
Extracts information from YouTube videos and channels using the YouTube Data API.
Retrieves transcripts from YouTube videos for content analysis and processing.
YouTube transcript API for AI agents - pay per successful transcript via x402 (USDC on Base); failed videos are never charged
Remote MCP that scrapes customer comments and reviews from Reddit, YouTube, Amazon, TikTok, app stores, and 25+ other platforms, then turns them into ad angles and customer language for marketers.
AI-powered Business Helper that analyzes thousands of YouTube videos to extract precise insights, timestamps, and actionable strategies. Instantly find the most relevant moments from podcasts, interviews, and lectures—turning long-form content into targeted business intelligence.
100% Free AI audio and video transcription with speaker diarization and YouTube support.
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.
