Render-fetch

by sub-techie09

Not rated
GitHub

About

Drop-in upgrade to Claude's WebFetch that auto-detects JS-rendered pages and fetches them with Playwright headless browser

Details

Author
sub-techie09
Categories
Web Scraping, Automation, Other

Setup

Install Render-fetch in your MCP client (Claude Desktop, Cursor, Windsurf, and others).

Repository: https://github.com/sub-techie09/render-fetch

Follow the installation instructions in the repository README, then restart your MCP client.

Drop-in upgrade to Claude Code's WebFetch — handles JS-rendered pages automatically.

Claude's built-inWebFetchdoesn't execute JavaScript. Modern SPAs return empty skeletons.render-fetchauto-detects whether a page needs a real browser and routes accordingly — no config needed.

Add to your Claude Code settings (~/.claude/settings.json):

{ "mcpServers": { "render-fetch": { "command": "npx", "args": ["-y", "render-fetch"] } } }

First run installs Chromium (~150MB, one-time). Subsequent runs are instant.

URL in │ ├─ GET page (fast, reuses response) │ ├─ Score for JS-rendering signals │ <div id="root/app/__next"> +3 │ thin body (<500 chars) +2 │ data-reactroot / ng-version +2 │ window.__REDUX_STATE__ +2 │ bundled JS patterns +1 │ .md / docs domain -3 │ ├─ Score < 3 → Static path │ HTTP → cheerio → Readability → markdown │ └─ Score ≥ 3 → Browser path Playwright headless → networkidle → Readability → markdown

Why not always use the browser?Static path averages ~200ms. Browser path averages 2–3s plus Chromium launch overhead on first request.

- DNS rebinding: hostname validation happens before the request; a malicious server could theoretically redirect to a private IP after validation. Mitigation planned for v1.1.
- Local use only: not designed for multi-tenant server deployments. For that, put a rate-limiting reverse proxy in front.
- Chromium install: ~150MB one-time download on first browser-mode request.

A browser screenshot tool to capture scrolling screenshots of webpages using Playwright, with support for intelligent section identification and multiple output formats.

Take screenshots and read console logs from web pages using Playwright.

CloakBrowser MCP server for AI agents: Playwright-powered browsing, clean tool forwarding, Docker support, and multi-session HTTP transport.

Control a browser for web automation tasks using Playwright on Cloudflare Workers.

Control a browser for web automation tasks like navigation, typing, clicking, and taking screenshots using Playwright on Cloudflare Workers.

Fetch and extract web content using a Playwright headless browser, with support for intelligent extraction and flexible output.

Query financial web tables from sources like iwencai, tdx, and eastmoney using Playwright.

A production-ready web scraping platform with ML-powered automation, browser automation via Playwright, and persistent caching.

Control a browser for automation and web scraping tasks using Playwright.

No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.