Web Research

by chuanmingliu

10 stars
Not rated
GitHub

About

Enables web browsing capabilities through Google searches and webpage content extraction using Playwright for browser automation and Turndown for HTML-to-Markdown conversion.

Details

Author
chuanmingliu
Repository
chuanmingliu/mcp-webresearch
GitHub stars
10
License
MIT License
Categories
Productivity, Developer Tools, Design, AI, Search, Knowledge Base, Frontend
Tags
#web

- Google search integration
- Webpage content extraction
- Research session tracking (list of visited pages, search queries, etc.)
- Screenshot capture

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

  1. Download and install Highlight from highlightai.com/download
  2. Navigate to the plugins tab and select "Add Custom Plugin"
  3. Configure the plugin with the settings below
    Plugin Name Web Research
    Command (node, npx, python, etc.) npx
    Arguments
    • Argument 1 -y
    • Argument 2 @mzxrai/mcp-webresearch@latest

    Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.

  4. Enable "Start Automatically" if you want the plugin to start when Highlight launches

From the repository

Simply start a chat with Claude and send a prompt that would benefit from web research. If you'd like a prebuilt prompt customized for deeper web research, you can use the agentic-research prompt that we provide through this package. Access that prompt in Claude Desktop by clicking the Paperclip icon in the chat input and then selecting Choose an integrationwebresearchagentic-research.

Example screenshot of web research

pnpm install

search_google

Performs Google searches and extracts results. Arguments: { query: string }

visit_page

Visits a webpage and extracts its content. Arguments: { url: string, takeScreenshot?: boolean }

take_screenshot

Takes a screenshot of the current page. No arguments required.

1. search_google
- Performs Google searches and extracts results
- Arguments: { query: string }

2. visit_page
- Visits a webpage and extracts its content
- Arguments: { url: string, takeScreenshot?: boolean }

3. take_screenshot
- Takes a screenshot of the current page
- No arguments required

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "web research": {
            "cwd": "string (optional)",
            "env": {},
            "args": [
                "-y",
                "@mzxrai/mcp-webresearch@latest"
            ],
            "shell": false,
            "command": "npx"
        }
    }
}

Linux

{
    "cwd": "string (optional)",
    "env": [],
    "args": [
        "-y",
        "@mzxrai/mcp-webresearch@latest"
    ],
    "shell": false,
    "command": "npx"
}

Macos

{
    "cwd": "string (optional)",
    "env": [],
    "args": [
        "-y",
        "@mzxrai/mcp-webresearch@latest"
    ],
    "shell": false,
    "command": "npx"
}

Windows

{
    "cwd": "string (optional)",
    "env": [],
    "args": [
        "/c",
        "npx",
        "-y",
        "@mzxrai/mcp-webresearch@latest"
    ],
    "shell": false,
    "command": "cmd"
}

MCP Web Research Server

A Model Context Protocol (MCP) server for web research.

Bring real-time info into Claude and easily research any topic.

Features

- Google search integration
- Webpage content extraction
- Research session tracking (list of visited pages, search queries, etc.)
- Screenshot capture

Prerequisites

- Node.js >= 18 (includes npm and npx)
- Claude Desktop app

Installation

First, ensure you've downloaded and installed the Claude Desktop app and you have npm installed.

Next, add this entry to your claude_desktop_config.json (on Mac, found at ~/Library/Application\ Support/Claude/claude_desktop_config.json):

{
  "mcpServers": {
    "webresearch": {
      "command": "npx",
      "args": ["-y", "@mzxrai/mcp-webresearch@latest"]
    }
  }
}

This config allows Claude Desktop to automatically start the web research MCP server when needed.

Usage

Simply start a chat with Claude and send a prompt that would benefit from web research. If you'd like a prebuilt prompt customized for deeper web research, you can use the agentic-research prompt that we provide through this package. Access that prompt in Claude Desktop by clicking the Paperclip icon in the chat input and then selecting Choose an integrationwebresearchagentic-research.

Example screenshot of web research

Tools

1. search_google
- Performs Google searches and extracts results
- Arguments: { query: string }

2. visit_page
- Visits a webpage and extracts its content
- Arguments: { url: string, takeScreenshot?: boolean }

3. take_screenshot
- Takes a screenshot of the current page
- No arguments required

Prompts

agentic-research

A guided research prompt that helps Claude conduct thorough web research. The prompt instructs Claude to: - Start with broad searches to understand the topic landscape - Prioritize high-quality, authoritative sources - Iteratively refine the research direction based on findings - Keep you informed and let you guide the research interactively - Always cite sources with URLs

Resources

We expose two things as MCP resources: (1) captured webpage screenshots, and (2) the research session.

Screenshots

When you take a screenshot, it's saved as an MCP resource. You can access captured screenshots in Claude Desktop via the Paperclip icon.

Research Session

The server maintains a research session that includes:
- Search queries
- Visited pages
- Extracted content
- Screenshots
- Timestamps

Suggestions

For the best results, if you choose not to use the agentic-research prompt when doing your research, it may be helpful to suggest high-quality sources for Claude to use when researching general topics. For example, you could prompt news today from reuters or AP instead of news today.

Problems

This is very much pre-alpha code. And it is also AIGC, so expect bugs.

If you run into issues, it may be helpful to check Claude Desktop's MCP logs:

tail -n 20 -f ~/Library/Logs/Claude/mcp*.log

Development

```bash

No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.