Web Browser

by blazickjp

28 stars
9.5k downloads
Not rated
GitHub

About

Integrates web browsing capabilities for realtime data retrieval, content extraction, and task automation using popular Python libraries.

Details

Author
blazickjp
Repository
blazickjp/web-browser-mcp-server
GitHub stars
28
Downloads
9,517
License
MIT License
Categories
Web Scraping, Automation, Other, Productivity, Developer Tools, Design, AI, Search, Project Management, Frontend
Tags
#web

> 🌐 Enable AI assistants to browse and extract content from the web through a simple MCP interface.

The Web Browser MCP Server provides AI models with the ability to browse websites, extract content, and understand web pages through the Message Control Protocol (MCP). It enables smart content extraction with CSS selectors and robust error handling.

<div align="center">

🀝 Contribute β€’
πŸ“ Report Bug

</div>

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

  1. Download and install Highlight from highlightai.com/download
  2. Navigate to the plugins tab and select "Add Custom Plugin"
  3. Configure the plugin with the settings below
    Plugin Name Web Browser
    Command (node, npx, python, etc.) uv
    Arguments
    • Argument 1 tool
    • Argument 2 run
    • Argument 3 web-browser-mcp-server
    Environment
    • REQUEST_TIMEOUT 30

    Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.

  4. Enable "Start Automatically" if you want the plugin to start when Highlight launches

From the repository

To install Web Browser Server for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install web-browser-mcp-server --client claude

Install using uv:

uv tool install web-browser-mcp-server

For development:


git clone https://github.com/blazickjp/web-browser-mcp-server.git
cd web-browser-mcp-server

uv venv
source .venv/bin/activate

uv pip install -e ".[test]"

Configure through environment variables:

| Variable | Purpose | Default |
|----------|---------|---------|
| REQUEST_TIMEOUT | Webpage request timeout in seconds | 30 |

browse_webpage

Browse and extract content from web pages. Parameters: url (string), selectors (optional object with CSS selectors for targeting specific content)

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "web browser": {
            "env": {
                "REQUEST_TIMEOUT": "30"
            },
            "args": [
                "tool",
                "run",
                "web-browser-mcp-server"
            ],
            "command": "uv"
        }
    }
}

Linux

{
    "env": {
        "REQUEST_TIMEOUT": "30"
    },
    "args": [
        "tool",
        "run",
        "web-browser-mcp-server"
    ],
    "command": "uv"
}

Macos

{
    "env": {
        "REQUEST_TIMEOUT": "30"
    },
    "args": [
        "tool",
        "run",
        "web-browser-mcp-server"
    ],
    "command": "uv"
}

Windows

{
    "env": {
        "REQUEST_TIMEOUT": "30"
    },
    "args": [
        "tool",
        "run",
        "web-browser-mcp-server"
    ],
    "command": "uv"
}

Twitter Follow
smithery badge
Python Version
License: MIT
PyPI Downloads
PyPI Version

<a href="https://glama.ai/mcp/servers/3hphahzvql">web-browser-mcp-server MCP server</a>

✨ Features

> 🌐 Enable AI assistants to browse and extract content from the web through a simple MCP interface.

The Web Browser MCP Server provides AI models with the ability to browse websites, extract content, and understand web pages through the Message Control Protocol (MCP). It enables smart content extraction with CSS selectors and robust error handling.

<div align="center">

🀝 Contribute β€’
πŸ“ Report Bug

</div>

✨ Core Features

- 🎯 Smart Content Extraction: Target exactly what you need with CSS selectors
- ⚑ Lightning Fast: Built with async processing for optimal performance
- πŸ“Š Rich Metadata: Capture titles, links, and structured content
- πŸ›‘οΈ Robust & Reliable: Built-in error handling and timeout management
- 🌍 Cross-Platform: Works everywhere Python runs

πŸš€ Quick Start

Installing via Smithery

To install Web Browser Server for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install web-browser-mcp-server --client claude

Installing Manually

Install using uv:
uv tool install web-browser-mcp-server

For development:

# Clone and set up development environment
git clone https://github.com/blazickjp/web-browser-mcp-server.git
cd web-browser-mcp-server

Create and activate virtual environment

uv venv source .venv/bin/activate

Install with test dependencies

uv pip install -e ".[test]"

πŸ”Œ MCP Integration

Add this configuration to your MCP client config file:

{
    "mcpServers": {
        "web-browser-mcp-server": {
            "command": "uv",
            "args": [
                "tool",
                "run",
                "web-browser-mcp-server"
            ],
            "env": {
                "REQUEST_TIMEOUT": "30"
            }
        }
    }
}

For Development:

{
    "mcpServers": {
        "web-browser-mcp-server": {
            "command": "uv",
            "args": [
                "--directory",
                "path/to/cloned/web-browser-mcp-server",
                "run",
                "web-browser-mcp-server"
            ],
            "env": {
                "REQUEST_TIMEOUT": "30"
            }
        }
    }
}

πŸ’‘ Available Tools

The server provides a powerful web browsing tool:

browse_webpage

Browse and extract content from web pages with optional CSS selectors:
# Basic webpage fetch
result = await call_tool("browse_webpage", {
    "url": "https://example.com"
})

Target specific content with CSS selectors

result = await call_tool("browse_webpage", { "url": "https://example.com", "selectors": { "headlines": "h1, h2", "main_content": "article.content", "navigation": "nav a" } })

βš™οΈ Configuration

Configure through environment variables:

| Variable | Purpose | Default |
|----------|---------|---------|
| REQUEST_TIMEOUT | Webpage request timeout in seconds | 30 |

πŸ§ͺ Testing

Run the test suite:

python -m pytest

πŸ“„ License

Released under the MIT License. See the LICENSE file for details.

---

<div align="center">

Made with ❀️ by the Pear Labs Team

<a href="https://glama.ai/mcp/servers/04dtxi5i5n">Web Browser MCP Server</a>
</div>29:["$","div",null,{"className":"my-8 pb-8 h-full max-

No reviews yet β€” be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.