Article Scraper Mcp
About
Article Scraper Mcp is a Model Context Protocol (MCP) server that fetches article data from URLs using the newspaper3k library. It extracts title, text, author, and publication date, providing structured output for use with MCP clients.
Details
- Author
- dmitriiweb
- GitHub stars
- 2
- Downloads
- 391
- Categories
- Automation
Jump to
- Extracts article title, text, author, and publication date
- Robust error handling with URL validation
- Returns structured dictionary output
- Built with FastMCP for easy MCP integration
- Raises clear exceptions for invalid URLs or HTTP failures
Setting up with Highlight
This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:
- Download and install Highlight from highlightai.com/download
- Navigate to the plugins tab and select "Add Custom Plugin"
-
Configure the plugin with the settings below
Plugin Name
Article Scraper McpCommand (node, npx, python, etc.)Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
- Enable "Start Automatically" if you want the plugin to start when Highlight launches
From the repository
Install the package from PyPI with uvx article-scraper-mcp. Add it to your MCP client’s configuration by including a server entry with the command uvx and arguments ["article-scraper-mcp"]. After configuration, invoke the fetch_article tool by passing a URL.
fetch_article
Fetch a news article by URL and return structured data. Args: url: The URL of the news article. Returns: A dict with keys: title, text, author, date. Raises: ValueError: If URL is invalid or article cannot be parsed. requests.RequestException: If HTTP request fails.
Claude Desktop / Cursor
Paste into your MCP client config file to install this server.
{
"mcpServers": {
"article scraper mcp": {
"article-scraper": {
"command": "uvx",
"args": [
"article-scraper-mcp"
]
}
}
}
}McpServers
{
"article-scraper": {
"command": "uvx",
"args": [
"article-scraper-mcp"
]
}
}Article Scraper MCP
A Model Context Protocol (MCP) server that fetches article data from URLs using newspaper3k.
Features
- Extract article title, text, author, and publication date
- Robust error handling and URL validation
- Structured data output
- Built with FastMCP for easy integration
Installation
Install directly from PyPI:
uvx article-scraper-mcp
Usage
Add to your MCP client configuration:
{
"mcpServers": {
"article-scraper": {
"command": "uvx",
"args": ["article-scraper-mcp"]
}
}
}
API
fetch_article(url: str) -> dict[str, Any]
Fetches and parses a news article from the given URL.
Parameters:
- url: The URL of the news article to fetch
Returns:
A dictionary containing:
- title: Article title
- text: Article content text
- author: Author name(s) (may be None)
- date: Publication date in ISO format (may be None)
Raises:
- ValueError: If URL is invalid or article cannot be parsed
- requests.RequestException: If HTTP request fails
Requirements
- Python 3.11+
- newspaper3k
- requests
- loguru
- mcp[cli]
License
MIT
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.
