Website Downloader
About
Provides a tool to download entire websites using wget. It preserves the website structure and converts links to work locally.
Details
- Author
- pskill9
- Repository
- pskill9/website-downloader
- GitHub stars
- 76
- Downloads
- 22
- Categories
- File Management, Developer Tools, Other, Web Scraping
Jump to
The website downloader:
- Downloads recursively with infinite depth
- Includes all page requisites (CSS, images, etc.)
- Converts links to work locally
- Adds appropriate extensions to files
- Restricts downloads to the same domain
- Preserves the website structure
Setting up with Highlight
Follow these steps to add this server as a custom Highlight plugin:
- Download and install Highlight from highlightai.com/download
- Navigate to the plugins tab and select "Add Custom Plugin"
-
Configure the plugin with the settings below
Plugin Name
Website DownloaderCommand (node, npx, python, etc.)nodeArguments-
Argument 1
/path/to/website-downloader/build/index.js
Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
-
Argument 1
- Enable "Start Automatically" if you want the plugin to start when Highlight launches
From the repository
1. Build the server:
npm install
npm run build
2. Add to MCP settings:
```json
{
"mcpServers": {
"website-downloader": {
"command": "node",
"args": ["/path/to/website-downloader/build/index.js"]
}
}
}
download_website
Downloads an entire website recursively. Parameters: url (required string), outputPath (optional string), depth (optional integer)
Claude Desktop / Cursor
Paste into your MCP client config file to install this server.
{
"mcpServers": {
"website downloader": {
"env": {},
"args": [
"/path/to/website-downloader/build/index.js"
],
"shell": false,
"command": "node"
}
}
}Linux
{
"env": [],
"args": [
"/path/to/website-downloader/build/index.js"
],
"shell": false,
"command": "node"
}Macos
{
"env": [],
"args": [
"/path/to/website-downloader/build/index.js"
],
"shell": false,
"command": "node"
}Windows
{
"env": [],
"args": [
"/c",
"node",
"/path/to/website-downloader/build/index.js"
],
"shell": true,
"command": "cmd"
}Website Downloader MCP Server
This MCP server provides a tool to download entire websites using wget. It preserves the website structure and converts links to work locally.
<a href="https://glama.ai/mcp/servers/egcwr79vu2"></a>
Prerequisites
The server requires wget to be installed on your system.
Installing wget
macOS
Using Homebrew:brew install wget
Linux (Debian/Ubuntu)
sudo apt-get update
sudo apt-get install wget
Linux (Red Hat/Fedora)
sudo dnf install wget
Windows
1. Using Chocolatey:choco install wget
2. Or download the binary from: https://eternallybored.org/misc/wget/
- Download the latest wget.exe
- Place it in a directory that's in your PATH (e.g., C:\Windows\System32)
Usage
The server provides a tool called download_website with the following parameters:
- url (required): The URL of the website to download
- outputPath (optional): The directory where the website should be downloaded. Defaults to the current directory.
- depth (optional): Maximum depth level for recursive downloading. Defaults to infinite. Set to 0 for just the specified page, 1 for direct links, etc.
Example
{
"url": "https://example.com",
"outputPath": "/path/to/output",
"depth": 2 // Optional: Download up to 2 levels deep
}
Features
The website downloader:
- Downloads recursively with infinite depth
- Includes all page requisites (CSS, images, etc.)
- Converts links to work locally
- Adds appropriate extensions to files
- Restricts downloads to the same domain
- Preserves the website structure
Installation
1. Build the server:
npm install
npm run build
2. Add to MCP settings:
```json
{
"mcpServers": {
"website-downloader": {
"command": "node",
"args": ["/path/to/website-downloader/build/index.js"]
}
}
}
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.
