Quorel - Web Data MCP

by var-raphael

261 downloads
Not rated
GitHub

About

Quorel turns any public website into a versioned, queryable API. Define a schema once in plain English, and Quorel extracts, structures, and refreshes the data nightly, full version history, diffs, and rollback included. The MCP server lets Claude or any agent browse datasets, qu

Details

Author
var-raphael
Downloads
261
Categories
Search, Web Scraping, AI

- Schema-first extraction — describe fields in plain English
- Nightly automatic refresh plus on-demand ping URL
- Immutable version history with diff viewer and rollback
- Export to JSON, JSONL, CSV, TSV, XML, or Parquet
- Webhook notifications on dataset refresh completion
- Clone and extend any public marketplace dataset

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

  1. Download and install Highlight from highlightai.com/download
  2. Navigate to the plugins tab and select "Add Custom Plugin"
  3. Configure the plugin with the settings below
    Plugin Name Quorel - Web Data MCP
    Command (node, npx, python, etc.)

    Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.

  4. Enable "Start Automatically" if you want the plugin to start when Highlight launches

From the repository

Use an MCP-compatible agent (e.g., Claude) and invoke the provided MCP tools. Key tools include list_datasets, get_dataset_schema, query_dataset, pull_for_edit, update_entity, delete_entity, push_alt_version, and append_alt_version. No scraping scripts or manual cleaning are needed — all interactions happen via natural language or structured queries.

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "quorel - web data mcp": {
            "quorel": {
                "url": "https://quorel.onrender.com/mcp/<YOUR_TOKEN>/sse",
                "transport": "sse"
            }
        }
    }
}

McpServers

{
    "quorel": {
        "url": "https://quorel.onrender.com/mcp/<YOUR_TOKEN>/sse",
        "transport": "sse"
    }
}

Quorel — The source of truth for the live web

Quorel turns any public website into a clean, versioned, queryable API. Define what data you want once in plain English, and Quorel fetches it, structures it against your schema, and refreshes it automatically every night. No scrapers to maintain, no cleaning scripts, no dirty surprises.

Every Quorel dataset ships with a native MCP server included on every plan, so Claude or any MCP-compatible agent can browse, filter, clean, and edit your data conversationally — without you writing a single script.

Features

- Schema-first extraction — describe the fields you want in plain English, Quorel maps web content to them precisely
- Nightly automatic refresh, plus on-demand refresh via a dedicated ping URL
- Immutable version history with full diff viewer and one-click rollback
- Export to JSON, JSONL, CSV, TSV, XML, or Parquet
- Webhook notifications when a dataset finishes refreshing
- Clone and extend any public dataset from the marketplace

MCP Tools

| Tool | What it does |
|---|---|
| list_datasets | List all datasets owned by the authenticated user |
| get_dataset_schema | Inspect a dataset's fields and version metadata |
| query_dataset | Filter, sort, dedupe, and paginate entities; export in any format |
| get_entity | Fetch a single entity by index |
| pull_for_edit | Pull the full entity list for agent-driven cleanup |
| update_entity | Patch a single entity's fields in the alt version |
| delete_entity | Remove one or more entities from the alt version |
| push_alt_version | Publish a cleaned/processed batch as the alt version |
| append_alt_version | Append a processed batch to an existing alt version |

Example

``
query_dataset(dataset_id: 142, keywords: "senior remote", sort: "salary:desc", limit: 5)
→ 47 entities matched, returned as JSON sorted by salary

pull_for_edit(dataset_id: 142, use_alt: false)
→ Claude reviews 1,204 entities, dedupes and fixes null fields

push_alt_version(dataset_id: 142, version: 3, entities: [...])
→ live at /remote-jobs/v3/alt
``

Links

- Product: quorel.vercel.app
- Docs: quorel.vercel.app/docs
- GitHub: var-raphael/QUOREL

No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.