Artificial Analysis

by davidhariri

625 downloads
Not rated
GitHub

About

I built this to give my AI assistants the latest information on model performance benchmarks provided by https://artificialanalysis.ai to make informed decisions on model choice.

Details

Author
davidhariri
Downloads
625
Categories
Developer Tools, API, Other, AI

- List and filter 300+ LLM models by creator and metric
- Get real-time pricing (input/output/blended per 1M tokens)
- Compare speed metrics (tokens/sec, time to first token)
- Access benchmark scores (Intelligence Index, Coding Index, etc.)
- Sort models by any metric (price, speed, benchmarks, release date)

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

  1. Download and install Highlight from highlightai.com/download
  2. Navigate to the plugins tab and select "Add Custom Plugin"
  3. Configure the plugin with the settings below
    Plugin Name Artificial Analysis
    Command (node, npx, python, etc.)

    Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.

  4. Enable "Start Automatically" if you want the plugin to start when Highlight launches

From the repository

Install via npx with your API key set as the AA_API_KEY environment variable, or add the server to your Claude configuration file (settings.json). Use tools like list_models and get_model to fetch and filter model data by creator, metric, or benchmark.

list_models

List all available LLM models from Artificial Analysis with pricing, speed, and benchmark data. Filter by creator (OpenAI, Anthropic, Google, etc.) and sort by price, speed, or benchmark scores.

get_model

Get detailed information about a specific LLM model including pricing (input/output/blended per 1M tokens), speed metrics (tokens/sec, TTFT), and benchmark scores (Intelligence Index, Coding Index, MMLU-Pro, GPQA, etc.).

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "artificial analysis": {
            "artificial-analysis": {
                "command": "npx",
                "args": [
                    "-y",
                    "artificial-analysis-mcp"
                ],
                "env": {
                    "AA_API_KEY": "your-api-key"
                }
            }
        }
    }
}

McpServers

{
    "artificial-analysis": {
        "command": "npx",
        "args": [
            "-y",
            "artificial-analysis-mcp"
        ],
        "env": {
            "AA_API_KEY": "your-api-key"
        }
    }
}

Artificial Analysis MCP Server

An MCP (Model Context Protocol) server that provides LLM model pricing, speed metrics, and benchmark scores from Artificial Analysis.

Features

- Get real-time pricing for 300+ LLM models (input/output/blended rates)
- Compare speed metrics (tokens/sec, time to first token)
- Access benchmark scores (Intelligence Index, Coding Index, MMLU-Pro, GPQA, and more)
- Filter by provider (OpenAI, Anthropic, Google, etc.)
- Sort by any metric

Installation

Claude Code

claude mcp add artificial-analysis -e AA_API_KEY=your-key -- npx -y artificial-analysis-mcp

Or install from GitHub:

claude /mcp add https://github.com/davidhariri/artificial-analysis-mcp

Manual Configuration

Add to your Claude settings (~/.claude/settings.json):

{
  "mcpServers": {
    "artificial-analysis": {
      "command": "npx",
      "args": ["-y", "artificial-analysis-mcp"],
      "env": {
        "AA_API_KEY": "your-api-key"
      }
    }
  }
}

Configuration

| Environment Variable | Required | Description |
|---------------------|----------|-------------|
| AA_API_KEY | Yes | Your Artificial Analysis API key |

Get your API key at artificialanalysis.ai.

Tools

list_models

List all available LLM models with optional filtering and sorting.

Parameters:

| Name | Type | Required | Description |
|------|------|----------|-------------|
| creator | string | No | Filter by model creator (e.g., "OpenAI", "Anthropic") |
| sort_by | string | No | Sort field (see below) |
| sort_order | string | No | "asc" or "desc" (default: "desc") |
| limit | number | No | Maximum results to return |

Sort fields: price_input, price_output, price_blended, speed, ttft, intelligence_index, coding_index, math_index, mmlu_pro, gpqa, release_date

Example usage:
- "List the top 5 fastest models"
- "Show me Anthropic models sorted by price"
- "What are the cheapest models with high intelligence scores?"

get_model

Get detailed information about a specific model.

Parameters:

| Name | Type | Required | Description |
|------|------|----------|-------------|
| model | string | Yes | Model name or slug (e.g., "gpt-4o", "claude-4-5-sonnet") |

Returns: Complete model details including pricing, speed metrics, and all benchmark scores.

Example usage:
- "Get pricing for GPT-4o"
- "What are Claude 4.5 Sonnet's benchmark scores?"

Model Data

Each model includes:

- Pricing: Input/output/blended rates per 1M tokens (USD)
- Speed: Output tokens per second, time to first token
- Benchmarks: Intelligence Index, Coding Index, Math Index, MMLU-Pro, GPQA, LiveCodeBench, and more

Development

```bash

No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.