Iris

by iris-eval

377 downloads

Not rated

GitHub

About

The first MCP-native eval and observability tool for AI agents. Any MCP-compatible agent discovers and uses Iris automatically — no SDK, no code changes. Log traces with hierarchical span trees, evaluate output quality with 12 built-in rules (PII detection, prompt injection, cost

Details

Author: iris-eval
Downloads: 377
Categories: Developer Tools, AI, Infrastructure

- Hierarchical trace logging with per-tool costs in USD
- 12 built-in output evaluation rules (completeness, relevance, safety, cost)
- Real-time web dashboard with dark-mode UI
- Cost visibility with aggregate reports and budget thresholds
- Custom eval rules using Zod schemas
- SQLite storage, queryable instantly

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

Download and install Highlight from highlightai.com/download
Navigate to the plugins tab and select "Add Custom Plugin"
Configure the plugin with the settings below

Plugin Name Iris

Command (node, npx, python, etc.)

Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
Enable "Start Automatically" if you want the plugin to start when Highlight launches

Setting up with Cursor

Open Cursor's settings
Navigate to the MCP section
Click "Add new Global MCP server"
Copy and paste the configuration below based on your operating system

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

Setting up with Claude Desktop

Open Claude Desktop's settings
Go to the Integrations tab
Click "Add MCP Server"
Use the configuration below based on your operating system

Note: Make sure Claude Desktop is running before attempting to connect.

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

Setting up with Windsurf

Open Windsurf's preferences
Go to the Integrations section
Click "Add MCP Integration"
Use the configuration below based on your operating system

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

Setting up with Cline

Open Cline's settings
Navigate to the Integrations section
Click "Add MCP Server"
Copy and paste the configuration below based on your operating system

Note: Make sure to restart Cline after adding the configuration.

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

Setting up with Goose

Open Goose's preferences
Go to the Integrations tab
Select "MCP Servers"
Click "Add New Server"
Use the configuration below based on your operating system

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

From the repository

Add Iris to your MCP config (e.g., Claude Desktop) with "command": "npx", "args": ["@iris-eval/mcp-server"]. To enable the web dashboard, run npx @iris-eval/mcp-server --dashboard and open http://localhost:6920. Iris also supports global npm install, Docker, and HTTP transport with optional API key authentication.

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "iris": {
            "iris": {
                "command": "npx",
                "args": [
                    "-y",
                    "@iris-eval/mcp-server"
                ]
            }
        }
    }
}

McpServers

{
    "iris": {
        "command": "npx",
        "args": [
            "-y",
            "@iris-eval/mcp-server"
        ]
    }
}

Iris won't start /`ERR_MODULE_NOT_FOUND`

You may have a cached older version. Clear the npx cache and retry:

Or install globally to avoid cache issues entirely:

npm install -g @iris-eval/mcp-server@latest

MCP tools only load at session start. After adding iris-eval, restart the session with/clearor relaunch the terminal.

Iris logs its version on the first startup line:

npx @iris-eval/mcp-server --dashboard # First log line: "Starting Iris MCP server vX.Y.Z"

For a global install,npm ls -g @iris-eval/mcp-servershows the installed version.

# If using npx (clears cache and fetches latest) npx --yes @iris-eval/mcp-server@latest # If installed globally npm update -g @iris-eval/mcp-server

Iris requires Node.js 20 or later. Node 18 reached EOL in April 2025 and is not supported.

node --version # Must be v20.x or v22.x+

Claude Code's/doctormay suggest wrapping npx withcmd /c. This is not needed and causes path parsing issues. Usenpxdirectly:

# Correct claude mcp add --transport stdio iris-eval -- npx @iris-eval/mcp-server # Wrong (causes /c to be parsed as a path) claude mcp add --transport stdio iris-eval -- cmd /c "npx @iris-eval/mcp-server"

If Iris is useful to you,](https://github.com/iris-eval/mcp-server/blob/HEAD/docs/roadmap.md)consider starring the repo— it helps others find it.

This is a web browser that enables your coding agent, such as Claude Code, to visit websites on your behalf and assist you in identifying bugs or creating UI test cases.

Create crafted UI components inspired by the best 21st.dev design engineers.

Bring agent evaluations, observability, and synthetic test set generation directly into your IDE for free with Galileo's new MCP server

An MCP server to help AI assistants to answer questions and generate AccelByte Extend SDK code more effectively .

MCP server for AI Diagram Maker — generate beautiful software engineering diagrams directly inside Cursor, Claude Desktop, Claude Code, or any MCP-compatible AI agent

ALAPI MCP Tools,Call hundreds of API interfaces via MCP

AI-powered SVG animation generator that transforms static files into animated SVG components using the Allyson platform

MCP server that gives AI assistants on-demand access to 1,500+ amCharts docs, ~300 code examples, and 1000+ class API references.

APIMatic MCP Server is used to validate OpenAPI specifications using APIMatic. The server processes OpenAPI files and returns validation summaries by leveraging APIMatic’s API.

One shared context layer for AI agents and humans — live API specs, DB schemas, and versioned contracts across repos so every agent and teammate works from the same source of truth.

Build and deploy full-stack Next.js apps with 98 tools for React, AWS, and MongoDB

No reviews yet — be the first

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.

Iris

About

Details

Jump to

Setting up with Highlight

Setting up with Cursor

JSON

JSON

JSON

Setting up with Claude Desktop

JSON

JSON

JSON

Setting up with Windsurf

JSON

JSON

JSON

Setting up with Cline

JSON

JSON

JSON

Setting up with Goose

JSON

JSON

JSON

From the repository

Claude Desktop / Cursor

McpServers

Iris won't start /`ERR_MODULE_NOT_FOUND`

Install

About

Details

Jump to

Setting up with Highlight

From the repository

Claude Desktop / Cursor

McpServers

Iris won't start /ERR_MODULE_NOT_FOUND

Install

More like this

Sentry

Github

Git

GitLab

Context 7

1Panel

Iris won't start /`ERR_MODULE_NOT_FOUND`