Atla
About
Enable AI agents to interact with the [Atla API](https://docs.atla-ai.com/) for state-of-the-art LLMJ evaluation.
Details
- Author
- atla-ai
- Categories
- Developer Tools
Jump to
Setup
Install Atla in your MCP client (Claude Desktop, Cursor, Windsurf, and others).
Repository: https://github.com/atla-ai/atla-mcp-server
Follow the installation instructions in the repository README, then restart your MCP client.
- Evaluate a single LLM response— Score and critique an LLM's answer against a custom evaluation criterion usingevaluate_llm_response.
- Evaluate across multiple criteria— Assess an LLM response on several criteria at once and get per-criterion scores and feedback withevaluate_llm_response_on_multiple_criteria.
[!CAUTION] This repository was archived on July 21, 2025. The Atla API is no longer active.
An MCP server implementation providing a standardized interface for LLMs to interact with the Atla API for state-of-the-art LLMJ evaluation.
Learn more about Atlahere. Learn more about the Model Context Protocolhere.
- evaluate_llm_response: Evaluate an LLM's response to a prompt using a given evaluation criteria. This function uses an Atla evaluation model under the hood to return a dictionary containing a score for the model's response and a textual critique containing feedback on the model's response.
- evaluate_llm_response_on_multiple_criteria: Evaluate an LLM's response to a prompt acrossmultipleevaluation criteria. This function uses an Atla evaluation model under the hood to return a list of dictionaries, each containing an evaluation score and critique for a given criteria.
To use the MCP server, you will need an Atla API key. You can find your existing API keyhereor create a new onehere.
We recommend usinguvto manage the Python environment. Seeherefor installation instructions.
Once you haveuvinstalled and have your Atla API key, you can manually run the MCP server usinguvx(which is provided byuv):
ATLA_API_KEY=<your-api-key> uvx atla-mcp-server
Having issues or need help connecting to another client? Feel free to open an issue orcontact us!
For more details on using the OpenAI Agents SDK with MCP servers, refer to theofficial documentation.
- Use the OpenAI Agents SDK to connect to the server:
import os from agents import Agent from agents.mcp import MCPServerStdio async with MCPServerStdio( params={ "command": "uvx", "args": ["atla-mcp-server"], "env": {"ATLA_API_KEY": os.environ.get("ATLA_API_KEY")} } ) as atla_mcp_server: ...
For more details on configuring MCP servers in Claude Desktop, refer to theofficial MCP quickstart guide.
- Add the following to yourclaude_desktop_config.jsonfile:
{ "mcpServers": { "atla-mcp-server": { "command": "uvx", "args": ["atla-mcp-server"], "env": { "ATLA_API_KEY": "<your-atla-api-key>" } } } }
- Restart Claude Desktopto apply the changes.
You should now see options fromatla-mcp-serverin the list of available MCP tools.
For more details on configuring MCP servers in Cursor, refer to theofficial documentation.
- Add the following to your.cursor/mcp.jsonfile:
{ "mcpServers": { "atla-mcp-server": { "command": "uvx", "args": ["atla-mcp-server"], "env": { "ATLA_API_KEY": "<your-atla-api-key>" } } } }
You should now seeatla-mcp-serverin the list of available MCP servers.
Contributions are welcome! Please see theCONTRIBUTING.mdfile for details.
This project is licensed under the MIT License. See theLICENSEfile for details.
This is a web browser that enables your coding agent, such as Claude Code, to visit websites on your behalf and assist you in identifying bugs or creating UI test cases.
Create crafted UI components inspired by the best 21st.dev design engineers.
Bring agent evaluations, observability, and synthetic test set generation directly into your IDE for free with Galileo's new MCP server
An MCP server to help AI assistants to answer questions and generate AccelByte Extend SDK code more effectively .
MCP server for AI Diagram Maker — generate beautiful software engineering diagrams directly inside Cursor, Claude Desktop, Claude Code, or any MCP-compatible AI agent
ALAPI MCP Tools,Call hundreds of API interfaces via MCP
AI-powered SVG animation generator that transforms static files into animated SVG components using the Allyson platform
MCP server that gives AI assistants on-demand access to 1,500+ amCharts docs, ~300 code examples, and 1000+ class API references.
APIMatic MCP Server is used to validate OpenAPI specifications using APIMatic. The server processes OpenAPI files and returns validation summaries by leveraging APIMatic’s API.
One shared context layer for AI agents and humans — live API specs, DB schemas, and versioned contracts across repos so every agent and teammate works from the same source of truth.
Build and deploy full-stack Next.js apps with 98 tools for React, AWS, and MongoDB
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.
