MCP Client for Ollama (ollmcp)
About
Harness the power of local LLMs with this TUI MCP Client for Ollama. Featuring all core MCP primitives (tools, prompts, resources), agent mode, multi-server, model switching, streaming responses, human-in-the-loop, thinking mode, model params config, system prompts, and saved pre
Details
- Author
- jonigl
- GitHub stars
- 768
- Downloads
- 2,212
- Categories
- Developer Tools, AI
Jump to
- Agent Mode with iterative tool execution and configurable loop limits
- Multi-Server Support and multiple transport types (STDIO, SSE, Streamable HTTP)
- Human-in-the-Loop (HIL) tool execution for safety
- Rich terminal interface with streaming responses and fuzzy autocomplete
- Dynamic model switching and advanced model parameter configuration
- Server hot-reloading and conversation history management
- Support for Ollama (default) and OpenAI-compatible LLM providers
Setting up with Highlight
This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:
- Download and install Highlight from highlightai.com/download
- Navigate to the plugins tab and select "Add Custom Plugin"
-
Configure the plugin with the settings below
Plugin Name
MCP Client for Ollama (ollmcp)Command (node, npx, python, etc.)Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
- Enable "Start Automatically" if you want the plugin to start when Highlight launches
From the repository
Install the package via uv tool install --upgrade ollmcp or pip install --upgrade ollmcp. Add an MCP server with ollmcp mcp add <name> -- <command>, then launch the client by running ollmcp. Use /help inside the interactive session for available commands.
Claude Desktop / Cursor
Paste into your MCP client config file to install this server.
{
"mcpServers": {
"mcp client for ollama (ollmcp)": {
"mcp-client-for-ollama": {
"command": "uv",
"args": [
"tool",
"install",
"--upgrade",
"ollmcp"
]
}
}
}
}
McpServers
{
"mcp-client-for-ollama": {
"command": "uv",
"args": [
"tool",
"install",
"--upgrade",
"ollmcp"
]
}
}
MCP Client for Ollama (ollmcp)
<p align="center">

</p>
<p align="center">
<a href="https://asciinema.org/a/875917" target="_blank">🎥 Watch this demo as an Asciinema recording</a>
</p>
Table of Contents
- Overview
- Features
- Requirements
- Quick Start
- Installation options
- Troubleshooting
- ✨NEW Managing MCP Servers via CLI
- mcp add options
- Scopes
- Command-line Arguments
- MCP Server Configuration
- ✨NEW Inference Provider Configuration
- General Options
- ✨NEW Supported Inference Providers
- API key resolution order
- Usage Examples
- How Tool Calls Work
- Agent Mode
- Interactive Commands
- MCP Tools
- MCP Prompts
- MCP Resources
- ✨NEW Answer Display Modes
- Input Mode
- Model Selection
- Advanced Model Configuration
- ✨NEW Thinking Mode and Reasoning Effort
- Server Reloading for Development
- Human-in-the-Loop (HIL) Tool Execution
- Human-in-the-Loop (HIL) Configuration
- Performance Metrics
- History Management
- Autocomplete and Prompt Features
- Typer Shell Autocompletion
- FZF-style Autocomplete
- MCP Prompts Autocomplete
- Contextual Prompt
- Configuration Management
- ✨NEW Per-provider profiles
- Server Configuration Format
- Tips: Where to Put MCP Server Configs and a Working Example
- Compatible Models
- Ollama Cloud Models
- Where Can I Find More MCP Servers?
- Related Projects
- License
- Acknowledgments
Overview
MCP Client for Ollama (ollmcp) is a modern, interactive terminal application (TUI) built for harness engineering, connecting local Ollama LLMs to one or more Model Context Protocol (MCP) servers. By fully supporting the core MCP primitives (tools, prompts, and resources), it provides a controlled terminal space where you steer, and the agent executes. With a rich, user-friendly interface, it lets you safely manage your setup in real time with no coding required. Whether you're building, testing, or exploring, this client streamlines your workflow with features like fuzzy autocomplete, advanced model configuration, MCP server hot-reloading for rapid development, and strict Human-in-the-Loop safety controls.
Features
- 🤖 Agent Mode: Iterative tool execution when models request multiple tool calls, with a configurable loop limit and interactive choices when the limit is reached (continue, wrap up, or abort)
- 🌐 Multi-Server Support: Connect to multiple MCP servers simultaneously
- 🚀 Multiple Transport Types: Supports STDIO, SSE, and Streamable HTTP server connections
- 📋 MCP Prompts Support: Browse, invoke, and manage prompts from MCP servers with argument collection, preview, and safe rollback
- 📦 MCP Resources Support: Browse and read contextual data from MCP servers including files, documents, and structured data
- ☁️ Ollama Cloud Support: Works seamlessly with Ollama Cloud models for tool calling, enabling access to powerful cloud-hosted models while using local MCP tools
- 🌍 Multiple LLM Providers: Use Ollama (default) or OpenAI-compatible providers (OpenAI, OpenRouter, DeepSeek, etc.), with connection settings remembered per provider
- 🎨 Rich Terminal Interface: Interactive console UI with modern styling
- 🌊 Streaming Responses: View model outputs in real-time as they're generated
- 📝 Answer Display Modes: Switch between Plain, Markdown, Both, or Markdown (blocks) response views while streaming
- 🛠️ Tool Management: Enable/disable specific tools or entire servers during chat sessions
- 🧑💻 Human-in-the-Loop (HIL): Review and approve tool executions before they run for enhanced control and safety
- 🎮 Advanced Model Configuration: Fine-tune 15+ model parameters including context window size, temperature, sampling, repetition control, and more
- 💬 System Prompt Customization: Define and edit the system prompt to control model behavior and persona
- 🧠 Context Window Control: Adjust the context window size (num_ctx) to handle longer conversations and complex tasks
- 🎨 Enhanced Tool Display: Beautiful, structured visualization of tool executions with JSON syntax highlighting
- 🧠 Context Management: Control conversation memory with configurable retention settings
- 🤔 Thinking Mode: Advanced reasoning capabilities with visible thought processes for supported models (e.g., gpt-oss, deepseek-r1, qwen3, etc.)
- 💪 Reasoning Effort Levels: Set reasoning effort to auto, minimal, low, medium, high, or xhigh for supported models
- 🖼️ Vision Tool Support: Images returned by tools are automatically forwarded to vision-capable models
- 🗣️ Cross-Language Support: Seamlessly work with both Python and JavaScript MCP servers
- 📜 History Management: View full conversation history, export to JSON for backup/analysis, and import previous sessions for continuity
- 🔍 Auto-Discovery: Automatically find and use Claude's existing MCP server configurations
- 🔁 Dynamic Model Switching: Switch between any installed Ollama model without restarting
- 💾 Configuration Persistence: Save and load tool preferences and model settings between sessions
- 🔄 Server Reloading: Hot-reload MCP servers during development without restarting the client
- ✨ Fuzzy Autocomplete: Interactive, arrow-key command autocomplete with descriptions
- 🏷️ Dynamic Prompt: Shows current model, thinking mode, and enabled tools
- 📊 Performance Metrics: Detailed model performance data after each query, including duration timings and token counts
- 🔌 Plug-and-Play: Works immediately with standard MCP-compliant tool servers
- 🔔 Update Notifications: Automatically detects when a new version is available
- 🖥️ Modern CLI with Typer: Grouped options, shell autocompletion, and improved help output
- ⏹️ Abort Generation: You can abort model generation at any time by pressing 'a' during response streaming
Requirements
- Python 3.11+ (Installation guide)
- Ollama running locally (Installation guide)
- After installation, run ollama list to see available models. If no models are installed, you can pull one using ollama pull <model_name>. For example, ollama pull gemma4:latest.
- UV package manager (Installation guide)
Quick Start
Install ollmcp via pip, add an MCP server, and run the client:
```bash
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.




