UI Explorer MCP Server
About
MCP Server for tools to explore the UI on your computer.
Details
- Author
- modularflow
- Downloads
- 184
- Categories
- Other
Jump to
- Explore UI hierarchies across screen regions
- Take screenshots with highlighted UI boundaries
- Click at screen coordinates programmatically
- Send keyboard input and shortcuts
- Record and playback UI workflows as macros
Setting up with Highlight
This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:
- Download and install Highlight from highlightai.com/download
- Navigate to the plugins tab and select "Add Custom Plugin"
-
Configure the plugin with the settings below
Plugin Name
UI Explorer MCP ServerCommand (node, npx, python, etc.)Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
- Enable "Start Automatically" if you want the plugin to start when Highlight launches
From the repository
Install the package via pip install mcp-ui-explorer or clone the repository. Then, configure your MCP client (e.g., Roo in Cursor or Claude Desktop) with the server command uvx mcp-ui-explorer. Use the provided MCP tools like explore_ui, screenshot_ui, and click_ui_element to scan and control UI elements.
Claude Desktop / Cursor
Paste into your MCP client config file to install this server.
{
"mcpServers": {
"ui explorer mcp server": {
"mcp-ui-explorer": {
"command": "python",
"args": [
"record_macro.py",
"--name",
"Login Workflow"
]
}
}
}
}McpServers
{
"mcp-ui-explorer": {
"command": "python",
"args": [
"record_macro.py",
"--name",
"Login Workflow"
]
}
}UI Explorer MCP Server
An MCP server that provides tools for exploring and interacting with UI elements on your screen.
Features
- Explore UI hierarchies: Scan and analyze all UI elements on your screen
- Screenshot UI with highlights: Visualize UI elements with boundaries and hierarchy
- Control mouse clicks: Click on UI elements based on coordinates
- Explore specific regions: Focus on parts of the screen like top-left, center, etc.
- 🎬 Macro Recording: Record and playback UI workflows independently or through MCP
🚀 Quick Start: Standalone Macro Recording
New! You can now record UI workflows without running the MCP server:
```bash
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.
