Multimodal Model Context Protocal Server

by pixeltable

308 downloads
Not rated
GitHub

About

Integrates with Pixeltable for multimodal data indexing and querying. Provides multiple server implementations for audio, video, images, and documents, orchestrated with Docker. Designed for developers needing semantic search and RAG capabilities.

Details

Author
pixeltable
Downloads
308
Categories
Other

- Audio indexing with transcription and semantic search
- Video indexing with frame extraction and content-based search
- Image indexing with object detection and similarity search
- Document indexing with text extraction and RAG support
- Multi-index support for collections
- Docker orchestration for local development

Install Pixeltable, clone the repository, and run docker-compose up --build from the servers/ directory. Each service runs on a designated port (audio on 8080, video on 8081, image on 8082, document on 8083).

Multimodal Model Context Protocal Server

<p align="center">
Python Version
License
Status
</p>

This repository contains a collection of server implementations for Pixeltable, designed to handle multimodal data indexing and querying (audio, video, images, and documents). These services are orchestrated using Docker for local development.

🚀 Available Servers

Audio Index Server

Located in servers/audio-index/, this server provides: - Audio file indexing with transcription capabilities - Semantic search over audio content - Multi-index support for audio collections - Accessible at /audio endpoint

Video Index Server

Located in servers/video-index/, this server provides: - Video file indexing with frame extraction - Content-based video search - Accessible at /video endpoint

Image Index Server

Located in servers/image-index/, this server provides: - Image indexing with object detection - Similarity search for images - Accessible at /image endpoint

Document Index Server

Located in servers/doc-index/, this server provides: - Document indexing with text extraction - Retrieval-Augmented Generation (RAG) support - Accessible at /doc endpoint

Base SDK Server

Located in servers/base-sdk/, this server provides: - Core functionality for Pixeltable integration - Foundation for building specialized servers

📦 Installation

Local Development

pip install pixeltable
git clone https://github.com/pixeltable/mcp-server-pixeltable.git

cd mcp-server-pixeltable/servers

docker-compose up --build # Run locally with docker-compose
docker-compose down # Take down resources

🔧 Configuration

- Each service runs on its designated port (8080 for audio, 8081 for video, 8082 for image, 8083 for doc). - Configure service settings in the respective Dockerfile or through environment variables.

🔗 Links

- Pixeltable GitHub - Pixeltable Documentation - Discord Community

📞 Support

- GitHub Issues: Report bugs or request features - Discord: Join our community

📜 License

This project is licensed under the Apache 2.0 License.
No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.