meGPT - upload an author's content into an LLM
About
Code to process many kinds of content by an author into an MCP server
Details
- Author
- adrianco
- GitHub stars
- 287
- Downloads
- 684
- Categories
- AI
Jump to
- Supports books, blogs, Twitter archives, podcasts, and videos.
- Includes an MCP server with semantic search and filtering.
- Automatically detects and processes YouTube videos, playlists, and channels.
- Handles Medium and Blogger archive extraction.
- Generates MCP resources for any author directory.
- Supports STDIO, HTTP, and SSE transports.
Setting up with Highlight
This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:
- Download and install Highlight from highlightai.com/download
- Navigate to the plugins tab and select "Add Custom Plugin"
-
Configure the plugin with the settings below
Plugin Name
meGPT - upload an author's content into an LLMCommand (node, npx, python, etc.)Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
- Enable "Start Automatically" if you want the plugin to start when Highlight launches
From the repository
Clone the repository, set up a Python virtual environment, and install dependencies. Run python build.py <author> to process content, then start the MCP server with python mcp_server.py --author <author> for STDIO mode or --transport streamable-http --port 8080 for HTTP.
Claude Desktop / Cursor
Paste into your MCP client config file to install this server.
{
"mcpServers": {
"megpt - upload an author's content into an llm": {
"meGPT": {
"command": "python",
"args": [
"mcp_server.py",
"--author",
"virtual_adrianco"
]
}
}
}
}
McpServers
{
"meGPT": {
"command": "python",
"args": [
"mcp_server.py",
"--author",
"virtual_adrianco"
]
}
}
meGPT - upload an author's content into an LLM
I have 20 years of public content I've produced and presented over my career, and I'd like to have an LLM that is trained to answer questions and generate summaries of my opinions, in my "voice", At this point, I've found a few companies that are building persona's and tried out soopra.ai. To encourage development and competition in this space I have organized my public content and references to sources in this repo.
My own content is stored or linked to in authors/virtual_adrianco and consists of:
- 4 published books (pdf of two provided), ~10 forewords to books, ~100 blog posts (text)
- Twitter archive 2008-2022 (conversation text)
- Mastodon.social - 2021-now https://mastodon.social/@adrianco (RSS at https://mastodon.social/@adrianco.rss)
- Github projects (code)
- Blog posts from https://adrianco.medium.com extracted as text to authors/virtual_adrianco/medium_posts (with extraction script)
- Blog posts from https://perfcap.blogspot.com extracted as text to authors/virtual_adrianco/blogger_percap_posts (with extraction script)
- ~100 presentation decks (images) greatest hits: https://github.com/adrianco/slides/tree/master/Greatest%20Hits
- ~20 podcasts (audio conversations, should be good Q&A training material)
- over 135 videos of talks and interviews (audio/video/YouTube individual videos, playlists, and entire channels)
If another author wants to use this repo as a starting point, clone it and add your own directory of content under authors. If you want to contribute the content freely for other people to use as a training data set, then send a pull request and I'll include it here. The scripts in the code directory are there to help pre-process content for an author by extracting from a twitter or medium archive that has to be downloaded by the account owner.
Creative Commons - attribution share-alike. Permission explicitly granted for anyone to use as a training set to develop the meGPT concept. Free for use by any author/speaker/expert resulting in a Chatbot that can answer questions as if it was the author, with reference to published content. I have called my own build of this virtual_adrianco - with opinions on cloud computing, sustainability, performance tools, microservices, speeding up innovation, Wardley mapping, open source, chaos engineering, resilience, Sun Microsystems, Netflix, AWS etc. etc. I'm happy to share any models that are developed. I don't need to monetize this, I'm semi-retired and have managed to monetize this content well enough already, I don't work for a big corporation any more..
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.
