reprompt
About
Prompt analytics MCP server: score prompts, search history, detect leaked credentials, and scan AI coding sessions.
Details
- Author
- reprompt-dev
- Categories
- Developer Tools, Other, Security, AI, Infrastructure
Jump to
Setup
Install reprompt in your MCP client (Claude Desktop, Cursor, Windsurf, and others).
Repository: https://github.com/reprompt-dev/reprompt
Follow the installation instructions in the repository README, then restart your MCP client.
X-ray your AI coding sessions across Claude Code, Cursor, ChatGPT, and 6 more tools. Discover your patterns, find wasted tokens, catch leaked secrets — all locally, nothing leaves your machine.
pip install ctxray ctxray scan # discover prompts from your AI tools ctxray wrapped # your AI coding persona + shareable card ctxray insights # your patterns vs research-optimal ctxray privacy # what sensitive data you've exposed
Drop ctxray into your CI as a prompt quality gate. No LLM, no API key, no network — <50ms per prompt.
# .github/workflows/prompt-quality.yml - uses: ctxray/ctxray@main with: score-threshold: 43 # experimentally validated quality threshold model: claude # model-specific rules (claude/gpt/gemini) comment-on-pr: true
# .pre-commit-config.yaml repos: - repo: https://github.com/ctxray/ctxray rev: v3.0.0 hooks: - id: ctxray-lint-score # fail below quality threshold # or: id: ctxray-lint-claude # Claude-specific rules + threshold
- Deterministic— same prompt, same score, every run. No flaky LLM-based checks.
- Air-gapped— runs in offline and private networks. All analysis stays on your infrastructure.
- Configurable—.ctxray.tomlor[tool.ctxray.lint]in pyproject.toml. Per-project rules.
Full setup:GitHub Action·pre-commit·.ctxray.toml
ctxray wrappedgenerates a Spotify Wrapped-style report of your AI interactions — your persona (Debugger? Architect? Explorer?), top patterns, and a shareable card.
ctxray insightscompares your actual prompting habits against research-backed benchmarks. Are your prompts specific enough? Do you front-load instructions? How much context do you provide?
ctxray privacy --deepscans every prompt you've sent for API keys, tokens, passwords, and PII. See exactly what you've shared with which AI tool.
ctxray check "your prompt"scores, lints, and rewrites in one command — no LLM, <50ms.
Experimentally validated on3000+ LLM calls across 8 models(1.5B → 27B): prompts at or above score43hit ~93% pass rate on executable code tests. Below 43 they average 72% or lower. ctxray tells you which side you're on and what to fix — seeexperiments/RESULTS.mdfor the full cross-model data.
ctxray check "fix the auth bug in login.ts" # threshold pass/fail + diagnostics ctxray check "fix bug" --model claude # model-specific scoring for Claude ctxray check "refactor middleware" --threshold 50 # custom threshold for stricter teams
ctxray rewrite— rule-based prompt improvement
ctxray build— assemble prompts from components
pip install ctxray # core (all features, zero config) pip install ctxray[chinese] # + Chinese prompt analysis (jieba) pip install ctxray[mcp] # + MCP server for Claude Code / Continue.dev / Zed
ctxray install-hook # adds post-session hook to Claude Code
Capture prompts from ChatGPT, Claude.ai, and Gemini directly in your browser. Live quality badge shows prompt tier as you type — click "Rewrite & Apply" to improve and replace the text directly in the input box.
- Install the extensionfromChrome Web StoreorFirefox Add-ons
- Connect to the CLI:ctxray install-extension
- Verify:ctxray extension-status
Captured prompts sync locally via Native Messaging — nothing leaves your machine.
# .github/workflows/prompt-lint.yml name: Prompt Quality on: pull_request jobs: lint: runs-on: ubuntu-latest permissions: pull-requests: write steps: - uses: actions/checkout@v4 - uses: ctxray/ctxray@main with: score-threshold: 43 # experimentally validated (below = 83% failure rate) model: claude # optional: model-specific rules strict: true comment-on-pr: true
# .pre-commit-config.yaml repos: - repo: https://github.com/ctxray/ctxray rev: v3.0.0 hooks: - id: ctxray-lint-score # quality threshold gate (score >= 43) # - id: ctxray-lint-claude # Claude-specific rules + threshold # - id: ctxray-lint-gpt # GPT-specific rules + threshold
ctxray lint --score-threshold 43 # exit 1 below experimentally validated threshold ctxray lint --score-threshold 50 # or set your own bar ctxray lint --model claude # model-specific lint rules ctxray lint --strict # exit 1 on warnings ctxray lint --json # machine-readable output
ctxray init # generates .ctxray.toml with all rules documented
# .ctxray.toml (or [tool.ctxray.lint] in pyproject.toml) [lint] score-threshold = 43 # experimentally validated quality threshold model = "claude" # model-specific rules (claude/gpt/gemini) [lint.rules] min-length = 20 short-prompt = 40 vague-prompt = true debug-needs-reference = true
Scoring is calibrated against 10 peer-reviewed papers covering 30+ features across 5 dimensions:
Cross-validated findings that inform our engine:
- Position bias is architectural— present at initialization, not learned. Front-loading instructions is effective for prompts under 50% of context window (3 papers agree)
- Moderate compression improves output— rule-based filler removal doesn't just save tokens, it enhances LLM performance (2505.00019)
- Prompt quality is independently measurable— prompt-only scoring predicts output quality without seeing the response (ACL 2025,2503.10084)
- Quality threshold at score ~43— our own experiment (30 prompts, 5 tiers, 2 models) found a step function: below 43, 83% failure rate; above 43, 94% success (Pearson r=0.56, Spearman ρ=0.64)
- Format preferences are model-dependent— XML benefits Claude, Markdown benefits GPT, but havinganystructure matters more than the specific format (PromptBridge 2512.01420)
Model-specific scoring (--model claude/gpt/gemini) applies research-backed adjustments for each model's known preferences and sensitivities.
All analysis runs locally in <1ms per prompt. No LLM calls, no network requests.
Data sources: ┌──────────┐ ┌──────────┐ ┌──────────┐ ┌──────────┐ ┌──────────┐ │Claude Code│ │ Cursor │ │ Aider │ │ ChatGPT │ │ 5 more.. │ └─────┬────┘ └─────┬────┘ └─────┬────┘ └─────┬────┘ └─────┬────┘ └─────────────┴───────────┴─────────────┴─────────────┘ │ scan -> dedup -> store -> analyze │ ┌──────────────────┼──────────────────┐ v v v ┌──────────┐ ┌──────────────┐ ┌──────────┐ │ insights │ │ patterns │ │ sessions │ │ wrapped │ │ repetition │ │ projects │ │ style │ │ privacy │ │ agent │ └──────────┘ └──────────────┘ └──────────┘
- Pure rules, no LLM— scoring and rewriting use regex + TF-IDF + research heuristics. Deterministic, private, <1ms per prompt.
- Adapter pattern— each AI tool gets a parser that normalizes to a commonPromptmodel. Adding a new tool = one file.
- Two-layer dedup— SHA-256 for exact matches, TF-IDF cosine similarity for near-dupes.
- Research-calibrated— 10 peer-reviewed papers inform the scoring weights.
ctxray distillscores every turn in a conversation using 6 signals:
- Position— first/last turns carry framing and conclusions
- Length— substantial turns contain more information
- Tool trigger— turns that cause tool calls are action-driving
- Error recovery— turns that follow errors show problem-solving
- Semantic shift— topic changes mark conversation boundaries
- Uniqueness— novel phrasing vs repetitive follow-ups
Session type (debugging, feature-dev, exploration, refactoring) is auto-detected and signal weights adapt accordingly.
AfterPromptfoo joined OpenAIandHumanloop joined Anthropic, ctxray is the independent, open-source alternative for understanding your AI interactions.
- 100% local— your prompts never leave your machine
- No LLM required— pure rule-based analysis, <50ms per prompt
- 9 AI tools— the only tool that works across Claude Code, Cursor, ChatGPT, and more
- Research-backed— calibrated against 10 peer-reviewed papers, not vibes
Previously published asreprompt-cli. Same tool, new name, clean namespace.
- All analysis runs locally. No prompts leave your machine.
- ctxray privacyshows exactly what you've sent to which AI tool.
- Optional telemetry sends only anonymous feature vectors — never prompt text.
- Open source: audit exactly what's collected.
- PyPI:ctxray
- Chrome Extension:Chrome Web Store
- Firefox Add-on:Firefox Add-ons
- Changelog:CHANGELOG.md
SeeCONTRIBUTING.mdfor development setup and guidelines.
This is a web browser that enables your coding agent, such as Claude Code, to visit websites on your behalf and assist you in identifying bugs or creating UI test cases.
AI health, token usage, LLM cost optimization, BYOK vault, and cleanup audits for MCP agents.
MCP server that lets AI agents analyze Claude Code session cost & context attribution — token usage, cached re-reads, and cache writes. Local, read-only.
Behavioral trust layer for the AI agent economy. Check MCP server reliability scores, report interactions, detect anomalies, and discover the most trusted servers. 8 tools, free, real-time.
Behavioral trust scoring for MCP servers and AI agents. Live registry tracking 4,500+ servers with trust scores based on interaction history, success rates, and latency.
Integrates with PostHog for feature flag management and error tracking.
Skene is a codebase analysis toolkit for product-led growth. It scan your codebase, detect growth opportunities, and generate actionable implementation plans.
Remote MCP server (Streamable HTTP) at https://mcp.agenticrail.nz/ — deterministic step-order enforcement for AI agents. evaluate_step returns ALLOW or DENY before a step runs; verify_receipt proves a sequence's Ed25519-signed, hash-chained receipt chain is intact. No auth required: omit the bearer token and calls run on the public demo key. That first clause matters — the form has no "remote/hosted" field, and putting the endpoint in the description is the convention on that list ("Fully REMOTE! Just use…"). The rest mirrors your own server card verbatim, so the listing and the card can't drift.
Paid remote MCP for AI agent run monitoring, failure detection, tool-call incident replay, SLA receipts, and client status exports.
Deterministic security preflight for AI agents. Check URLs, files and shell commands before acting.
EU AI Act compliance scanner for Python AI agents — 10 tools for scanning, analysis, and remediation
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.





