release-readiness-triage-mcp

Aggregates CI failures and outputs GO/NO_GO release verdicts

Stop reading CI logs. Start getting verdicts.

MCP server that aggregates test failures, cross-references flakiness history, and outputs aGO / CONDITIONAL_GO / NO_GO / INVESTIGATErelease decision — so your AI agent can triage a broken CI run in seconds instead of asking you to read 3000 lines of logs.

In any real codebase, CI always hassomethingfailing. The hard question isn't "are there failures?" — it's"are these failures real regressions, or just the usual noise?"

Answering that requires correlating three signals at once:

- 🔍Error signatures— is this the same failure repeated 12 times, or 12 different problems?
- 📊Flakiness history— is this test known to be unreliable?
- 🔗Code changes— is the failing test actually related to what changed?

An AI agent can't do this without structured tools. Raw CI logs are thousands of lines. Flakiness databases are external. Code→test mapping requires AST analysis. Without this MCP, the agent just guesses.

Groups failures by normalized error signature, deduplicates repeated errors, categorizes asassertion / timeout / network / crash. PasscustomInfraPatternsfor cloud-specific errors.

Scores each failure against your flakiness history:KNOWN FLAKY,MILDLY FLAKY, orNO HISTORY.

Matches changed files against failing tests. Works standalone or with pre-computed affected test lists fromast-impact-mapper-mcp.

- aggregate_risk_score— 0.0–1.0, probability union across all regression risk contributions
- failing_tests_analysis[]— per-regression breakdown withdomain,severity(HIGH/MEDIUM/LOW),risk_contribution,blast_radius

Analyzes historical failures with timestamps to identify chronometric artifacts — failures that only appear at the same UTC hour, weekday, day of month, or during DST transitions. When a pattern is found, the failure is a time artifact, not a code regression.

- temporal_pattern_detected— boolean
- clusters[]— per-test:pattern_type(hourly | daily | monthly | timezone_shift),cluster_times,confidence_score

Scans a repository for versioned migration files (FlywayV*.sql, Prismamigration.sql, Liquibase XML/YAML) and classifies each operation as additive (rollback safe) or destructive (forward-fix only).

Detected destructive operations:DROP TABLE,DROP COLUMN,ALTER COLUMN TYPE,MODIFY COLUMN,TRUNCATE

- rollback_eligible— boolean
- blocking_migrations[]— each withfile,line,operation,reason
- deployment_strategy—standard | forward_fix_only

5 failures in CI. What's real, what's noise?

failures: - Auth Suite > login with expired token → "Expected status 200, got 401" - API Suite > health check → "connect ECONNREFUSED 127.0.0.1:3000" - Button Suite > renders button correctly → "Expected null, got <button>Submit</button>" - Search Suite > debounce timing → "Expected 42, received 43" - Storage Suite > upload avatar → "GCP quota exceeded for this project" changedFiles: ["src/components/Button.tsx"] affectedTests: ["renders button correctly"] customInfraPatterns: ["GCP quota exceeded"] format: "markdown"

## 🔴 Release Recommendation: NO_GO (75% confidence) > 1 confirmed regression(s) in critical domain(s) [payment]. Do not release. Aggregate risk score: 1.0 | Category | Count | | ------------------- | ----- | | Total failures | 5 | | 🔴 Real regressions | 1 | | 🟡 Known flaky | 2 | | ⚪ Infra blips | 2 | | ❓ Unknown | 0 | ### Risk Breakdown | Test | Domain | Severity | Risk | Blast Radius | | -------------------------------------- | ------ | -------- | ---- | ------------ | | Button Suite::renders button correctly | core | MEDIUM | 0.5 | 1 | ### Blockers (must fix before release) Button Suite > renders button correctly - Test is directly affected by code changes in this commit - Expected null, got <button>Submit</button> ### Safe to ignore - ~~Auth Suite > login with expired token~~ — Historically flaky: 73% failure rate in history - ~~API Suite > health check~~ — Error pattern matches infrastructure issues (network) - ~~Search Suite > debounce timing~~ — Mildly flaky: 22% historical failure rate - ~~Storage Suite > upload avatar~~ — Error pattern matches infrastructure issues (network)

One tool call. One verdict. Go fixButton.tsx.

{ "mcpServers": { "release-readiness-triage": { "command": "npx", "args": ["-y", "release-readiness-triage-mcp"] } } }

"Here are the failures from our CI run, our flakiness database, and the files changed in this PR. Is it safe to release?"

The agent callsgenerate_release_recommendationand returns a verdict with a full breakdown — ready to paste into a PR comment or Slack.

Works standalone, or as a meta-orchestrator on top of:

- flakiness-knowledge-graph-mcp— for flakiness history
- ast-impact-mapper-mcp— for code→test correlation
- playwright-trace-decoder-mcp— for trace-level failure analysis

- npm:npmjs.com/package/release-readiness-triage-mcp
- GitHub:github.com/vola-trebla/release-readiness-triage-mcp

The Octopus MCP Server provides your AI assistant with powerful tools that allow it to inspect, query, and diagnose problems within your Octopus instance, transforming it into your ultimate DevOps wingmate.