ci: gate the qa/ release-gate + scoring tests (closes #729) - #737
Conversation
The 'test' job only collected servers/*/tests/ — qa/test_*.py was NEVER run in CI, so a *tested* crash (#723 build_shas, caught by test_release_readiness.py's 4 build_sha tests) merged green and shipped, surfacing only when the live RRI rollup crashed. Add a qa-release-gate-tests job running the release-authority surface: test_release_readiness, test_release_readiness_scope, test_scores_db_comparability, test_scores_db, test_release_gate_static (67 tests, validated locally via the engine venv). A regression in release_readiness.py / scores_db.py can no longer merge green. Closes #729.
|
Warning Review limit reached
More reviews will be available in 13 minutes and 51 seconds. Learn how PR review limits work. Your organization has run out of usage credits. Purchase more in the billing tab. ⌛ How to resolve this issue?After more reviews become available, a review can be triggered using the We recommend that you space out your commits to avoid hitting the rate limit. 🚦 How do rate limits work?CodeRabbit enforces hourly rate limits for each developer per organization. Our paid plans include higher PR review limits than trial, open-source, and free plans. In all cases, reviews become available again over time. During sustained high-volume PR review activity, CodeRabbit may temporarily slow when the next review becomes available. Please see our Fair Usage Limits Policy for further information. ℹ️ Review info⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (1)
Comment |
|
Review the following changes in direct dependencies. Learn more about Socket for GitHub.
|
1 participant
Closes #729. The CI
testjob only ranservers/*/tests/—qa/test_*.pywas never gated, so the #723build_shascrash (caught by 4 tests intest_release_readiness.py) shipped green. Adds aqa-release-gate-testsjob over the release-authority surface (67 tests; validated locally). Part of the v1.0.4 velocity workstream.