Skip to content

fix(rri): restore main()'s build_shas — #723 regression that crashed every RRI rollup #728

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
100yenadmin merged 2 commits into from
Jun 9, 2026
Merged

fix(rri): restore main()'s build_shas — #723 regression that crashed every RRI rollup #728

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
23a1e01
fix(rri): restore main()'s build_shas — #723 regression that crashed …
Jun 9, 2026
bf45fe1
qa(scores): record v1.0.4-rc1 RRI = 3.6/10 (4/11) @fa97b34 — first co…
Jun 9, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions qa/release_readiness.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -792,6 +792,11 @@ def main() -> int:
failed.insert(0, "missing_personas")
release_ready = passed == total_gates and not evidence_gaps and not missing_personas and not harness_failures

# Distinct build SHAs across ALL persona runs (diagnostic output field; the native_gate CONTRACT is
# release-persona-scoped via build_sha_evidence_gaps). Restored in main()'s scope after #723 factored
# the gate logic into the helper and left this output reference dangling -> NameError at rollup time.
build_shas = sorted({str(p["run_build_sha"]) for p in persona_scores if p.get("run_build_sha")})

result = {
"rri": rri,
"release_ready": release_ready,
Expand Down
Binary file modified qa/scores.db
View file
Open in desktop
Binary file not shown.
3 changes: 2 additions & 1 deletion qa/scores_ledger.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,10 +6,11 @@

> **Ruler** = `scoring_config_version` (a content hash of the rubric + schema + gate files). Rows under DIFFERENT Ruler values are **NOT directly comparable as a quality trend** — the ruler changed (a rubric recalibration or a new gate moves the number with no change in play quality). Use `python3 qa/scores_db.py --compare` for a ruler-fenced trend; comparing across rulers requires re-scoring an archived transcript under the current ruler. **RC** = the release candidate a run scored (e.g. `v1.0.4-rc1`).

> Rows: **64** · rendered 2026-06-09T13:53:41+00:00
> Rows: **65** · rendered 2026-06-09T18:10:34+00:00

| Run | When | SHA | Build date | Surface | DM model | Actor model | Scorer | Ruler | RC | Methodology | Story | Mech | AngryDM | Behav | Sat | RRI | Crit | Img% | Pass | Source | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| v1.0.4-rc1-fa97b34 | 2026-06-09T18:10:34+00:00 | fa97b34 | 2026-06-09 | GUI-built-app | opus | opus | claude | sc_5ac7a1d9103c | v1.0.4-rc1 | 11-gate RRI RC1: Mac part-A handoff 100/100 + VM part-B 5-persona sweep (lean-ON); rollup via fixed release_readiness.py (#728) | 3.9 | 3.5 | 3.2 | GREEN | 4.8 | 3.6 | 4 | 0% | FAIL | /Volumes/LEXAR/Codex/worldos-qa-results-fa97b34/RRI-full.json | RC1 honest 11-gate RRI @fa97b34 (post #719/#720). PASS: native_gate(signal; Mac handoff 100/100), arc, no_give_up, behavioral GREEN, palette. FAIL: cross_persona_sat 4.8<7, zero_critical(4), story 3.9<4.3, mech 3.2<4.5(one-duo sampling, understated), ui_audit FAIL(axe). native_gate withheld credit pending --support-preflight (split VM+Mac contract) — handoff itself is valid 100/100. image_render 0% = VM-gateway gap (Mac/gateway lane measures it). vs Tuesday 3.6: no_give_up RED->PASS (input-lock give-up gone), sat 4.4->4.8, behavioral GREEN. Caught+fixed build_shas rollup regression (#728) that had crashed EVERY release_readiness.py rollup since #723. |
| reorient-leanON-e2c0da4 | 2026-06-09T13:53:41+00:00 | e2c0da4 | 2026-06-09 | engine-duo | opus | opus | claude | sc_52a5cbd26775 | | 3-lens duo 8-beat lean-ON (CLAWDND_LEAN_BEATS); reorient post-fix baseline | 4.1 | 3.7 | 3.4 | GREEN | | | | | | /Volumes/LEXAR/Codex/session-notes/2026-06-05/worldos-release-grind/reorient-leanON-duo-e2c0da4.log | First ruler-stamped baseline (#722). Lean-ON Opus healthy → confirms the lean-ON dip was transient (patched lean re-ground bug). Lens files identical e2c0da4↔52e74e2; only release_readiness.py changed (#723), which does NOT affect engine-duo lens scoring. |
| handoff-20260607-da05101-current-main-clean | 2026-06-07 | da05101 | | GUI-built-app | scripted+codex | scripted | | | | hybrid handoff gate (web smoke 5 + built smoke 5 + built Codex 1) | | | | | | | | | PASS | /Volumes/LEXAR/Codex/worldos-agent-grade-app-testability/handoff-20260607-da05101-current-main-clean/ | handoff_score=100/100 on current origin/main da05101; clean same-disk worktree, dirty=false, release_verdict=false. Supersedes 9545383 as GUI velocity proof. Full #466 five-persona RRI still required. No quality lens. |
| opus-lean-armB | 2026-06-02 | efb4f29 | | engine-duo | claude-opus-4-8 | sonnet | sonnet | | | lean A/B lean arm (pre-#543 buggy lean path) | | | | | | | | | FAIL | | ERRORED exit 1; quality VOID; ~24min; superseded by the #543 fix |
Expand Down
Loading