Skip to content

[DFL-AUDIT-121 follow-up] Set coverage gate and source-mutation baseline #506

Description

@Anionix

Risk

Coverage regressions can remain ungated, and descriptive artifact-mutation counts do not measure source-code mutation adequacy.

Owner

Repository maintainers.

Exit contract

The accepted risk recorded by #303 expires after the third successful manual coverage run on distinct merged main commits, or on 2026-08-07, whichever comes first.

  • Record each exact main SHA, workflow run URL, branch-coverage artifact name, total coverage, and job duration.
  • After three successful runs, set a numeric coverage floor no higher than the minimum observed total so the existing baseline passes while later regressions fail.
  • Run one serial source-mutation pilot against src/format_bench/report.py and src/format_bench/robustness/summary.py; record tool/version, exact SHA, killed/survived/error/timeout counts, and duration.
  • If the pilot completes within the 20-minute workflow budget, add a reproducible manual mutation workflow and publish its baseline. If it exceeds the budget, retain the evidence and move this issue to ready-for-human for an explicit budget decision.

Acceptance

Close only after the coverage gate and reproducible source-mutation baseline are merged, or after a maintainer records a new time-bounded accepted-risk decision with measured evidence.

Refs #303.

Metadata

Metadata

Assignees

No one assigned

    Labels

    audit:2026-07-19Strict audit finding from 2026-07-19enhancementNew feature or requestpriority:p2Important audit follow-upready-for-agentReady for implementation

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions