Skip to content

Reproducibility sweep iterates hardcoded [transparency, robustness] instead of generic phase_results #322

Description

@stanlrt

From /simplify codebase sweep (2026-06-10).

reproducibility.py:42-45: stochastic_methods walks exactly outputs.transparency and outputs.robustness, while every other RunOutputs consumer (tracker logging, report sections) iterates phase_results.values() generically -- pipeline/outputs.py:29-36 explicitly promises "a new module plugs in without touching pipeline/ or reporting/".

Cost: a future phase whose results carry semantics.stochastic (fairness #288, privacy #291, uncertainty #290, data-augmentation audits) silently escapes the reproducibility caveat, REPRODUCIBILITY.md, and the report banner.

Fix: iterate outputs.phase_results.items() and duck-read each result list's semantics.stochastic (the per-result AdapterResult envelope already guarantees .semantics), or add an optional stochastic_methods() hook to the PhaseResult protocol.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions