Skip to content

Review empty expected results for CORE-000080 and CORE-000081 timing placeholder fixtures #67

Description

@Y-Fukiya

Summary

Two Open Rules cases have empty official results/results.csv files while the
fixture/rule combination appears to produce large structural candidate output in
a downstream structural comparison.

The request is to confirm whether the official oracle is intentionally empty or
whether fixture data / expected results should be reconciled.

Observed cases

Rule Case Official issues Candidate structural issues Missing Extra Fingerprint
CORE-000080 negative/01 0 6360 0 6360 c9cc4e7f39f2fa67
CORE-000081 negative/01 0 3232 0 3232 7d8f17c321ea1553

Review request

  • For CORE-000080, confirm whether fixture rows containing --TPTREF
    without corresponding timing reference columns should produce expected
    issues.
  • For CORE-000081, confirm whether fixture rows containing --STAT without
    --PRESP should produce expected issues.
  • If the empty official results.csv files are intentional, please consider
    adding explanatory metadata or comments so downstream oracle harnesses can
    treat them as reviewed exceptions.

Until reconciled, downstream harnesses should probably keep these cases out of
supported accuracy rather than turning an empty expected file into a false pass.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    Priority

    None yet

    T-shirt sizing

    None yet

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions