Summary
Two Open Rules cases have empty official results/results.csv files while the
fixture/rule combination appears to produce large structural candidate output in
a downstream structural comparison.
The request is to confirm whether the official oracle is intentionally empty or
whether fixture data / expected results should be reconciled.
Observed cases
| Rule |
Case |
Official issues |
Candidate structural issues |
Missing |
Extra |
Fingerprint |
| CORE-000080 |
negative/01 |
0 |
6360 |
0 |
6360 |
c9cc4e7f39f2fa67 |
| CORE-000081 |
negative/01 |
0 |
3232 |
0 |
3232 |
7d8f17c321ea1553 |
Review request
- For
CORE-000080, confirm whether fixture rows containing --TPTREF
without corresponding timing reference columns should produce expected
issues.
- For
CORE-000081, confirm whether fixture rows containing --STAT without
--PRESP should produce expected issues.
- If the empty official
results.csv files are intentional, please consider
adding explanatory metadata or comments so downstream oracle harnesses can
treat them as reviewed exceptions.
Until reconciled, downstream harnesses should probably keep these cases out of
supported accuracy rather than turning an empty expected file into a false pass.
Summary
Two Open Rules cases have empty official
results/results.csvfiles while thefixture/rule combination appears to produce large structural candidate output in
a downstream structural comparison.
The request is to confirm whether the official oracle is intentionally empty or
whether fixture data / expected results should be reconciled.
Observed cases
c9cc4e7f39f2fa677d8f17c321ea1553Review request
CORE-000080, confirm whether fixture rows containing--TPTREFwithout corresponding timing reference columns should produce expected
issues.
CORE-000081, confirm whether fixture rows containing--STATwithout--PRESPshould produce expected issues.results.csvfiles are intentional, please consideradding explanatory metadata or comments so downstream oracle harnesses can
treat them as reviewed exceptions.
Until reconciled, downstream harnesses should probably keep these cases out of
supported accuracy rather than turning an empty expected file into a false pass.