Skip to content

fix(verify): stop comparing PassMark's two scales - #58

Merged
Seungpyo1007 merged 1 commit into
mainfrom
fix/passmark-scales-not-comparable
Aug 10, 2026
Merged

fix(verify): stop comparing PassMark's two scales#58
Seungpyo1007 merged 1 commit into
mainfrom
fix/passmark-scales-not-comparable

Conversation

@Seungpyo1007

Copy link
Copy Markdown
Member

Problem

passmark_multi_ge_single asserts passmark_cpu_mark >= passmark_single. Those are two separately normalised PassMark scales — CPU Mark and Single Thread Rating — so their magnitudes are not comparable, and the check reads a scale difference as a defect.

Measured over every CPU record holding both figures (866):

records CPU Mark median
fails the check 123 641 (max 1,378)
passes 743 19,657
  • 51 of 51 single-core parts fail — 100%. There is no multi-thread aggregation to exceed a single-thread figure.
  • Failure tracks absolute weakness, not parallelism: only 5 failures have a CPU Mark above 1,200, and at the boundary the two figures are near-ties — Core 2 Duo E8600 at 1378 vs 1388, E8500 at 1301 vs 1324.
  • The check only ever "held" because modern CPU Marks are large.

Examples, all with a Wikipedia source and no data problem: athlon-64-3000 (mark 342 / single 623), athlon-xp-1800 (195 / 301), sempron-3000 (299 / 530).

Change

Drop the PassMark comparison. cb23_multi_ge_single and gb_multi_ge_single stay — Cinebench and Geekbench report both figures on one scale, so multi ≥ single is a real expectation there, and a violation is a genuine defect.

Two regression tests: a single-core PassMark pair no longer emits the signal, and a Cinebench multi < single still fails. tests/verify is 58 passed.

Effect

57 near-miss CPU records carry this flag (near-miss = T1/T2 host, score 65–74, where consistency averages 24.1/35). Removing a false failure returns those points; how many cross the green threshold of 75 will show in the next verify run rather than being predicted here.

Refs #1

`passmark_multi_ge_single` asserted cpu_mark >= passmark_single, but
CPU Mark and Single Thread Rating are separately normalised PassMark
scales — their magnitudes are not comparable, so the check read a scale
difference as a defect.

Of 866 CPU records holding both figures, 123 fail. All 51 single-core
parts fail, and failure tracks absolute weakness rather than
parallelism: failing CPU Mark median 641 against 19,657 for passing,
with near-ties at the boundary (Core 2 Duo E8600, 1378 vs 1388). The
check only ever held because modern CPU Marks are large.

Cinebench and Geekbench keep their multi >= single checks: those report
both figures on one scale, so a violation there is a real defect.

Refs #1
@Seungpyo1007 Seungpyo1007 added the bug Something isn't working label Aug 10, 2026
@Seungpyo1007 Seungpyo1007 self-assigned this Aug 10, 2026
@Seungpyo1007
Seungpyo1007 merged commit d84bcec into main Aug 10, 2026
1 check passed
@Seungpyo1007
Seungpyo1007 deleted the fix/passmark-scales-not-comparable branch August 10, 2026 05:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant