Skip to content

Benchmark selection rework + time/memory CLI unification#31

Merged
FBumann merged 4 commits into
masterfrom
benchmark/quick-subset
Jun 6, 2026
Merged

Benchmark selection rework + time/memory CLI unification#31
FBumann merged 4 commits into
masterfrom
benchmark/quick-subset

fix(benchmarks): fail cleanly on malformed/unreadable snapshot files

60fa372
Select commit
Loading
Failed to load commit list.
CodSpeed HQ / CodSpeed Performance Analysis succeeded Jun 6, 2026 in 0s

Performance Gate Passed

✅ 79 untouched benchmarks
🆕 98 new benchmarks
⏩ 495 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
🆕 Memory test_to_lp[kvl_cycles-severity=100] N/A 38.5 MB N/A
🆕 Memory test_to_solver[highs-knapsack-n=10000] N/A 2.5 MB N/A
🆕 Memory test_to_solver[gurobi-knapsack-n=10000] N/A 2.8 MB N/A
🆕 Memory test_to_solver[highs-piecewise-n=5000] N/A 20.6 MB N/A
🆕 Memory test_to_solver[gurobi-sos-n=1000] N/A 3.1 MB N/A
🆕 Memory test_to_solver[highs-expression_arithmetic-n=250] N/A 34.9 MB N/A
🆕 Memory test_to_solver[gurobi-piecewise-n=1000] N/A 5.1 MB N/A
🆕 Memory test_to_solver[gurobi-qp-n=1000] N/A 831.1 KB N/A
🆕 Memory test_to_solver[gurobi-qp-n=20000] N/A 11.2 MB N/A
🆕 Memory test_to_solver[gurobi-sos-n=10000] N/A 29.2 MB N/A
🆕 Memory test_build[masked-n=1000] N/A 70.7 MB N/A
🆕 Memory test_to_solver[gurobi-kvl_cycles-severity=100] N/A 198.8 MB N/A
🆕 Memory test_to_lp[nodal_balance-severity=100] N/A 17.9 MB N/A
🆕 Memory test_to_lp[merge_balance-severity=100] N/A 17.6 MB N/A
🆕 Memory test_to_solver[highs-storage-n=1000] N/A 150 MB N/A
🆕 Memory test_build[milp-n=50] N/A 283.7 KB N/A
🆕 Memory test_to_solver[highs-kvl_cycles-severity=100] N/A 217 MB N/A
🆕 Memory test_build[masked-n=100] N/A 735.4 KB N/A
🆕 Memory test_to_solver[highs-sparse_network-n=250] N/A 64.8 MB N/A
🆕 Memory test_to_solver[gurobi-basic-n=1600] N/A 2.8 GB N/A
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing benchmark/quick-subset (60fa372) with master (3fdb9b4)

Open in CodSpeed

Footnotes

  1. 495 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.