Skip to content

ci(codspeed): drop simulation (cachegrind); memory is the always-on baseline#29

Merged
FBumann merged 1 commit into
masterfrom
ci/codspeed-drop-simulation
Jun 5, 2026
Merged

ci(codspeed): drop simulation (cachegrind); memory is the always-on baseline#29
FBumann merged 1 commit into
masterfrom
ci/codspeed-drop-simulation

Conversation

@FBumann

@FBumann FBumann commented Jun 5, 2026

Copy link
Copy Markdown
Collaborator

TODO (human): why drop simulation — your words.

Note

The following content was generated by AI (Claude).

Drop the CodSpeed simulation (cachegrind) instrument. Instruction counts
under-weight the numpy/scipy/sparse work this fork targets, and the cachegrind
pass was ~11 min — by far the slowest instrument. This project doesn't do
micro-CPU tuning, so simulation's deterministic-sub-1%-CPU value doesn't earn it.

Dropping it also removes the whole reason codspeed.yml existed — memory and
simulation shared one run only to avoid a same-environment overwrite.

Result

  • codspeed-memory.yml — memory on master + every PR + dispatch (the
    always-on baseline; no more label gate). ~2 min.
  • codspeed-macro.yml — walltime on master + dispatch + labeled PRs (unchanged).
  • codspeed.yml — deleted.

memory (ubuntu) and walltime (macro) are separate environments, so their uploads
don't clash.

What runs when

  • Every PR → memory (~2 min)
  • Master / dispatch → memory + walltime
  • trigger:benchmark-labeled PR → memory + walltime

🤖 Generated with Claude Code

…aseline

Instruction counts under-weight the numpy/scipy/sparse work this fork targets,
and the cachegrind pass was ~11 min — by far the slowest. This project doesn't
do micro-CPU tuning, so its deterministic-sub-1%-CPU value isn't worth it.

Dropping it also removes the whole reason codspeed.yml existed (memory+simulation
shared one run to avoid same-environment overwrite). Now:
- codspeed-memory.yml: memory on master + every PR + dispatch (always-on).
- codspeed-macro.yml: walltime on master + dispatch + labeled PRs (unchanged).
- codspeed.yml: deleted.
memory (ubuntu) and walltime (macro) are separate environments, so no clash.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@FBumann FBumann force-pushed the ci/codspeed-drop-simulation branch from f25e5a0 to 9af13c7 Compare June 5, 2026 20:57
@codspeed-hq

codspeed-hq Bot commented Jun 5, 2026

Copy link
Copy Markdown

Merging this PR will not alter performance

✅ 79 untouched benchmarks
⏩ 495 skipped benchmarks1


Comparing ci/codspeed-drop-simulation (9af13c7) with master (f37c8be)

Open in CodSpeed

Footnotes

  1. 495 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@FBumann FBumann merged commit 520bb43 into master Jun 5, 2026
18 of 19 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant