Skip to content

Split benchmarks into individual targets#1759

Merged
preinlein merged 1 commit intomainfrom
paul.reinlein/split-benchmarks
Feb 13, 2026
Merged

Split benchmarks into individual targets#1759
preinlein merged 1 commit intomainfrom
paul.reinlein/split-benchmarks

Conversation

@preinlein
Copy link
Contributor

@preinlein preinlein commented Feb 11, 2026

What does this PR do?

Restructures the benchmarking system for lading_payload by:

  1. Splitting the single default.rs benchmark entry point into individual standalone benchmarks
  2. Reducing benchmark runtime by adjusting measurement times:
    • Setup benchmarks: 10 seconds with 1 second warm-up
    • Throughput benchmarks: 30 seconds with 1 second warm-up
    • Block operation benchmarks: 10 seconds with 1 second warm-up
  3. Adding criterion_main! to each benchmark file to make them independently runnable

Motivation

This change improves the developer experience by:

  • Allowing benchmarks to be run individually rather than all at once
  • Reducing benchmark execution time from 90 seconds per benchmark to more reasonable durations
  • Separating setup and throughput benchmarks with appropriate timing configurations

Additional Notes

The benchmark structure now follows a more modular approach where each payload type has its own dedicated benchmark file with appropriate measurement times. This makes it easier to run specific benchmarks during development and reduces the overall time needed for benchmark execution.

Copy link
Contributor Author

preinlein commented Feb 11, 2026

@preinlein
Copy link
Contributor Author

The stack can be validated by looking at the final Claude hunt results here: https://drive.google.com/file/d/1mbgFAFuC5s2HwM3IhoNCgqZcmt7Ho7a2/view?usp=sharing

@preinlein preinlein marked this pull request as ready for review February 11, 2026 18:18
@preinlein preinlein requested a review from a team as a code owner February 11, 2026 18:19
@preinlein preinlein force-pushed the paul.reinlein/split-benchmarks branch from 5485811 to fe00bff Compare February 12, 2026 16:09
@preinlein preinlein merged commit 3ababc3 into main Feb 13, 2026
50 of 52 checks passed
@preinlein preinlein deleted the paul.reinlein/split-benchmarks branch February 13, 2026 13:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants