Add latency benchmark harness - #75
Merged
LimiNode merged 21 commits intoSep 20, 2025
Merged
Conversation
Add benchmark harness with adapters for log-it-cpp and spdlog, integrate build options, and document usage.
Run the benchmark configure/build/run steps only when relevant events trigger.
Adopt the revised latency recorder, scenario runner, and README guidance so the benchmark captures timestamps after slot reservation, calculates percentiles via nearest rank, and allows workload overrides via environment variables.
Ensure the Linux workflow runs the built logit_bench executable from the build directory so the step no longer fails with a missing file.
Ensure the CI job finds the logit_bench binary and add timeout-based watchdog logging so hangs surface with context.
Switch the CI workflow to pull_request_target so forked pull requests run without maintainer approval. Explicitly check out the contributor repository when needed and tighten permissions while still allowing checks and artifacts.
Run the workflow on pull_request events for repository branches while keeping pull_request_target for forks, and ensure each job checks out the proper head and skips duplicate runs.
Revert the conditional triggers added earlier so the CI matches the prior configuration without pull_request_target logic.
Reset the CI workflow to commit 728c7a5 so benchmark jobs, timeout, and stable branch trigger return.
Print timestamps for every bench log line, refresh the watchdog when output appears, and fail only after prolonged inactivity so the run no longer times out mid-execution.
Update the benchmark watchdog while producers run so slow scenarios keep reporting progress, bump the default timeout to twenty minutes, and keep the watchdog alive through adapter flushes.
…-libraries' into codex/fix-ci-issue-with-logit_bench-execution-5dkzon
LimiNode
deleted the
codex/add-latency-and-throughput-benchmarks-for-logging-libraries
branch
September 20, 2025 05:34
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Testing
https://chatgpt.com/codex/tasks/task_e_68cb7658ef80832c8baa9e24a922bc78