Skip to content

🤖 Update Mock Benchmark Results#6444

Merged
thomhurst merged 1 commit into
mainfrom
automated-mock-benchmarks-update
Jul 18, 2026
Merged

🤖 Update Mock Benchmark Results#6444
thomhurst merged 1 commit into
mainfrom
automated-mock-benchmarks-update

Conversation

@thomhurst

Copy link
Copy Markdown
Owner

Automated Mock Benchmark Update

This PR updates the mock benchmark documentation with the latest results from the Mock Benchmarks workflow.

Benchmarks Produced

Individual benchmark artifacts are available for download:

  • mock-benchmark-MockCreation
  • mock-benchmark-Setup
  • mock-benchmark-Invocation
  • mock-benchmark-Verification
  • mock-benchmark-Callback
  • mock-benchmark-CombinedWorkflow
  • mock-benchmark-summary (aggregated overview)

Libraries Compared

Libraries are discovered dynamically from the benchmark output. See the generated summary.json for the full list.

Changes

  • Updated mock benchmark data in docs/static/benchmarks/mocks/latest.json
  • Regenerated mock benchmark documentation in docs/docs/benchmarks/mocks/
  • Updated mock benchmark summary in docs/static/benchmarks/mocks/summary.json

Workflow Run

  • Run ID: 29628226371
  • Triggered: schedule

🤖 This PR was automatically created and will be merged automatically once CI checks pass.

@thomhurst thomhurst added automated benchmarks documentation Improvements or additions to documentation ignore-for-release labels Jul 18, 2026
@thomhurst
thomhurst merged commit be58c65 into main Jul 18, 2026
12 of 13 checks passed
@thomhurst
thomhurst deleted the automated-mock-benchmarks-update branch July 18, 2026 03:20
@claude

claude Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Code Review

Note: This PR is already merged (auto-merged bot PR). Reviewing for the record.

Overview

Fully automated, mechanical update of mock benchmark data/docs from the scheduled Mock Benchmarks workflow (run ID 29628226371). All 15 changed files are either:

  • docs/static/benchmarks/mocks/*.json — raw benchmark result data (timestamps, Mean/Error/StdDev/Allocated per library)
  • docs/docs/benchmarks/mocks/*.md — generated docs (tables + Mermaid xychart-beta charts) derived from that data

No source/library code, tests, or public API surface is touched.

Analysis

  • Diff is internally consistent: each .md's table values, chart y-axis bounds, and bar [...] series match the corresponding .json numbers (spot-checked Callback.md/Callback.json, index.md, summary.json).
  • Timestamps updated uniformly (2026-07-172026-07-18) across all files — no stale/mismatched dates.
  • New numbers show TUnit.Mocks and the runtime-proxy libraries all trending faster (e.g. Moq Callback: 187,749 ns → 133,770 ns), consistent with normal run-to-run benchmark noise rather than a regression signal.
  • Labeled documentation, ignore-for-release, automated, benchmarks — correctly excluded from release notes.

Risks / Suggestions

  • None applicable to the diff itself — it's generated output, not hand-written code, so there's nothing here to refactor architecturally.
  • General (non-blocking) suggestion for the generator pipeline: consider trimming benchmark JSON to fixed decimal precision to reduce diff noise/churn on every scheduled run (e.g. 13,770.5 ns vs 133,770.53 ns-style rounding drift), but this is a minor nice-to-have, not a defect in this PR.

Verdict: LGTM — matches the pattern of prior automated benchmark-update PRs, data is internally consistent, no code risk.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automated benchmarks documentation Improvements or additions to documentation ignore-for-release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant