Skip to content

docs: lead benchmarks with the Realistic scenario and drop Size=64#99

Merged
vbreuss merged 1 commit into
mainfrom
docs/benchmarks-realistic-first
Jul 8, 2026
Merged

docs: lead benchmarks with the Realistic scenario and drop Size=64#99
vbreuss merged 1 commit into
mainfrom
docs/benchmarks-realistic-first

Conversation

@vbreuss

@vbreuss vbreuss commented Jul 8, 2026

Copy link
Copy Markdown
Member

Make Realistic the first and default tab, since it is the most representative workload, and update the methodology note to the current container sizes (8 and 256) now that the Size=64 case has been retired from the benchmark suite.

Make Realistic the first and default tab, since it is the most representative
workload, and update the methodology note to the current container sizes
(8 and 256) now that the Size=64 case has been retired from the suite.
@vbreuss vbreuss self-assigned this Jul 8, 2026
@vbreuss vbreuss added the documentation Improvements or additions to documentation label Jul 8, 2026
@vbreuss vbreuss enabled auto-merge (squash) July 8, 2026 17:17
@sonarqubecloud

sonarqubecloud Bot commented Jul 8, 2026

Copy link
Copy Markdown

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Test Results

   18 files  ±0     18 suites  ±0   6m 59s ⏱️ -43s
1 038 tests ±0  1 037 ✅ ±0  1 💤 ±0  0 ❌ ±0 
5 160 runs  ±0  5 159 ✅ ±0  1 💤 ±0  0 ❌ ±0 

Results for commit 5e292ec. ± Comparison against base commit 6657202.

@vbreuss vbreuss merged commit b356b5f into main Jul 8, 2026
15 checks passed
@vbreuss vbreuss deleted the docs/benchmarks-realistic-first branch July 8, 2026 17:22
@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

🚀 Benchmark Results

Details

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.4 LTS (Noble Numbat)
AMD EPYC 9V74 3.69GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 10.0.301
[Host] : .NET 10.0.9 (10.0.9, 10.0.926.27113), X64 RyuJIT x86-64-v4

Job=InProcess Toolchain=InProcessEmitToolchain IterationCount=15
LaunchCount=1 WarmupCount=10

Resolve Size Mean Error StdDev Median Ratio Allocated Alloc Ratio
baseline* 8 5.761 ns 0.0111 ns 0.0093 ns 1.00 0.90 NA
Awaiten 8 6.423 ns 0.1886 ns 0.1764 ns 6.278 ns 1.00 - NA
MsDI 8 6.750 ns 0.0083 ns 0.0069 ns 6.749 ns 1.05 - NA
Autofac 8 84.553 ns 0.1575 ns 0.1315 ns 84.535 ns 13.17 656 B NA
Jab 8 2.016 ns 0.0978 ns 0.0915 ns 2.048 ns 0.31 - NA
PureDI 8 4.500 ns 0.0114 ns 0.0095 ns 4.498 ns 0.70 - NA
DryIoc 8 6.627 ns 0.1430 ns 0.1338 ns 6.693 ns 1.03 - NA
SimpleInjector 8 8.248 ns 0.1491 ns 0.1395 ns 8.321 ns 1.29 - NA
baseline* 256 7.053 ns 0.0068 ns 0.0063 ns 1.00 1.05 NA
Awaiten 256 6.746 ns 0.1348 ns 0.1261 ns 6.829 ns 1.00 - NA
MsDI 256 6.445 ns 0.0095 ns 0.0088 ns 6.443 ns 0.96 - NA
Autofac 256 85.128 ns 0.4466 ns 0.3729 ns 85.187 ns 12.62 656 B NA
Jab 256 36.436 ns 0.0290 ns 0.0257 ns 36.424 ns 5.40 - NA
PureDI 256 6.659 ns 0.0062 ns 0.0058 ns 6.658 ns 0.99 - NA
DryIoc 256 6.402 ns 0.1367 ns 0.1279 ns 6.322 ns 0.95 - NA
SimpleInjector 256 8.428 ns 0.1506 ns 0.1176 ns 8.484 ns 1.25 - NA
Details

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.4 LTS (Noble Numbat)
Intel Xeon Platinum 8370C CPU 2.80GHz (Max: 2.79GHz), 1 CPU, 4 logical and 2 physical cores
.NET SDK 10.0.301
[Host] : .NET 10.0.9 (10.0.9, 10.0.926.27113), X64 RyuJIT x86-64-v4

Job=InProcess Toolchain=InProcessEmitToolchain IterationCount=15
LaunchCount=1 WarmupCount=10

Realistic Mean Error StdDev Ratio Allocated Alloc Ratio
baseline* 270.1 ns 2.17 ns 2.03 ns 0.91 568 B 1.00
Awaiten 297.7 ns 0.41 ns 0.34 ns 1.00 568 B 1.00
MsDI 723.3 ns 2.58 ns 2.15 ns 2.43 1104 B 1.94
Autofac 7,787.9 ns 15.72 ns 14.71 ns 26.16 13696 B 24.11
Jab 242.4 ns 0.43 ns 0.41 ns 0.81 432 B 0.76
DryIoc 462.7 ns 1.33 ns 1.24 ns 1.55 944 B 1.66
SimpleInjector 794.5 ns 1.50 ns 1.33 ns 2.67 1096 B 1.93
PureDI 221.4 ns 0.82 ns 0.76 ns 0.74 632 B 1.11
Details

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.4 LTS (Noble Numbat)
AMD EPYC 7763 2.45GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 10.0.301
[Host] : .NET 10.0.9 (10.0.9, 10.0.926.27113), X64 RyuJIT x86-64-v3

Job=InProcess Toolchain=InProcessEmitToolchain IterationCount=15
LaunchCount=1 WarmupCount=10

Build Size Mean Error StdDev Ratio Allocated Alloc Ratio
baseline* 8 17.847 ns 0.3086 ns 0.2886 ns 1.08 144 B 1.00
Awaiten 8 16.56 ns 0.224 ns 0.199 ns 1.00 144 B 1.00
MsDI 8 1,447.50 ns 9.363 ns 8.758 ns 87.44 5688 B 39.50
Autofac 8 29,739.51 ns 248.203 ns 220.025 ns 1,796.55 33098 B 229.85
Jab 8 10.67 ns 0.516 ns 0.483 ns 0.64 96 B 0.67
PureDI 8 15.12 ns 0.143 ns 0.127 ns 0.91 128 B 0.89
DryIoc 8 732.34 ns 5.340 ns 4.734 ns 44.24 1528 B 10.61
SimpleInjector 8 11,597.07 ns 56.663 ns 50.231 ns 700.57 24761 B 171.95
baseline* 256 105.307 ns 3.9730 ns 3.7164 ns 1.15 2128 B 1.00
Awaiten 256 91.66 ns 0.790 ns 0.700 ns 1.00 2128 B 1.00
MsDI 256 14,560.58 ns 107.288 ns 95.108 ns 158.86 61016 B 28.67
Autofac 256 711,055.72 ns 4,324.074 ns 3,833.179 ns 7,757.91 737612 B 346.62
Jab 256 76.14 ns 0.388 ns 0.344 ns 0.83 2080 B 0.98
PureDI 256 84.48 ns 0.411 ns 0.364 ns 0.92 2112 B 0.99
DryIoc 256 43,758.32 ns 245.166 ns 217.333 ns 477.42 81167 B 38.14
SimpleInjector 256 350,989.72 ns 2,097.688 ns 1,962.179 ns 3,829.44 573057 B 269.29

baseline* rows show the corresponding Awaiten benchmark from the most recent successful main branch build with results, for regression comparison.

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

👽 Mutation Results

Mutation testing badge

Awaiten

Details
File Score Killed Survived Timeout No Coverage Ignored Compile Errors Runtime Errors Total Detected Total Undetected Total Mutants

The final mutation score is NaN%

Coverage Thresholds: high:80 low:60 break:0

github-actions Bot added a commit that referenced this pull request Jul 8, 2026
…c scenario and drop Size=64 (#99) by Valentin Breuß
github-actions Bot added a commit that referenced this pull request Jul 8, 2026
…c scenario and drop Size=64 (#99) by Valentin Breuß
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant