Skip to content

Conversation

@gleocadie
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Jan 30, 2026

Benchmarks

Comparison

Benchmark execution time: 2026-01-30 22:29:53

Comparing candidate commit 04594a0 in PR branch gleocadie/use-builder-on-windows-gitlab with baseline commit c9d6835 in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 56 metrics, 2 unstable metrics.

scenario:single_flag_killswitch/rules-based

  • 🟥 execution_time [+8.727ns; +9.572ns] or [+4.565%; +5.006%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 161.023µs 161.712µs ± 0.612µs 161.639µs ± 0.125µs 161.790µs 162.072µs 162.754µs 169.270µs 4.72% 9.896 116.323 0.38% 0.043µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.628µs; 161.797µs] or [-0.052%; +0.052%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.957µs 26.030µs ± 10.116µs 18.135µs ± 0.143µs 34.540µs 43.958µs 45.137µs 72.974µs 302.39% 1.148 1.651 38.76% 0.715µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.628µs; 27.432µs] or [-5.386%; +5.386%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.271µs 3.190µs ± 1.378µs 2.985µs ± 0.028µs 3.012µs 3.669µs 13.570µs 14.570µs 388.17% 7.331 55.054 43.09% 0.097µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.999µs; 3.381µs] or [-5.988%; +5.988%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 535.244µs 536.665µs ± 1.168µs 536.285µs ± 0.464µs 537.054µs 539.113µs 540.935µs 542.567µs 1.17% 1.794 4.002 0.22% 0.083µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1843089.547op/s 1863369.360op/s ± 4039.658op/s 1864678.528op/s ± 1613.174op/s 1866001.397op/s 1867365.028op/s 1867926.516op/s 1868306.586op/s 0.19% -1.776 3.896 0.22% 285.647op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 381.523µs 382.205µs ± 0.292µs 382.180µs ± 0.178µs 382.361µs 382.733µs 382.850µs 382.939µs 0.20% 0.202 -0.176 0.08% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2611382.562op/s 2616395.515op/s ± 1998.553op/s 2616571.235op/s ± 1221.936op/s 2617722.167op/s 2619535.588op/s 2620693.818op/s 2621076.946op/s 0.17% -0.198 -0.177 0.08% 141.319op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.610µs 190.130µs ± 0.232µs 190.136µs ± 0.185µs 190.301µs 190.500µs 190.668µs 190.741µs 0.32% 0.204 -0.700 0.12% 0.016µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5242717.664op/s 5259568.124op/s ± 6404.416op/s 5259401.433op/s ± 5112.327op/s 5264996.025op/s 5269167.056op/s 5270522.195op/s 5273983.440op/s 0.28% -0.200 -0.704 0.12% 452.861op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.465µs 36.611µs ± 0.059µs 36.606µs ± 0.035µs 36.641µs 36.713µs 36.774µs 36.845µs 0.65% 0.578 1.242 0.16% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 27141020.190op/s 27314382.729op/s ± 43648.955op/s 27318024.353op/s ± 26113.244op/s 27344126.404op/s 27375942.026op/s 27415913.355op/s 27423881.077op/s 0.39% -0.564 1.215 0.16% 3086.447op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.952µs 46.067µs ± 0.047µs 46.065µs ± 0.029µs 46.093µs 46.151µs 46.179µs 46.233µs 0.37% 0.344 0.505 0.10% 0.003µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21629577.207op/s 21707606.669op/s ± 21922.757op/s 21708675.189op/s ± 13737.446op/s 21721915.827op/s 21742094.085op/s 21754612.138op/s 21761976.790op/s 0.25% -0.336 0.496 0.10% 1550.173op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [536.503µs; 536.827µs] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1862809.502op/s; 1863929.218op/s] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [382.165µs; 382.246µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2616118.534op/s; 2616672.495op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.098µs; 190.162µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5258680.534op/s; 5260455.714op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.603µs; 36.619µs] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27308333.403op/s; 27320432.054op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.060µs; 46.073µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21704568.386op/s; 21710644.952op/s] or [-0.014%; +0.014%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.787µs 206.473µs ± 0.361µs 206.447µs ± 0.248µs 206.686µs 207.047µs 207.426µs 207.984µs 0.74% 0.684 0.934 0.17% 0.026µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4808054.661op/s 4843262.688op/s ± 8465.123op/s 4843856.011op/s ± 5836.932op/s 4849679.276op/s 4855355.165op/s 4858737.212op/s 4859398.556op/s 0.32% -0.671 0.891 0.17% 598.575op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.590µs 18.670µs ± 0.044µs 18.664µs ± 0.027µs 18.692µs 18.741µs 18.785µs 18.887µs 1.20% 1.093 2.735 0.23% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52945383.642op/s 53563322.722op/s ± 124853.016op/s 53579849.932op/s ± 78058.832op/s 53653136.865op/s 53728395.196op/s 53787004.833op/s 53792985.117op/s 0.40% -1.068 2.618 0.23% 8828.441op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.855µs 10.924µs ± 0.037µs 10.923µs ± 0.028µs 10.949µs 10.987µs 11.006µs 11.029µs 0.97% 0.232 -0.637 0.34% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 90668510.260op/s 91541509.678op/s ± 310203.127op/s 91546372.212op/s ± 235886.176op/s 91790570.509op/s 92023328.106op/s 92098517.133op/s 92126163.903op/s 0.63% -0.219 -0.649 0.34% 21934.673op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [206.423µs; 206.523µs] or [-0.024%; +0.024%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4842089.504op/s; 4844435.873op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.664µs; 18.676µs] or [-0.032%; +0.032%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53546019.295op/s; 53580626.150op/s] or [-0.032%; +0.032%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.919µs; 10.929µs] or [-0.047%; +0.047%] None None None
normalization/normalize_name/normalize_name/good throughput [91498518.508op/s; 91584500.848op/s] or [-0.047%; +0.047%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.631ms 10.659ms ± 0.013ms 10.657ms ± 0.008ms 10.666ms 10.684ms 10.700ms 10.728ms 0.67% 1.278 3.500 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.657ms; 10.661ms] or [-0.018%; +0.018%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 49.390ms 49.783ms ± 0.803ms 49.678ms ± 0.085ms 49.756ms 49.906ms 54.158ms 57.165ms 15.07% 7.278 56.302 1.61% 0.057ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [49.671ms; 49.894ms] or [-0.223%; +0.223%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.896µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.917µs 3.919µs 3.921µs 0.19% -0.806 3.660 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 255053725.930op/s 255564501.493op/s ± 193249.762op/s 255542630.679op/s ± 137652.930op/s 255704007.675op/s 255858533.566op/s 255940160.345op/s 256643435.215op/s 0.43% 0.818 3.721 0.08% 13664.822op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.033µs 77.542µs ± 0.391µs 77.446µs ± 0.273µs 77.740µs 78.213µs 78.781µs 78.878µs 1.85% 1.010 0.936 0.50% 0.028µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12677823.676op/s 12896540.351op/s ± 64718.622op/s 12912280.227op/s ± 45579.208op/s 12954741.941op/s 12971085.962op/s 12978578.771op/s 12981521.358op/s 0.54% -0.982 0.844 0.50% 4576.298op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 70.647µs 71.156µs ± 0.339µs 71.121µs ± 0.196µs 71.319µs 71.763µs 72.218µs 72.750µs 2.29% 1.120 2.343 0.48% 0.024µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13745716.528op/s 14053858.681op/s ± 66642.684op/s 14060494.234op/s ± 38770.820op/s 14099044.086op/s 14142375.898op/s 14152206.259op/s 14154805.993op/s 0.67% -1.076 2.158 0.47% 4712.349op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.916µs 3.917µs 3.918µs 0.15% -1.674 11.193 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255214836.596op/s 255613807.243op/s ± 168757.610op/s 255599855.977op/s ± 93731.211op/s 255704500.400op/s 255883584.958op/s 255942765.559op/s 256809777.774op/s 0.47% 1.695 11.360 0.07% 11932.965op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 67.452µs 67.866µs ± 0.261µs 67.811µs ± 0.176µs 68.030µs 68.359µs 68.544µs 68.641µs 1.22% 0.548 -0.057 0.38% 0.018µs 1 200
credit_card/is_card_number/378282246310005 throughput 14568489.224op/s 14735082.944op/s ± 56653.673op/s 14746940.508op/s ± 38073.669op/s 14769685.960op/s 14818727.983op/s 14824732.398op/s 14825340.955op/s 0.53% -0.529 -0.086 0.38% 4006.020op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 44.796µs 45.223µs ± 0.164µs 45.236µs ± 0.119µs 45.342µs 45.474µs 45.521µs 45.581µs 0.76% -0.253 -0.473 0.36% 0.012µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21938792.351op/s 22113168.305op/s ± 80058.673op/s 22106174.788op/s ± 57952.021op/s 22170513.792op/s 22248333.618op/s 22298883.350op/s 22323655.191op/s 0.98% 0.269 -0.460 0.36% 5661.003op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.027µs 6.038µs ± 0.012µs 6.036µs ± 0.003µs 6.038µs 6.047µs 6.103µs 6.113µs 1.28% 4.495 21.972 0.20% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163583119.920op/s 165618483.709op/s ± 324055.604op/s 165673997.466op/s ± 70446.907op/s 165744382.202op/s 165851753.526op/s 165882922.583op/s 165916753.647op/s 0.15% -4.472 21.789 0.20% 22914.192op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.896µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.914µs 3.917µs 3.918µs 3.923µs 0.28% -0.812 6.899 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254883404.549op/s 255580923.286op/s ± 180803.778op/s 255585842.586op/s ± 113915.405op/s 255691926.527op/s 255820296.947op/s 255915291.825op/s 256705876.306op/s 0.44% 0.830 6.992 0.07% 12784.758op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.315µs 65.617µs ± 0.086µs 65.620µs ± 0.050µs 65.669µs 65.764µs 65.805µs 65.849µs 0.35% -0.140 0.305 0.13% 0.006µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15186202.194op/s 15239993.832op/s ± 19870.165op/s 15239195.610op/s ± 11589.173op/s 15251244.821op/s 15274808.565op/s 15281321.907op/s 15310383.502op/s 0.47% 0.149 0.313 0.13% 1405.033op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 52.960µs 53.019µs ± 0.027µs 53.017µs ± 0.019µs 53.038µs 53.068µs 53.090µs 53.099µs 0.16% 0.410 -0.222 0.05% 0.002µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18832678.823op/s 18861277.494op/s ± 9712.054op/s 18862041.085op/s ± 6862.673op/s 18868722.263op/s 18875078.008op/s 18879290.326op/s 18882024.313op/s 0.11% -0.407 -0.226 0.05% 686.746op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.896µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.917µs 3.919µs 3.922µs 0.22% -1.022 6.665 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254996754.179op/s 255556766.296op/s ± 180927.115op/s 255553770.336op/s ± 123572.061op/s 255682444.816op/s 255807078.393op/s 255900644.883op/s 256691529.390op/s 0.45% 1.039 6.766 0.07% 12793.479op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 49.728µs 49.820µs ± 0.034µs 49.821µs ± 0.021µs 49.840µs 49.877µs 49.900µs 49.929µs 0.22% 0.068 0.092 0.07% 0.002µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 20028358.561op/s 20072386.298op/s ± 13858.986op/s 20071756.031op/s ± 8561.242op/s 20082156.502op/s 20096098.243op/s 20102262.912op/s 20109302.563op/s 0.19% -0.063 0.089 0.07% 979.978op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 44.785µs 45.220µs ± 0.161µs 45.233µs ± 0.101µs 45.328µs 45.474µs 45.517µs 45.531µs 0.66% -0.381 -0.255 0.35% 0.011µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21962919.074op/s 22114625.455op/s ± 78646.451op/s 22107624.411op/s ± 49074.860op/s 22160610.626op/s 22265922.280op/s 22301345.997op/s 22329149.568op/s 1.00% 0.398 -0.240 0.35% 5561.144op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.027µs 6.038µs ± 0.012µs 6.035µs ± 0.003µs 6.038µs 6.070µs 6.088µs 6.102µs 1.11% 3.311 11.327 0.19% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 163869359.309op/s 165627474.718op/s ± 313610.829op/s 165695332.810op/s ± 74108.424op/s 165772548.506op/s 165848524.844op/s 165890451.131op/s 165911282.749op/s 0.13% -3.297 11.225 0.19% 22175.634op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255537718.935op/s; 255591284.052op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [77.488µs; 77.596µs] or [-0.070%; +0.070%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12887570.972op/s; 12905509.729op/s] or [-0.070%; +0.070%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.109µs; 71.203µs] or [-0.066%; +0.066%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14044622.646op/s; 14063094.716op/s] or [-0.066%; +0.066%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255590419.061op/s; 255637195.425op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [67.830µs; 67.902µs] or [-0.053%; +0.053%] None None None
credit_card/is_card_number/378282246310005 throughput [14727231.289op/s; 14742934.598op/s] or [-0.053%; +0.053%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.200µs; 45.245µs] or [-0.050%; +0.050%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [22102072.943op/s; 22124263.667op/s] or [-0.050%; +0.050%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.036µs; 6.040µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/x371413321323331 throughput [165573572.719op/s; 165663394.699op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255555865.621op/s; 255605980.950op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.605µs; 65.629µs] or [-0.018%; +0.018%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15237240.018op/s; 15242747.645op/s] or [-0.018%; +0.018%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.015µs; 53.022µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18859931.497op/s; 18862623.491op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255531691.538op/s; 255581841.055op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [49.815µs; 49.824µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [20070465.576op/s; 20074307.020op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.197µs; 45.242µs] or [-0.049%; +0.049%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [22103725.813op/s; 22125525.097op/s] or [-0.049%; +0.049%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.036µs; 6.039µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165584011.273op/s; 165670938.163op/s] or [-0.026%; +0.026%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 143.651µs 145.494µs ± 1.845µs 145.269µs ± 0.534µs 145.748µs 147.224µs 151.552µs 165.261µs 13.76% 7.165 68.009 1.27% 0.130µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [145.238µs; 145.750µs] or [-0.176%; +0.176%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.881µs 34.593µs ± 1.284µs 33.994µs ± 0.056µs 34.096µs 37.361µs 37.404µs 38.132µs 12.17% 1.702 0.942 3.70% 0.091µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.415µs; 34.771µs] or [-0.514%; +0.514%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 3.936ms 3.948ms ± 0.008ms 3.948ms ± 0.003ms 3.950ms 3.953ms 3.956ms 4.040ms 2.33% 8.691 103.096 0.19% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [3.947ms; 3.949ms] or [-0.027%; +0.027%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 89.865µs 90.036µs ± 0.126µs 90.009µs ± 0.040µs 90.063µs 90.149µs 90.386µs 91.202µs 1.33% 5.604 43.841 0.14% 0.009µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [90.018µs; 90.053µs] or [-0.019%; +0.019%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 197.849ns 200.343ns ± 2.110ns 200.124ns ± 1.630ns 201.479ns 204.782ns 205.645ns 206.829ns 3.35% 0.845 0.015 1.05% 0.149ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [200.051ns; 200.636ns] or [-0.146%; +0.146%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 12.719ms 13.083ms ± 0.102ms 13.109ms ± 0.043ms 13.143ms 13.208ms 13.250ms 13.401ms 2.23% -1.030 1.564 0.78% 0.007ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [13.069ms; 13.098ms] or [-0.108%; +0.108%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.355µs 2.386µs ± 0.021µs 2.382µs ± 0.013µs 2.396µs 2.442µs 2.449µs 2.449µs 2.83% 1.312 1.598 0.89% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.383µs; 2.389µs] or [-0.124%; +0.124%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 240.531ns 252.551ns ± 15.486ns 244.936ns ± 3.467ns 254.300ns 287.450ns 302.379ns 305.511ns 24.73% 1.749 2.265 6.12% 1.095ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [250.405ns; 254.698ns] or [-0.850%; +0.850%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.978µs 5.059µs ± 0.038µs 5.053µs ± 0.027µs 5.091µs 5.120µs 5.125µs 5.132µs 1.58% 0.133 -0.964 0.76% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.054µs; 5.065µs] or [-0.105%; +0.105%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 538.505µs 539.204µs ± 0.338µs 539.169µs ± 0.167µs 539.337µs 539.680µs 540.169µs 541.716µs 0.47% 2.545 14.901 0.06% 0.024µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [539.158µs; 539.251µs] or [-0.009%; +0.009%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 04594a0 1769811211 gleocadie/use-builder-on-windows-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.575ms 14.658ms ± 0.034ms 14.655ms ± 0.018ms 14.674ms 14.705ms 14.774ms 14.837ms 1.24% 1.441 5.197 0.23% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.653ms; 14.663ms] or [-0.032%; +0.032%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 70.98%. Comparing base (8815a80) to head (04594a0).
⚠️ Report is 2 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1496      +/-   ##
==========================================
- Coverage   71.06%   70.98%   -0.08%     
==========================================
  Files         422      422              
  Lines       68640    68791     +151     
==========================================
+ Hits        48776    48830      +54     
- Misses      19864    19961      +97     
Components Coverage Δ
libdd-crashtracker 60.92% <ø> (-0.48%) ⬇️
libdd-crashtracker-ffi 16.21% <ø> (-0.29%) ⬇️
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.86% <ø> (+0.01%) ⬆️
libdd-data-pipeline-ffi 78.57% <ø> (ø)
libdd-common 80.97% <ø> (ø)
libdd-common-ffi 74.54% <ø> (ø)
libdd-telemetry 59.82% <ø> (ø)
libdd-telemetry-ffi 21.17% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.60% <ø> (ø)
libdd-profiling 81.49% <ø> (-0.03%) ⬇️
libdd-profiling-ffi 64.71% <ø> (ø)
datadog-sidecar 34.94% <ø> (ø)
datdog-sidecar-ffi 10.25% <ø> (ø)
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 93.43% <ø> (ø)
libdd-trace-normalization 82.33% <ø> (ø)
libdd-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 61.18% <ø> (ø)
libdd-trace-utils 89.45% <ø> (ø)
datadog-tracer-flare 63.49% <ø> (ø)
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@dd-octo-sts
Copy link

dd-octo-sts bot commented Jan 30, 2026

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 91.78 MB 91.78 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.44 MB 8.44 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 62.79 MB 62.79 MB 0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 9.48 MB 9.48 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 106.11 MB 106.11 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.76 MB 10.76 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 25.25 MB 25.25 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 75.59 KB 75.59 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 167.19 MB 167.19 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 847.18 MB 847.18 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.61 MB 9.61 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 75.59 KB 75.59 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 23.09 MB 23.09 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 48.36 MB 48.36 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 21.32 MB 21.32 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 76.76 KB 76.76 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 171.30 MB 171.30 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 833.92 MB 833.92 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.27 MB 7.27 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 76.76 KB 76.76 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 24.70 MB 24.70 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 44.08 MB 44.08 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 80.25 MB 80.25 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 9.90 MB 9.90 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 64.66 MB 64.66 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 10.50 MB 10.50 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 100.09 MB 100.09 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.48 MB 11.48 MB 0% (0 B) 👌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants