Benchmarks for dotnet/runtime#126790 (for @EgorBo)

[EgorBot]

Processing benchmark request from PR dotnet/runtime#126790.

Targets: macos15_helix_arm64, ubuntu24_azure_cobalt100, ubuntu24_aws_graviton4
Commits: main;PR_126790

• macos15_helix_arm64: live logs
• ubuntu24_azure_cobalt100: live logs
• ubuntu24_aws_graviton4: live logs

Results will be posted here once they are ready.

[EgorBot]

Results for macos15_helix_arm64

@EgorBo

BenchmarkDotNet v0.15.8, macOS Sequoia 15.4.1 (24E263) [Darwin 24.4.0]
Apple M2, 1 CPU, 8 logical and 8 physical cores
.NET SDK 11.0.100-preview.4.26210.111
  [Host]     : .NET 10.0.5 (10.0.5, 10.0.526.15411), Arm64 RyuJIT armv8.0-a

Method	Toolchain	Mean	Error	Ratio
IndexOfAnyBench	PR #126790	0.9423 ns	0.0018 ns	1.00
IndexOfAnyBench	main	1.2445 ns	0.0026 ns	1.32
LastIndexOfBench	PR #126790	0.7239 ns	0.0013 ns	1.00
LastIndexOfBench	main	1.0379 ns	0.0026 ns	1.43

Full logs

[EgorBot]

Results for ubuntu24_aws_graviton4

@EgorBo

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04 LTS (Noble Numbat)
Neoverse-V2, 8 physical cores
.NET SDK 11.0.100-preview.4.26210.111
  [Host]     : .NET 10.0.5 (10.0.5, 10.0.526.15411), Arm64 RyuJIT armv8.0-a

Method	Toolchain	Mean	Error	Ratio
IndexOfAnyBench	PR #126790	1.0178 ns	0.0001 ns	1.00
IndexOfAnyBench	main	1.0636 ns	0.0019 ns	1.05
LastIndexOfBench	PR #126790	0.9827 ns	0.0002 ns	1.00
LastIndexOfBench	main	1.0202 ns	0.0001 ns	1.04

Full logs

[EgorBot]

Results for ubuntu24_azure_cobalt100

@EgorBo

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.4 LTS (Noble Numbat)
Neoverse-N2, 8 physical cores
.NET SDK 11.0.100-preview.4.26210.111
  [Host]     : .NET 10.0.5 (10.0.5, 10.0.526.15411), Arm64 RyuJIT armv8.0-a

Method	Toolchain	Mean	Error	Ratio
IndexOfAnyBench	PR #126790	0.9603 ns	0.0004 ns	1.00
IndexOfAnyBench	main	1.9311 ns	0.0017 ns	2.01
LastIndexOfBench	PR #126790	0.9771 ns	0.0002 ns	1.00
LastIndexOfBench	main	1.3521 ns	0.0007 ns	1.38

Full logs

[EgorBo]

@EgorBot -arm -azure_arm -aws_arm

using BenchmarkDotNet.Attributes;
using BenchmarkDotNet.Running;
using System.Runtime.CompilerServices;
using System.Runtime.InteropServices;
using System.Runtime.Intrinsics;

public class Benchmarks
{
    static void Main(string[] args)
    {
        BenchmarkSwitcher.FromAssembly(typeof(Benchmarks).Assembly).Run(args);
    }

    byte[] data = [0,0,0,11,0,0,0,12,0,0,0,13,0,0,0,14];

    [Benchmark]
    public int IndexOfAnyBench() => IndexOfAny(ref MemoryMarshal.GetReference(data), 13, 14);

    [Benchmark]
    public int LastIndexOfBench() => LastIndexOf(ref MemoryMarshal.GetReference(data), 13);

    [MethodImpl(MethodImplOptions.NoInlining)]
    static int IndexOfAny(ref byte haystack, byte needle1, byte needle2)
    {
        var data = Vector128.LoadUnsafe(ref haystack);
        var cmp1 = Vector128.Equals(data, Vector128.Create(needle1));
        var cmp2 = Vector128.Equals(data, Vector128.Create(needle2));
        return Vector128.IndexOfWhereAllBitsSet(cmp1 | cmp2);
    }

    [MethodImpl(MethodImplOptions.NoInlining)]
    static int LastIndexOf(ref byte haystack, byte needle1)
    {
        var data = Vector128.LoadUnsafe(ref haystack);
        var cmp1 = Vector128.Equals(data, Vector128.Create(needle1));
        return Vector128.LastIndexOfWhereAllBitsSet(cmp1);
    }
}

[EgorBot]

Benchmark job submitted. The results will be posted here once they are ready.

• macos15_helix_arm64: live logs
• ubuntu24_azure_cobalt100: live logs
• ubuntu24_aws_graviton4: live logs

[EgorBot]

Results for macos15_helix_arm64

@EgorBo

BenchmarkDotNet v0.15.8, macOS Sequoia 15.4.1 (24E263) [Darwin 24.4.0]
Apple M4, 1 CPU, 10 logical and 10 physical cores
.NET SDK 11.0.100-preview.4.26210.111
  [Host]     : .NET 10.0.5 (10.0.5, 10.0.526.15411), Arm64 RyuJIT armv8.0-a

Method	Toolchain	Mean	Error	Ratio
IndexOfAnyBench	PR #126790	0.0706 ns	0.0008 ns	1.00
IndexOfAnyBench	main	0.2226 ns	0.0005 ns	3.15
LastIndexOfBench	PR #126790	0.2836 ns	0.0023 ns	1.00
LastIndexOfBench	main	0.0622 ns	0.0005 ns	0.22

Full logs

[EgorBot]

Results for ubuntu24_aws_graviton4

@EgorBo

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04 LTS (Noble Numbat)
Neoverse-V2, 8 physical cores
.NET SDK 11.0.100-preview.4.26210.111
  [Host]     : .NET 10.0.5 (10.0.5, 10.0.526.15411), Arm64 RyuJIT armv8.0-a

Method	Toolchain	Mean	Error	Ratio
IndexOfAnyBench	PR #126790	1.1022 ns	0.0015 ns	1.00
IndexOfAnyBench	main	1.0646 ns	0.0019 ns	0.97
LastIndexOfBench	PR #126790	1.0706 ns	0.0011 ns	1.00
LastIndexOfBench	main	0.9919 ns	0.0015 ns	0.93

Full logs

[EgorBot]

Results for ubuntu24_azure_cobalt100

@EgorBo

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.4 LTS (Noble Numbat)
Neoverse-N2, 8 physical cores
.NET SDK 11.0.100-preview.4.26210.111
  [Host]     : .NET 10.0.5 (10.0.5, 10.0.526.15411), Arm64 RyuJIT armv8.0-a

Method	Toolchain	Mean	Error	Ratio
IndexOfAnyBench	PR #126790	0.9757 ns	0.0003 ns	1.00
IndexOfAnyBench	main	1.9248 ns	0.0006 ns	1.97
LastIndexOfBench	PR #126790	0.9814 ns	0.0002 ns	1.00
LastIndexOfBench	main	1.4572 ns	0.0003 ns	1.48

Full logs

[tannergooding]

@EgorBot -arm -azure_arm -aws_arm

using BenchmarkDotNet.Attributes;
using BenchmarkDotNet.Running;
using System.Runtime.CompilerServices;
using System.Runtime.InteropServices;
using System.Runtime.Intrinsics;

public class Benchmarks
{
    static void Main(string[] args)
    {
        BenchmarkSwitcher.FromAssembly(typeof(Benchmarks).Assembly).Run(args);
    }

    byte[] data = [0,0,0,11,0,0,0,12,0,0,0,13,0,0,0,14];

    [Benchmark]
    public int IndexOfAnyBench() => IndexOfAny(ref MemoryMarshal.GetReference(data), 13, 14);

    [Benchmark]
    public int LastIndexOfBench() => LastIndexOf(ref MemoryMarshal.GetReference(data), 13);

    [MethodImpl(MethodImplOptions.NoInlining)]
    static int IndexOfAny(ref byte haystack, byte needle1, byte needle2)
    {
        var data = Vector128.LoadUnsafe(ref haystack);
        var cmp1 = Vector128.Equals(data, Vector128.Create(needle1));
        var cmp2 = Vector128.Equals(data, Vector128.Create(needle2));
        return Vector128.IndexOfWhereAllBitsSet(cmp1 | cmp2);
    }

    [MethodImpl(MethodImplOptions.NoInlining)]
    static int LastIndexOf(ref byte haystack, byte needle1)
    {
        var data = Vector128.LoadUnsafe(ref haystack);
        var cmp1 = Vector128.Equals(data, Vector128.Create(needle1));
        return Vector128.LastIndexOfWhereAllBitsSet(cmp1);
    }
}

[EgorBot]

Benchmark job submitted. The results will be posted here once they are ready.

• macos15_helix_arm64: live logs
• ubuntu24_azure_cobalt100: live logs
• ubuntu24_aws_graviton4: live logs

[EgorBot]

Results for macos15_helix_arm64

@tannergooding

BenchmarkDotNet v0.15.8, macOS Sequoia 15.4.1 (24E263) [Darwin 24.4.0]
Apple M4, 1 CPU, 10 logical and 10 physical cores
.NET SDK 11.0.100-preview.4.26210.111
  [Host]     : .NET 10.0.5 (10.0.5, 10.0.526.15411), Arm64 RyuJIT armv8.0-a

Method	Toolchain	Mean	Error	Ratio
IndexOfAnyBench	PR #126790	0.0689 ns	0.0016 ns	1.00
IndexOfAnyBench	main	0.1767 ns	0.0008 ns	2.57
LastIndexOfBench	PR #126790	0.2843 ns	0.0048 ns	1.00
LastIndexOfBench	main	0.3294 ns	0.0009 ns	1.16

Full logs

[EgorBot]

Results for ubuntu24_aws_graviton4

@tannergooding

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04 LTS (Noble Numbat)
Neoverse-V2, 8 physical cores
.NET SDK 11.0.100-preview.4.26210.111
  [Host]     : .NET 10.0.5 (10.0.5, 10.0.526.15411), Arm64 RyuJIT armv8.0-a

Method	Toolchain	Mean	Error	Ratio
IndexOfAnyBench	PR #126790	1.105 ns	0.0026 ns	1.00
IndexOfAnyBench	main	1.005 ns	0.0021 ns	0.91
LastIndexOfBench	PR #126790	1.071 ns	0.0008 ns	1.00
LastIndexOfBench	main	1.054 ns	0.0002 ns	0.98

Full logs

[EgorBot]

Results for ubuntu24_azure_cobalt100

@tannergooding

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.4 LTS (Noble Numbat)
Neoverse-N2, 8 physical cores
.NET SDK 11.0.100-preview.4.26210.111
  [Host]     : .NET 10.0.5 (10.0.5, 10.0.526.15411), Arm64 RyuJIT armv8.0-a

Method	Toolchain	Mean	Error	Ratio
IndexOfAnyBench	PR #126790	0.9324 ns	0.0002 ns	1.00
IndexOfAnyBench	main	1.0487 ns	0.0006 ns	1.12
LastIndexOfBench	PR #126790	0.9591 ns	0.0001 ns	1.00
LastIndexOfBench	main	0.8721 ns	0.0020 ns	0.91

Full logs