Benchmarks for #121280 (EgorBo)

[EgorBot]

Processing dotnet/runtime#121280 (comment) command:

Command

-aws_arm -profiler

using System.Runtime.CompilerServices;
using BenchmarkDotNet.Attributes;

public class Benchmark
{
    static readonly object SyncRoot = new();

    [Benchmark]
    public void Object()
    {
        lock (SyncRoot)
            DoWork();
    }
}

(EgorBot will reply in this issue)

[EgorBot]

❌ Benchmark validation failed

cc @EgorBo (logs). EgorBot manual: link.

[EgorBo]

@EgorBot -aws_arm -profiler

using System.Runtime.CompilerServices;
using BenchmarkDotNet.Attributes;

public class Program
{
    static readonly object SyncRoot = new();

    [Benchmark]
    public void Object()
    {
        lock (SyncRoot)
            DoWork();
    }

    [MethodImpl(MethodImplOptions.NoInlining)]
    private static void DoWork() { }
}

[EgorBot]

❌ Benchmark validation failed

cc @EgorBo (logs). EgorBot manual: link.

[EgorBo]

@EgorBot -aws_arm -profiler

using System.Runtime.CompilerServices;
using BenchmarkDotNet.Attributes;

public class Benchmark
{
    static readonly object SyncRoot = new();

    [Benchmark]
    public void Object()
    {
        lock (SyncRoot)
            DoWork();
    }

    [MethodImpl(MethodImplOptions.NoInlining)]
    private static void DoWork() { }
}

[EgorBot]

Benchmark results on linux_aws_graviton4

BenchmarkDotNet v0.15.0, Linux Ubuntu 24.04 LTS (Noble Numbat)
Neoverse-V2, 16 physical cores
  Job-AEKFOC : .NET 10.0.0 (42.42.42.42424), Arm64 RyuJIT AdvSIMD
  Job-LZGYYS : .NET 10.0.0 (42.42.42.42424), Arm64 RyuJIT AdvSIMD
StdDev=0.003 ns

Method	Toolchain	Mean	Error	Ratio
Object	Main	19.64 ns	0.003 ns	1.00
Object	PR	19.68 ns	0.003 ns	1.00

Artifacts.zip

Profiling for Benchmark_Object:

SVG flamegraph: Main vs PR 🔥
Speedscope flamegraph: Main vs PR
Hot asm code: Main vs PR
HW counters: Main vs PR

cc @EgorBo (agent_logs.txt). EgorBot manual: link.

[EgorBo]

@EgorBot -aws_arm -profiler

using System.Runtime.CompilerServices;
using BenchmarkDotNet.Attributes;

public class Benchmark
{
    static readonly object SyncRoot = new();

    [Benchmark]
    public void Object()
    {
        lock (SyncRoot)
            DoWork();
    }

    [MethodImpl(MethodImplOptions.NoInlining)]
    private static void DoWork() { }
}

[EgorBo]

@EgorBot -aws_arm -profiler

using System.Runtime.CompilerServices;
using BenchmarkDotNet.Attributes;

public class Benchmark
{
    static readonly object SyncRoot = new();

    [Benchmark]
    public void Object()
    {
        lock (SyncRoot)
            DoWork();
    }

    [MethodImpl(MethodImplOptions.NoInlining)]
    private static void DoWork() { }
}

[EgorBot]

❌ Failed on AwsGraviton4: Job failed, see logs.

cc @EgorBo (logs). EgorBot manual: link.

[EgorBo]

@EgorBot -aws_arm -profiler

using System.Runtime.CompilerServices;
using BenchmarkDotNet.Attributes;

public class Benchmark
{
    static readonly object SyncRoot = new();

    [Benchmark]
    public void Object()
    {
        lock (SyncRoot)
            DoWork();
    }

    [MethodImpl(MethodImplOptions.NoInlining)]
    private static void DoWork() { }
}

[EgorBot]

Benchmark results on linux_aws_graviton4

BenchmarkDotNet v0.15.0, Linux Ubuntu 24.04 LTS (Noble Numbat)
Neoverse-V2, 16 physical cores
  Job-NQIFQC : .NET 10.0.0 (42.42.42.42424), Arm64 RyuJIT AdvSIMD
  Job-CKDAJY : .NET 10.0.0 (42.42.42.42424), Arm64 RyuJIT AdvSIMD

Method	Toolchain	Mean	Error	Ratio
Object	Main	19.66 ns	0.007 ns	1.00
Object	PR	18.91 ns	0.002 ns	0.96

Artifacts.zip

Profiling for Benchmark_Object:

SVG flamegraph: Main vs PR 🔥
Speedscope flamegraph: Main vs PR
Hot asm code: Main vs PR
HW counters: Main vs PR

cc @EgorBo (agent_logs.txt). EgorBot manual: link.

[EgorBot]

Benchmark results on linux_aws_graviton4

BenchmarkDotNet v0.15.0, Linux Ubuntu 24.04 LTS (Noble Numbat)
Neoverse-V2, 16 physical cores
  Job-UYHUDV : .NET 10.0.0 (42.42.42.42424), Arm64 RyuJIT AdvSIMD
  Job-ZDNSSF : .NET 10.0.0 (42.42.42.42424), Arm64 RyuJIT AdvSIMD

Method	Toolchain	Mean	Error	Ratio
Object	Main	21.15 ns	0.002 ns	1.00
Object	PR	19.03 ns	0.001 ns	0.90

Artifacts.zip

Profiling for Benchmark_Object:

SVG flamegraph: Main vs PR 🔥
Speedscope flamegraph: Main vs PR
Hot asm code: Main vs PR
HW counters: Main vs PR

cc @EgorBo (agent_logs.txt). EgorBot manual: link.

[EgorBo]

@EgorBot -arm

using System.Runtime.CompilerServices;
using BenchmarkDotNet.Attributes;

public class Benchmark
{
    static readonly object SyncRoot = new();

    [Benchmark]
    public void Object()
    {
        lock (SyncRoot)
            DoWork();
    }

    [MethodImpl(MethodImplOptions.NoInlining)]
    private static void DoWork() { }
}

[EgorBot]

Benchmark results on linux_azure_cobalt100

BenchmarkDotNet v0.15.0, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
Neoverse-N2, 16 physical cores
  Job-SRQAEA : .NET 10.0.0 (42.42.42.42424), Arm64 RyuJIT AdvSIMD
  Job-GSEJIR : .NET 10.0.0 (42.42.42.42424), Arm64 RyuJIT AdvSIMD

Method	Toolchain	Mean	Error	Ratio
Object	Main	17.44 ns	0.035 ns	1.00
Object	PR	15.82 ns	0.004 ns	0.91

Artifacts.zip

cc @EgorBo (agent_logs.txt). EgorBot manual: link.