Skip to content

🤖 Update Mock Benchmark Results#6189

Merged
thomhurst merged 1 commit into
mainfrom
automated-mock-benchmarks-update
Jun 8, 2026
Merged

🤖 Update Mock Benchmark Results#6189
thomhurst merged 1 commit into
mainfrom
automated-mock-benchmarks-update

Conversation

@thomhurst

Copy link
Copy Markdown
Owner

Automated Mock Benchmark Update

This PR updates the mock benchmark documentation with the latest results from the Mock Benchmarks workflow.

Benchmarks Produced

Individual benchmark artifacts are available for download:

  • mock-benchmark-MockCreation
  • mock-benchmark-Setup
  • mock-benchmark-Invocation
  • mock-benchmark-Verification
  • mock-benchmark-Callback
  • mock-benchmark-CombinedWorkflow
  • mock-benchmark-summary (aggregated overview)

Libraries Compared

Libraries are discovered dynamically from the benchmark output. See the generated summary.json for the full list.

Changes

  • Updated mock benchmark data in docs/static/benchmarks/mocks/latest.json
  • Regenerated mock benchmark documentation in docs/docs/benchmarks/mocks/
  • Updated mock benchmark summary in docs/static/benchmarks/mocks/summary.json

Workflow Run

  • Run ID: 27113978861
  • Triggered: schedule

🤖 This PR was automatically created and will be merged automatically once CI checks pass.

@thomhurst thomhurst added automated benchmarks documentation Improvements or additions to documentation ignore-for-release labels Jun 8, 2026
@thomhurst thomhurst merged commit becc097 into main Jun 8, 2026
12 of 13 checks passed
@thomhurst thomhurst deleted the automated-mock-benchmarks-update branch June 8, 2026 03:31

@claude claude Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated Benchmark Update — Review

This is a routine automated PR updating mock benchmark data and documentation from the latest CI run (2026-06-08). The changes are purely data-driven: timestamps, numeric benchmark results, chart axis ranges, and JSON payloads.

What Changed

  • Timestamps updated across all benchmark .md files and JSON data files from 2026-06-06 to 2026-06-08.
  • Benchmark numbers updated for all 6 categories (Callback, CombinedWorkflow, Invocation, MockCreation, Setup, Verification) across all compared libraries (TUnit.Mocks, Imposter, Mockolate, Moq, NSubstitute, FakeItEasy).
  • Mermaid chart y-axis ranges automatically scaled to reflect the new data ranges.

Notable Observations

  • TUnit.Mocks holds its relative position across all categories — it continues to lead or be competitive in most benchmark scenarios. No regressions evident.
  • Moq's Callback times increased notably (~141k ns → ~188k ns), which is an external library variance, not a TUnit concern.
  • The automation pipeline correctly generates, formats, and commits both the Markdown docs and the backing JSON data files in sync — no drift between latest.json and the rendered .md tables.

Assessment

The PR is mechanically correct and well-structured. The automated workflow handles timestamp propagation, data formatting, and chart scaling consistently. No issues found.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automated benchmarks documentation Improvements or additions to documentation ignore-for-release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant