Skip to content

🤖 Update Mock Benchmark Results#6154

Merged
thomhurst merged 1 commit into
mainfrom
automated-mock-benchmarks-update
Jun 3, 2026
Merged

🤖 Update Mock Benchmark Results#6154
thomhurst merged 1 commit into
mainfrom
automated-mock-benchmarks-update

Conversation

@thomhurst
Copy link
Copy Markdown
Owner

Automated Mock Benchmark Update

This PR updates the mock benchmark documentation with the latest results from the Mock Benchmarks workflow.

Benchmarks Produced

Individual benchmark artifacts are available for download:

  • mock-benchmark-MockCreation
  • mock-benchmark-Setup
  • mock-benchmark-Invocation
  • mock-benchmark-Verification
  • mock-benchmark-Callback
  • mock-benchmark-CombinedWorkflow
  • mock-benchmark-summary (aggregated overview)

Libraries Compared

Libraries are discovered dynamically from the benchmark output. See the generated summary.json for the full list.

Changes

  • Updated mock benchmark data in docs/static/benchmarks/mocks/latest.json
  • Regenerated mock benchmark documentation in docs/docs/benchmarks/mocks/
  • Updated mock benchmark summary in docs/static/benchmarks/mocks/summary.json

Workflow Run

  • Run ID: 26861529853
  • Triggered: schedule

🤖 This PR was automatically created and will be merged automatically once CI checks pass.

@thomhurst thomhurst added automated benchmarks documentation Improvements or additions to documentation ignore-for-release labels Jun 3, 2026
@thomhurst thomhurst merged commit dc0bfe0 into main Jun 3, 2026
12 of 13 checks passed
@thomhurst thomhurst deleted the automated-mock-benchmarks-update branch June 3, 2026 03:30
@codacy-production
Copy link
Copy Markdown

Up to standards ✅

🟢 Issues 0 issues

Results:
0 new issues

View in Codacy

NEW Get contextual insights on your PRs based on Codacy's metrics, along with PR and Jira context, without leaving GitHub. Enable AI reviewer
TIP This summary will be updated as you push new changes.

@claude
Copy link
Copy Markdown
Contributor

claude Bot commented Jun 3, 2026

Code Review

This is a clean automated benchmark documentation update. I reviewed it across multiple angles:

Data integrity checks (all passed):

  • Bar chart values match table Mean values across all 78 benchmarks
  • Y-axis upper bounds correctly use ceil(max * 1.2) in every chart
  • Units are consistent (ns vs μs) — CombinedWorkflow.md correctly uses μs throughout
  • latest.json values match all individual category JSON files exactly
  • JSON Mean strings match every Markdown table value
  • stats.totalBenchmarks = 78 is correct (Callback×12 + CombinedWorkflow×6 + Invocation×18 + MockCreation×12 + Setup×12 + Verification×18)

Observations (not blocking):

  • Invocation benchmarks show unusually high error-to-mean ratios (e.g., FakeItEasy Invocation: Error=1,199.87 ns on Mean=1,977.5 ns ≈ 61%). This is faithfully reproduced from the CI run but may indicate JIT/warm-up noise in those specific micro-benchmarks. Worth monitoring across future runs.
  • FakeItEasy Callback allocation dropped from 9.52 KB9.4 KB with reduced precision — consistent with how the new run formatted the output, no actual inconsistency.

No issues found. The automation is working correctly. ✅

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automated benchmarks documentation Improvements or additions to documentation ignore-for-release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant