Add CI test results summary as PR comment#355
Conversation
🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Scan-Build Report
Bug Summary
Reports
|
||||||||||||||||||||||||||||||||||||
Integration Tests❌ 6 passed, 18 failed out of 24 configurations Test Matrix
Failure Detailsglibc-arm64-hotspot-jdk11Profiler-only: glibc-arm64-hotspot-jdk17Profiler-only: glibc-arm64-hotspot-jdk21Profiler-only: glibc-arm64-hotspot-jdk8Profiler-only: glibc-arm64-openj9-jdk11Profiler-only: glibc-arm64-openj9-jdk17Profiler-only: glibc-arm64-openj9-jdk21Profiler-only: glibc-arm64-openj9-jdk8Profiler-only: glibc-x64-hotspot-jdk8Profiler-only: glibc-x64-openj9-jdk17Profiler-only: glibc-x64-openj9-jdk21Profiler-only: glibc-x64-openj9-jdk8Profiler-only: musl-arm64-hotspot-jdk21Profiler-only: musl-arm64-openj9-jdk11Profiler-only: musl-arm64-openj9-jdk17Profiler-only: musl-arm64-openj9-jdk21Profiler-only: musl-x64-openj9-jdk17Profiler-only: musl-x64-openj9-jdk21Profiler-only: Links
|
Benchmarks [x86_64 wall]Parameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 15 metrics, 23 unstable metrics. |
Benchmarks [x86_64 cpu]Parameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 24 unstable metrics. |
Benchmarks [x86_64 alloc]Parameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 15 metrics, 23 unstable metrics. |
Benchmarks [x86_64 memleak,alloc]Parameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 15 metrics, 23 unstable metrics. |
Benchmarks [x86_64 memleak]Parameters
See matching parameters
SummaryFound 1 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 23 unstable metrics.
|
Benchmarks [x86_64 cpu,wall,alloc,memleak]Parameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 15 metrics, 23 unstable metrics. |
Benchmarks [x86_64 cpu,wall]Parameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 24 unstable metrics. |
Benchmarks [aarch64 cpu,wall,alloc,memleak]Parameters
See matching parameters
SummaryFound 1 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 23 unstable metrics.
|
Benchmarks [aarch64 memleak]Parameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 16 metrics, 22 unstable metrics. |
Benchmarks [aarch64 cpu]Parameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 15 metrics, 23 unstable metrics. |
Benchmarks [aarch64 memleak,alloc]Parameters
See matching parameters
SummaryFound 1 performance improvements and 0 performance regressions! Performance is the same for 16 metrics, 21 unstable metrics.
|
Benchmarks [aarch64 wall]Parameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 17 metrics, 21 unstable metrics. |
Benchmarks [aarch64 alloc]Parameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 17 metrics, 21 unstable metrics. |
Benchmarks [aarch64 cpu,wall]Parameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 15 metrics, 23 unstable metrics. |
🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Initialize associative arrays with dummy key/unset for set -u compatibility - Use mapfile for array splitting (SC2207) - Quote variables properly (SC2086) - Use parameter expansion instead of sed (SC2001) - Add shellcheck disable for intentional literal regex matches (SC2076) 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
CI Test ResultsRun: #21707296456 | Commit:
Summary
Updated: 2026-02-05 10:24:05 UTC |
What does this PR do?:
Adds automated PR comments that summarize CI test results after all jobs complete. The comment is updated on each subsequent CI run.
Motivation:
Provides quick visibility into CI results directly on the PR without navigating to the Actions tab. Shows a matrix of all test configurations with pass/fail status and details for any failures.
Additional Notes:
.github/scripts/generate-test-summary.sh- fetches job data via GitHub API, generates markdown summarysummarize-testsjob to ci.yml that runs after all test matrix jobs completeHow to test the change?:
The PR itself will test the feature - check the CI tab and wait for the summary comment to appear after all test jobs complete.
For Datadog employees:
credentials of any kind, I've requested a review from
@DataDog/security-design-and-guidance.Unsure? Have a question? Request a review!
🤖 Generated with Claude Code
Co-Authored-By: Claude Opus 4.5 noreply@anthropic.com