Skip to content

EHT-1238: Granular metrics#116

Open
spoutn1k wants to merge 8 commits into
mainfrom
spoutn1k/EHT-1238-explode-metrics
Open

EHT-1238: Granular metrics#116
spoutn1k wants to merge 8 commits into
mainfrom
spoutn1k/EHT-1238-explode-metrics

Conversation

@spoutn1k

Copy link
Copy Markdown
Contributor

Use parameters to select the nature of the output metrics.

@spoutn1k spoutn1k requested a review from jgrund as a code owner September 26, 2025 04:27
@notion-workspace

Copy link
Copy Markdown

Explode lustre metrics

@codecov

codecov Bot commented Sep 26, 2025

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 15.21739% with 39 lines in your changes missing coverage. Please review.
✅ Project coverage is 37.47%. Comparing base (72748b2) to head (4492bd6).

Files with missing lines Patch % Lines
lustre-collector/src/parser.rs 0.00% 37 Missing ⚠️
lustre-collector/src/llite/mod.rs 0.00% 1 Missing ⚠️
lustre-collector/src/quota.rs 87.50% 1 Missing ⚠️

❗ There is a different number of reports uploaded between BASE (72748b2) and HEAD (4492bd6). Click for more details.

HEAD has 1 upload less than BASE
Flag BASE (72748b2) HEAD (4492bd6)
all-tests 1 0
Additional details and impacted files
@@             Coverage Diff             @@
##             main     #116       +/-   ##
===========================================
- Coverage   94.57%   37.47%   -57.11%     
===========================================
  Files          46       32       -14     
  Lines        6107     4189     -1918     
  Branches     6107     4189     -1918     
===========================================
- Hits         5776     1570     -4206     
- Misses        256     2604     +2348     
+ Partials       75       15       -60     
Flag Coverage Δ
2_14_0_ddn133 35.52% <15.21%> (-0.12%) ⬇️
2_14_0_ddn145 37.28% <15.21%> (-0.13%) ⬇️
all-tests ?

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@github-actions

github-actions Bot commented Sep 26, 2025

Copy link
Copy Markdown

🐰 Bencher Report

Branchspoutn1k/EHT-1238-explode-metrics
Testbedci-runner
Click to view all benchmark results
BenchmarkLatencyBenchmark Result
nanoseconds (ns)
(Result Δ%)
Lower Boundary
nanoseconds (ns)
(Limit %)
Upper Boundary
nanoseconds (ns)
(Limit %)
parse_benchmarks/combine_performance📈 view plot
🚷 view threshold
122,550,000.00 ns
(-50.61%)Baseline: 248,146,368.42 ns
-699,409,878.40 ns
(-570.71%)
1,195,702,615.24 ns
(10.25%)
🐰 View full continuous benchmarking report in Bencher

@github-actions

github-actions Bot commented Sep 26, 2025

Copy link
Copy Markdown

🐰 Bencher Report

Branchspoutn1k/EHT-1238-explode-metrics
Testbedci-runner

⚠️ WARNING: No Threshold found!

Without a Threshold, no Alerts will ever be generated.

Click here to create a new Threshold
For more information, see the Threshold documentation.
To only post results if a Threshold exists, set the --ci-only-thresholds flag.

Click to view all benchmark results
BenchmarkD1 Miss Ratemisses (%)D1mrmisses (reads) x 1e3D1mwmisses (writes) x 1e3DLmrmisses (reads)DLmwmisses (writes) x 1e3Drreads x 1e6Dwwrites x 1e6Estimated Cyclescycles x 1e6I1 Miss Ratemisses (%)I1mrmisses (reads) x 1e3ILmrmisses (reads)InstructionsBenchmark Result
instructions x 1e6
(Result Δ%)
Lower Boundary
instructions x 1e6
(Limit %)
Upper Boundary
instructions x 1e6
(Limit %)
L1 Hit Ratehits (%)L1 Hitshits x 1e6LL Hit Ratehits (%)LL Hitshits x 1e3LL Miss Ratemisses (%)LLd Miss Ratemisses (%)LLi Miss Ratemisses (%)RAM Hit Ratehits (%)RAM Hitshits x 1e3Total read+writereads/writes x 1e6
lustre_metrics::memory_benches::bench_encode_lustre_metrics with_setup:generate_records()📈 view plot
⚠️ NO THRESHOLD
0.92 %📈 view plot
⚠️ NO THRESHOLD
24.89 reads x 1e3📈 view plot
⚠️ NO THRESHOLD
9.17 writes x 1e3📈 view plot
⚠️ NO THRESHOLD
108.00 reads📈 view plot
⚠️ NO THRESHOLD
6.47 writes x 1e3📈 view plot
⚠️ NO THRESHOLD
2.49 x 1e6📈 view plot
⚠️ NO THRESHOLD
1.23 x 1e6📈 view plot
⚠️ NO THRESHOLD
14.87 x 1e6📈 view plot
⚠️ NO THRESHOLD
0.01 %📈 view plot
⚠️ NO THRESHOLD
1.01 reads x 1e3📈 view plot
⚠️ NO THRESHOLD
850.00 reads📈 view plot
🚷 view threshold
10.79 x 1e6
(-30.92%)Baseline: 15.62 x 1e6
1.98 x 1e6
(18.36%)
29.25 x 1e6
(36.88%)
📈 view plot
⚠️ NO THRESHOLD
99.76 %📈 view plot
⚠️ NO THRESHOLD
14.47 x 1e6📈 view plot
⚠️ NO THRESHOLD
0.19 %📈 view plot
⚠️ NO THRESHOLD
27.63 x 1e3📈 view plot
⚠️ NO THRESHOLD
0.05 %📈 view plot
⚠️ NO THRESHOLD
0.18 %📈 view plot
⚠️ NO THRESHOLD
0.01 %📈 view plot
⚠️ NO THRESHOLD
0.05 %📈 view plot
⚠️ NO THRESHOLD
7.43 x 1e3📈 view plot
⚠️ NO THRESHOLD
14.51 x 1e6
🐰 View full continuous benchmarking report in Bencher

@github-actions

github-actions Bot commented Sep 26, 2025

Copy link
Copy Markdown

🐰 Bencher Report

Branchspoutn1k/EHT-1238-explode-metrics
Testbedci-runner

⚠️ WARNING: No Threshold found!

Without a Threshold, no Alerts will ever be generated.

Click here to create a new Threshold
For more information, see the Threshold documentation.
To only post results if a Threshold exists, set the --ci-only-thresholds flag.

Click to view all benchmark results
Benchmarkavg_runtime_rss_mibMeasure (MiB)avg_runtime_virtual_mibMeasure (MiB)end_rss_mibMeasure (MiB)end_virtual_mibMeasure (MiB)memory_growth_mibMeasure (MiB)peak_over_start_rss_ratioMeasure (units)peak_over_start_virtual_ratioMeasure (units)peak_rss_mibBenchmark Result
Measure (MiB)
(Result Δ%)
Lower Boundary
Measure (MiB)
(Limit %)
Upper Boundary
Measure (MiB)
(Limit %)
peak_virtual_mibMeasure (MiB)start_rss_mibMeasure (MiB)start_virtual_mibMeasure (MiB)virtual_growth_mibMeasure (MiB)
scrape_allocations📈 view plot
⚠️ NO THRESHOLD
40.87 MiB📈 view plot
⚠️ NO THRESHOLD
915.56 MiB📈 view plot
⚠️ NO THRESHOLD
40.91 MiB📈 view plot
⚠️ NO THRESHOLD
915.64 MiB📈 view plot
⚠️ NO THRESHOLD
0.20 MiB📈 view plot
⚠️ NO THRESHOLD
1.02 units📈 view plot
⚠️ NO THRESHOLD
1.01 units📈 view plot
🚷 view threshold
42.27 MiB
(-45.29%)Baseline: 77.25 MiB
-134.50 MiB
(-318.23%)
289.01 MiB
(14.62%)
📈 view plot
⚠️ NO THRESHOLD
944.97 MiB📈 view plot
⚠️ NO THRESHOLD
40.70 MiB📈 view plot
⚠️ NO THRESHOLD
911.66 MiB📈 view plot
⚠️ NO THRESHOLD
3.98 MiB
🐰 View full continuous benchmarking report in Bencher

@spoutn1k spoutn1k force-pushed the spoutn1k/EHT-1238-explode-metrics branch from 6822dad to efb67b9 Compare September 26, 2025 15:37
@spoutn1k spoutn1k self-assigned this Oct 6, 2025
@spoutn1k spoutn1k force-pushed the spoutn1k/EHT-1238-explode-metrics branch from 7232228 to 5e1a788 Compare October 7, 2025 05:58
@spoutn1k spoutn1k force-pushed the spoutn1k/EHT-1238-explode-metrics branch from 5e1a788 to 98fd85c Compare October 23, 2025 09:19
@github-actions

github-actions Bot commented Oct 23, 2025

Copy link
Copy Markdown

🐰 Bencher Report

Branchspoutn1k/EHT-1238-explode-metrics
Testbedci-runner

⚠️ WARNING: No Threshold found!

Without a Threshold, no Alerts will ever be generated.

Click here to create a new Threshold
For more information, see the Threshold documentation.
To only post results if a Threshold exists, set the --ci-only-thresholds flag.

Click to view all benchmark results
BenchmarkD1 Miss Ratemisses (%)D1mrmisses (reads) x 1e3D1mwmisses (writes) x 1e3DLmrmisses (reads)DLmwmisses (writes) x 1e3Drreads x 1e6Dwwrites x 1e6Estimated Cyclescycles x 1e6I1 Miss Ratemisses (%)I1mrmisses (reads) x 1e3ILmrmisses (reads)InstructionsBenchmark Result
instructions x 1e6
(Result Δ%)
Lower Boundary
instructions x 1e6
(Limit %)
Upper Boundary
instructions x 1e6
(Limit %)
L1 Hit Ratehits (%)L1 Hitshits x 1e6LL Hit Ratehits (%)LL Hitshits x 1e3LL Miss Ratemisses (%)LLd Miss Ratemisses (%)LLi Miss Ratemisses (%)RAM Hit Ratehits (%)RAM Hitshits x 1e3Total read+writereads/writes x 1e6
lustre_metrics::memory_benches::bench_encode_lustre_metrics with_setup:generate_records()📈 view plot
⚠️ NO THRESHOLD
0.92 %📈 view plot
⚠️ NO THRESHOLD
24.97 reads x 1e3📈 view plot
⚠️ NO THRESHOLD
9.18 writes x 1e3📈 view plot
⚠️ NO THRESHOLD
123.00 reads📈 view plot
⚠️ NO THRESHOLD
6.67 writes x 1e3📈 view plot
⚠️ NO THRESHOLD
2.47 x 1e6📈 view plot
⚠️ NO THRESHOLD
1.23 x 1e6📈 view plot
⚠️ NO THRESHOLD
14.82 x 1e6📈 view plot
⚠️ NO THRESHOLD
0.01 %📈 view plot
⚠️ NO THRESHOLD
1.07 reads x 1e3📈 view plot
⚠️ NO THRESHOLD
904.00 reads📈 view plot
🚷 view threshold
10.75 x 1e6
(-19.53%)Baseline: 13.35 x 1e6
2.42 x 1e6
(22.56%)
24.28 x 1e6
(44.25%)
📈 view plot
⚠️ NO THRESHOLD
99.76 %📈 view plot
⚠️ NO THRESHOLD
14.41 x 1e6📈 view plot
⚠️ NO THRESHOLD
0.19 %📈 view plot
⚠️ NO THRESHOLD
27.53 x 1e3📈 view plot
⚠️ NO THRESHOLD
0.05 %📈 view plot
⚠️ NO THRESHOLD
0.18 %📈 view plot
⚠️ NO THRESHOLD
0.01 %📈 view plot
⚠️ NO THRESHOLD
0.05 %📈 view plot
⚠️ NO THRESHOLD
7.70 x 1e3📈 view plot
⚠️ NO THRESHOLD
14.44 x 1e6
🐰 View full continuous benchmarking report in Bencher

@spoutn1k spoutn1k force-pushed the spoutn1k/EHT-1238-explode-metrics branch 2 times, most recently from 15cbb56 to ff94e98 Compare October 23, 2025 13:55
@breuhan

breuhan commented Feb 19, 2026

Copy link
Copy Markdown
Contributor

Is this needed for current release? If so, please rebase

@spoutn1k spoutn1k force-pushed the spoutn1k/EHT-1238-explode-metrics branch from 0e8ff00 to 243dfe6 Compare March 3, 2026 00:47
@spoutn1k spoutn1k requested review from breuhan and johnsonw and removed request for jgrund March 3, 2026 01:27
@spoutn1k spoutn1k force-pushed the spoutn1k/EHT-1238-explode-metrics branch from 243dfe6 to 15c235d Compare July 9, 2026 12:36
@spoutn1k spoutn1k force-pushed the spoutn1k/EHT-1238-explode-metrics branch from 15c235d to 4492bd6 Compare July 9, 2026 14:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants