[Bug] Tests statistics graph (runs vs test name) not rendering

[cj36457]

Bug

On the Tests section, the first graph — the one with runs on the X axis and test name on the Y axis — is not loading. The chart area is blank; no bars/data are rendered.

Other graphs on the page appear to render fine.

Expected

Graph populates with test names and their run counts.

Actual

Graph area is empty / nothing shows.

[cj36457]

robot_dashboard (1).html

[timdegroot1996]

I'm assuming you added that example to show that it's empty but when I open that dashboard and look at it I see a fully rendered graph:

Could you maybe provide your JSON from the settings so I can see if that causes the issue. Also can you check the browser console (F12 > console tab) and just screenshot what you see there and send it here.

[cj36457]

settings.json

[cj36457]

I seem to see the issue when the filter is filtering by run, instead of "all", although i cant reproduce it on the log file I sent. Only on my self-hosted dashboard

[cj36457]

im on Latest dashboard version

[timdegroot1996]

@cj36457 Thanks for the settings + console screenshots, thanks to that data my AI overlord found it 😄

Root cause found. Your settings.json has "Only Changes" enabled in the Compare section (compareOnlyChanges: true). The Test-section Statistics graph and the Compare graph share the same data function, and that function was applying both sections' "Only Changes" filters regardless of which section was active.

So in the Test section, the graph was silently keeping only tests whose status changed (pass↔fail↔skip) across the visible runs. That's also why it depended on the run filter:

• All 59 runs → some test flipped status at least once → graph renders.
• Filtered to fewer runs (e.g. latest 5) → your tests are stable, nothing flips → every test gets filtered out → blank chart.

And why it didn't repro on the file you uploaded — different toggle state / data with status changes.

Immediate workaround: turn off "Only Changes" in the Compare section. Your Test Statistics graph should come right back.

Fix:
the Compare-section filters no longer leak into the Test section (and vice-versa). It'll be in the next release. Duration/Messages weren't affected because they never read that filter — only the Statistics graph did.

[timdegroot1996]

@cj36457 accidentially closed it, but I will ping you when the newest version is out and this is released!

[cj36457]

awesome @tim thanks so much!!