Get chargeback data results from loki and validate by ayefimov-1 · Pull Request #335 · infrawatch/feature-verification-tests

ayefimov-1 · 2026-02-03T20:28:51Z

that the total cost is correct

Used Gemini and Cursor
Validates chargeback total cost

uses synth data to calculate total cost via script
run "openstack rating summary get" to get total cost from loki
compares script_totals and Loki_Totals if same then job passes

Closes: https://issues.redhat.com/browse/OSPRH-26066
Closes: https://issues.redhat.com/browse/OSPRH-26361

softwarefactory-project-zuul · 2026-02-04T23:37:50Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/3653e0a8dd2e4ddea41c10ef97a7d073

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 07m 55s
✔️ functional-chargeback-tests-osp18 SUCCESS in 1h 20m 22s
✔️ feature-verification-tests-noop SUCCESS in 5s
❌ functional-tests-osp18 FAILURE in 1h 50m 06s

softwarefactory-project-zuul · 2026-02-05T22:03:19Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/e14cf51447bc425d874de78466d0ea27

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 1h 57m 21s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 07m 17s
✔️ feature-verification-tests-noop SUCCESS in 5s
❌ functional-tests-osp18 FAILURE in 1h 39m 09s

ayefimov-1 · 2026-02-05T22:06:24Z

recheck

softwarefactory-project-zuul · 2026-02-06T18:55:50Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/4d8e228d62f2458bb70aaf51d23d0edb

❌ telemetry-openstack-meta-content-provider-master FAILURE in 15m 22s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

softwarefactory-project-zuul · 2026-02-06T19:23:44Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/ef2941d8a8c842d0ba8fb8832d217602

❌ telemetry-openstack-meta-content-provider-master FAILURE in 14m 27s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

ayefimov-1 · 2026-02-06T19:30:15Z

recheck

softwarefactory-project-zuul · 2026-02-06T19:45:54Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/ef445a39c5e347aa955c54db965f5a6f

❌ telemetry-openstack-meta-content-provider-master FAILURE in 14m 30s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

ayefimov-1 · 2026-02-06T21:09:20Z

recheck

softwarefactory-project-zuul · 2026-02-06T21:26:46Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/0a9a2771578a4bd9af5a72501030d667

❌ telemetry-openstack-meta-content-provider-master FAILURE in 16m 10s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

softwarefactory-project-zuul · 2026-02-06T22:12:56Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/d172ce02695b40e593f54c99fc7e9e3b

❌ telemetry-openstack-meta-content-provider-master FAILURE in 14m 56s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

ayefimov-1 · 2026-02-08T20:53:52Z

recheck

softwarefactory-project-zuul · 2026-02-09T19:17:39Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/070a8250ac274f96b5bd8f5a250ef6b2

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 36m 03s
❌ functional-chargeback-tests-osp18 RETRY_LIMIT in 18m 41s
✔️ feature-verification-tests-noop SUCCESS in 5s
❌ functional-tests-osp18 RETRY_LIMIT in 18m 14s

ayefimov-1 · 2026-02-09T19:20:25Z

recheck

ayefimov-1 · 2026-02-24T00:16:50Z

recheck

ayefimov-1 · 2026-02-24T15:26:34Z

recheck

softwarefactory-project-zuul · 2026-02-24T15:40:44Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/e74ac40b82ad4278a3a50ac02d0feb70

❌ telemetry-openstack-meta-content-provider-master FAILURE in 12m 54s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 6s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

ayefimov-1 · 2026-02-24T15:46:26Z

recheck

so that they can be compared easily

softwarefactory-project-zuul · 2026-02-24T21:22:19Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/22a2635784f849978dc299d43359491c

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 1h 47m 44s
✔️ functional-chargeback-tests-osp18 SUCCESS in 1h 30m 09s
✔️ feature-verification-tests-noop SUCCESS in 5s
❌ functional-tests-osp18 RETRY_LIMIT in 11m 41s

ayefimov-1 · 2026-02-24T22:00:09Z

recheck

softwarefactory-project-zuul · 2026-02-25T00:43:55Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/75852eb6c9e8482b87ea5c30a91cb6a9

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 42m 06s
❌ functional-chargeback-tests-osp18 RETRY_LIMIT in 11m 21s
✔️ feature-verification-tests-noop SUCCESS in 4s
✔️ functional-tests-osp18 SUCCESS in 2h 23m 23s

ayefimov-1 · 2026-02-25T13:27:42Z

recheck

softwarefactory-project-zuul · 2026-02-25T13:59:40Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/e56da1e461a4423388df0f7eec705771

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 30m 39s
❌ functional-chargeback-tests-osp18 RETRY_LIMIT in 11m 32s
✔️ feature-verification-tests-noop SUCCESS in 4s
❌ functional-tests-osp18 RETRY_LIMIT in 11m 52s

ayefimov-1 · 2026-02-25T14:57:34Z

recheck

softwarefactory-project-zuul · 2026-02-25T15:40:04Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/8c83a6fe38124032b41afc8725cc76ba

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 40m 37s
❌ functional-chargeback-tests-osp18 RETRY_LIMIT in 22m 24s
✔️ feature-verification-tests-noop SUCCESS in 4s
❌ functional-tests-osp18 RETRY_LIMIT in 22m 12s

softwarefactory-project-zuul · 2026-02-25T18:16:36Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/3fff73cca9fa43338b0d44ad6322200d

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 40m 35s
❌ functional-chargeback-tests-osp18 RETRY_LIMIT in 21m 37s
✔️ feature-verification-tests-noop SUCCESS in 5s
❌ functional-tests-osp18 RETRY_LIMIT in 22m 10s

ayefimov-1 · 2026-02-26T13:39:55Z

recheck

softwarefactory-project-zuul · 2026-02-26T16:04:27Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/1be4472a5d5347c8a21fd59893d86510

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 21m 04s
✔️ functional-chargeback-tests-osp18 SUCCESS in 1h 48m 20s
✔️ feature-verification-tests-noop SUCCESS in 5s
❌ functional-tests-osp18 FAILURE in 1h 54m 32s

softwarefactory-project-zuul · 2026-02-26T19:15:50Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/3281e98ebc384d6c90adbcdb83e02744

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 22m 42s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 37m 56s
✔️ feature-verification-tests-noop SUCCESS in 5s
✔️ functional-tests-osp18 SUCCESS in 2h 04m 15s

removed second filter for Loki data output

softwarefactory-project-zuul · 2026-02-27T02:13:39Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/d40a8e0618bb422390f6ba99127fe2fd

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 31m 04s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 33m 03s
✔️ feature-verification-tests-noop SUCCESS in 4s
✔️ functional-tests-osp18 SUCCESS in 2h 11m 51s

if I add all log_types to each test, will it fix db results?

softwarefactory-project-zuul · 2026-02-27T19:49:20Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/e90f1e9e41bc4f24b889f0ac03b0fa68

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 3h 49m 25s
❌ functional-chargeback-tests-osp18 FAILURE in 2h 59m 35s
✔️ feature-verification-tests-noop SUCCESS in 5s
✔️ functional-tests-osp18 SUCCESS in 2h 15m 34s

ayefimov-1 force-pushed the alexy_ck_get_cost branch 3 times, most recently from eac0578 to 81c746b Compare February 4, 2026 21:28

ayefimov-1 force-pushed the alexy_ck_get_cost branch 6 times, most recently from 63c23a2 to df89225 Compare February 5, 2026 20:04

ayefimov-1 force-pushed the alexy_ck_get_cost branch 2 times, most recently from 2421fe3 to cae4835 Compare February 6, 2026 18:39

ayefimov-1 force-pushed the alexy_ck_get_cost branch from 04d648f to 5e40438 Compare February 6, 2026 19:07

ayefimov-1 force-pushed the alexy_ck_get_cost branch from e95dd39 to ec89594 Compare February 6, 2026 21:10

ayefimov-1 force-pushed the alexy_ck_get_cost branch from abc403a to 2def821 Compare February 9, 2026 18:40

ayefimov-1 force-pushed the alexy_ck_get_cost branch 3 times, most recently from 7e94bdd to d2866b4 Compare February 11, 2026 20:47

ayefimov-1 force-pushed the alexy_ck_get_cost branch 3 times, most recently from 40f356b to 7fc89ac Compare February 23, 2026 21:07

ayefimov-1 force-pushed the alexy_ck_get_cost branch from 7fc89ac to 071afc2 Compare February 24, 2026 14:25

Added user_id variable and passing to syn data generator

febfdb6

ayefimov-1 force-pushed the alexy_ck_get_cost branch from 071afc2 to febfdb6 Compare February 24, 2026 14:49

Fix synth data formatting and loki data formatting

3bfee8c

so that they can be compared easily

added json format checker to gen_synth_loki_data.py

b503120

ayefimov-1 force-pushed the alexy_ck_get_cost branch from 8a089be to b503120 Compare February 26, 2026 16:51

fixed variable names

49fa9af

removed second filter for Loki data output

ayefimov-1 force-pushed the alexy_ck_get_cost branch from d7c2f9d to 49fa9af Compare February 26, 2026 21:32

set groupby ID values "null"

b783577

testing behavior of db:

a3424fe

if I add all log_types to each test, will it fix db results?

Conversation

ayefimov-1 commented Feb 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

softwarefactory-project-zuul bot commented Feb 4, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 5, 2026

Uh oh!

ayefimov-1 commented Feb 5, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 6, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 6, 2026

Uh oh!

ayefimov-1 commented Feb 6, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 6, 2026

Uh oh!

ayefimov-1 commented Feb 6, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 6, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 6, 2026

Uh oh!

ayefimov-1 commented Feb 8, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 9, 2026

Uh oh!

ayefimov-1 commented Feb 9, 2026

Uh oh!

ayefimov-1 commented Feb 24, 2026

Uh oh!

ayefimov-1 commented Feb 24, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 24, 2026

Uh oh!

ayefimov-1 commented Feb 24, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 24, 2026

Uh oh!

ayefimov-1 commented Feb 24, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 25, 2026

Uh oh!

ayefimov-1 commented Feb 25, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 25, 2026

Uh oh!

ayefimov-1 commented Feb 25, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 25, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 25, 2026

Uh oh!

ayefimov-1 commented Feb 26, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 26, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 26, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 27, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 27, 2026

Uh oh!

Reviewers

Assignees

Labels

Milestone

Development

Uh oh!

4 participants

ayefimov-1 commented Feb 3, 2026 •

edited

Loading