[telemetry_chargeback] Get chargeback data results from loki and validate (TEMP) by ayefimov-1 · Pull Request #335 · infrawatch/feature-verification-tests

ayefimov-1 · 2026-02-03T20:28:51Z

Test changes validate Synthetic data push and pull from loki

Generates Synthetic data
Uploads data to loki
pull data from loki
Validates chargeback synthetic data upload and download
Checks to see that CK rating data is generated from synthetic data

Closes: https://issues.redhat.com/browse/OSPRH-26066
Closes: https://issues.redhat.com/browse/OSPRH-26361
Closes: https://issues.redhat.com/browse/OSPRH-26969

Assisted-by: Claude

softwarefactory-project-zuul · 2026-02-05T22:03:19Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/e14cf51447bc425d874de78466d0ea27

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 1h 57m 21s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 07m 17s
✔️ feature-verification-tests-noop SUCCESS in 5s
❌ functional-tests-osp18 FAILURE in 1h 39m 09s

ayefimov-1 · 2026-02-05T22:06:24Z

recheck

softwarefactory-project-zuul · 2026-02-06T18:55:50Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/4d8e228d62f2458bb70aaf51d23d0edb

❌ telemetry-openstack-meta-content-provider-master FAILURE in 15m 22s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

softwarefactory-project-zuul · 2026-02-06T19:23:44Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/ef2941d8a8c842d0ba8fb8832d217602

❌ telemetry-openstack-meta-content-provider-master FAILURE in 14m 27s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

ayefimov-1 · 2026-02-06T19:30:15Z

recheck

softwarefactory-project-zuul · 2026-02-06T19:45:54Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/ef445a39c5e347aa955c54db965f5a6f

❌ telemetry-openstack-meta-content-provider-master FAILURE in 14m 30s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

ayefimov-1 · 2026-02-06T21:09:20Z

recheck

softwarefactory-project-zuul · 2026-02-06T21:26:46Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/0a9a2771578a4bd9af5a72501030d667

❌ telemetry-openstack-meta-content-provider-master FAILURE in 16m 10s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

softwarefactory-project-zuul · 2026-02-06T22:12:56Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/d172ce02695b40e593f54c99fc7e9e3b

❌ telemetry-openstack-meta-content-provider-master FAILURE in 14m 56s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

ayefimov-1 · 2026-02-08T20:53:52Z

recheck

softwarefactory-project-zuul · 2026-02-09T19:17:39Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/070a8250ac274f96b5bd8f5a250ef6b2

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 36m 03s
❌ functional-chargeback-tests-osp18 RETRY_LIMIT in 18m 41s
✔️ feature-verification-tests-noop SUCCESS in 5s
❌ functional-tests-osp18 RETRY_LIMIT in 18m 14s

ayefimov-1 · 2026-02-09T19:20:25Z

recheck

elfiesmelfie

In general, is this intended to be run in pieces or all together?

There are tags are not needed if all the tasks are going to always be run.

There's also a few tasks that save data to files, and then re-load it from files in a different task. If the data files are needed for log, you can write them to the logs dir, and keep the content in a var.

When creating the test data, you can just save the list of files as a fact at that point instead of running extra tasks to get the task file names.

softwarefactory-project-zuul · 2026-04-20T13:24:24Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/feature-verification-tests for 351,5b41b1c5c6ccd38148a114d96c451b065bfa887b

softwarefactory-project-zuul · 2026-04-20T15:12:44Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/feature-verification-tests for 351,5b41b1c5c6ccd38148a114d96c451b065bfa887b

softwarefactory-project-zuul · 2026-04-20T15:13:37Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/feature-verification-tests for 351,5b41b1c5c6ccd38148a114d96c451b065bfa887b

- uses synth data to calculate total cost via script - run "openstack rating summary get" to get total cost from loki - compares script_totals and Loki_Totals if same then job passes - Used Gemini and Cursor AI

softwarefactory-project-zuul · 2026-04-20T15:28:52Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/feature-verification-tests for 351,5b41b1c5c6ccd38148a114d96c451b065bfa887b

ayefimov-1 · 2026-04-20T15:32:10Z

recheck

push and retriieved from loki - uses synth data to calculate total cost via script - run "openstack rating summary get" to get total cost from loki - compares script_totals and Loki_Totals if same then job passes - Used Gemini and Cursor AI

* Validates chargeback data is generated and then push and retriieved from loki - uses synth data to calculate total cost via script - run "openstack rating summary get" to get total cost from loki - compares script_totals and Loki_Totals if same then job passes - Used Gemini and Cursor AI * Review Changes * Delete roles/telemetry_chargeback/.gitignore --------- Co-authored-by: ayefimov <ayefimov@redhat.com>

push and retriieved from loki - uses synth data to calculate total cost via script - run "openstack rating summary get" to get total cost from loki - compares script_totals and Loki_Totals if same then job passes - Used Gemini and Cursor AI

…quire changing the role

Address review feedback: consolidate repeated when conditions into blocks and skip the entire workflow when no scenarios are found.

ayefimov-1 · 2026-04-20T20:20:23Z

recheck

ayefimov-1 · 2026-04-20T20:30:54Z

recheck

Adding a method to selecting telemetry_chargeback scenarios to run which do not require changing the role

ayefimov-1 · 2026-04-28T14:05:23Z

recheck

softwarefactory-project-zuul · 2026-04-28T18:36:40Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/c7d7b2fbddb64749ad84a31f22c45795

❌ telemetry-openstack-meta-content-provider-master FAILURE in 4m 46s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

ayefimov-1 · 2026-04-28T18:45:09Z

recheck

with db rating output

centosinfra-prod-github-app · 2026-04-30T11:50:09Z

Unable to freeze job graph: Unable to modify final job <Job noop explicit: None implied: None source: None#0> attribute parent=noop with variant <Job feature-verification-tests-noop explicit: None implied: {MatchAny:{ImpliedBranchMatcher:master}} source: infrawatch/feature-verification-tests/.zuul.yaml@master#139>

centosinfra-prod-github-app · 2026-05-07T21:51:55Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/acf6f797f566457994cf42ab49edcf32

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 12m 17s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 51m 23s
✔️ feature-verification-tests-noop SUCCESS in 1m 06s
❌ functional-tests-osp18 FAILURE in 1h 55m 12s

ayefimov-1 force-pushed the alexy_ck_get_cost branch 9 times, most recently from 63c23a2 to df89225 Compare February 5, 2026 20:04

ayefimov-1 force-pushed the alexy_ck_get_cost branch 2 times, most recently from 2421fe3 to cae4835 Compare February 6, 2026 18:39

ayefimov-1 force-pushed the alexy_ck_get_cost branch from 04d648f to 5e40438 Compare February 6, 2026 19:07

ayefimov-1 force-pushed the alexy_ck_get_cost branch from e95dd39 to ec89594 Compare February 6, 2026 21:10

ayefimov-1 force-pushed the alexy_ck_get_cost branch from abc403a to 2def821 Compare February 9, 2026 18:40

ayefimov-1 force-pushed the alexy_ck_get_cost branch 3 times, most recently from 7e94bdd to d2866b4 Compare February 11, 2026 20:47

elfiesmelfie reviewed Feb 11, 2026

View reviewed changes

ayefimov-1 added 2 commits April 20, 2026 11:27

Updating README file and rebasing

9ddc144

- uses synth data to calculate total cost via script - run "openstack rating summary get" to get total cost from loki - compares script_totals and Loki_Totals if same then job passes - Used Gemini and Cursor AI

Review Changes

99b320f

ayefimov-1 and others added 7 commits April 20, 2026 11:33

Removing internal variables from README

6c10d04

Review Changes

da2f3df

Method to select telemetry_chargeback scenarios to run that do not re…

d2bbe9c

…quire changing the role

Use Ansible blocks to group conditional scenario selection logic

1b3e334

Address review feedback: consolidate repeated when conditions into blocks and skip the entire workflow when no scenarios are found.

Merge pull request #349 from infrawatch/myadla_neg_tests

1b78dde

Adding a method to selecting telemetry_chargeback scenarios to run which do not require changing the role

myadla mentioned this pull request Apr 20, 2026

PR against master to run Zuul CI checks for PR349 #358

Draft

ayefimov-1 added 2 commits April 21, 2026 09:38

Merge branch 'master' into alexy_ck_get_cost

46db84b

Merge branch 'master' into alexy_ck_get_cost

815cc32

Merge branch 'master' into alexy_ck_get_cost

0cb1ea9

ayefimov-1 added 2 commits April 29, 2026 10:01

Add updated db summary output to be more consistent

7e9e88a

with db rating output

Merge branch 'master' into alexy_ck_get_cost

1577d50

myadla mentioned this pull request May 5, 2026

Refactor telemetry_chargeback to use scenario_result dictionary #376

Open

Merge branch 'master' into alexy_ck_get_cost

01a3432

Conversation

ayefimov-1 commented Feb 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

softwarefactory-project-zuul Bot commented Feb 5, 2026

Uh oh!

ayefimov-1 commented Feb 5, 2026

Uh oh!

softwarefactory-project-zuul Bot commented Feb 6, 2026

Uh oh!

softwarefactory-project-zuul Bot commented Feb 6, 2026

Uh oh!

ayefimov-1 commented Feb 6, 2026

Uh oh!

softwarefactory-project-zuul Bot commented Feb 6, 2026

Uh oh!

ayefimov-1 commented Feb 6, 2026

Uh oh!

softwarefactory-project-zuul Bot commented Feb 6, 2026

Uh oh!

softwarefactory-project-zuul Bot commented Feb 6, 2026

Uh oh!

ayefimov-1 commented Feb 8, 2026

Uh oh!

softwarefactory-project-zuul Bot commented Feb 9, 2026

Uh oh!

ayefimov-1 commented Feb 9, 2026

Uh oh!

elfiesmelfie left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

softwarefactory-project-zuul Bot commented Apr 20, 2026

Uh oh!

softwarefactory-project-zuul Bot commented Apr 20, 2026

Uh oh!

softwarefactory-project-zuul Bot commented Apr 20, 2026

Uh oh!

softwarefactory-project-zuul Bot commented Apr 20, 2026

Uh oh!

ayefimov-1 commented Apr 20, 2026

Uh oh!

ayefimov-1 commented Apr 20, 2026

Uh oh!

ayefimov-1 commented Apr 20, 2026

Uh oh!

ayefimov-1 commented Apr 28, 2026

Uh oh!

softwarefactory-project-zuul Bot commented Apr 28, 2026

Uh oh!

ayefimov-1 commented Apr 28, 2026

Uh oh!

centosinfra-prod-github-app Bot commented Apr 30, 2026

Uh oh!

centosinfra-prod-github-app Bot commented May 7, 2026

Uh oh!

Reviewers

Assignees

Labels

Milestone

Development

Uh oh!

4 participants

ayefimov-1 commented Feb 3, 2026 •

edited

Loading