CCO-767: test-ext: Migrate openshift-tests-private E2E cases #961

huangmingxia · 2026-01-15T21:29:09Z

Description

Migrates CCO test cases from openshift-tests-private to the CCO repository

Test Suite Configuration

This update configures 4 test suites to organize and categorize CCO test cases:

cco/conformance/parallel
- LEVEL0 parallel tests
- Filter: [LEVEL0] and excludes [Serial] or [Disruptive]
cco/conformance/serial (0 tests)
- Serial but non-disruptive tests
- Filter: contains [Serial] but excludes [Disruptive]
- Currently empty, reserved for future non-disruptive serial tests
cco/disruptive (4 tests)
- Disruptive tests that modify cluster state
- Filter: contains [Disruptive]
cco/all (16 tests)
- All CCO test cases

Currently, Level0 test cases are enabled in the cco/conformance/parallel test suite.
Once these tests are running stably, will plan to migrate additional test cases (non-Disruptive,
non-Serial, and non-long-running) to the cco/conformance/parallel test suite.

Changes

Added SkipIfHyperShift(oc) calls to all test cases marked with NonHyperShiftHOST tag
Fixed checkModeInMetric() function to properly update global modeInMetric variable for error reporting
Added file cleanup logic for temporary files (root-secret.yaml) to prevent resource leaks
Added wait logic in checkCCOHealth() to handle transient Progressing states in mint mode

openshift-ci-robot · 2026-01-15T21:29:12Z

@huangmingxia: This pull request references CCO-767 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.22.0" version, but no target version was set.

Details

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot · 2026-01-15T21:31:07Z

@huangmingxia: This pull request references CCO-767 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.22.0" version, but no target version was set.

Details

In response to this:

Migrate CCO QE E2E cases from openshift-tests-private into this repo under test/extend.

Replace the previous openshift/origin test CLI dependency with a small local CLI wrapper.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

huangmingxia · 2026-01-15T21:37:23Z

/hold

codecov · 2026-01-15T21:46:34Z

Codecov Report

❌ Patch coverage is 0% with 74 lines in your changes missing coverage. Please review.
✅ Project coverage is 46.20%. Comparing base (af37b11) to head (fa8e844).

Files with missing lines	Patch %	Lines
cmd/cloud-credential-tests-ext/main.go	0.00%	74 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master     #961      +/-   ##
==========================================
- Coverage   46.31%   46.20%   -0.11%     
==========================================
  Files          98       98              
  Lines       12225    12253      +28     
==========================================
  Hits         5662     5662              
- Misses       5913     5941      +28     
  Partials      650      650

Files with missing lines	Coverage Δ
cmd/cloud-credential-tests-ext/main.go	`0.00% <0.00%> (ø)`

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

huangmingxia · 2026-01-19T20:02:04Z

/unhold

openshift-ci-robot · 2026-01-19T22:06:04Z

@huangmingxia: This pull request references CCO-767 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.22.0" version, but no target version was set.

Details

In response to this:

Description

Migrates CCO test cases from openshift-tests-private to the CCO repository

Changes

Added SkipIfHyperShift(oc) calls to all test cases marked with NonHyperShiftHOST tag

Fixed checkModeInMetric() function to properly update global modeInMetric variable for error reporting

Added file cleanup logic for temporary files (root-secret.yaml) to prevent resource leaks

Added wait logic in checkCCOHealth() to handle transient Progressing states in mint mode

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot · 2026-01-19T23:12:11Z

@huangmingxia: This pull request references CCO-767 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.22.0" version, but no target version was set.

Details

In response to this:

Description

Migrates CCO test cases from openshift-tests-private to the CCO repository

Test Suite Configuration

This update configures 4 test suites to organize and categorize CCO test cases:

cco/conformance/parallel (3 tests)

LEVEL0 parallel tests

Filter: [LEVEL0] and excludes [Serial] or [Disruptive]

cco/conformance/serial (0 tests)

Serial but non-disruptive tests

Filter: contains [Serial] but excludes [Disruptive]

Currently empty, reserved for future non-disruptive serial tests

cco/disruptive (4 tests)

Disruptive tests that modify cluster state

Filter: contains [Disruptive]

cco/all (16 tests)

All CCO test cases

Changes

Updated cco/conformance/serial suite filter to exclude disruptive tests

Configured test suite qualifiers to properly categorize tests by execution type and impact

Changes

Added SkipIfHyperShift(oc) calls to all test cases marked with NonHyperShiftHOST tag

Fixed checkModeInMetric() function to properly update global modeInMetric variable for error reporting

Added file cleanup logic for temporary files (root-secret.yaml) to prevent resource leaks

Added wait logic in checkCCOHealth() to handle transient Progressing states in mint mode

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot · 2026-01-19T23:13:51Z

@huangmingxia: This pull request references CCO-767 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.22.0" version, but no target version was set.

Details

In response to this:

Description

Migrates CCO test cases from openshift-tests-private to the CCO repository

Test Suite Configuration

This update configures 4 test suites to organize and categorize CCO test cases:

cco/conformance/parallel (3 tests)

LEVEL0 parallel tests

Filter: [LEVEL0] and excludes [Serial] or [Disruptive]

cco/conformance/serial (0 tests)

Serial but non-disruptive tests

Filter: contains [Serial] but excludes [Disruptive]

Currently empty, reserved for future non-disruptive serial tests

cco/disruptive (4 tests)

Disruptive tests that modify cluster state

Filter: contains [Disruptive]

cco/all (16 tests)

All CCO test cases

Changes

Added SkipIfHyperShift(oc) calls to all test cases marked with NonHyperShiftHOST tag

Fixed checkModeInMetric() function to properly update global modeInMetric variable for error reporting

Added file cleanup logic for temporary files (root-secret.yaml) to prevent resource leaks

Added wait logic in checkCCOHealth() to handle transient Progressing states in mint mode

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot · 2026-01-20T08:46:31Z

@huangmingxia: This pull request references CCO-767 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.22.0" version, but no target version was set.

Details

In response to this:

Description

Migrates CCO test cases from openshift-tests-private to the CCO repository

Test Suite Configuration

This update configures 4 test suites to organize and categorize CCO test cases:

cco/conformance/parallel (3 tests)

LEVEL0 parallel tests

Filter: [LEVEL0] and excludes [Serial] or [Disruptive]

cco/conformance/serial (0 tests)

Serial but non-disruptive tests

Filter: contains [Serial] but excludes [Disruptive]

Currently empty, reserved for future non-disruptive serial tests

cco/disruptive (4 tests)

Disruptive tests that modify cluster state

Filter: contains [Disruptive]

cco/all (16 tests)

All CCO test cases

Currently, Level0 test cases are enabled in the cco/conformance/parallel test suite.
Once these tests are running stably, will plan to migrate additional test cases (non-Disruptive,
non-Serial, and non-long-running) to the cco/conformance/parallel test suite.

Changes

Added SkipIfHyperShift(oc) calls to all test cases marked with NonHyperShiftHOST tag

Fixed checkModeInMetric() function to properly update global modeInMetric variable for error reporting

Added file cleanup logic for temporary files (root-secret.yaml) to prevent resource leaks

Added wait logic in checkCCOHealth() to handle transient Progressing states in mint mode

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci · 2026-02-09T16:26:23Z