Skip to content

Conversation

@rauchy
Copy link

@rauchy rauchy commented Jan 13, 2026

Summary

Migrate from GitHub Statuses API to Checks API for integration test reporting.

Why: The current setup uses a Personal Access Token (PAT) with the Statuses API, which requires monthly token rotation. By switching to the Checks API with GitHub App authentication, we eliminate this maintenance burden.

Changes:

  • Generate a second GitHub App token (DECO_TEST_APPROVAL_APP) for creating check runs
  • Create an "Integration Tests" check before triggering the workflow
  • Pass check_run_id to eng-dev-ecosystem so it can update the check status
  • Update get_status() to query Checks API instead of Statuses API

This aligns CLI with how the SDKs handle integration test status reporting.

@eng-dev-ecosystem-bot
Copy link
Collaborator

eng-dev-ecosystem-bot commented Jan 13, 2026

Commit: bec0687

Run: 21114383638

Env 🟨​KNOWN 🔄​flaky 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
🟨​ aws linux 7 10 2 411 695 20:18
🟨​ aws windows 10 7 2 413 693 21:17
💚​ azure linux 12 3 413 694 20:10
🔄​ gcp linux 3 11 3 400 700 18:54
21 interesting tests: 10 KNOWN, 8 RECOVERED, 2 flaky, 1 SKIP
Test Name aws linux aws windows azure linux gcp linux
🟨​ TestAccept 🟨​K 🟨​K 💚​R 🔄​f
💚​ TestAccept/bundle/deployment/bind/alert 🙈​S 🙈​S 💚​R 💚​R
🟨​ TestAccept/bundle/generate/alert 💚​R 🟨​K 💚​R 💚​R
🟨​ TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=direct 💚​R 🟨​K 💚​R 💚​R
🟨​ TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=terraform 💚​R 🟨​K 💚​R 💚​R
💚​ TestAccept/bundle/resources/alerts/basic 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/alerts/basic/DATABRICKS_BUNDLE_ENGINE=direct 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/alerts/basic/DATABRICKS_BUNDLE_ENGINE=terraform 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/alerts/with_file 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=direct 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=terraform 💚​R 💚​R 💚​R 💚​R
🙈​ TestAccept/bundle/resources/permissions 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions 🟨​K 🟨​K 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct 🟨​K 🟨​K
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform 🟨​K 🟨​K
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions 🟨​K 🟨​K 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct 🟨​K 🟨​K
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform 🟨​K 🟨​K
🔄​ TestAccept/bundle/templates/default-python/integration_classic ✅​p ✅​p ✅​p 🔄​f
🔄​ TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_BUNDLE_ENGINE=terraform/UV_PYTHON=3.13 ✅​p ✅​p ✅​p 🔄​f
💚​ TestAccept/ssh/connection 💚​R 💚​R 💚​R 💚​R
Top 24 slowest tests (at least 2 minutes):
duration env testname
6:02 gcp linux TestAccept/ssh/connection
5:54 aws linux TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
5:40 aws windows TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
5:38 aws windows TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
5:31 aws linux TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
5:25 gcp linux TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
5:17 gcp linux TestSecretsPutSecretStringValue
5:05 aws linux TestAccept/ssh/connection
5:02 aws windows TestAccept/ssh/connection
4:59 aws windows TestSecretsPutSecretStringValue
4:58 aws linux TestSecretsPutSecretStringValue
4:54 azure linux TestAccept/ssh/connection
4:09 azure linux TestSecretsPutSecretStringValue
3:57 azure linux TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
3:51 azure linux TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
3:09 gcp linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:42 aws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:39 aws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:39 aws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:38 aws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:36 gcp linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:27 gcp linux TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
2:12 azure linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:06 azure linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct

@rauchy rauchy force-pushed the deco-26060-checks-api branch from b246212 to 7bc545c Compare January 13, 2026 09:28
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 09:28 — with GitHub Actions Inactive
@rauchy rauchy force-pushed the deco-26060-checks-api branch from 7bc545c to f262fde Compare January 13, 2026 09:37
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 09:37 — with GitHub Actions Inactive
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 09:37 — with GitHub Actions Inactive
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 09:38 — with GitHub Actions Inactive
@rauchy rauchy force-pushed the deco-26060-checks-api branch from f262fde to 7ec8e57 Compare January 13, 2026 09:54
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 09:54 — with GitHub Actions Inactive
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 09:54 — with GitHub Actions Inactive
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 09:55 — with GitHub Actions Inactive
@rauchy rauchy force-pushed the deco-26060-checks-api branch from 7ec8e57 to 82b55b4 Compare January 13, 2026 10:13
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 10:13 — with GitHub Actions Inactive
@rauchy rauchy force-pushed the deco-26060-checks-api branch from 82b55b4 to 3b91a81 Compare January 13, 2026 10:31
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 10:31 — with GitHub Actions Inactive
@rauchy rauchy requested a review from pietern January 13, 2026 10:32
@rauchy rauchy temporarily deployed to test-trigger-is January 16, 2026 15:57 — with GitHub Actions Inactive
Use GitHub Checks API instead of Statuses API to report integration
test results. This enables the use of GitHub App authentication and
eliminates the need for monthly PAT rotation.

Changes:
- Generate a second GitHub App token for check creation
- Create check run before triggering tests in eng-dev-ecosystem
- Pass check_run_id to the workflow for status updates
- Update get_status() to query Checks API instead of Statuses API
@rauchy rauchy force-pushed the deco-26060-checks-api branch from 5002672 to bec0687 Compare January 18, 2026 15:45
@rauchy rauchy deployed to test-trigger-is January 18, 2026 15:45 — with GitHub Actions Active
@rauchy rauchy enabled auto-merge January 18, 2026 15:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants