Summary
The Track LLM Support GitHub Action still runs without a SaaS API key, so live SaaS confirmation is skipped during automated updates.
Evidence
Recent successful workflow runs still log:
Warning: no API key available, cannot confirm SaaS verified models
For example, run 25004131734 completed successfully after the infra token fix, but it still emitted the warning repeatedly during model tracking.
Why this matters
We already fixed the larger regression caused by missing infra access, so automated runs no longer drop proxy support. However, without a SaaS API key the workflow still cannot confirm live SaaS availability, which means:
frontend_saas_available may remain stale or incomplete in workflow-generated updates- automated tracker refreshes do not fully match what a local credentialed run can verify
- future debugging is harder because workflow behavior differs from local behavior
Proposed fix
Add a repository secret that the workflow can use for SaaS confirmation, then wire it into .github/workflows/track-llm-support.yml.
Expected env for the tracker job:
OPENHANDS_CLOUD_API_KEY- optionally
LLM_API_KEY mapped to the same secret for compatibility
Acceptance criteria
- the workflow can query
https://app.all-hands.dev/api/v1/config/models/search?provider__eq=openhands
- tracker workflow logs no longer contain the
no API key available warning
- workflow-generated data matches local SaaS-confirming runs for
frontend_saas_available
AI-generated issue by OpenHands on behalf of the user.
Summary
The
Track LLM SupportGitHub Action still runs without a SaaS API key, so live SaaS confirmation is skipped during automated updates.Evidence
Recent successful workflow runs still log:
Warning: no API key available, cannot confirm SaaS verified modelsFor example, run
25004131734completed successfully after the infra token fix, but it still emitted the warning repeatedly during model tracking.Why this matters
We already fixed the larger regression caused by missing infra access, so automated runs no longer drop proxy support. However, without a SaaS API key the workflow still cannot confirm live SaaS availability, which means:
frontend_saas_availablemay remain stale or incomplete in workflow-generated updatesProposed fix
Add a repository secret that the workflow can use for SaaS confirmation, then wire it into
.github/workflows/track-llm-support.yml.Expected env for the tracker job:
OPENHANDS_CLOUD_API_KEYLLM_API_KEYmapped to the same secret for compatibilityAcceptance criteria
https://app.all-hands.dev/api/v1/config/models/search?provider__eq=openhandsno API key availablewarningfrontend_saas_availableAI-generated issue by OpenHands on behalf of the user.