Skip to content

ci(tests): run Windows tests on Python 3.10 and 3.13 - #4473

Closed
feiiiiii5 wants to merge 1 commit into
openai:mainfrom
feiiiiii5:fix/windows-tests-python-matrix
Closed

ci(tests): run Windows tests on Python 3.10 and 3.13#4473
feiiiiii5 wants to merge 1 commit into
openai:mainfrom
feiiiiii5:fix/windows-tests-python-matrix

Conversation

@feiiiiii5

Copy link
Copy Markdown

Summary

tests-windows pins a single Python version (3.13), which is exactly the version where the Windows clock became fine-grained — so the whole class of coarse-clock bug (e.g. #4392, 37 tests failing on a clean checkout while CI stayed green) is invisible on Windows for the other supported versions. This matrices the job across "3.10" (the declared minimum, on the coarse-clock side) and "3.13" (what runs today), using the shape suggested in the issue: 2x the current Windows runner cost instead of 5x. fail-fast: false keeps both legs reporting, and the detect-changes gate is preserved unchanged. packaged-contract-windows is intentionally untouched (packaging smoke, not test coverage).

Test plan

Workflow-only change; verified locally:

  • tests.yml parses as valid YAML and the tests-windows job carries strategy.matrix.python-version == ["3.10", "3.13"] with fail-fast: false, and Setup uv consumes ${{ matrix.python-version }} (asserted programmatically).
  • The matrix shape mirrors the existing Linux tests job, and no other job references the changed keys.

Final proof is CI itself: this PR's checks page should show two tests-windows legs (3.10 and 3.13), both honoring the detect-changes gate.

Issue number

Fixes #4472

Checks

  • I've added new tests, if relevant
  • I've run .agents/skills/code-change-verification/scripts/run.sh
  • I've confirmed all verification steps pass
  • If using Codex, I've run /review before submitting this PR

The verification-stack checkboxes are left unchecked honestly: this diff touches only a CI workflow file, and the applicable verification is the YAML/structure check described in the test plan plus the workflow legs on this PR.

Pin tests-windows to 3.13 only exercises the one Windows Python where
the clock is fine-grained, leaving coarse-clock bugs (like openai#4392)
invisible for the other supported versions. Matrix the job across 3.10
(the declared minimum, coarse clock) and 3.13, matching the shape
proposed in openai#4472 at 2x the current Windows cost.

Signed-off-by: fei <204683769+feiiiiii5@users.noreply.github.com>
@seratch

seratch commented Aug 17, 2026

Copy link
Copy Markdown
Member

Thanks for sending this. #4475 resolves the issue.

@seratch seratch closed this Aug 17, 2026
@feiiiiii5

Copy link
Copy Markdown
Author

Thanks @seratch! Closing in favor of #4475, which covers this more comprehensively (aligning version coverage across all CI jobs rather than just the Windows matrix). Happy the underlying gap got addressed — keeping the branch on my fork in case anything is reusable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

tests-windows pins one Python version, so clock-resolution bugs are invisible on Windows for 3 of 5 supported versions

2 participants