fix: update Python version to 3.11 and use latest setup-python action in workflows by ttak-apphelix · Pull Request #317 · edx/configuration

ttak-apphelix · 2026-02-17T06:29:56Z

Description

Fixes GitHub Actions workflow failures caused by Python 3.9 being removed from hosted runners (EOL October 2025).

Changes

Workflows

Updated Python version from 3.9 to '3.11' (quoted to prevent YAML float parsing)
Upgraded actions/setup-python from v1 to v5

2. Consolidated Requirements Structure (Reverting PR #175)

This PR reverts the approach taken in PR #175, which introduced separate base3_12.in files. Instead, we:

Updated the main requirements/base.in to use Python 3.11+ compatible dependencies
Removed requirements/base3_12.in
Removed requirements3_12.txt
Updated workflows to use the consolidated requirements.txt
Updated Makefile to remove Python version-specific compilation steps

Dependencies

Updated requirements/base.in and generated requirements.txt with Ansible 8.7.0
- Ansible 9+ removed support for deprecated include syntax used in playbooks
- Ansible 8.7.0 (ansible-core 2.15.13) supports both Python 3.11 and existing playbook syntax
Added ansible<9.0.0 constraint to requirements/constraints.txt to prevent future upgrades
Uses Jinja2 3.1.2 (from requirements.txt) instead of deprecated 2.8 version

Future Migration to Python 3.12

Yes, the plan is to update to Python 3.12 in the future. However, the current challenge is that Ansible 9+ (which supports Python 3.12) removed support for the deprecated include syntax used throughout the playbooks, and Ansible versions < 9.0.0 are not supported on Python 3.12.

The plan is to create a separate PR that will require SRE support to validate all the changes and update to Python 3.12 with an updated Ansible version. This will involve:

Migrating all 63 instances of deprecated - include: syntax to include_tasks: or import_tasks:
Updating to Ansible 9+ which supports Python 3.12
Removing the ansible<9.0.0 constraint from requirements/constraints.txt

JIRA ticket

https://2u-internal.atlassian.net/browse/BOMS-408

… in workflows

Copilot

Pull request overview

Updates CI workflows to run tests under Python 3.10 and modernizes the setup-python GitHub Action used to provision Python in those workflows.

Changes:

Bump workflow matrix Python version from 3.9 to 3.10.
Upgrade actions/setup-python from v1 to v5 in affected workflows.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 4 comments.

File	Description
.github/workflows/syntax-test.yml	Moves Syntax Test workflow to Python 3.10 and updates `setup-python` action.
.github/workflows/playbook-test.yml	Moves Playbook Test workflow to Python 3.10 and updates `setup-python` action.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

…flows

…book syntax

Copilot

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

…tibility

Copilot

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated 4 comments.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

timmc-edx · 2026-02-17T14:49:38Z

      max-parallel: 4
      matrix:
-        python-version: [3.9]
+        python-version: ['3.11']


Should this be 3.12? (To match requirements file.)

Yes, plan is to update this to 3.12. But current challenge is Ansible 9+ removed support for deprecated include syntax used in playbooks and lower version(ansible<9.0.0) is not supported on 3.12.
Plan is to create a separate PR which will require a SRE support where they can validate all the changes and update this to 3.12 with updated Ansible version.

Makes sense, thanks! (Might be good to include this in the PR description, and the commit message when you squash.)

As discussed in meeting, renaming the file to requirements3_11.txt (assuming we even need multiple requirements files), would help avoid some confusion.

We should update comments appropriately about the relationship between python and ansible versions, and deferring the ansible upgrade. We may want a new ticket to link to, but I think https://2u-internal.atlassian.net/browse/GSRE-2249?focusedCommentId=5530695 might be the closest one to this topic at this time, except it is focused on the ubuntu upgrade.

Copilot

Pull request overview

Copilot reviewed 6 out of 6 changed files in this pull request and generated 1 comment.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot

Pull request overview

Copilot reviewed 16 out of 17 changed files in this pull request and generated 1 comment.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot

Pull request overview

Copilot reviewed 16 out of 17 changed files in this pull request and generated 2 comments.

+# pip 26 is incompatible with pip-tools hence causing failures during the build process
+# Make upgrade command and all requirements upgrade jobs are broken due to this.
+# The constraint can be removed once a release (pip-tools > 7.5.2) is available with support for pip 26
+# Issue to track this dependency and unpin later on: https://github.com/jazzband/pip-tools/issues/2319
+pip<26.0


 # using LTS django version
-Django<5.0
+Django<6.0


robrap

Looks good. Minor comment update request.

@timmc-edx: Any concerns?

robrap · 2026-06-04T16:27:58Z

+# Ansible 9+ supports Python 3.11+ but removed the deprecated 'include' syntax causing playbook failures
+# Ansible 8.7.0 is the latest version that supports both Python 3.11 AND the deprecated 'include' syntax
+# The constraint can be removed once all 63 instances of 'include' are migrated to 'include_tasks' or 'import_tasks'
+# Tracking: Configuration playbooks need migration before upgrading to Ansible 9+


There should already be a ticket for this. We should link to it. Also, we should not in the ticket (if not already noted) that cleaning up edxapp ansible usage before upgrade should simplify it.

timmc-edx · 2026-06-04T20:42:59Z

+# pip 26 is incompatible with pip-tools hence causing failures during the build process
+# Make upgrade command and all requirements upgrade jobs are broken due to this.
+# The constraint can be removed once a release (pip-tools > 7.5.2) is available with support for pip 26
+# Issue to track this dependency and unpin later on: https://github.com/jazzband/pip-tools/issues/2319


Hmm... looks like that issue has closed. Can we use newer pip now? (But I'm fine with merging as is. It's not like we need a newer pip or pip-tools for this repo anyhow.)

timmc-edx · 2026-06-04T20:46:45Z

No concerns. I did note one thing that we might be able to unpin, but it's not worth blocking this PR further.

fix: update Python version to 3.10 and use latest setup-python action…

10eb5c8

… in workflows

Copilot AI review requested due to automatic review settings February 17, 2026 06:29

Copilot started reviewing on behalf of ttak-apphelix February 17, 2026 06:30 View session

fix: update Python version to 3.10 and use latest setup-python action…

d2e12cb

… in workflows

Copilot AI reviewed Feb 17, 2026

View reviewed changes

Comment thread .github/workflows/syntax-test.yml

Comment thread .github/workflows/playbook-test.yml Outdated

Comment thread .github/workflows/playbook-test.yml

Comment thread .github/workflows/syntax-test.yml Outdated

ttak-apphelix added 2 commits February 17, 2026 06:43

fix: update dependency file reference to requirements3_12.txt in work…

7a61516

…flows

fix: ansible constraint to <9.0.0 to maintain compatibility with play…

96244aa

…book syntax

Copilot AI review requested due to automatic review settings February 17, 2026 06:57

Copilot started reviewing on behalf of ttak-apphelix February 17, 2026 06:58 View session

Copilot AI reviewed Feb 17, 2026

View reviewed changes

Comment thread .github/workflows/syntax-test.yml Outdated

Comment thread .github/workflows/playbook-test.yml Outdated

Comment thread requirements/constraints.txt Outdated

ttak-apphelix added 2 commits February 17, 2026 07:55

fix: downgrade ansible to 8.7.0 and ansible-core to 2.15.13 for compa…

5ad0191

…tibility

fix: update Python version to 3.11 in workflows

4b1d3a6

Copilot AI review requested due to automatic review settings February 17, 2026 09:28

Copilot started reviewing on behalf of ttak-apphelix February 17, 2026 09:29 View session

ttak-apphelix changed the title ~~fix: update Python version to 3.10 and use latest setup-python action in workflows~~ fix: update Python version to 3.11 and use latest setup-python action in workflows Feb 17, 2026

Copilot AI reviewed Feb 17, 2026

View reviewed changes

Comment thread .github/workflows/syntax-test.yml Outdated

Comment thread .github/workflows/syntax-test.yml

Comment thread .github/workflows/playbook-test.yml Outdated

Comment thread .github/workflows/playbook-test.yml

timmc-edx reviewed Feb 17, 2026

View reviewed changes

ttak-apphelix added 2 commits February 19, 2026 13:18

fix: update requirements to use Python 3.11

917dce2

Merge branch 'master' into ttak/BOMS-408

d3b0fdb

Copilot AI review requested due to automatic review settings February 19, 2026 13:20

Copilot started reviewing on behalf of ttak-apphelix February 19, 2026 13:21 View session

Copilot AI reviewed Feb 19, 2026

View reviewed changes

Comment thread requirements/base3_11.in Outdated

ttak-apphelix added 2 commits February 19, 2026 13:50

fix: downgrade ansible version to <9.0.0 for compatibility

1c9317f

fix: update dependencies and remove obsolete requirement files

8c11f2f

Copilot AI review requested due to automatic review settings February 20, 2026 07:54

Copilot started reviewing on behalf of ttak-apphelix February 20, 2026 07:54 View session

Copilot AI reviewed Feb 20, 2026

View reviewed changes

Comment thread requirements/constraints.txt Outdated

ttak-apphelix added 2 commits February 20, 2026 08:33

fix: updated comments

f52e152

Merge branch 'master' into ttak/BOMS-408

68195fc

Copilot AI review requested due to automatic review settings June 4, 2026 08:33

Copilot started reviewing on behalf of ttak-apphelix June 4, 2026 08:33 View session

Copilot AI reviewed Jun 4, 2026

View reviewed changes

robrap reviewed Jun 4, 2026

View reviewed changes

timmc-edx reviewed Jun 4, 2026

View reviewed changes

Conversation

ttak-apphelix commented Feb 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Changes

Workflows

2. Consolidated Requirements Structure (Reverting PR #175)

Dependencies

Future Migration to Python 3.12

JIRA ticket

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

timmc-edx Feb 17, 2026

Choose a reason for hiding this comment

Uh oh!

ttak-apphelix Feb 18, 2026

Choose a reason for hiding this comment

Uh oh!

timmc-edx Feb 18, 2026

Choose a reason for hiding this comment

Uh oh!

robrap Feb 18, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

robrap left a comment

Choose a reason for hiding this comment

Uh oh!

robrap Jun 4, 2026

Choose a reason for hiding this comment

Uh oh!

timmc-edx Jun 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

timmc-edx commented Jun 4, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

ttak-apphelix commented Feb 17, 2026 •

edited

Loading

timmc-edx Jun 4, 2026 •

edited

Loading