Skip to content

Fix rescheduled sensors hanging before poke#68012

Open
hkc-8010 wants to merge 2 commits into
apache:mainfrom
hkc-8010:fix/reschedule-start-date-context
Open

Fix rescheduled sensors hanging before poke#68012
hkc-8010 wants to merge 2 commits into
apache:mainfrom
hkc-8010:fix/reschedule-start-date-context

Conversation

@hkc-8010

@hkc-8010 hkc-8010 commented Jun 4, 2026

Copy link
Copy Markdown
Contributor

Rescheduled tasks currently fetch their first task reschedule start date from the supervisor when RuntimeTaskInstance.get_first_reschedule_date() is called. For sensors, this can happen before poke() starts, which means a worker can block on the supervisor/API round trip before emitting the sensor's usual poke log line.

This PR includes the first task reschedule start date in the task instance run context returned by the Execution API. The Task SDK uses that value directly when present, while keeping the existing supervisor request as a compatibility fallback for older API responses.

closes: #68010

Tests:

  • breeze testing task-sdk-tests --python 3.10 -- task-sdk/tests/task_sdk/execution_time/test_task_runner.py -k get_first_reschedule_date -q
  • breeze testing core-tests --python 3.10 --db-reset -- airflow-core/tests/unit/api_fastapi/execution_api/versions/head/test_task_instances.py airflow-core/tests/unit/api_fastapi/execution_api/versions/v2026_06_30/test_task_instances.py -q
  • breeze testing core-tests --backend postgres --python 3.10 --db-reset -- airflow-core/tests/unit/api_fastapi/execution_api/versions/head/test_task_instances.py airflow-core/tests/unit/api_fastapi/execution_api/versions/v2026_06_30/test_task_instances.py -q
  • breeze testing task-sdk-tests --python 3.10
  • prek run --files <changed-files>
  • prek run --files <changed-files> --stage manual

Was generative AI tooling used to co-author this PR?
  • Yes (please specify the tool below)

Generated-by: OpenAI Codex following the guidelines


  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

@boring-cyborg boring-cyborg Bot added area:API Airflow's REST/HTTP API area:task-sdk labels Jun 4, 2026
@eladkal eladkal added this to the Airflow 3.3.0 milestone Jun 7, 2026
@eladkal eladkal added the type:bug-fix Changelog: Bug Fixes label Jun 7, 2026
@potiuk

potiuk commented Jun 9, 2026

Copy link
Copy Markdown
Member

@hkc-8010 A few things need addressing before review — see our Pull Request quality criteria.

  • Merge conflicts with main. See docs.

No rush.

Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

@hkc-8010 hkc-8010 force-pushed the fix/reschedule-start-date-context branch from 08823ae to f3bd4aa Compare June 12, 2026 08:56
@hkc-8010

Copy link
Copy Markdown
Contributor Author

@potiuk thanks for the heads up. I rebased the branch on current main, resolved the conflicts, and force-pushed the updated commit (f3bd4aae0da6ad23a2b06500b6c9354dec140a77).

The local pre-push hooks are passing now, including the supervisor schema snapshot/version checks that caught one missing generated snapshot update during the rebase. GitHub checks have restarted on the updated commit.

Could you please take another look when you get a chance?

@potiuk potiuk added the ready for maintainer review Set after triaging when all criteria pass. label Jun 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:API Airflow's REST/HTTP API area:task-sdk ready for maintainer review Set after triaging when all criteria pass. type:bug-fix Changelog: Bug Fixes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Rescheduled sensors can hang before poke while fetching first reschedule start date

3 participants