Status of testing Providers that were prepared on March 03, 2026

[potiuk]

Body

I have a kind request for all the contributors to the latest provider distributions release.
Could you please help us to test the RC versions of the providers?

The guidelines on how to test providers can be found in

Verify providers by contributors

Let us know in the comments, whether the issue is addressed.

These are providers that require testing as there were some substantial changes introduced:

Provider amazon: 9.22.0rc3

• Support custom KMS keys in S3CopyObjectOperator (#60597): @dominikhei
  Linked issues:
  • Linked Issue #55708: @RajasGujarathi
• Add best-effort cleanup to EmrCreateJobFlowOperator on post-creation failure (#61010): @SameerMesiah97
  Linked issues:
  • Linked Issue #60904: @SameerMesiah97
• Add best-effort cleanup to EksCreateNodegroupOperator on post-create failure (#61145): @SameerMesiah97
• Add best-effort cleanup to EcsRunTaskOperator on post-start failure (#61051): @SameerMesiah97
• Restrict EC2CreateInstanceOperator cleanup to waiter failures and add guard flag (#61272): @SameerMesiah97
  Linked issues:
  • Linked Issue #60904: @SameerMesiah97
  • Linked Issue #61145: @SameerMesiah97
  • Linked Issue #61010: @SameerMesiah97
  • Linked Issue #61051: @SameerMesiah97
• Add cancel_on_kill support for EMR Serverless deferrable operator (#60440): @cruseakshay
• Add delay in example_emr_eks after updating execution role (#62415): @vincbeck
• AIP-67 - Multi Team: Update AwsLambdaExecutor to support multi team (#61321): @henry3260
• Add SageMaker Unified Studio domain_id, project_id, domain_region as new parameters to SageMakerNotebookOperator (#62147): @Shnekit
  Linked issues:
  • Linked Issue #61498: @ruijiang-rjian
• feat: Add Hook Level Lineage to SQL hooks (#61535): @kacpermuda
• Check teams defined in auth managers exist in DB when spinning up API server (#62527): @vincbeck
• EKS hook: Update auth. API version to v1 and replace non-POSIX 'source' with '.' (#61441): @idrisakorede
  Linked issues:
  • Linked Issue #60269: @andrewhharmon
• add wait_policy in EmrCreateJobFlorOperator (#61195): @henry3260
  Linked issues:
  • Linked Issue #61180: @karenbraganz
• Fix host in AWS auth manager (#61368): @vincbeck
• Fix variable name in exemple_emr_eks (#62480): @vincbeck
• fix S3RemoteLogIO using incorrect transfer config (#62423): @stephen-bracken
• Fix EKSPodOperator credential refresh errors and improve error handling (#57585) (#58743): @aviralgarg05
  Linked issues:
  • Linked Issue #57585: @NilsJPWerner
• Fix ECS Executor compatibility with Airflow 3.x in try_adopt_task_instances (#62192): @vincbeck
  Linked issues:
  • Linked Issue #58207: @iamapez
• fix(amazon): flush file buffer in S3Hook.download_file() before returning path (#62078): @pippo995
  Linked issues:
  • Linked Issue #61157: @amoghrajesh
• Handle CrawlerRunningException gracefully in GlueCrawlerOperator (#62016): @bahram-cdt
• RedshiftCreateClusterOperator could leave clusters running after failure (#61333): @SameerMesiah97
• Fix EKS operator failures by consolidating API version references into a shared constant (#61891): @ferruzzi
• Remove Connection dependency from shared secrets backend (#61523): @amoghrajesh
• Increase the redshift cluster deletion to 25 minutes in system tests (#62413): @vincbeck
• Bump min sqlalchemy version to 1.4.54 (#62299): @potiuk
• Update trigger rule in example_emr_eks.py (#62228): @vincbeck
• Fix EKS system test xcom issue and standardize naming between tests (#61893): @ferruzzi
• Add warning about AWS auth manager being in alpha stage in identity-c… (#61745): @imrichardwu
• fix(amazon): Filter kwargs in AthenaSQLHook to prevent TypeError (#62227): @shivaam
  Linked issues:
  • Linked Issue #55678: @FrancisLfg

Provider celery: 3.17.0rc2

• Celery: explicitly specify psycopg2 in driverless postgres URLs (#62159): @Dev-iL
  Linked issues:
  • Linked Issue #61229: @Dev-iL
• Executor Synchronous callback workload (#61153): @ferruzzi
• Enable multi-team in Celery executor (#62534): @vincbeck
• docs(celery): fix wrong link in cli (#62460): @Lee-W
• Fix Celery worker crash on macOS due to unpicklable local function (#62655): @Vamsi-klu
  Linked issues:
  • Linked Issue #62512: @bluczko
• Insert a team_name similar to team conf for 2.X compat (#61923): @o-nikolas
  Linked issues:
  • Linked Issue #61913: @potiuk

Provider edge3: 3.1.0rc2

• Introduce EdgeDBManager: Independent Provider Specific Database Schema Management (#61155): @dheerajturaga
  Linked issues:
  • Linked Issue #60752: @dheerajturaga
• Add Filtering to Edge UI Plugin Jobs Page (#61934): @Eason09053360
  Linked issues:
  • Linked Issue #61920: @jscheffl
• Route providers to consume Stats from common compat provider (#61812): @amoghrajesh
• Fix Toaster in Plugin in Edge UI (#55641): @jscheffl
• Executor Synchronous callback workload (#61153): @ferruzzi
• Fix edge3 executor startup crash on Airflow < 3.2 (#62593): @dheerajturaga
• Bump minimum prek version to 0.3.2 in edge3 provider (#62194): @dheerajturaga
• Auto-discover DB managers from provider.yaml (#62308): @dheerajturaga
• Upgrade dependency to minimatch (#62303): @jscheffl
• Warn when EdgeDBManager is missing from external_db_managers in config (#62204): @dheerajturaga
• Replace Base.metadata.remove() hack with dedicated Edge3 declarative base (#62202): @dheerajturaga
  Linked issues:
  • Linked Issue #61155: @dheerajturaga
• Enable dynamic generation of assets for Edge UI Plugin (#56456): @jscheffl
• Dependabot: Upgrade vulnerable rolloup (#62535): @jscheffl
• docs: Add external_db_managers configuration requirement (#62203): @dheerajturaga
• docs: edge3 db-manager is auto loaded by provider manager (#62550): @dheerajturaga

Provider elasticsearch: 6.5.0rc3

• feat: Add Hook Level Lineage to SQL hooks (#61535): @kacpermuda
• Fix the write-to-es feature (#53821): @Owen-CH-Leung
  Linked issues:
  • Linked Issue #51456: @kmaksimovv
  • Linked Issue #62121: @Owen-CH-Leung
  • Linked Issue #50349: @peter-cheon
• add max_lines_per_page setting to ElasticsearchTaskHandler (#61492): @stephen-bracken
• Fix max_lines_per_page config setting for ElasticsearchRemoteLogIO (#62562): @stephen-bracken
  Linked issues:
  • Linked Issue #53821: @Owen-CH-Leung

All users involved in the PRs:
@Lee-W @pippo995 @Eason09053360 @aviralgarg05 @jscheffl @idrisakorede @dominikhei @vincbeck @shivaam @dheerajturaga @SameerMesiah97 @imrichardwu @kacpermuda @stephen-bracken @henry3260 @Dev-iL @Vamsi-klu @cruseakshay @bahram-cdt @ferruzzi @o-nikolas @Owen-CH-Leung @amoghrajesh @Shnekit @poti

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[dheerajturaga]

Tested all my changes to Edge. Everything looks good! Thanks for taking the extra trouble for rc2 @potiuk !

[stephen-bracken]

Can we merge the release notes for #61492 and #62562 please? The first change was held back from the rc2 wave and is now fixed in rc3. There should only be one change for adding the new config setting IMO.

[SameerMesiah97]

All of the changes for my PRs have been tested for apache-airflow-providers-amazon==9.22.0rc2. Those results should still be valid for apache-airflow-providers-amazon==9.22.0rc3

[potiuk]

Thank you everyone. Providers are released.

I invite everyone to help improve providers for the next release, a list of open issues can be found here.
Remove Provider distributions scheduled for removal

[potiuk]

Can we merge the release notes for #61492 and #62562 please? The first change was held back from the rc2 wave and is now fixed in rc3. There should only be one change for adding the new config setting IMO.

@stephen-bracken

I am not sure what exactly you mean by "merge release notes" - but probably this: https://airflow.apache.org/docs/apache-airflow-providers-elasticsearch/stable/changelog.html - generally documentation. - if needed - should ba added in PR if we want it to appear in release notes, there is no "extra step" here about merging release notes. Merging PR is what constitutes release notes documentation.

We had some extra description added - in another PR (on @eladkal request) that explained that finally ES issues should be fixed:

The write_to_es Elasticsearch task logging feature, was incompatible with Airflow 3. This is now fixed. Users must upgrade apache-airflow-providers-elasticsearch>=6.5.0 to pick up the new ElasticsearchRemoteLogIO class required by the fixed logging path. No configuration changes are needed — existing settings such as write_to_es, target_index, json_format, host_field, and offset_field continue to work as before. This fix will work with any airflow-airflow>=3.0 version.

Both PRs you mentioned are listed in the changelog as well.

If that's what you meant - all that is released and docs are published.

But maybe you thought about somethign else?

[stephen-bracken]

I don't think that's necessary thanks. What I was thinking was that #62562 'fixes' the feature that is added in #61492, so the max_lines_per_page config setting is being 'added' and 'fixed' in the same release, which could be confusing. Its not a big problem, and the release notes are sufficient.