-
Notifications
You must be signed in to change notification settings - Fork 16.8k
Open
Labels
kind:metaHigh-level information important to the communityHigh-level information important to the community
Description
Body
I have a kind request for all the contributors to the latest provider distributions release.
Could you please help us to test the RC versions of the providers?
The guidelines on how to test providers can be found in
Verify providers by contributors
Let us know in the comments, whether the issue is addressed.
These are providers that require testing as there were some substantial changes introduced:
Provider airbyte: 5.4.0rc1
- [providers] Airbyte add submit_reset_connection func (#63578): @nhuantho
- Fix typo in debug message for AirbyteTriggerSyncOperator (#64084): @SameerMesiah97
Provider alibaba: 3.3.6rc1
- fix(providers/alibaba): pass relative path to oss_write in OSSRemoteLogIO.upload (#63246): @YoannAbriel
Linked issues:
Provider amazon: 9.24.0rc1
- Add bucket_namespace support to S3CreateBucketOperator (#63622): @moomindani
Linked issues: - Adds match_glob to template_fields in GCS operators (#61819): @yohoos
- Add skip_on_exit_code support to EcsRunTaskOperator (#63274): @yunhobb
Linked issues: - Fix SageMakerNotebookOperator domain_id/project_id/domain_region params (#62962): @Shnekit
- fix(providers/amazon): handle multi-node job log streams in BatchClientHook (#63476): @antonio-mello-ai
Linked issues: - fix:
resume_glue_job_on_retrywithxcom_pushinGlueJobOperator(#62560): @henry3260
Linked issues: - Add bounded retry cleanup to RedshiftCreateClusterOperator on post-start failure (#63074): @SameerMesiah97
Linked issues: - Fix mypy errors in kubernetes, fab, google, and amazon providers (#63947): @potiuk
- Add Python 3.14 Support for the Amazon Provider (#64096): @Dev-iL
Linked issues: - Remove unmaintained sqlean.py dependency from Amazon provider (#63623): @Subham-KRLX
Linked issues: - Update Amazon's provider.yaml with some missing modules (#64009): @ferruzzi
- Fix/typos and spelling (#64139): @Shrividya
Provider apache.hive: 9.4.1rc1
- Fix: Replace print with logger in Hive Hook kill method (#62990): @Ironankit525
- fix: pass through user-provided password in HiveServer2Hook for all auth modes (#62888): @YoannAbriel
Linked issues:
Provider apache.iceberg: 2.0.1rc1
Provider apache.kafka: 1.13.1rc1
- Fix AwaitMessageSensor not honoring timeout (#62104): @Pranaykarvi
- Fix docstring for AwaitMessageSensor and AwaitMessageTrigger in apache-kafka-provider (#63333): @filippzorin
Linked issues: - Migrate apache/kafka connection UI metadata to YAML (#63171): @wjddn279
Provider apache.livy: 4.5.4rc1
- FIX: Allow override of HTTP method in run_method of LivyAsyncHook (#64150): @dabla
- Refactor HttpAsyncHook to support session-based async HTTP operations and simplify LivyAsyncHook (#60458): @dabla
Provider apache.spark: 6.0.0rc1
- [breaking] Make pyspark-client as default and pyspark package optional (#60031): @raphaelauv
- Fix unclear error when pyspark is not installed for JDBC script (#64174): @eladkal
Provider apache.tinkerpop: 1.1.2rc1
Provider arangodb: 2.9.3rc1
Provider asana: 2.11.2rc1
- Migrate asana connection UI metadata to YAML (#62646): @yjaw
Linked issues:
Provider celery: 3.17.2rc1
- Set task name for 2.11.X path (#63746): @o-nikolas
Linked issues: - Fix misaligned
queued_taskstypes in hybrid executors (#63744): @Ironankit525 - add gc.freeze to minimize memory usage in celery worker (#62212): @wjddn279
- fix: warn about hardcoded 24h visibility_timeout that kills long-running Celery tasks (#62869): @YoannAbriel
Linked issues: - Make test_celery_integration runnable (#64153): @eladkal
- Update celery provider conf imports to use common compat SDK (#64134): @nailo2c
Linked issues:
Provider cloudant: 4.3.3rc1
Provider cncf.kubernetes: 10.15.0rc1
- Add runtime_class_name to KubernetesPodOperator (#63952): @kbpk
Linked issues: - add application name as env var to driver and executor pods for SparkKubernetesOperator (#64015): @Shrividya
Linked issues: - Deleting spark job before raising exception "Job took too long to start" in start_spark_job method (#63824) (#63922): @aalopatin
Linked issues: - Add cancel_on_kill and safe_to_cancel support to KubernetesPodOperator and trigger (#62401): @manipatnam
Linked issues: - Fix misaligned
queued_taskstypes in hybrid executors (#63744): @Ironankit525 - Fix K8s executor to use JoinableQueue matching its usage contract (#63789): @Dev-iL
Linked issues: - k8s executor - ensure pods cleaned up (#61839): @atrbgithub
- fix(providers/cncf-kubernetes): apply verify_ssl=False to returned ApiClient in KubernetesHook (#63478): @antonio-mello-ai
Linked issues: - Fix KubernetesJobOperator failing when pods are deleted after job completion (#63569): @ShubhamGondane
Linked issues: - Fix KubernetesPodOperator XCom sidecar hang on Alpine (#58931): @YahelyUshpiz
- Fix mypy errors in kubernetes, fab, google, and amazon providers (#63947): @potiuk
- Relax
kubernetes_asyncio<<36.0.0(#64144): @eladkal - Clarify reattach order of
find_spark_jobinSparkKubernetesOperator(#64186): @Nataneljpwd - Fix/typos and spelling (#64139): @Shrividya
Provider cohere: 1.6.4rc1
Provider common.compat: 1.14.2rc1
- Remove usage of deprecated module airflow.security.permissions in common compat provider (#63335): @Crowiant
Provider common.sql: 1.34.0rc1
- Simplify default rows limit return result (#64183): @gopidesupavan
- Removed logging of rows length in SQLInsertRowsOperator to avoid crash on non materialized rows (#63346): @dabla
- Fix provider YAML validation for common SQL analytics operator (#63393): @gopidesupavan
Provider databricks: 7.12.0rc1
- Databricks Add new hook method (#62822): @Zinkue
Linked issues: - Fix typo in Databricks operator logging (#63651): @Gautam-Bharadwaj
- Enable TLS Certificate Verification for K8s Token Exchange in Databricks Hook (#63704): @mwojtyczka
- fix: Map Airflow trigger_rule to Databricks run_if in DatabricksWorkflowTaskGroup (#63420): @moomindani
Linked issues:- Linked Issue #47024: @anilreddaboina54
- Fix broken import of
aiofilesinBaseDatabricksHook(#63518): @mwojtyczka - Databricks: propagate terminal failure for deferrable runs before defer (#62917): @kbohra
Linked issues:- Linked Issue #53904: @rafael-buttignon
- Fix sql_warehouse_name resolution: handle 'warehouses' API response key (#63286): @ataulmujeeb-cyber
Linked issues:- Linked Issue #63285: @ataulmujeeb-cyber
- Handle race condition in DatabricksReposCreateOperator when concurrently creating the same repo path (#62422): @SameerMesiah97
- Refactor DatabricksSqlHook timeout handling to use explicit signaling (#62623): @SameerMesiah97
Provider dbt.cloud: 4.8.0rc1
- Implement execution_timeout semantics for DbtCloudRunJobOperator in deferrable mode (#61472): @SameerMesiah97
- Migrate dbt Cloud connection UI metadata to YAML (#62579): @josh-fell
Linked issues:
Provider edge3: 3.3.0rc1
- Add Bulk operations for edge workers page (#64033): @shubhamraj-git
- Fix edge executor UI navigation when behind reverse proxy with subpath (#63777): @dheerajturaga
- Fix dependabot alarms for Flatted (#63955): @jscheffl
- Fix make_partial_model (#63716): @pierrejeambrun
- Re-introducing
--use-migration-filesand fix inconsistences between ORM/migration files (#62234): @ephraimbuddy
Linked issues:- Linked Issue #41120: @ephraimbuddy
- Fix dependabot warning regarding flatten lib - providers (#63586): @jscheffl
- Bump pydantic min version to 2.12.3 (#63570): @gopidesupavan
- Fix dependabot for edge3 on TS (#63375): @jscheffl
- Update edge executor's import conf path to use common compat SDK (#64137): @wjddn279
- Generate ERD diagrams at doc build time instead of committing them (#63402): @potiuk
- Fix/typos and spelling (#64139): @Shrividya
Provider elasticsearch: 6.5.1rc1
- fix: Elasticsearch logging exception details are missing in task logs tab (#63739): @Subham-KRLX
Linked issues:- Linked Issue #63736: @poilade-de-coulemelle
- Fix conf import to common.compat in
ElasticsearchTaskHandler(#64118): @eladkal - Remove self parameter from resolve_nested (#64146): @eladkal
- Support Elasticsearch 9 in Elasticsearch Provider (#64070): @Subham-KRLX
Linked issues:
Provider fab: 3.6.0rc1
- Add order_by parameter to GET /permissions for pagination consistency (#63418): @henry3260
- FAB: fix 403 from roles endpoint despite admin rights (#64097): @Dev-iL
Linked issues:- Linked Issue #59510: @gschuurman
- Linked Issue #63359: @YoannAbriel
- Fix dependabot alarms for Flatted in Fab (#63956): @jscheffl
- Fix/fab auth manager race condition (#63842): @Pyasma
Linked issues: - fix(providers/fab): pass role name string to delete_role instead of Role object (#63337): @YoannAbriel
Linked issues:- Linked Issue #63336: @Jeoffreybauvin
- fix(fab): recover from first idle MySQL disconnect in token auth (#62919): @kbohra
Linked issues:- Linked Issue #62903: @davidjfrickert
- Fix mypy errors in kubernetes, fab, google, and amazon providers (#63947): @potiuk
- Remove various upper version bounds in the FAB provider (#63868): @Dev-iL
- Add marshmallow to fab provider dependencies (#63896): @eladkal
- Re-introducing
--use-migration-filesand fix inconsistences between ORM/migration files (#62234): @ephraimbuddy
Linked issues:- Linked Issue #41120: @ephraimbuddy
- Fix dependabot warning regarding flatten lib - providers (#63586): @jscheffl
- Fix/fab provider to import conf from sdk (#64165): @Pyasma
Linked issues: - Generate ERD diagrams at doc build time instead of committing them (#63402): @potiuk
Provider git: 0.3.0rc1
- Add SSH auth parameters to GitHook for bastion hosts, custom ports, a… (#63942): @potiuk
- Fix shell injection in GitHook SSH passphrase askpass script (#64126): @potiuk
- Docs: Fix Git connection docs to match actual GitHook parameters (#63265): @potiuk
Provider github: 2.11.1rc1
- Migrate github connection UI metadata to YAML (#62668): @yuseok89
Linked issues:
Provider google: 21.0.0rc2
- Delete google provider deprecated items sheduled for Jan 2026 (#62802): @olegkachur-e
- Remove deprecated scheduled for March 2026 (#64098): @Crowiant
- Add configuration drift detection and optional reconciliation to ComputeEngineInsertInstanceOperator (#61830): @SameerMesiah97
Linked issues: - Add bounded best-effort cleanup to GKECreateClusterOperator on post-start failure (#62302): @SameerMesiah97
- Add ClusterType field for Zero-Scale cluster support (#62207): @moli2398
- Adds match_glob to template_fields in GCS operators (#61819): @yohoos
- Add optional parallel downloads and uploads to GCSTimeSpanFileTransformOperator (#62196): @SameerMesiah97
- Add retry logic to BigQueryInsertJobOperator for 429 error (#63181): @Crowiant
- Add start_from_trigger support for
DataprocSubmitJobOperator(#62331): @haseebmalik18
Linked issues:- Linked Issue #50563: @RNHTTR
- Linked Issue #52005: @kgw7401
- Add operators for Google BidManager API (#62521): @Crowiant
- Return destination GCS URIs from ADLSToGCSOperator (#61463): @Abhishekmishra2808
Linked issues:- Linked Issue #11323: @FHoffmannCode
- Return GCS URIs from GoogleAdsToGcsOperator (#61334): @Abhishekmishra2808
- fix google provider DataprocSubmitTrigger deferred tasks stuck forever (#62082): @olegkachur-e
- fix(google-ads): support flat extra format from connection form (#62791): @yuseok89
- fix(providers/google): sanitize Dataproc batch labels to use dashes instead of underscores (#62926): @YoannAbriel
Linked issues:- Linked Issue #59332: @rawwar
- fix(providers/google): wrap sync get_job with sync_to_async in BigQueryAsyncHook (#63230): @YoannAbriel
Linked issues:- Linked Issue #56363: @VladaZakharova
- Linked Issue #63182: @evgeniy-b
- DataprocCreateClusterOperator: Fix non-deferrable reconciliation and handle deletion during creation (#61951): @SameerMesiah97
- Fix SSRF in Bid Manager report download via URL allowlist (#64180): @eladkal
- Add Python 3.14 Support to Google Provider (#64061): @Dev-iL
- Upgrade version of Campaign Manager API to v5 (#62510): @Crowiant
- Fix mypy errors in kubernetes, fab, google, and amazon providers (#63947): @potiuk
- Fix mypy issues from trinodb 0.337.0 (#62998): @eladkal
- Remove PyOpenSSL from dependencies (#63869): @eladkal
- Fix/typos and spelling (#64139): @Shrividya
Provider hashicorp: 4.5.1rc1
- Fix incorrect protocol selection when use_tls is provided as string in VaultHook (#62641): @SameerMesiah97
- Refactor VaultBackend to centralize secret path resolution and retrieval logic (#62643): @SameerMesiah97
Provider http: 6.0.1rc1
- FIX: Allow override of HTTP method in run_method of LivyAsyncHook (#64150): @dabla
- Refactor HttpAsyncHook to support session-based async HTTP operations and simplify LivyAsyncHook (#60458): @dabla
Provider keycloak: 0.7.0rc1
- Add TTL cache with single-flight dedup to Keycloak filter_authorized_dag_ids (#63184): @stegololz
- Adds a state param into keycloak login (#64114): @aritra24
Provider microsoft.azure: 13.1.0rc1
- Add async hook for Azure Synapse pipelines (#62966): @SameerMesiah97
- Add Azure Virtual Machines operators, sensor, and trigger (#49796) (#62391): @nailo2c
Linked issues:- Linked Issue #49796: @vargacypher
- Improve performance of AzureContainerInstanceHook.exists using direct container lookup (#63567): @SameerMesiah97
- Fix/msgraph sensor timeout (#62241): @Subham-KRLX
Linked issues:- Linked Issue #62157: @morelgeorge
- Fix/typos and spelling (#64139): @Shrividya
Provider openai: 1.7.3rc1
- Fix OpenAI provider get_provider_info (#63404): @jason810496
- Fix CI regression of "Improve OpenAI provider metadata" (#63403): @jason810496
Linked issues:- Linked Issue #61054: @Harshitha98A
- Improve OpenAI provider metadata and documentation (#61054): @Harshitha98A
- Migrate openai connection UI metadata to YAML (#62669): @yuseok89
Linked issues:
Provider openfaas: 3.9.3rc1
- Migrate openfaas connection UI metadata to YAML (#62683): @ahilashsasidharan
Linked issues:
Provider openlineage: 2.13.0rc1
- feat: Add Deadline Alerts to OL events (#63352): @kacpermuda
- docs: Clarify HLL in extraction precedence (#63723): @kacpermuda
- Fix/typos and spelling (#64139): @Shrividya
Provider opensearch: 1.8.5rc1
- fix: Elasticsearch logging exception details are missing in task logs tab (#63739): @Subham-KRLX
Linked issues:- Linked Issue #63736: @poilade-de-coulemelle
Provider pagerduty: 5.2.4rc1
Provider pinecone: 2.4.3rc1
- Migrate pinecone connection UI metadata to YAML (#62650): @justinpakzad
Linked issues:
Provider postgres: 6.6.2rc1
- Add validation for missing host and cluster/workgroup identifier in aws iam token retrieval (#61965): @justinpakzad
Provider qdrant: 1.5.4rc1
- Remove version cap from qdrant-client (#63745): @bugraoz93
- Migrate Qdrant connection UI metadata to YAML (#62644): @fat-catTW
Linked issues:
Provider redis: 4.4.3rc1
- Migrate redis connection UI metadata to YAML (#62670): @yuseok89
Linked issues: - Docs: Add RedisTaskHandler configuration example (#63898): @Subham-KRLX
Linked issues:- Linked Issue #63881: @KengoWada
Provider salesforce: 5.13.0rc1
- Add template_fields support to SalesforceBulkOperator (#63109): @Sagargupta16
Linked issues:- Linked Issue #62840: @Sagargupta16
- Linked Issue #62375: @felipearcaro-buildium
Provider sftp: 5.7.2rc1
- Fix an import in providers/sftp to be Airflow 2 compatible (#63822): @axxeny
- Fix make SFTPOperator delete idempotent (return a warning instead of a error when file is already absent) (#62639): @Eason090533
Linked issues:- Linked Issue #56190: @marcbal
Provider slack: 9.9.0rc1
- Add return value to Slack operators for XCom (#63397): @yuseok89
- Validate thread_ts requires single channel in SlackAPIFileOperator (#63523): @yuseok89
Provider snowflake: 6.12.0rc1
- Add PAT authentication support to SnowflakeSqlApiHook (#62162): @cruseakshay
Linked issues:- Linked Issue #62037: @Poornima030596
- adds documentation for previously added extra proxy fields in snowflake hook (#63487): @mansfieldj3
Linked issues:- Linked Issue #60432: @mansfieldj3
- Linked Issue #63486: @mansfieldj3
- Snowpark Operator: Remove version 3.12 warning (#63325): @danicafine
Provider standard: 1.12.2rc1
- fix(providers/standard): improve error message for non-serializable op_kwargs in virtualenv operators (#63270): @YoannAbriel
Linked issues:- Linked Issue #61741: @akhundovte
- Fix ExternalTaskSensor to use timeout parameter in deferrable mode (#… (#62556): @y-sudharshan
Linked issues:- Linked Issue #62516: @iveselin-glooko
- fix(providers/standard): add response_timeout to HITLOperator to prevent race with execution_timeout (#63475): @antonio-mello-ai
Linked issues:- Linked Issue #55866: @zachliu
Provider tableau: 5.3.4rc1
Provider teradata: 3.5.1rc1
Provider trino: 6.5.1rc1
Provider weaviate: 3.3.2rc1
- Migrate Weaviate connection UI metadata to YAML (#62765): @henry3260
Linked issues:
Provider yandex: 4.4.1rc1
- Migrate yandex connection UI metadata to YAML (#63506): @fat-catTW
Linked issues: - Add
PydanticAIHooktocommon.aiprovider (#62546): @kaxil
Linked issues:
Provider ydb: 2.5.1rc1
- Migrate ydb connection UI metadata to YAML (#63412): @henry3260
Linked issues:
Provider zendesk: 4.11.2rc1
- Migrate Zendesk connection UI metadata to YAML (#63326): @henry3260
Linked issues:
All users involved in the PRs:
@Sagargupta16 @Shrividya @ahmadtfarhan @jason810496 @henry3260 @ferruzzi @moli2398 @danicafine @eladkal @aalopatin @josh-fell @y-sudharshan @Crowiant @Shnekit @filippzorin @aritra24
Committer
- I acknowledge that I am a maintainer/committer of the Apache Airflow project.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
kind:metaHigh-level information important to the communityHigh-level information important to the community