eladkal opened a new issue, #32389: URL: https://github.com/apache/airflow/issues/32389
### Body Issue title: Status of testing Providers that were prepared on July 06, 2023 I have a kind request for all the contributors to the latest provider packages release. Could you please help us to test the RC versions of the providers? Let us know in the comment, whether the issue is addressed. Those are providers that require testing as there were some substantial changes introduced: ## Provider [alibaba: 2.5.0rc2](https://pypi.org/project/apache-airflow-providers-alibaba/2.5.0rc2) - [ ] [Add Alibaba Cloud AnalyticDB Spark Support (#31787)](https://github.com/apache/airflow/pull/31787): @dcoliversun ## Provider [amazon: 8.3.0rc2](https://pypi.org/project/apache-airflow-providers-amazon/8.3.0rc2) - [ ] [Add `ChimeWebhookHook` (#31939)](https://github.com/apache/airflow/pull/31939): @cjames23 - [ ] [Add `ChimeNotifier` (#32222)](https://github.com/apache/airflow/pull/32222): @cjames23 - [ ] [Add deferrable mode to S3KeysUnchangedSensor (#31940)](https://github.com/apache/airflow/pull/31940): @sunank200 - [ ] [Add deferrable mode to `RdsCreateDbInstanceOperator` and `RdsDeleteDbInstanceOperator` (#32171)](https://github.com/apache/airflow/pull/32171): @syedahsn - [ ] [Add deferrable mode for `AthenaOperator` (#32186)](https://github.com/apache/airflow/pull/32186): @vandonr-amz - [ ] [Add a deferrable mode to `BatchCreateComputeEnvironmentOperator` (#32036)](https://github.com/apache/airflow/pull/32036): @vandonr-amz - [ ] [Add deferrable mode in EMR operator and sensor (#32029)](https://github.com/apache/airflow/pull/32029): @pankajastro - [ ] [add async wait method to the "with logging" aws utils (#32055)](https://github.com/apache/airflow/pull/32055): @vandonr-amz - [ ] [Add custom waiters to EMR Serverless (#30463)](https://github.com/apache/airflow/pull/30463): @syedahsn - [ ] [Add an option to `GlueJobOperator` to stop the job run when the TI is killed (#32155)](https://github.com/apache/airflow/pull/32155): @hussein-awala - [ ] [deferrable mode for `SageMakerTuningOperator` and `SageMakerEndpointOperator` (#32112)](https://github.com/apache/airflow/pull/32112): @vandonr-amz - [ ] [EKS Create/Delete Nodegroup Deferrable mode (#32165)](https://github.com/apache/airflow/pull/32165): @syedahsn - [ ] [Deferrable mode for ECS operators (#31881)](https://github.com/apache/airflow/pull/31881): @vandonr-amz - [ ] [Add `job_poll_interval` argument to AWS GlueJobOperator (#32147)](https://github.com/apache/airflow/pull/32147): @raphaelauv - [ ] [Added `AzureBlobStorageToS3Operator` transfer operator (#32270)](https://github.com/apache/airflow/pull/32270): @Adaverse - [ ] [bugfix: break down run+wait method in ECS operator (#32104)](https://github.com/apache/airflow/pull/32104): @vandonr-amz - [ ] [Handle `UnboundLocalError` while parsing invalid `s3_url` (#32120)](https://github.com/apache/airflow/pull/32120): @Adaverse - [ ] [Fix `LambdaInvokeFunctionOperator` payload parameter type (#32259)](https://github.com/apache/airflow/pull/32259): @eladi99 - [ ] [Bug fix GCSToS3Operator: avoid `ValueError` when `replace=False` with files already in S3 (#32322)](https://github.com/apache/airflow/pull/32322): @Adaverse - [ ] [Deprecate `delimiter` param and source object's wildcards in GCS, introduce `match_glob` param. (#31261)](https://github.com/apache/airflow/pull/31261): @shahar1 - [ ] [aws waiter util: log status info with error level on waiter error (#32247)](https://github.com/apache/airflow/pull/32247): @vandonr-amz - [ ] [rewrite method used in ecs to fetch less logs (#31786)](https://github.com/apache/airflow/pull/31786): @vandonr-amz - [ ] [Refactor Eks Create Cluster Operator code (#31960)](https://github.com/apache/airflow/pull/31960): @syedahsn - [ ] [Use a waiter in `AthenaHook` (#31942)](https://github.com/apache/airflow/pull/31942): @vandonr-amz - [ ] [Add `on_finish_action` to `KubernetesPodOperator` (#30718)](https://github.com/apache/airflow/pull/30718): @hussein-awala - [ ] [Add default_deferrable config (#31712)](https://github.com/apache/airflow/pull/31712): @Lee-W - [ ] [deprecate arbitrary parameter passing to RDS hook (#32352)](https://github.com/apache/airflow/pull/32352): @vandonr-amz ## Provider [apache.hive: 6.1.2rc2](https://pypi.org/project/apache-airflow-providers-apache-hive/6.1.2rc2) - [ ] [Add proxy_user template check (#32334)](https://github.com/apache/airflow/pull/32334): @potiuk ## Provider [apache.impala: 1.1.2rc2](https://pypi.org/project/apache-airflow-providers-apache-impala/1.1.2rc2) - [ ] [Add kerberos dependency to Impala Provider (#32304)](https://github.com/apache/airflow/pull/32304): @Joffreybvn ## Provider [apache.kafka: 1.1.2rc2](https://pypi.org/project/apache-airflow-providers-apache-kafka/1.1.2rc2) - [ ] [Break AwaitMessageTrigger execution when finding a message with the desired format (#31803)](https://github.com/apache/airflow/pull/31803): @hussein-awala ## Provider [apache.livy: 3.5.2rc2](https://pypi.org/project/apache-airflow-providers-apache-livy/3.5.2rc2) - [ ] [Fix `LivyHook` TypeError exception on `session_id` log format (#32051)](https://github.com/apache/airflow/pull/32051): @joaopamaral - [ ] [Add default_deferrable config (#31712)](https://github.com/apache/airflow/pull/31712): @Lee-W ## Provider [cncf.kubernetes: 7.2.0rc2](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/7.2.0rc2) - [ ] [Add `on_finish_action` to `KubernetesPodOperator` (#30718)](https://github.com/apache/airflow/pull/30718): @hussein-awala - [ ] [Fix KubernetesPodOperator validate xcom json and add retries (#32113)](https://github.com/apache/airflow/pull/32113): @aagateuip - [ ] [Fix `KubernetesPodTrigger` waiting strategy (#31348)](https://github.com/apache/airflow/pull/31348): @hussein-awala - [ ] [fix spark-kubernetes-operator compatibility (#31798)](https://github.com/apache/airflow/pull/31798): @blcksrx - [ ] [Add default_deferrable config (#31712)](https://github.com/apache/airflow/pull/31712): @Lee-W ## Provider [common.sql: 1.6.0rc2](https://pypi.org/project/apache-airflow-providers-common-sql/1.6.0rc2) - [ ] [openlineage, common.sql: provide OL SQL parser as internal OpenLineage provider API (#31398)](https://github.com/apache/airflow/pull/31398): @JDarDagran - [ ] [openlineage: pass SQLAlchemy engine to construct information schema query. (#32371)](https://github.com/apache/airflow/pull/32371): @JDarDagran ## Provider [databricks: 4.3.1rc2](https://pypi.org/project/apache-airflow-providers-databricks/4.3.1rc2) - [ ] [Modify `template_fields` of `DatabricksSqlOperator` to support parent class fields (#32253)](https://github.com/apache/airflow/pull/32253): @eladkal - [ ] [Add default_deferrable config (#31712)](https://github.com/apache/airflow/pull/31712): @Lee-W ## Provider [dbt.cloud: 3.2.2rc2](https://pypi.org/project/apache-airflow-providers-dbt-cloud/3.2.2rc2) - [ ] [Add default_deferrable config (#31712)](https://github.com/apache/airflow/pull/31712): @Lee-W ## Provider [elasticsearch: 5.0.0rc2](https://pypi.org/project/apache-airflow-providers-elasticsearch/5.0.0rc2) - [ ] [Deprecate the 2 non-official elasticsearch libraries (#31920)](https://github.com/apache/airflow/pull/31920): @Owen-CH-Leung ## Provider [google: 10.3.0rc2](https://pypi.org/project/apache-airflow-providers-google/10.3.0rc2) - [ ] [Add `on_finish_action` to `KubernetesPodOperator` (#30718)](https://github.com/apache/airflow/pull/30718): @hussein-awala - [ ] [Add deferrable mode to CloudSQLExportInstanceOperator (#30852)](https://github.com/apache/airflow/pull/30852): @bkossakowska - [ ] [Adding `src_fmt_configs` to the list of template fields. (#32097)](https://github.com/apache/airflow/pull/32097): @nathadfield - [ ] [Fix name format in the batch requests (#32070)](https://github.com/apache/airflow/pull/32070): @HaeSe0ng - [ ] [Fix `BigQueryInsertJobOperator` error handling in deferrable mode (#32034)](https://github.com/apache/airflow/pull/32034): @phanikumv - [ ] [Fix `BIGQUERY_JOB_DETAILS_LINK_FMT` in `BigQueryConsoleLink` (#31953)](https://github.com/apache/airflow/pull/31953): @bkossakowska - [ ] [Make the deferrable version of DataprocCreateBatchOperator handle a b… (#32216)](https://github.com/apache/airflow/pull/32216): @kristopherkane - [ ] [Switch Google Ads API version from v13 to v14 (#32028)](https://github.com/apache/airflow/pull/32028): @ahidalgob - [ ] [Deprecate `delimiter` param and source object's wildcards in GCS, introduce `match_glob` param. (#31261)](https://github.com/apache/airflow/pull/31261): @shahar1 - [ ] [Refactor GKECreateClusterOperator's body validation (#31923)](https://github.com/apache/airflow/pull/31923): @moiseenkov - [ ] [Optimize deferrable mode execution for `BigQueryValueCheckOperator` (#31872)](https://github.com/apache/airflow/pull/31872): @phanikumv - [ ] [Add default_deferrable config (#31712)](https://github.com/apache/airflow/pull/31712): @Lee-W ## Provider [hashicorp: 3.4.2rc2](https://pypi.org/project/apache-airflow-providers-hashicorp/3.4.2rc2) - [ ] [Add default retry to hvac client requests (#31073)](https://github.com/apache/airflow/pull/31073): @notatallshaw-gts ## Provider [microsoft.azure: 6.2.0rc2](https://pypi.org/project/apache-airflow-providers-microsoft-azure/6.2.0rc2) - [ ] [Adds connection test for ADLS Gen2 (#32126)](https://github.com/apache/airflow/pull/32126): @Adaverse - [ ] [Add option to pass extra configs to ClientSecretCredential (#31783)](https://github.com/apache/airflow/pull/31783): @Adaverse - [ ] [Added `AzureBlobStorageToS3Operator` transfer operator (#32270)](https://github.com/apache/airflow/pull/32270): @Adaverse - [ ] [feat(providers/azure): cancel pipeline if unexpected exception caught (#32238)](https://github.com/apache/airflow/pull/32238): @Lee-W - [ ] [Fix where account url is build if not provided using login (account name) (#32082)](https://github.com/apache/airflow/pull/32082): @Adaverse - [ ] [refresh connection if an exception is caught in "AzureDataFactory" (#32323)](https://github.com/apache/airflow/pull/32323): @Lee-W - [ ] [Add default_deferrable config (#31712)](https://github.com/apache/airflow/pull/31712): @Lee-W ## Provider [postgres: 5.5.2rc2](https://pypi.org/project/apache-airflow-providers-postgres/5.5.2rc2) - [ ] [postgres: deprecate `runtime_parameters` in favor of options in `hook_params` (#32345)](https://github.com/apache/airflow/pull/32345): @JDarDagran ## Provider [snowflake: 4.3.0rc2](https://pypi.org/project/apache-airflow-providers-snowflake/4.3.0rc2) - [ ] [Add Deferrable switch to SnowflakeSqlApiOperator (#31596)](https://github.com/apache/airflow/pull/31596): @utkarsharma2 ## Provider [trino: 5.2.0rc2](https://pypi.org/project/apache-airflow-providers-trino/5.2.0rc2) - [ ] [Trino Hook: Add ability to read JWT from file (#31950)](https://github.com/apache/airflow/pull/31950): @jhbigler ## Provider [vertica: 3.5.0rc2](https://pypi.org/project/apache-airflow-providers-vertica/3.5.0rc2) - [ ] [Add various Vertica connection parameters (#32089)](https://github.com/apache/airflow/pull/32089): @darkag The guidelines on how to test providers can be found in [Verify providers by contributors](https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-by-contributors) <!-- NOTE TO RELEASE MANAGER: Please move here the providers that have doc-only changes or for which changes are trivial, and you could assess that they are OK. In case The providers are automatically installed on Airflow 2.3 and latest `main` during the CI, so we know they are installable. Also, all classes within the providers are imported during the CI run so we know all providers can be imported. --> All users involved in the PRs: @darkag @raphaelauv @blcksrx @vandonr-amz @jhbigler @potiuk @Lee-W @bkossakowska @nathadfield @dcoliversun @phanikumv @pankajastro @aagateuip @joaopamaral @Adaverse @JDarDagran @moiseenkov @Joffreybvn @eladi99 @hussein-awala @notatallshaw-gts @Owen-CH-Leung @shahar1 @eladkal @utkarsharma2 @sunank200 @syedahsn @kristopherkane @cjames23 @ahidalgob @HaeSe0ng ### Committer - [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
