eladkal opened a new issue, #32030: URL: https://github.com/apache/airflow/issues/32030
### Body I have a kind request for all the contributors to the latest provider packages release. Could you please help us to test the RC versions of the providers? Let us know in the comment, whether the issue is addressed. Those are providers that require testing as there were some substantial changes introduced: ## Provider [amazon: 8.2.0rc1](https://pypi.org/project/apache-airflow-providers-amazon/8.2.0rc1) - [ ] [Add deferrable option to EmrTerminateJobFlowOperator (#31646)](https://github.com/apache/airflow/pull/31646): @syedahsn - [ ] [Add Deferrable option to EmrCreateJobFlowOperator (#31641)](https://github.com/apache/airflow/pull/31641): @syedahsn - [ ] [Add deferrable mode to `BatchSensor` (#30279)](https://github.com/apache/airflow/pull/30279): @phanikumv - [ ] [Add deferrable mode for S3KeySensor (#31018)](https://github.com/apache/airflow/pull/31018): @sunank200 - [ ] [Add Deferrable mode to Emr Add Steps operator (#30928)](https://github.com/apache/airflow/pull/30928): @syedahsn - [ ] [Add deferrable mode in Redshift delete cluster (#30244)](https://github.com/apache/airflow/pull/30244): @pankajastro - [ ] [Add discoverability for triggers in provider.yaml (#31576)](https://github.com/apache/airflow/pull/31576): @eladkal - [ ] [Add deferrable mode to AWS glue operators (Job & Crawl) (#30948)](https://github.com/apache/airflow/pull/30948): @vandonr-amz - [ ] [Add deferrable param in BatchOperator (#30865)](https://github.com/apache/airflow/pull/30865): @pankajastro - [ ] [Add Deferrable Mode to RedshiftCreateClusterSnapshotOperator (#30856)](https://github.com/apache/airflow/pull/30856): @syedahsn - [ ] [Deferrable mode for EksCreateFargateProfileOperator and EksDeleteFargateProfileOperator (#31657)](https://github.com/apache/airflow/pull/31657): @syedahsn - [ ] [allow anonymous AWS access (#31659)](https://github.com/apache/airflow/pull/31659): @melugoyal - [ ] [Support of wildcard in S3ListOperator and S3ToGCSOperator (#31640)](https://github.com/apache/airflow/pull/31640): @moiseenkov - [ ] [Add `deferrable` param in `EmrContainerSensor` (#30945)](https://github.com/apache/airflow/pull/30945): @pankajastro - [ ] [Add realtime container execution logs for BatchOperator (#31837)](https://github.com/apache/airflow/pull/31837): @killua1zoldyck - [ ] [Various fixes on ECS run task operator (#31838)](https://github.com/apache/airflow/pull/31838): @vandonr-amz - [ ] [fix return values on glue operators deferrable mode (#31694)](https://github.com/apache/airflow/pull/31694): @vandonr-amz - [ ] [Add back missing AsyncIterator import (#31710)](https://github.com/apache/airflow/pull/31710): @uranusjr - [ ] [Use a continuation token to get logs in ecs (#31824)](https://github.com/apache/airflow/pull/31824): @vandonr-amz - [ ] [Fetch status in while loop so as to not exit too early (#31804)](https://github.com/apache/airflow/pull/31804): @o-nikolas - [ ] [[AWS hook] use provided client to get the official waiter on fallback (#31748)](https://github.com/apache/airflow/pull/31748): @vandonr-amz - [ ] [fix(providers/amazon): handle missing LogUri in emr describe_cluster API response (#31482)](https://github.com/apache/airflow/pull/31482): @Lee-W - [ ] [Add Python 3.11 support (#27264)](https://github.com/apache/airflow/pull/27264): @potiuk - [ ] [Added config template field to EmrServerlessStartJobOperator (#31746)](https://github.com/apache/airflow/pull/31746): @mahammi - [ ] [Add null check for host in Amazon Redshift connection (#31567)](https://github.com/apache/airflow/pull/31567): @sunank200 - [ ] [add workgroup to templated fields (#31574)](https://github.com/apache/airflow/pull/31574): @simonprydden - [ ] [Add docstring and signature for _read_remote_logs (#31623)](https://github.com/apache/airflow/pull/31623): @dstandish - [ ] [Deprecate `wait_for_completion` from `EcsRegisterTaskDefinitionOperator` and `EcsDeregisterTaskDefinitionOperator` (#31884)](https://github.com/apache/airflow/pull/31884): @vandonr-amz - [ ] [ Change Deferrable implementation for RedshiftResumeClusterOperator to follow standard (#30864)](https://github.com/apache/airflow/pull/30864): @syedahsn - [ ] [Change Deferrable implementation for RedshiftPauseClusterOperator to follow standard (#30853)](https://github.com/apache/airflow/pull/30853): @syedahsn ## Provider [apache.hive: 6.1.1rc1](https://pypi.org/project/apache-airflow-providers-apache-hive/6.1.1rc1) - [ ] [Sanitize beeline principal parameter (#31983)](https://github.com/apache/airflow/pull/31983): @potiuk - [ ] [Replace unicodecsv with standard csv library (#31693)](https://github.com/apache/airflow/pull/31693): @dstandish ## Provider [apache.livy: 3.5.1rc1](https://pypi.org/project/apache-airflow-providers-apache-livy/3.5.1rc1) - [ ] [Push Spark appId to XCOM for LivyOperator with deferrable mode (#31201)](https://github.com/apache/airflow/pull/31201): @pankajkoti - [ ] [Optimize deferrable mode execution for `LivyOperator` (#31685)](https://github.com/apache/airflow/pull/31685): @phanikumv ## Provider [apache.spark: 4.1.1rc1](https://pypi.org/project/apache-airflow-providers-apache-spark/4.1.1rc1) - [ ] [Update SparkSubmitOperator doc: rename spark_conn_id to conn_id (#31952)](https://github.com/apache/airflow/pull/31952): @enchant3dmango ## Provider [atlassian.jira: 2.1.1rc1](https://pypi.org/project/apache-airflow-providers-atlassian-jira/2.1.1rc1) - [ ] [Fix: JiraOperator support any return response from Jira client (#31672)](https://github.com/apache/airflow/pull/31672): @Joffreybvn ## Provider [cncf.kubernetes: 7.1.0rc1](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/7.1.0rc1) - [ ] [KubernetesResourceOperator - KubernetesDeleteResourceOperator & KubernetesCreateResourceOperator (#29930)](https://github.com/apache/airflow/pull/29930): @raphaelauv - [ ] [Add a return statement to enforce a single yield in certain triggers (#31985)](https://github.com/apache/airflow/pull/31985): @hussein-awala - [ ] [Add possibility to disable logging the pod template in a case when task fails (#31595)](https://github.com/apache/airflow/pull/31595): @svdimchenko - [ ] [Remove return statement after yield from triggers class (#31703)](https://github.com/apache/airflow/pull/31703): @pankajastro - [ ] [Fix Fargate logging for AWS system tests (#31622)](https://github.com/apache/airflow/pull/31622): @vincbeck ## Provider [databricks: 4.3.0rc1](https://pypi.org/project/apache-airflow-providers-databricks/4.3.0rc1) - [ ] [Add a return statement to enforce a single yield in certain triggers (#31985)](https://github.com/apache/airflow/pull/31985): @hussein-awala - [ ] [`DatabricksSubmitRunOperator` : Fix type annotation for `libraries` param (#31888)](https://github.com/apache/airflow/pull/31888): @phanikumv - [ ] [Fix Databricks SQL operator serialization (#31780)](https://github.com/apache/airflow/pull/31780): @potiuk - [ ] [Making Databricks run related multi-query string in one session again (#31899)](https://github.com/apache/airflow/pull/31899): @dimonchik-suvorov - [ ] [Remove return statement after yield from triggers class (#31703)](https://github.com/apache/airflow/pull/31703): @pankajastro ## Provider [discord: 3.3.0rc1](https://pypi.org/project/apache-airflow-providers-discord/3.3.0rc1) - [ ] [Add `DiscordNotifier` (#31273)](https://github.com/apache/airflow/pull/31273): @vargacypher ## Provider [google: 10.2.0rc1](https://pypi.org/project/apache-airflow-providers-google/10.2.0rc1) - [ ] [Add a return statement to enforce a single yield in certain triggers (#31985)](https://github.com/apache/airflow/pull/31985): @hussein-awala - [ ] [Add deferrable mode to PubsubPullSensor (#31284)](https://github.com/apache/airflow/pull/31284): @bkossakowska - [ ] [Add a new param to set parquet row group size in `BaseSQLToGCSOperator` (#31831)](https://github.com/apache/airflow/pull/31831): @hussein-awala - [ ] [Add `cacheControl` field to google cloud storage (#31338)](https://github.com/apache/airflow/pull/31338): @ying-w - [ ] [Add `preserveAsciiControlCharacters` to `src_fmt_configs` for GCStoBQ (#31643)](https://github.com/apache/airflow/pull/31643): @nathadfield - [ ] [Add credential configuration file support to Google Secrets Manager secrets backend (#31597)](https://github.com/apache/airflow/pull/31597): @pgagnon - [ ] [Add credential configuration file support to Google Cloud Hook (#31548)](https://github.com/apache/airflow/pull/31548): @pgagnon - [ ] [Add deferrable mode to `GCSUploadSessionCompleteSensor` (#31081)](https://github.com/apache/airflow/pull/31081): @phanikumv - [ ] [Add append_job_name parameter in DataflowStartFlexTemplateOperator (#31511)](https://github.com/apache/airflow/pull/31511): @VladaZakharova - [ ] [Introduce configuration to disable md5 used for security (#31171)](https://github.com/apache/airflow/pull/31171): @longslvr - [ ] [MetastoreHivePartitionSensor (#31016)](https://github.com/apache/airflow/pull/31016): @moiseenkov - [ ] [Bigquery: fix links for already existing tables and datasets. (#31589)](https://github.com/apache/airflow/pull/31589): @bkossakowska - [ ] [Provide missing project id and creds for TabularDataset (#31991)](https://github.com/apache/airflow/pull/31991): @hussein-awala - [ ] [Optimize deferrable mode execution for `DataprocSubmitJobOperator` (#31317)](https://github.com/apache/airflow/pull/31317): @phanikumv - [ ] [Optimize deferrable mode execution for `BigQueryInsertJobOperator` (#31249)](https://github.com/apache/airflow/pull/31249): @phanikumv - [ ] [Remove return statement after yield from triggers class (#31703)](https://github.com/apache/airflow/pull/31703): @pankajastro - [ ] [Replace unicodecsv with standard csv library (#31693)](https://github.com/apache/airflow/pull/31693): @dstandish - [ ] [Optimize deferrable mode execution for `BigQueryCheckOperator` (#31758)](https://github.com/apache/airflow/pull/31758): @phanikumv ## Provider [hashicorp: 3.4.1rc1](https://pypi.org/project/apache-airflow-providers-hashicorp/3.4.1rc1) - [ ] [Fix Hashicorp client authentication for `userpass` and `aws_iam` methods (#31593)](https://github.com/apache/airflow/pull/31593): @hussein-awala ## Provider [jdbc: 4.0.0rc1](https://pypi.org/project/apache-airflow-providers-jdbc/4.0.0rc1) - [ ] [Restrict direct usage of driver params via extras for JDBC connection (#31849)](https://github.com/apache/airflow/pull/31849): @pankajkoti - [ ] [Improve docstrings in providers (#31681)](https://github.com/apache/airflow/pull/31681): @uranusjr - [ ] [Add D400 pydocstyle check - Providers (#31427)](https://github.com/apache/airflow/pull/31427): @vincbeck ## Provider [microsoft.azure: 6.1.2rc1](https://pypi.org/project/apache-airflow-providers-microsoft-azure/6.1.2rc1) - [ ] [Replace unicodecsv with standard csv library (#31693)](https://github.com/apache/airflow/pull/31693): @dstandish - [ ] [Removed unused variables in AzureBlobStorageToGCSOperator (#31765)](https://github.com/apache/airflow/pull/31765): @Adaverse - [ ] [Add docstring and signature for _read_remote_logs (#31623)](https://github.com/apache/airflow/pull/31623): @dstandish ## Provider [microsoft.mssql: 3.4.1rc1](https://pypi.org/project/apache-airflow-providers-microsoft-mssql/3.4.1rc1) - [ ] [Check if sqlalchemy_scheme extra contains forbidden characters (#31984)](https://github.com/apache/airflow/pull/31984): @potiuk ## Provider [mysql: 5.1.1rc1](https://pypi.org/project/apache-airflow-providers-mysql/5.1.1rc1) - [ ] [Replace unicodecsv with standard csv library (#31693)](https://github.com/apache/airflow/pull/31693): @dstandish ## Provider [odbc: 4.0.0rc1](https://pypi.org/project/apache-airflow-providers-odbc/4.0.0rc1) - [ ] [Disable setting ODBC driver via extra by default (#31713)](https://github.com/apache/airflow/pull/31713): @potiuk - [ ] [Check if sqlalchemy_scheme extra contains forbidden characters (#31984)](https://github.com/apache/airflow/pull/31984): @potiuk - [ ] [Control permissibility of driver config in extra from airflow.cfg (#31754)](https://github.com/apache/airflow/pull/31754): @dstandish - [ ] [Improve docstrings in providers (#31681)](https://github.com/apache/airflow/pull/31681): @uranusjr - [ ] [Add D400 pydocstyle check - Providers (#31427)](https://github.com/apache/airflow/pull/31427): @vincbeck ## Provider [pagerduty: 3.3.0rc1](https://pypi.org/project/apache-airflow-providers-pagerduty/3.3.0rc1) - [ ] [Add notifier for pagerduty (#31207)](https://github.com/apache/airflow/pull/31207): @utkarsharma2 - [ ] [Add send_event method in PagerdutyEventsHook (#31290)](https://github.com/apache/airflow/pull/31290): @utkarsharma2 ## Provider [smtp: 1.2.0rc1](https://pypi.org/project/apache-airflow-providers-smtp/1.2.0rc1) - [ ] [Add notifier for Smtp (#31359)](https://github.com/apache/airflow/pull/31359): @utkarsharma2 ## Provider [snowflake: 4.2.0rc1](https://pypi.org/project/apache-airflow-providers-snowflake/4.2.0rc1) - [ ] [Add SnowflakeSqlApiOperator operator (#30698)](https://github.com/apache/airflow/pull/30698): @utkarsharma2 - [ ] [SnowflakeSqlApiOperator - Change the base class (#31751)](https://github.com/apache/airflow/pull/31751): @utkarsharma2 - [ ] [Moved sql_api_generate_jwt out of hooks folder (#31586)](https://github.com/apache/airflow/pull/31586): @utkarsharma2 The guidelines on how to test providers can be found in [Verify providers by contributors](https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-by-contributors) <!-- NOTE TO RELEASE MANAGER: Please move here the providers that have doc-only changes or for which changes are trivial, and you could assess that they are OK. In case The providers are automatically installed on Airflow 2.3 and latest `main` during the CI, so we know they are installable. Also, all classes within the providers are imported during the CI run so we know all providers can be imported. --> All users involved in the PRs: @o-nikolas @utkarsharma2 @phanikumv @nathadfield @simonprydden @vargacypher @svdimchenko @longslvr @dstandish @uranusjr @dimonchik-suvorov @vincbeck @melugoyal @eladkal @Joffreybvn @sunank200 @moiseenkov @pankajastro @potiuk @killua1zoldyck @hussein-awala @raphaelauv @enchant3dmango @Lee-W @Adaverse @vandonr-amz @syedahsn @ying-w @bkossakowska @VladaZakharova @mahammi @pankajkoti @pgagnon ### Committer - [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
