eladkal opened a new issue, #42393: URL: https://github.com/apache/airflow/issues/42393
### Body I have a kind request for all the contributors to the latest provider packages release. Could you please help us to test the RC versions of the providers? The guidelines on how to test providers can be found in [Verify providers by contributors](https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-the-release-candidate-by-contributors) Let us know in the comment, whether the issue is addressed. Those are providers that require testing as there were some substantial changes introduced: ## Provider [airbyte: 4.0.0rc1](https://pypi.org/project/apache-airflow-providers-airbyte/4.0.0rc1) - [ ] [Provider Airbyte: breaking change, update provider to use Airbyte API Python SDK (#41122)](https://github.com/apache/airflow/pull/41122): @marcosmarxm - [ ] [Fix wrong casing in airbyte hook. (#42170)](https://github.com/apache/airflow/pull/42170): @potiuk Linked issues: - [ ] [Linked Issue #42154](https://github.com/apache/airflow/issues/42154): @jscheffl - [ ] [Pin airbyte-api to 0.51.0 (#42154) (#42155)](https://github.com/apache/airflow/pull/42155): @jscheffl Linked issues: - [ ] [Linked Issue #42154](https://github.com/apache/airflow/issues/42154): @jscheffl ## Provider [alibaba: 2.9.1rc1](https://pypi.org/project/apache-airflow-providers-alibaba/2.9.1rc1) - [ ] [log handler deprecated filename_template argument removal (#41552)](https://github.com/apache/airflow/pull/41552): @dirrao ## Provider [amazon: 8.29.0rc1](https://pypi.org/project/apache-airflow-providers-amazon/8.29.0rc1) - [ ] [Adding support for volume configurations in ECSRunTaskOperator (#42087)](https://github.com/apache/airflow/pull/42087): @srehman420 - [ ] [Openlineage s3 to redshift operator integration (#41575)](https://github.com/apache/airflow/pull/41575): @Artuz37 - [ ] [ECS Exec: Drop params that aren't compatible with EC2 (#42228)](https://github.com/apache/airflow/pull/42228): @o-nikolas Linked issues: - [ ] [Linked Issue #41824](https://github.com/apache/airflow/issues/41824): @AdamStrLSEC - [ ] [Fix GlueDataBrewStartJobOperator template fields (#42073)](https://github.com/apache/airflow/pull/42073): @ferruzzi - [ ] [Validate aws service exceptions in waiters (#41941)](https://github.com/apache/airflow/pull/41941): @gopidesupavan Linked issues: - [ ] [Linked Issue #41918](https://github.com/apache/airflow/issues/41918): @sarkch - [ ] [Fix treatment of "#" in S3Hook.parse_s3_url() (#41796)](https://github.com/apache/airflow/pull/41796): @GlenboLake - [ ] [fix: remove part of openlineage extraction from S3ToRedshiftOperator (#41631)](https://github.com/apache/airflow/pull/41631): @kacpermuda - [ ] [filename template arg in providers file task handlers backward compitability support (#41633)](https://github.com/apache/airflow/pull/41633): @dirrao Linked issues: - [ ] [Linked Issue #41552](https://github.com/apache/airflow/pull/41552): @dirrao - [ ] [fix: custom query should have precedence over default query in RedshiftToS3Operator (#41634)](https://github.com/apache/airflow/pull/41634): @kacpermuda Linked issues: - [ ] [Linked Issue #37861](https://github.com/apache/airflow/pull/37861): @okirialbert - [ ] [Actually move saml to amazon provider (mistakenly added in papermill) (#42148)](https://github.com/apache/airflow/pull/42148): @potiuk Linked issues: - [ ] [Linked Issue #42137](https://github.com/apache/airflow/pull/42137): @potiuk - [ ] [Use base aws classes in AWS Glue DataBrew Operators/Triggers (#41848)](https://github.com/apache/airflow/pull/41848): @gopidesupavan Linked issues: - [ ] [Linked Issue #35278](https://github.com/apache/airflow/issues/35278): @Taragolis - [ ] [Move `register_views` to auth manager interface (#41777)](https://github.com/apache/airflow/pull/41777): @vincbeck - [ ] [Limit watchtower as depenendcy as 3.3.0 breaks main. (#41612)](https://github.com/apache/airflow/pull/41612): @potiuk - [ ] [log handler deprecated filename_template argument removal (#41552)](https://github.com/apache/airflow/pull/41552): @dirrao ## Provider [apache.hdfs: 4.5.1rc1](https://pypi.org/project/apache-airflow-providers-apache-hdfs/4.5.1rc1) - [ ] [log handler deprecated filename_template argument removal (#41552)](https://github.com/apache/airflow/pull/41552): @dirrao ## Provider [apache.impala: 1.5.1rc1](https://pypi.org/project/apache-airflow-providers-apache-impala/1.5.1rc1) - [ ] [Make kerberos an optional and devel dependency for impala and fab (#41616)](https://github.com/apache/airflow/pull/41616): @potiuk ## Provider [apache.livy: 3.9.1rc1](https://pypi.org/project/apache-airflow-providers-apache-livy/3.9.1rc1) - [ ] [bugfix/livy-set-base-url (#41658)](https://github.com/apache/airflow/pull/41658): @harryshi10 ## Provider [apache.spark: 4.11.0rc1](https://pypi.org/project/apache-airflow-providers-apache-spark/4.11.0rc1) - [ ] [Add kerberos related connection fields(principal, keytab) on SparkSubmitHook (#40757)](https://github.com/apache/airflow/pull/40757): @seyoon-lim ## Provider [cloudant: 4.0.0rc1](https://pypi.org/project/apache-airflow-providers-cloudant/4.0.0rc1) - [ ] [Switch cloudant provider from cloudant library to ibmcloudant library (#41555)](https://github.com/apache/airflow/pull/41555): @topherinternational Linked issues: - [ ] [Linked Issue #21004](https://github.com/apache/airflow/issues/21004): @uranusjr ## Provider [cncf.kubernetes: 8.4.2rc1](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.4.2rc1) - [ ] [Deprecated configuration removed (#42129)](https://github.com/apache/airflow/pull/42129): @dirrao ## Provider [common.io: 1.4.1rc1](https://pypi.org/project/apache-airflow-providers-common-io/1.4.1rc1) - [ ] [Protect against None components of universal pathlib xcom backend (#41921)](https://github.com/apache/airflow/pull/41921): @potiuk Linked issues: - [ ] [Linked Issue #41723](https://github.com/apache/airflow/issues/41723): @potiuk ## Provider [common.sql: 1.17.0rc1](https://pypi.org/project/apache-airflow-providers-common-sql/1.17.0rc1) - [ ] [Generalize caching of connection in DbApiHook to improve performance (#40751)](https://github.com/apache/airflow/pull/40751): @dabla - [ ] [feat: log client db messages for provider postgres (#40171)](https://github.com/apache/airflow/pull/40171): @dondaum Linked issues: - [ ] [Linked Issue #40116](https://github.com/apache/airflow/issues/40116): @hpereira98 ## Provider [databricks: 6.10.0rc1](https://pypi.org/project/apache-airflow-providers-databricks/6.10.0rc1) - [ ] [[FEAT] databricks repair run with reason match and appropriate new settings (#41412)](https://github.com/apache/airflow/pull/41412): @gaurav7261 - [ ] [Removed deprecated method reference airflow.www.auth.has_access when min airflow version >= 2.8.0 (#41747)](https://github.com/apache/airflow/pull/41747): @dirrao ## Provider [docker: 3.14.0rc1](https://pypi.org/project/apache-airflow-providers-docker/3.14.0rc1) - [ ] [Added logging device and logging device options (#41416)](https://github.com/apache/airflow/pull/41416): @geraj1010 Linked issues: - [ ] [Linked Issue #40533](https://github.com/apache/airflow/issues/40533): @xjchew - [ ] [Add retrieve output docker swarm operator (#41531)](https://github.com/apache/airflow/pull/41531): @rgriffier ## Provider [elasticsearch: 5.5.1rc1](https://pypi.org/project/apache-airflow-providers-elasticsearch/5.5.1rc1) - [ ] [Fix ElasticSearch SQLClient deprecation warning (#41871)](https://github.com/apache/airflow/pull/41871): @Owen-CH-Leung - [ ] [Generalize caching of connection in DbApiHook to improve performance (#40751)](https://github.com/apache/airflow/pull/40751): @dabla - [ ] [filename template arg in providers file task handlers backward compitability support (#41633)](https://github.com/apache/airflow/pull/41633): @dirrao Linked issues: - [ ] [Linked Issue #41552](https://github.com/apache/airflow/pull/41552): @dirrao - [ ] [log handler deprecated filename_template argument removal (#41552)](https://github.com/apache/airflow/pull/41552): @dirrao ## Provider [fab: 1.4.0rc1](https://pypi.org/project/apache-airflow-providers-fab/1.4.0rc1) - [ ] [Add FAB migration commands (#41804)](https://github.com/apache/airflow/pull/41804): @ephraimbuddy - [ ] [Separate FAB migration from Core Airflow migration (#41437)](https://github.com/apache/airflow/pull/41437): @ephraimbuddy - [ ] [Deprecated kerberos auth removed (#41693)](https://github.com/apache/airflow/pull/41693): @dirrao - [ ] [Deprecated configuration removed (#42129)](https://github.com/apache/airflow/pull/42129): @dirrao - [ ] [Move `is_active` user property to FAB auth manager (#42042)](https://github.com/apache/airflow/pull/42042): @vincbeck - [ ] [Move `register_views` to auth manager interface (#41777)](https://github.com/apache/airflow/pull/41777): @vincbeck - [ ] [Revert "Provider fab auth manager deprecated methods removed (#41720)" (#41960)](https://github.com/apache/airflow/pull/41960): @potiuk - [ ] [provider fab auth manager deprecated methods removed (#41720)](https://github.com/apache/airflow/pull/41720): @dirrao - [ ] [Make kerberos an optional and devel dependency for impala and fab (#41616)](https://github.com/apache/airflow/pull/41616): @potiuk ## Provider [google: 10.23.0rc1](https://pypi.org/project/apache-airflow-providers-google/10.23.0rc1) - [ ] [Add ability to create Flink Jobs in dataproc cluster (#42342)](https://github.com/apache/airflow/pull/42342): @VladaZakharova - [ ] [Add new Google Search 360 Reporting Operators (#42255)](https://github.com/apache/airflow/pull/42255): @molcay - [ ] [Add return_immediately parameter to PubSubPullSensor class (#41842)](https://github.com/apache/airflow/pull/41842): @arnaubadia Linked issues: - [ ] [Linked Issue #41838](https://github.com/apache/airflow/issues/41838): @arnaubadia - [ ] [Linked Issue #23231](https://github.com/apache/airflow/pull/23231): @eladkal - [ ] [Add parent_model param in `UploadModelOperator` (#42091)](https://github.com/apache/airflow/pull/42091): @jx2lee Linked issues: - [ ] [Linked Issue #41194](https://github.com/apache/airflow/issues/41194): @GLaDAP - [ ] [Add DataflowStartYamlJobOperator (#41576)](https://github.com/apache/airflow/pull/41576): @moiseenkov - [ ] [Add RunEvaluationOperator for Google Vertex AI Rapid Evaluation API (#41940)](https://github.com/apache/airflow/pull/41940): @CYarros10 - [ ] [Add CountTokensOperator for Google Generative AI CountTokensAPI (#41908)](https://github.com/apache/airflow/pull/41908): @CYarros10 - [ ] [Add Supervised Fine Tuning Train Operator, Hook, Tests, Docs (#41807)](https://github.com/apache/airflow/pull/41807): @CYarros10 - [ ] [Minor fixes to ensure successful Vertex AI LLMops pipeline (#41997)](https://github.com/apache/airflow/pull/41997): @CYarros10 - [ ] [Exclude partition from BigQuery table name (#42130)](https://github.com/apache/airflow/pull/42130): @moiseenkov - [ ] [[Fix #41763]: Redundant forward slash in SFTPToGCSOperator when destination_path is not specified or have default value (#41928)](https://github.com/apache/airflow/pull/41928): @Mayuresh16 Linked issues: - [ ] [Linked Issue #41763](https://github.com/apache/airflow/issues/41763): @mpospis - [ ] [Fix poll_interval in GKEJobTrigger (#41712)](https://github.com/apache/airflow/pull/41712): @gopidesupavan Linked issues: - [ ] [Linked Issue #41705](https://github.com/apache/airflow/issues/41705): @bwatan - [ ] [update pattern for dataflow job id extraction (#41794)](https://github.com/apache/airflow/pull/41794): @lukas-mi - [ ] [Fix 'do_xcom_push' and 'get_logs' functionality for KubernetesJobOperator (#40814)](https://github.com/apache/airflow/pull/40814): @MaksYermak - [ ] [Mark VertexAI AutoMLText deprecation (#42251)](https://github.com/apache/airflow/pull/42251): @olegkachur-e - [ ] [Remove system test for deprecated Google analytics operators (#41946)](https://github.com/apache/airflow/pull/41946): @moiseenkov - [ ] [Unpin google-cloud-bigquery package version for Google provider (#41839)](https://github.com/apache/airflow/pull/41839): @MaksYermak - [ ] [Move away from deprecated DAG.following_schedule() method (#41773)](https://github.com/apache/airflow/pull/41773): @jscheffl - [ ] [log handler deprecated filename_template argument removal (#41552)](https://github.com/apache/airflow/pull/41552): @dirrao ## Provider [jdbc: 4.5.1rc1](https://pypi.org/project/apache-airflow-providers-jdbc/4.5.1rc1) - [ ] [Generalize caching of connection in DbApiHook to improve performance (#40751)](https://github.com/apache/airflow/pull/40751): @dabla ## Provider [microsoft.azure: 10.5.0rc1](https://pypi.org/project/apache-airflow-providers-microsoft-azure/10.5.0rc1) - [ ] [Allow custom api versions in MSGraphAsyncOperator (#41331)](https://github.com/apache/airflow/pull/41331): @dabla - [ ] [ Add callback to process Azure Service Bus message contents (#41601)](https://github.com/apache/airflow/pull/41601): @perry2of5 - [ ] [log handler deprecated filename_template argument removal (#41552)](https://github.com/apache/airflow/pull/41552): @dirrao ## Provider [microsoft.mssql: 3.9.1rc1](https://pypi.org/project/apache-airflow-providers-microsoft-mssql/3.9.1rc1) - [ ] [Generalize caching of connection in DbApiHook to improve performance (#40751)](https://github.com/apache/airflow/pull/40751): @dabla ## Provider [mongo: 4.2.1rc1](https://pypi.org/project/apache-airflow-providers-mongo/4.2.1rc1) - [ ] [Adjust typing in Mongo hook to prevent mypy errors (#42354)](https://github.com/apache/airflow/pull/42354): @jscheffl - [ ] [Improve Mongo connection validation and UI (#41717)](https://github.com/apache/airflow/pull/41717): @topherinternational Linked issues: - [ ] [Linked Issue #41371](https://github.com/apache/airflow/pull/41371): @topherinternational ## Provider [mysql: 5.7.1rc1](https://pypi.org/project/apache-airflow-providers-mysql/5.7.1rc1) - [ ] [Generalize caching of connection in DbApiHook to improve performance (#40751)](https://github.com/apache/airflow/pull/40751): @dabla ## Provider [odbc: 4.7.1rc1](https://pypi.org/project/apache-airflow-providers-odbc/4.7.1rc1) - [ ] [Generalize caching of connection in DbApiHook to improve performance (#40751)](https://github.com/apache/airflow/pull/40751): @dabla ## Provider [openai: 1.4.0rc1](https://pypi.org/project/apache-airflow-providers-openai/1.4.0rc1) - [ ] [feat(providers/openai): support batch api in hook/operator/trigger (#41554)](https://github.com/apache/airflow/pull/41554): @josix Linked issues: - [ ] [Linked Issue #41336](https://github.com/apache/airflow/issues/41336): @josix ## Provider [openlineage: 1.12.0rc1](https://pypi.org/project/apache-airflow-providers-openlineage/1.12.0rc1) - [ ] [feat: notify about potential serialization failures when sending DagRun, don't serialize unnecessary params, guard listener for exceptions (#41690)](https://github.com/apache/airflow/pull/4169 - [ ] [fix: revert behavior of flattening lists in OpenLineage's InfoJsonEncodable (#41786)](https://github.com/apache/airflow/pull/41786): @mobuchowski - [ ] [chore: bump OL provider dependencies versions (#42059)](https://github.com/apache/airflow/pull/42059): @kacpermuda - [ ] [move to dag_run.logical_date from execution date in OpenLineage provider (#41889)](https://github.com/apache/airflow/pull/41889): @mobuchowski - [ ] [Unify DAG schedule args and change default to None (#41453)](https://github.com/apache/airflow/pull/41453): @uranusjr ## Provider [papermill: 3.8.1rc1](https://pypi.org/project/apache-airflow-providers-papermill/3.8.1rc1) - [ ] [Actually move saml to amazon provider (mistakenly added in papermill) (#42148)](https://github.com/apache/airflow/pull/42148): @potiuk Linked issues: - [ ] [Linked Issue #42137](https://github.com/apache/airflow/pull/42137): @potiuk - [ ] [Make SAML a required dependency of Amazon provider (#42137)](https://github.com/apache/airflow/pull/42137): @potiuk ## Provider [postgres: 5.13.0rc1](https://pypi.org/project/apache-airflow-providers-postgres/5.13.0rc1) - [ ] [feat: log client db messages for provider postgres (#40171)](https://github.com/apache/airflow/pull/40171): @dondaum Linked issues: - [ ] [Linked Issue #40116](https://github.com/apache/airflow/issues/40116): @hpereira98 - [ ] [Generalize caching of connection in DbApiHook to improve performance (#40751)](https://github.com/apache/airflow/pull/40751): @dabla ## Provider [snowflake: 5.7.1rc1](https://pypi.org/project/apache-airflow-providers-snowflake/5.7.1rc1) - [ ] [Update snowflake naming for account names and locators. (#41775)](https://github.com/apache/airflow/pull/41775): @JDarDagran <!-- NOTE TO RELEASE MANAGER: You can move here the providers that have doc-only changes or for which changes are trivial, and you could assess that they are OK. --> All users involved in the PRs: @gaurav7261 @ephraimbuddy @jscheffl @harryshi10 @dabla @moiseenkov @marcosmarxm @arnaubadia @o-nikolas @Artuz37 @geraj1010 @perry2of5 @josix @kacpermuda @dondaum @Mayuresh16 @olegkachur-e @ferruzzi @mob ### Committer - [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
