eladkal opened a new issue, #41237: URL: https://github.com/apache/airflow/issues/41237
### Body I have a kind request for all the contributors to the latest provider packages release. Could you please help us to test the RC versions of the providers? The guidelines on how to test providers can be found in [Verify providers by contributors](https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-the-release-candidate-by-contributors) Let us know in the comment, whether the issue is addressed. Those are providers that require testing as there were some substantial changes introduced: ## Provider [amazon: 8.27.0rc2](https://pypi.org/project/apache-airflow-providers-amazon/8.27.0rc2) - [ ] [Add RedriveExecution support to StepFunctionStartExecutionOperator (#40976)](https://github.com/apache/airflow/pull/40976): @gopidesupavan - [ ] [AIP-62: add hook lineage collection support for S3Hook (#40819)](https://github.com/apache/airflow/pull/40819): @mobuchowski - [ ] [Introduce Amazon Kinesis Analytics V2 (Managed Service for Apache Flink application) (#40765)](https://github.com/apache/airflow/pull/40765): @gopidesupavan - [ ] [Make EMR Container Trigger max attempts retries match the Operator (#41008)](https://github.com/apache/airflow/pull/41008): @o-nikolas Linked issues: - [ ] [Linked Issue #40483](https://github.com/apache/airflow/issues/40483): @akomisarek - [ ] [Fix `RdsStopDbOperator` operator in deferrable mode (#41059)](https://github.com/apache/airflow/pull/41059): @vincbeck - [ ] [Fix `RedshiftCreateClusterOperator` to always specify `PubliclyAccessible` (#40872)](https://github.com/apache/airflow/pull/40872): @vincbeck - [ ] [Fix AWS Redshift operators and sensors (#41191)](https://github.com/apache/airflow/pull/41191): @vincbeck - [ ] [Fix `EmrServerlessStartJobOperator` (#41103)](https://github.com/apache/airflow/pull/41103): @vincbeck - [ ] [Update `example_redshift` and `example_redshift_s3_transfers` to use `RedshiftDataHook` instead of `RedshiftSQLHook` (#40970)](https://github.com/apache/airflow/pull/40970): @vincbeck - [ ] [openlineage: migrate OpenLineage provider to V2 facets. (#39530)](https://github.com/apache/airflow/pull/39530): @JDarDagran - [ ] [[AIP-62] Translate AIP-60 URI to OpenLineage (#40173)](https://github.com/apache/airflow/pull/40173): @kacpermuda Linked issues: - [ ] [Linked Issue #40335](https://github.com/apache/airflow/pull/40335): @JDarDagran - [ ] [Linked Issue #38767](https://github.com/apache/airflow/issues/38767): @mobuchowski - [ ] [Move AWS Managed Service for Apache Flink sensor states to Hook (#40896)](https://github.com/apache/airflow/pull/40896): @gopidesupavan - [ ] [Replace usages of task context logger with the log table (#40867)](https://github.com/apache/airflow/pull/40867): @dstandish - [ ] [Deprecate `SageMakerTrainingPrintLogTrigger` (#41158)](https://github.com/apache/airflow/pull/41158): @vincbeck ## Provider [apache.beam: 5.7.2rc2](https://pypi.org/project/apache-airflow-providers-apache-beam/5.7.2rc2) - [ ] [Update default value for job_name in DataflowConfiguration (#40645)](https://github.com/apache/airflow/pull/40645): @e-galan Linked issues: - [ ] [Linked Issue #40515](https://github.com/apache/airflow/issues/40515): @turb ## Provider [apache.drill: 2.7.3rc1](https://pypi.org/project/apache-airflow-providers-apache-drill/2.7.3rc1) - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla ## Provider [apache.druid: 3.10.2rc1](https://pypi.org/project/apache-airflow-providers-apache-druid/3.10.2rc1) - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla ## Provider [apache.impala: 1.4.2rc1](https://pypi.org/project/apache-airflow-providers-apache-impala/1.4.2rc1) - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla ## Provider [apache.pinot: 4.4.2rc1](https://pypi.org/project/apache-airflow-providers-apache-pinot/4.4.2rc1) - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla ## Provider [apprise: 1.3.2rc1](https://pypi.org/project/apache-airflow-providers-apprise/1.3.2rc1) - [ ] [Fix default behaviour for init function in AppriseNotifier (#41054)](https://github.com/apache/airflow/pull/41054): @romsharon98 ## Provider [celery: 3.7.3rc1](https://pypi.org/project/apache-airflow-providers-celery/3.7.3rc1) - [ ] [Increase broker's visibility timeout to 24hrs (#40879)](https://github.com/apache/airflow/pull/40879): @ephraimbuddy ## Provider [cncf.kubernetes: 8.3.4rc1](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.3.4rc1) - [ ] [Pass content of kube/config file to triggerer as a dictionary (#41178)](https://github.com/apache/airflow/pull/41178): @VladaZakharova - [ ] [Fix confusing log message in kubernetes executor (#41035)](https://github.com/apache/airflow/pull/41035): @RNHTTR - [ ] [Fix ApiException handling when adopting completed pods (#41109)](https://github.com/apache/airflow/pull/41109): @jedcunningham ## Provider [common.compat: 1.1.0rc1](https://pypi.org/project/apache-airflow-providers-common-compat/1.1.0rc1) - [ ] [AIP-62: add method to common.compat to not force hooks to try/except every time (#40812)](https://github.com/apache/airflow/pull/40812): @mobuchowski - [ ] [openlineage: migrate OpenLineage provider to V2 facets. (#39530)](https://github.com/apache/airflow/pull/39530): @JDarDagran - [ ] [AIP-62: add hook lineage collection support for S3Hook (#40819)](https://github.com/apache/airflow/pull/40819): @mobuchowski ## Provider [common.io: 1.4.0rc1](https://pypi.org/project/apache-airflow-providers-common-io/1.4.0rc1) - [ ] [[AIP-62] Translate AIP-60 URI to OpenLineage (#40173)](https://github.com/apache/airflow/pull/40173): @kacpermuda Linked issues: - [ ] [Linked Issue #40335](https://github.com/apache/airflow/pull/40335): @JDarDagran - [ ] [Linked Issue #38767](https://github.com/apache/airflow/issues/38767): @mobuchowski - [ ] [AIP-62: add file dataset type support into common.io provider (#40817)](https://github.com/apache/airflow/pull/40817): @mobuchowski - [ ] [openlineage: migrate OpenLineage provider to V2 facets. (#39530)](https://github.com/apache/airflow/pull/39530): @JDarDagran - [ ] [AIP-62: add hook lineage collection support for S3Hook (#40819)](https://github.com/apache/airflow/pull/40819): @mobuchowski ## Provider [common.sql: 1.15.0rc1](https://pypi.org/project/apache-airflow-providers-common-sql/1.15.0rc1) - [ ] [Create SQLAlchemy engine from connection in DB Hook and added autocommit param to insert_rows method (#40669)](https://github.com/apache/airflow/pull/40669): @dabla ## Provider [databricks: 6.8.0rc1](https://pypi.org/project/apache-airflow-providers-databricks/6.8.0rc1) - [ ] [Add DatabricksWorkflowPlugin (#40724)](https://github.com/apache/airflow/pull/40724): @pankajkoti Linked issues: - [ ] [Linked Issue #40153](https://github.com/apache/airflow/pull/40153): @pankajkoti - [ ] [Linked Issue #40714](https://github.com/apache/airflow/pull/40714): @jscheffl - [ ] [Linked Issue #40708](https://github.com/apache/airflow/pull/40708): @jscheffl - [ ] [DatabricksPlugin - Fix dag view redirect URL by using url_for redirect (#41040)](https://github.com/apache/airflow/pull/41040): @pankajkoti - [ ] [Fix named parameters templating in Databricks operators (#40864)](https://github.com/apache/airflow/pull/40864): @boraberke Linked issues: - [ ] [Linked Issue #40788](https://github.com/apache/airflow/issues/40788): @vatsrahul1001 - [ ] [Linked Issue #40471](https://github.com/apache/airflow/pull/40471): @boraberke - [ ] [[Databricks Provider] Revert PRs #40864 and #40471 (#41050)](https://github.com/apache/airflow/pull/41050): @pankajkoti Linked issues: - [ ] [Linked Issue #40864](https://github.com/apache/airflow/pull/40864): @boraberke - [ ] [Linked Issue #35433](https://github.com/apache/airflow/issues/35433): @josh-fell - [ ] [Linked Issue #40471](https://github.com/apache/airflow/pull/40471): @boraberke ## Provider [docker: 3.12.3rc1](https://pypi.org/project/apache-airflow-providers-docker/3.12.3rc1) - [ ] [DockerSwarmOperator: Support line breaks in service logs (#40705)](https://github.com/apache/airflow/pull/40705): @mr1holmes Linked issues: - [ ] [Linked Issue #40571](https://github.com/apache/airflow/issues/40571): @bladerail ## Provider [elasticsearch: 5.4.2rc1](https://pypi.org/project/apache-airflow-providers-elasticsearch/5.4.2rc1) - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla ## Provider [exasol: 4.5.3rc1](https://pypi.org/project/apache-airflow-providers-exasol/4.5.3rc1) - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla ## Provider [ftp: 3.10.1rc1](https://pypi.org/project/apache-airflow-providers-ftp/3.10.1rc1) - [ ] [openlineage: migrate OpenLineage provider to V2 facets. (#39530)](https://github.com/apache/airflow/pull/39530): @JDarDagran ## Provider [google: 10.21.1rc2](https://pypi.org/project/apache-airflow-providers-google/10.21.1rc2) - [ ] [Dynamic import MySqlHook/PostgresHook in CloudSQLDatabaseHook (#41009)](https://github.com/apache/airflow/pull/41009): @jhongy1994 Linked issues: - [ ] [Linked Issue #40175](https://github.com/apache/airflow/issues/40175): @bourliam - [ ] [Make google_analytics_admin system tests self sufficient (#40951)](https://github.com/apache/airflow/pull/40951): @moiseenkov - [ ] [Fix Custom Training Job operators to accept results without a model in def mode (#40685)](https://github.com/apache/airflow/pull/40685): @e-galan Linked issues: - [ ] [Linked Issue #40476](https://github.com/apache/airflow/issues/40476): @vignesh-sc - [ ] [Fix behavior for reattach_state parameter in BigQueryInsertJobOperator (#40664)](https://github.com/apache/airflow/pull/40664): @VladaZakharova - [ ] [Fix cloudsql-query system tests (#41092)](https://github.com/apache/airflow/pull/41092): @moiseenkov - [ ] [Refactor dataproc system tests (#40720)](https://github.com/apache/airflow/pull/40720): @VladaZakharova - [ ] [openlineage: migrate OpenLineage provider to V2 facets. (#39530)](https://github.com/apache/airflow/pull/39530): @JDarDagran - [ ] [Resolve google cloud sql deprecation in tests (#40834)](https://github.com/apache/airflow/pull/40834): @dirrao - [ ] [Update default value for job_name in DataflowConfiguration (#40645)](https://github.com/apache/airflow/pull/40645): @e-galan Linked issues: - [ ] [Linked Issue #40515](https://github.com/apache/airflow/issues/40515): @turb ## Provider [jdbc: 4.4.0rc1](https://pypi.org/project/apache-airflow-providers-jdbc/4.4.0rc1) - [ ] [Create SQLAlchemy engine from connection in DB Hook and added autocommit param to insert_rows method (#40669)](https://github.com/apache/airflow/pull/40669): @dabla - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla ## Provider [microsoft.azure: 10.3.0rc1](https://pypi.org/project/apache-airflow-providers-microsoft-azure/10.3.0rc1) - [ ] [Added priority to Azure Container Instances (#40616)](https://github.com/apache/airflow/pull/40616): @liamalsopp Linked issues: - [ ] [Linked Issue #40574](https://github.com/apache/airflow/issues/40574): @liamalsopp - [ ] [Bump minimum version for azure containerinstance. (#40767)](https://github.com/apache/airflow/pull/40767): @potiuk Linked issues: - [ ] [Linked Issue #40616](https://github.com/apache/airflow/pull/40616): @liamalsopp ## Provider [microsoft.mssql: 3.8.0rc1](https://pypi.org/project/apache-airflow-providers-microsoft-mssql/3.8.0rc1) - [ ] [Added support for replace option when using insert_rows with MsSqlHook (#40836)](https://github.com/apache/airflow/pull/40836): @dabla - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla ## Provider [mysql: 5.6.3rc1](https://pypi.org/project/apache-airflow-providers-mysql/5.6.3rc1) - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla ## Provider [odbc: 4.6.3rc1](https://pypi.org/project/apache-airflow-providers-odbc/4.6.3rc1) - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla ## Provider [openlineage: 1.10.0rc1](https://pypi.org/project/apache-airflow-providers-openlineage/1.10.0rc1) - [ ] [openlineage: add AirflowRun on COMPLETE/FAIL events (#40996)](https://github.com/apache/airflow/pull/40996): @mobuchowski - [ ] [openlineage: extend custom_run_facets to on_failed and on_complete (#40953)](https://github.com/apache/airflow/pull/40953): @kacpermuda Linked issues: - [ ] [Linked Issue #38982](https://github.com/apache/airflow/pull/38982): @anandhimurali - [ ] [openlineage: migrate OpenLineage provider to V2 facets. (#39530)](https://github.com/apache/airflow/pull/39530): @JDarDagran - [ ] [openlineage: Add AirflowDagRunFacet to dag runEvents (#40854)](https://github.com/apache/airflow/pull/40854): @dolfinus Linked issues: - [ ] [Linked Issue #40798](https://github.com/apache/airflow/issues/40798): @dolfinus - [ ] [[AIP-62] Translate AIP-60 URI to OpenLineage (#40173)](https://github.com/apache/airflow/pull/40173): @kacpermuda Linked issues: - [ ] [Linked Issue #40335](https://github.com/apache/airflow/pull/40335): @JDarDagran - [ ] [Linked Issue #38767](https://github.com/apache/airflow/issues/38767): @mobuchowski - [ ] [Ability to add custom facet in OpenLineage events (#38982)](https://github.com/apache/airflow/pull/38982): @anandhimurali - [ ] [AIP-62: add method to common.compat to not force hooks to try/except every time (#40812)](https://github.com/apache/airflow/pull/40812): @mobuchowski - [ ] [openlineage: use airflow provided getters in conf (#40790)](https://github.com/apache/airflow/pull/40790): @kacpermuda Linked issues: - [ ] [Linked Issue #40780](https://github.com/apache/airflow/pull/40780): @mobuchowski - [ ] [Linked Issue #40589](https://github.com/apache/airflow/pull/40589): @mobuchowski - [ ] [openlineage: add config to include 'full' task info based on conf setting (#40589)](https://github.com/apache/airflow/pull/40589): @mobuchowski - [ ] [Add log_url to OpenLineage AirflowRunFacet (#40797)](https://github.com/apache/airflow/pull/40797): @dolfinus - [ ] [openlineage: add deferrable information to task info in airflowRunFacet (#40682)](https://github.com/apache/airflow/pull/40682): @kacpermuda Linked issues: - [ ] [Linked Issue #38264](https://github.com/apache/airflow/pull/38264): @kacpermuda - [ ] [openlineage: adjust DefaultExtractor's on_failure detection for airflow 2.10 fix (#41094)](https://github.com/apache/airflow/pull/41094): @kacpermuda Linked issues: - [ ] [Linked Issue #41053](https://github.com/apache/airflow/pull/41053): @kacpermuda - [ ] [openlineage: make value of slots in attrs.define consistent (#40992)](https://github.com/apache/airflow/pull/40992): @kacpermuda Linked issues: - [ ] [Linked Issue #40972](https://github.com/apache/airflow/pull/40972): @JDarDagran - [ ] [openlineage: Set `slots` to True for facets used in dag level (#40972)](https://github.com/apache/airflow/pull/40972): @JDarDagran - [ ] [openlineage: fix / add some task attributes in AirflowRunFacet (#40725)](https://github.com/apache/airflow/pull/40725): @kacpermuda Linked issues: - [ ] [Linked Issue #40371](https://github.com/apache/airflow/pull/40371): @mobuchowski - [ ] [openlineage: replace dt.now with airflow.utils.timezone.utcnow (#40887)](https://github.com/apache/airflow/pull/40887): @kacpermuda - [ ] [openlineage: remove deprecated parentRun facet key (#40681)](https://github.com/apache/airflow/pull/40681): @kacpermuda ## Provider [pgvector: 1.2.2rc1](https://pypi.org/project/apache-airflow-providers-pgvector/1.2.2rc1) - [ ] [updating pgvector to !=0.3.0 to avoid recent issue in latest releases(0.3.0) (#40683)](https://github.com/apache/airflow/pull/40683): @vatsrahul1001 ## Provider [postgres: 5.11.3rc1](https://pypi.org/project/apache-airflow-providers-postgres/5.11.3rc1) - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla ## Provider [qdrant: 1.1.2rc1](https://pypi.org/project/apache-airflow-providers-qdrant/1.1.2rc1) - [ ] [Qdrant Provider: Bump Qdrant client to latest (#40831)](https://github.com/apache/airflow/pull/40831): @Anush008 ## Provider [sftp: 4.10.3rc1](https://pypi.org/project/apache-airflow-providers-sftp/4.10.3rc1) - [ ] [openlineage: migrate OpenLineage provider to V2 facets. (#39530)](https://github.com/apache/airflow/pull/39530): @JDarDagran ## Provider [slack: 8.8.0rc1](https://pypi.org/project/apache-airflow-providers-slack/8.8.0rc1) - [ ] [Add the ability to toggle the unfurl behavior for slack notifier (#40694)](https://github.com/apache/airflow/pull/40694): @armand-sauzay - [ ] [Add newly added unfurl args to the docstring of SlackNotifier (#40709)](https://github.com/apache/airflow/pull/40709): @armand-sauzay ## Provider [snowflake: 5.6.1rc1](https://pypi.org/project/apache-airflow-providers-snowflake/5.6.1rc1) - [ ] [openlineage: migrate OpenLineage provider to V2 facets. (#39530)](https://github.com/apache/airflow/pull/39530): @JDarDagran - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla ## Provider [sqlite: 3.8.2rc1](https://pypi.org/project/apache-airflow-providers-sqlite/3.8.2rc1) - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla ## Provider [ssh: 3.12.0rc1](https://pypi.org/project/apache-airflow-providers-ssh/3.12.0rc1) - [ ] [Add on kill to ssh (#40377)](https://github.com/apache/airflow/pull/40377): @MRLab12 Linked issues: - [ ] [Linked Issue #40343](https://github.com/apache/airflow/issues/40343): @potiuk ## Provider [teradata: 2.5.0rc1](https://pypi.org/project/apache-airflow-providers-teradata/2.5.0rc1) - [ ] [Implemented Query Band Support for the Teradata provider (#40716)](https://github.com/apache/airflow/pull/40716): @sc250072 - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla ## Provider [ydb: 1.2.0rc1](https://pypi.org/project/apache-airflow-providers-ydb/1.2.0rc1) - [ ] [ydb provider: add bulk upsert support (#40631)](https://github.com/apache/airflow/pull/40631): @uzhastik - [ ] [Clean up remaining getattr connection DbApiHook (#40665)](https://github.com/apache/airflow/pull/40665): @dabla <!-- NOTE TO RELEASE MANAGER: You can move here the providers that have doc-only changes or for which changes are trivial, and you could assess that they are OK. --> All users involved in the PRs: @MRLab12 @uzhastik @dstandish @kacpermuda @jedcunningham @mr1holmes @gopidesupavan @moiseenkov @Anush008 @dirrao @o-nikolas @vatsrahul1001 @dabla @romsharon98 @e-galan @JDarDagran @ephraimbuddy ### Committer - [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
