potiuk opened a new issue, #62794: URL: https://github.com/apache/airflow/issues/62794
### Body I have a kind request for all the contributors to the latest provider distributions release. Could you please help us to test the RC versions of the providers? The guidelines on how to test providers can be found in [Verify providers by contributors](https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDERS.md#verify-the-release-candidate-by-contributors) Let us know in the comments, whether the issue is addressed. These are providers that require testing as there were some substantial changes introduced: ## Provider [amazon: 9.22.0rc3](https://pypi.org/project/apache-airflow-providers-amazon/9.22.0rc3) - [ ] [Support custom KMS keys in S3CopyObjectOperator (#60597)](https://github.com/apache/airflow/pull/60597): @dominikhei Linked issues: - [Linked Issue #55708](https://github.com/apache/airflow/issues/55708): @RajasGujarathi - [x] [Add best-effort cleanup to EmrCreateJobFlowOperator on post-creation failure (#61010)](https://github.com/apache/airflow/pull/61010): @SameerMesiah97 Linked issues: - [Linked Issue #60904](https://github.com/apache/airflow/pull/60904): @SameerMesiah97 - [x] [Add best-effort cleanup to EksCreateNodegroupOperator on post-create failure (#61145)](https://github.com/apache/airflow/pull/61145): @SameerMesiah97 - [x] [Add best-effort cleanup to EcsRunTaskOperator on post-start failure (#61051)](https://github.com/apache/airflow/pull/61051): @SameerMesiah97 - [x] [Restrict EC2CreateInstanceOperator cleanup to waiter failures and add guard flag (#61272)](https://github.com/apache/airflow/pull/61272): @SameerMesiah97 Linked issues: - [Linked Issue #60904](https://github.com/apache/airflow/pull/60904): @SameerMesiah97 - [Linked Issue #61145](https://github.com/apache/airflow/pull/61145): @SameerMesiah97 - [Linked Issue #61010](https://github.com/apache/airflow/pull/61010): @SameerMesiah97 - [Linked Issue #61051](https://github.com/apache/airflow/pull/61051): @SameerMesiah97 - [x] [Add cancel_on_kill support for EMR Serverless deferrable operator (#60440)](https://github.com/apache/airflow/pull/60440): @cruseakshay - [ ] [Add delay in `example_emr_eks` after updating execution role (#62415)](https://github.com/apache/airflow/pull/62415): @vincbeck - [x] [AIP-67 - Multi Team: Update AwsLambdaExecutor to support multi team (#61321)](https://github.com/apache/airflow/pull/61321): @henry3260 - [x] [Add SageMaker Unified Studio domain_id, project_id, domain_region as new parameters to SageMakerNotebookOperator (#62147)](https://github.com/apache/airflow/pull/62147): @Shnekit Linked issues: - [Linked Issue #61498](https://github.com/apache/airflow/pull/61498): @ruijiang-rjian - [x] [feat: Add Hook Level Lineage to SQL hooks (#61535)](https://github.com/apache/airflow/pull/61535): @kacpermuda - [ ] [Check teams defined in auth managers exist in DB when spinning up API server (#62527)](https://github.com/apache/airflow/pull/62527): @vincbeck - [ ] [EKS hook: Update auth. API version to v1 and replace non-POSIX 'source' with '.' (#61441)](https://github.com/apache/airflow/pull/61441): @idrisakorede Linked issues: - [Linked Issue #60269](https://github.com/apache/airflow/issues/60269): @andrewhharmon - [x] [add wait_policy in EmrCreateJobFlorOperator (#61195)](https://github.com/apache/airflow/pull/61195): @henry3260 Linked issues: - [Linked Issue #61180](https://github.com/apache/airflow/issues/61180): @karenbraganz - [ ] [Fix `host` in AWS auth manager (#61368)](https://github.com/apache/airflow/pull/61368): @vincbeck - [ ] [Fix variable name in `exemple_emr_eks` (#62480)](https://github.com/apache/airflow/pull/62480): @vincbeck - [x] [fix S3RemoteLogIO using incorrect transfer config (#62423)](https://github.com/apache/airflow/pull/62423): @stephen-bracken - [x] [Fix EKSPodOperator credential refresh errors and improve error handling (#57585) (#58743)](https://github.com/apache/airflow/pull/58743): @aviralgarg05 Linked issues: - [Linked Issue #57585](https://github.com/apache/airflow/issues/57585): @NilsJPWerner - [ ] [Fix ECS Executor compatibility with Airflow 3.x in `try_adopt_task_instances` (#62192)](https://github.com/apache/airflow/pull/62192): @vincbeck Linked issues: - [Linked Issue #58207](https://github.com/apache/airflow/pull/58207): @iamapez - [ ] [fix(amazon): flush file buffer in S3Hook.download_file() before returning path (#62078)](https://github.com/apache/airflow/pull/62078): @pippo995 Linked issues: - [Linked Issue #61157](https://github.com/apache/airflow/pull/61157): @amoghrajesh - [x] [Handle CrawlerRunningException gracefully in GlueCrawlerOperator (#62016)](https://github.com/apache/airflow/pull/62016): @bahram-cdt - [x] [RedshiftCreateClusterOperator could leave clusters running after failure (#61333)](https://github.com/apache/airflow/pull/61333): @SameerMesiah97 - [ ] [Fix EKS operator failures by consolidating API version references into a shared constant (#61891)](https://github.com/apache/airflow/pull/61891): @ferruzzi - [ ] [Remove Connection dependency from shared secrets backend (#61523)](https://github.com/apache/airflow/pull/61523): @amoghrajesh - [ ] [Increase the redshift cluster deletion to 25 minutes in system tests (#62413)](https://github.com/apache/airflow/pull/62413): @vincbeck - [x] [Bump min sqlalchemy version to 1.4.54 (#62299)](https://github.com/apache/airflow/pull/62299): @potiuk - [ ] [Update trigger rule in `example_emr_eks.py` (#62228)](https://github.com/apache/airflow/pull/62228): @vincbeck - [ ] [Fix EKS system test xcom issue and standardize naming between tests (#61893)](https://github.com/apache/airflow/pull/61893): @ferruzzi - [ ] [Add warning about AWS auth manager being in alpha stage in identity-c… (#61745)](https://github.com/apache/airflow/pull/61745): @imrichardwu - [ ] [fix(amazon): Filter kwargs in AthenaSQLHook to prevent TypeError (#62227)](https://github.com/apache/airflow/pull/62227): @shivaam Linked issues: - [Linked Issue #55678](https://github.com/apache/airflow/issues/55678): @FrancisLfg ## Provider [celery: 3.17.0rc2](https://pypi.org/project/apache-airflow-providers-celery/3.17.0rc2) - [ ] [Celery: explicitly specify `psycopg2` in driverless postgres URLs (#62159)](https://github.com/apache/airflow/pull/62159): @Dev-iL Linked issues: - [Linked Issue #61229](https://github.com/apache/airflow/pull/61229): @Dev-iL - [ ] [Executor Synchronous callback workload (#61153)](https://github.com/apache/airflow/pull/61153): @ferruzzi - [ ] [Enable multi-team in Celery executor (#62534)](https://github.com/apache/airflow/pull/62534): @vincbeck - [ ] [docs(celery): fix wrong link in cli (#62460)](https://github.com/apache/airflow/pull/62460): @Lee-W - [ ] [Fix Celery worker crash on macOS due to unpicklable local function (#62655)](https://github.com/apache/airflow/pull/62655): @Vamsi-klu Linked issues: - [Linked Issue #62512](https://github.com/apache/airflow/issues/62512): @bluczko - [ ] [Insert a team_name similar to team conf for 2.X compat (#61923)](https://github.com/apache/airflow/pull/61923): @o-nikolas Linked issues: - [Linked Issue #61913](https://github.com/apache/airflow/issues/61913): @potiuk ## Provider [edge3: 3.1.0rc2](https://pypi.org/project/apache-airflow-providers-edge3/3.1.0rc2) - [ ] [Introduce EdgeDBManager: Independent Provider Specific Database Schema Management (#61155)](https://github.com/apache/airflow/pull/61155): @dheerajturaga Linked issues: - [Linked Issue #60752](https://github.com/apache/airflow/pull/60752): @dheerajturaga - [x] [Add Filtering to Edge UI Plugin Jobs Page (#61934)](https://github.com/apache/airflow/pull/61934): @Eason09053360 Linked issues: - [Linked Issue #61920](https://github.com/apache/airflow/issues/61920): @jscheffl - [ ] [Route providers to consume Stats from common compat provider (#61812)](https://github.com/apache/airflow/pull/61812): @amoghrajesh - [ ] [Fix Toaster in Plugin in Edge UI (#55641)](https://github.com/apache/airflow/pull/55641): @jscheffl - [ ] [Executor Synchronous callback workload (#61153)](https://github.com/apache/airflow/pull/61153): @ferruzzi - [ ] [Fix edge3 executor startup crash on Airflow < 3.2 (#62593)](https://github.com/apache/airflow/pull/62593): @dheerajturaga - [ ] [Bump minimum prek version to 0.3.2 in edge3 provider (#62194)](https://github.com/apache/airflow/pull/62194): @dheerajturaga - [ ] [Auto-discover DB managers from provider.yaml (#62308)](https://github.com/apache/airflow/pull/62308): @dheerajturaga - [x] [Upgrade dependency to minimatch (#62303)](https://github.com/apache/airflow/pull/62303): @jscheffl - [ ] [Warn when EdgeDBManager is missing from external_db_managers in config (#62204)](https://github.com/apache/airflow/pull/62204): @dheerajturaga - [ ] [Replace Base.metadata.remove() hack with dedicated Edge3 declarative base (#62202)](https://github.com/apache/airflow/pull/62202): @dheerajturaga Linked issues: - [Linked Issue #61155](https://github.com/apache/airflow/pull/61155): @dheerajturaga - [x] [Enable dynamic generation of assets for Edge UI Plugin (#56456)](https://github.com/apache/airflow/pull/56456): @jscheffl - [ ] [Dependabot: Upgrade vulnerable rolloup (#62535)](https://github.com/apache/airflow/pull/62535): @jscheffl - [ ] [docs: Add external_db_managers configuration requirement (#62203)](https://github.com/apache/airflow/pull/62203): @dheerajturaga - [ ] [docs: edge3 db-manager is auto loaded by provider manager (#62550)](https://github.com/apache/airflow/pull/62550): @dheerajturaga ## Provider [elasticsearch: 6.5.0rc3](https://pypi.org/project/apache-airflow-providers-elasticsearch/6.5.0rc3) - [x] [feat: Add Hook Level Lineage to SQL hooks (#61535)](https://github.com/apache/airflow/pull/61535): @kacpermuda - [ ] [Fix the write-to-es feature (#53821)](https://github.com/apache/airflow/pull/53821): @Owen-CH-Leung Linked issues: - [Linked Issue #51456](https://github.com/apache/airflow/issues/51456): @kmaksimovv - [Linked Issue #62121](https://github.com/apache/airflow/pull/62121): @Owen-CH-Leung - [Linked Issue #50349](https://github.com/apache/airflow/issues/50349): @peter-cheon - [ ] [add max_lines_per_page setting to ElasticsearchTaskHandler (#61492)](https://github.com/apache/airflow/pull/61492): @stephen-bracken - [ ] [Fix max_lines_per_page config setting for ElasticsearchRemoteLogIO (#62562)](https://github.com/apache/airflow/pull/62562): @stephen-bracken Linked issues: - [Linked Issue #53821](https://github.com/apache/airflow/pull/53821): @Owen-CH-Leung <!-- NOTE TO RELEASE MANAGER: You can move here the providers that have doc-only changes or for which changes are trivial, and you could assess that they are OK. --> All users involved in the PRs: @Lee-W @pippo995 @Eason09053360 @aviralgarg05 @jscheffl @idrisakorede @dominikhei @vincbeck @shivaam @dheerajturaga @SameerMesiah97 @imrichardwu @kacpermuda @stephen-bracken @henry3260 @Dev-iL @Vamsi-klu @cruseakshay @bahram-cdt @ferruzzi @o-nikolas @Owen-CH-Leung @amoghrajesh @Shnekit @poti ### Committer - [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
