CYarros10 opened a new pull request, #45001: URL: https://github.com/apache/airflow/pull/45001
MetastoreHivePartitionSensor is not working. The query it uses to list partitions (https://github.com/apache/airflow/blob/83da311e4ce5a7965b2e1c412941a8f26ad8225e/providers/src/airflow/providers/google/cloud/hooks/dataproc_metastore.py#L648): ``` query = f""" SELECT * FROM PARTITIONS INNER JOIN TBLS ON PARTITIONS.TBL_ID = TBLS.TBL_ID WHERE TBLS.TBL_NAME = '{table}'""" ``` fails, due to Duplicate Aliases (https://cloud.google.com/spanner/docs/reference/standard-sql/query-syntax#duplicate_aliases) This query fixes the issue: ``` query = f""" SELECT PARTITIONS.*, TBLS.TBL_TYPE, TBLS.TBL_NAME FROM PARTITIONS INNER JOIN TBLS ON PARTITIONS.TBL_ID = TBLS.TBL_ID WHERE TBLS.TBL_NAME = '{table}'""" ``` <!-- Please keep an empty line above the dashes. --> --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#pull-request-guidelines)** for more information. In case of fundamental code changes, an Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvement+Proposals)) is needed. In case of a new dependency, check compliance with the [ASF 3rd Party License Policy](https://www.apache.org/legal/resolved.html#category-x). In case of backwards incompatible changes please leave a note in a newsfragment file, named `{pr_number}.significant.rst` or `{issue_number}.significant.rst`, in [newsfragments](https://github.com/apache/airflow/tree/main/newsfragments). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
