Moira Tagle created AIRFLOW-6855:
------------------------------------
Summary: GCS to BQ load will fail with syntax error if specified
project has a - in it
Key: AIRFLOW-6855
URL: https://issues.apache.org/jira/browse/AIRFLOW-6855
Project: Apache Airflow
Issue Type: Bug
Components: gcp
Affects Versions: 1.10.9
Reporter: Moira Tagle
Assignee: Moira Tagle
If you try to run a GCS -> BQ load that explicitly specifies a destination
project that contains a -, the sql that runs to emit the final log message:
SELECT MAX(\{id}) FROM \{project_dataset_table}
will fail because the - in the project is not escaped in the SQL.
datasets and tables cannot have - in them, and if you are implicitly getting
the project from the configured connection it will not explicitly be in the
SQL, so this is only a problem if the project is explicitly specified and it
has a - in it.
To fix this, the project_dataset_table should be escaped in the SQL query.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
