Ryan Yuan created AIRFLOW-3318:
----------------------------------
Summary: Add a function to BigQueryHook to check the existence of
a dataset.
Key: AIRFLOW-3318
URL: https://issues.apache.org/jira/browse/AIRFLOW-3318
Project: Apache Airflow
Issue Type: New Feature
Components: contrib, gcp, hooks
Affects Versions: 1.10.0
Reporter: Ryan Yuan
Assignee: Ryan Yuan
To check the existence of a dataset in BigQuery, existing BigQueryHook only
supports either 1) using get_datasets_list() to get all the datasets and then
searching the target dataset from the list; or 2) using get_dataset().
However, with get_dataset(), it raises AirflowException whenever an HttpError
received. So it has no capabilities to determine if the dataset exists or not.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)