Ryan Yuan created AIRFLOW-3318:
----------------------------------

             Summary: Add a function to BigQueryHook to check the existence of 
a dataset.
                 Key: AIRFLOW-3318
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3318
             Project: Apache Airflow
          Issue Type: New Feature
          Components: contrib, gcp, hooks
    Affects Versions: 1.10.0
            Reporter: Ryan Yuan
            Assignee: Ryan Yuan


To check the existence of a dataset in BigQuery, existing BigQueryHook only 
supports either 1) using get_datasets_list() to get all the datasets and then 
searching the target dataset from the list; or 2) using get_dataset().

However, with get_dataset(), it raises AirflowException whenever an HttpError 
received. So it has no capabilities to determine if the dataset exists or not.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to