Alberto Calderari created AIRFLOW-1688:
------------------------------------------

             Summary: Automatically add load.time_partitioning to bigquery_hook 
when table name includes $
                 Key: AIRFLOW-1688
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1688
             Project: Apache Airflow
          Issue Type: Improvement
          Components: gcp, hooks
    Affects Versions: Airflow 1.8
            Reporter: Alberto Calderari
            Assignee: Alberto Calderari
            Priority: Minor
             Fix For: Airflow 2.0


The gcs_to_bq operator throws and exception when trying to auto-create a new 
date partitioned table. 
To allow the table creation the load configuration needs the api option:

 load.timePartitioning: {type: 'DAY'}

I will add a fix to identify date partitioned table from the presence of a $ in 
the table name and add the option.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to