[
https://issues.apache.org/jira/browse/AIRFLOW-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jack updated AIRFLOW-3254:
--------------------------
Affects Version/s: (was: 1.10.0)
1.10.1
> BigQueryGetDataOperator to support reading query from SQL file
> --------------------------------------------------------------
>
> Key: AIRFLOW-3254
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3254
> Project: Apache Airflow
> Issue Type: Improvement
> Affects Versions: 1.10.1
> Reporter: jack
> Assignee: Kaxil Naik
> Priority: Minor
> Fix For: 1.10.2
>
>
> As discussed with [~Fokko] on Slack:
> Currently the BigQueryGetDataOperator supports only reading query provided
> directly as:
>
> {code:java}
> sql = 'SELECT ID FROM TABLE'
> {code}
>
> it does not support reading the query from a SQL file which can be annoying
> as sometimes queries are quite large.
> This behavior is supported by other operators like
> MySqlToGoogleCloudStorageOperator:
> dag = DAG(
> dag_id='Import',
> default_args=args,
> schedule_interval='*/5 * * * *',
> max_active_runs=1,
> catchup=False,
> template_searchpath = ['/home/.../airflow/…/sql/Import']
> )
>
> importop = MySqlToGoogleCloudStorageOperator(
> task_id='import',
> mysql_conn_id='MySQL_con',
> google_cloud_storage_conn_id='gcp_con',
> provide_context=True,
> sql = 'importop.sql',
> params=\{'table_name' : TABLE_NAME},
> bucket=GCS_BUCKET_ID,
> filename=file_name_orders,
> dag=dag)
>
> If anyone can pick it up it would be great :)
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
