[
https://issues.apache.org/jira/browse/AIRFLOW-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Yuan updated AIRFLOW-3948:
-------------------------------
Description:
Fixing issue with operators' list as templated field issue
For example, with GoogleCloudStorageToBigQueryOperator's templated fields,
`source_objects` and `schema_fields`, if parsed in values are lists, they will
be recognized as strings, causing error returned by GCS.
e.g.
Variable before templating, source_objects = ['file_1.csv', 'file_2.csv']
Variable after templating, source_objects = "['file_1.csv', 'file_2.csv']"
was:
With GoogleCloudStorageToBigQueryOperator's templating fields, `source_objects`
and `schema_fields`, if parsed in values are lists, they will be recognized as
strings, causing error returned by GCS.
e.g.
Variable before templating, source_objects = ['file_1.csv', 'file_2.csv']
Variable after templating, source_objects = "['file_1.csv', 'file_2.csv']"
Summary: Operator list as templated field issue (was: GCSToBQOperator
list as templating field issue)
> Operator list as templated field issue
> --------------------------------------
>
> Key: AIRFLOW-3948
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3948
> Project: Apache Airflow
> Issue Type: Improvement
> Reporter: Ryan Yuan
> Assignee: Ryan Yuan
> Priority: Major
>
> Fixing issue with operators' list as templated field issue
>
> For example, with GoogleCloudStorageToBigQueryOperator's templated fields,
> `source_objects` and `schema_fields`, if parsed in values are lists, they
> will be recognized as strings, causing error returned by GCS.
> e.g.
> Variable before templating, source_objects = ['file_1.csv', 'file_2.csv']
> Variable after templating, source_objects = "['file_1.csv', 'file_2.csv']"
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
