[
https://issues.apache.org/jira/browse/AIRFLOW-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16791456#comment-16791456
]
ASF GitHub Bot commented on AIRFLOW-3736:
-----------------------------------------
XD-DENG commented on pull request #4906: AIRFLOW-3736: SqoopOperator Numeric
`extra_import_options` value
URL: https://github.com/apache/airflow/pull/4906
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> A numeric import option breaks the Sqoop hook/operator
> ------------------------------------------------------
>
> Key: AIRFLOW-3736
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3736
> Project: Apache Airflow
> Issue Type: Bug
> Components: contrib, hooks, operators
> Reporter: Alireza
> Assignee: kik
> Priority: Major
>
> Adding a numeric value to the _extra_import_options_ parameter, breaks the
> sqoop hook.
>
> {code:java}
> task1 = SqoopOperator(
> task_id='import_tbl',
> cmd_type='import',
> ....
> extra_import_options={'fetch-size':10000},
> dag=dag
> ){code}
>
> The following error is thrown:
> {code:java}
> ERROR - sequence item 18: expected string or Unicode, int found
> Traceback (most recent call last):
> File "/usr/lib/python2.7/site-packages/airflow/models.py", line 1659, in
> _run_raw_task
> result = task_copy.execute(context=context)
> File
> "/usr/lib/python2.7/site-packages/airflow/contrib/operators/sqoop_operator.py",
> line 218, in execute
> extra_import_options=self.extra_import_options)
> File "/usr/lib/python2.7/site-packages/airflow/contrib/hooks/sqoop_hook.py",
> line 232, in import_table
> self.Popen(cmd)
> File "/usr/lib/python2.7/site-packages/airflow/contrib/hooks/sqoop_hook.py",
> line 100, in Popen
> masked_cmd = ' '.join(self.cmd_mask_password(cmd)) {code}
>
>
>
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
