[
https://issues.apache.org/jira/browse/AIRFLOW-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009259#comment-16009259
]
ASF subversion and git services commented on AIRFLOW-1184:
----------------------------------------------------------
Commit b113432e7253811f55b373ab73c98079c724ead9 in incubator-airflow's branch
refs/heads/master from [~vfoucault]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=b113432 ]
[AIRFLOW-1184] SparkSubmitHook does not split args
> Contrib Spark Submit Hook does not split argument and argument value
> --------------------------------------------------------------------
>
> Key: AIRFLOW-1184
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1184
> Project: Apache Airflow
> Issue Type: Bug
> Components: contrib, hooks
> Affects Versions: Airflow 2.0, Airflow 1.8
> Reporter: Vianney FOUCAULT
> Assignee: Vianney FOUCAULT
> Fix For: Airflow 2.0, Airflow 1.8
>
>
> Python Popen expect a list as command. Spark submit too, as:
> * ['--option value']
> is not the same as
> * ['--option', 'value']
> in regards of spark. eg spark logs : (yarn logs)
> Error: Unknown option --end 2017-05-08
> Error: Unknown option --begin 2017-05-07
> Error: Unknown option --db_name mydb
> Error: Missing option --begin
> Error: Missing option --end
> Error: Missing option --db_name
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
