[ https://issues.apache.org/jira/browse/AIRFLOW-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083694#comment-16083694 ]
ASF subversion and git services commented on AIRFLOW-1326: ---------------------------------------------------------- Commit f5ffb9deb51e896cdda8992c8b28102f7d650662 in incubator-airflow's branch refs/heads/master from [~ashb] [ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=f5ffb9d ] [AIRFLOW-1326][[AIRFLOW-1326][AIRFLOW-1184] Don't split argument array -- it's already an array.[ Closes #2382 from ashb/spark-submit-operator- preserve-spaces > Contrib Spark Submit Hook should be able to produce arguments containing > spaces. > -------------------------------------------------------------------------------- > > Key: AIRFLOW-1326 > URL: https://issues.apache.org/jira/browse/AIRFLOW-1326 > Project: Apache Airflow > Issue Type: Bug > Components: contrib, hooks > Affects Versions: Airflow 2.0, Airflow 1.8 > Reporter: Ash Berlin-Taylor > Assignee: Vianney FOUCAULT > Fix For: Airflow 2.0, Airflow 1.8 > > > AIRFLOW-1184 introduced a bug making it impossible to include an argument > with an embedded space in the SparkSubmitOperator. (I believe the original > bug report should have been closed as wontfix/not-a-bug as it was user error > in how the SparkSubmitOperator is being called) > i.e. the correct way to achieve what was wanted in the bug is like this: > {code} > 'application_args': [ > '-f', ' foo', > '--bar', 'bar', > '--start', '{{ macros.ds_add(ds, -1)}}', > '--end', '{{ ds }}' > ] > {code} > This was possibly compounded as the tests were showing something that would > never "work" -- This message was sent by Atlassian JIRA (v6.4.14#64029)