[
https://issues.apache.org/jira/browse/AIRFLOW-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089592#comment-17089592
]
ASF subversion and git services commented on AIRFLOW-5517:
----------------------------------------------------------
Commit c9c475f124504387d16c364deed78867935f7643 in airflow's branch
refs/heads/v1-10-test from r-richmond
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=c9c475f ]
[AIRFLOW-5517] Remove default value spark_binary (#8508)
Backport of https://github.com/apache/airflow/pull/6680
> SparkSubmitOperator: spark-binary parameter no longer taken from connection
> extra
> ---------------------------------------------------------------------------------
>
> Key: AIRFLOW-5517
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5517
> Project: Apache Airflow
> Issue Type: Bug
> Components: contrib
> Affects Versions: 1.10.4, 1.10.5
> Reporter: Alexander Kazarin
> Priority: Major
> Fix For: 1.10.11
>
>
> We have an extra parameters in spark connection:
> {code:java}
> {"deploy-mode": "cluster", "spark-binary": "spark2-submit"}
> {code}
> After upgrade to 1.10.5 from 1.10.3 parameter 'spark-binary' in extra is no
> longer take effect.
> Broken after
> [this|https://github.com/apache/airflow/commit/8be59fb4edf0f2a132b13d0ffd1df0b8908191ab]
> commit, I think
> Workaround: call SparkSubmitOperator with spark_binary=None argument
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
