Alexander Kazarin created AIRFLOW-5517:

             Summary: SparkSubmitHook: spark-binary parameter no longer taken 
from extra
                 Key: AIRFLOW-5517
             Project: Apache Airflow
          Issue Type: Bug
          Components: contrib
    Affects Versions: 1.10.5, 1.10.4
            Reporter: Alexander Kazarin

We have an extra parameters in spark connection:
{"deploy-mode": "cluster", "spark-binary": "spark2-submit"}
After upgrade to 1.10.5 from 1.10.3 parameter 'spark-binary' in extra is no 
longer take effect.
 Broken after 
 commit, I think

Workaround: call SparkSubmitHook with spark_binary=None argument

This message was sent by Atlassian Jira

Reply via email to