[
https://issues.apache.org/jira/browse/AIRFLOW-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arthur Wiedmer resolved AIRFLOW-2380.
-------------------------------------
Resolution: Fixed
Fix Version/s: 1.10.0
Issue resolved by pull request #3268
[https://github.com/apache/incubator-airflow/pull/3268]
> Add support for environment variables in Spark submit operator
> --------------------------------------------------------------
>
> Key: AIRFLOW-2380
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2380
> Project: Apache Airflow
> Issue Type: Improvement
> Components: contrib, operators
> Reporter: Cristòfol Torrens
> Assignee: Cristòfol Torrens
> Priority: Minor
> Fix For: 1.10.0
>
>
> Add support for environment variables in Spark submit operator.
> For example, to pass the *HADOOP_CONF_DIR* in case of use same Spark cluster
> with multiple HDFS.
> The idea is to pass as a dict, and resolve it in the case of using
> *yarn-*_client/cluster_*,* and *standalone-*_client_ mode.
> In *standalone-*_cluster_ mode is not possible to do this.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
