Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/6360#issuecomment-109084895
> Another thing I was wondering is: was there a particular reason behind
the change to how Spark properties are distributed (command line java opts ->
--properties-file)?
Mainly because if you do it in the command line YARN will replace any env
variable references in the values, which in this case we do not want (because
we want the expansion to occur on the node where executors will be launched, no
where the AM is run).
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
