Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/9118#issuecomment-149309256
This isn't really a but as it was kind of designed this way. Originally
you had to either set SPARK_LOG4J_CONF (which does SPARK_LOG4J_CONF still work
properly?) or you had to upload it with the --files.
I'm definitely fine with having this happen automatically but we need to
update the documentation at
http://spark.apache.org/docs/latest/running-on-yarn.html. It talks about using
the --files and setting the java options.
I assume --files still works because it will show up on the classpath first
because it looks like it will still upload the one from the conf dir?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
