Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/1022#issuecomment-45530991
Note that I had actually filed
https://issues.apache.org/jira/browse/SPARK-1720 to switch all of Spark (not
just spark on yarn) to use LD_LIBRARY_PATH to try to keep it consistent across
Spark if possible.
@pwendell @mateiz do you have any objections to switching to use
LD_LIBRARY_PATH? If any questions about it then we should remove that change
from this PR and just fix yarn-client mode to work with
spark.executor.extraLibraryPath and handle the change under SPARK-1720.
@pwendell @mateiz are you aware of anyone using hadoop 2.x before
2.0.2-alpha? I haven't seen any queries about it but there are 2.0.1-alpha and
2.0.0-alpha.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---