Github user mridulm commented on the pull request:
https://github.com/apache/spark/pull/514#issuecomment-41363418
Thanks patrick - looks like the tests passed now !
This was just a quick and dirty change based on what I did to unblock our
immediate jobs - so might be suboptimal. Unfortunately, I am slightly swamped -
so cant clean it up.
Please do feel free to use this and make appropriate changes.
Note that we used to propagate all SPARK_* env variables from Client to app
master and so on - which got removed; which caused part of the problem (I
selectively re-added only for these two variables, but it is possible other
variables might be broken too ?).
Additionally, ofcourse, dropping setting of the env variable entirely. I
have not followed up the discussions on why this happened and for what reasons
either ...
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---