Github user liancheng commented on the pull request:
https://github.com/apache/spark/pull/2145#issuecomment-53536988
@tnachen Thanks a lot! I'm currently working on another version that can
figure out executor side classpath correctly. The basic idea is:
1. we still start the executor with `spark-class`, and
1. we pass `extraJavaOpts` and `extraLibraryPath` via
`SPARK_EXECUTOR_OPTS`, which is recognized by `spark-class` and not used
anywhere else.
You may find the WIP version
[here](https://github.com/liancheng/spark/compare/apache:branch-1.1...liancheng:mesos-fix-with-env-var?expand=1#diff-d425d35aa23c47a62fbb538554f2f2cfR123).
Discussed with @pwendell about this solution tonight, and it seems workable.
And it's also much simpler. For now, the only issue is that it cannot handle
quoted string with spaces correctly (i.e. `-Dfoo="bar bar"`). It might be buggy
in other ways though, still testing it.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
