Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/3409#issuecomment-65140498
Oh I think I misread the jira. I thought you were wanting to modify the
classpath but you are really just wanting to specify jvm options that are used
in things like mapred-site.xml for the classpath.
I do think its weird that we are not consistent across the use of
driver.extra* variables though. There are definitely cases where the client AM
doesn't need the same settings as the driver. For instance memory size. The AM
doesn't need to be very large at all but the driver may need to be. ( I have
different jira for that case). Similarly I could see java options being
different between these and really the classpath also. If you are running in
yarn client mode, the driver may have a bunch of other things in its classpath
that don't apply to the application master at all.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
