Github user jerryshao commented on the pull request:
https://github.com/apache/spark/pull/11885#issuecomment-200625978
@vanzin , thanks for your review. I know that putting into `confArchive` is
a more elegant way, but here `confArchive` is only added to AM's classpath. I
read your patch why it only adds to AM's classpath,
> These are only used by the AM, since executors will use the
configuration object broadcast by
the driver. The files are zipped and added to the job as an archive, so
that YARN will explode
it when distributing to the AM. This directory is then added to the
classpath of the AM
process, just to make sure that everybody is using the same default
config.
So I'm not sure if there's any side-affect if we add this `confArchive` to
executor's classpath.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
