Github user zhichao-li commented on the pull request:
https://github.com/apache/spark/pull/8915#issuecomment-165699875
@andrewor14 @liancheng , These options like "-S" "-v" still be discarded
since they are all stored within SessionState which would be reconstructed by
HiveContext while creating ClientWrapper.
The logic flow kind of like:
SessionState is stored in a static field.
1)sparkClassLoader(SparkSQLCLIDriver) -> SessionState (containing user
parameters)
2)sparkClassLoader(executationHive) -> reconstruct SessionState
3)MutableURLClassLoader(metaDataHive) -> reconstruct SessionState
Somehow we need to pass the parameters from sparkClassLoader to
MutableURLClassLoader, my approach is to defined a new class which share the
same root loader.
It's kind of hack here, not sure it's worth a try for such tiny issue.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
