Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22084
To maybe summarize: what this isn't doing is actually making these external
modules available on the classpath for standalone mode. That would be a
reasonable goal, as it would make standalone mode work more like vendor distros
happen to work, but it's a behavior change, and Matei pointed out that this
also means adding a lot of transitive dependencies to the classpath.
If we're not doing that, there's not much point in doing anything. Just
shipping these external modules' JARs doesn't help standalone mode, and many
people would use them by including them in an app (like they do now).
Except that, well, it's still odd that there is no binary distribution of
the external modules at all in the binary distribution. So my suggestion here
was to at least ship the bits for whatever it may be worth. I also think it's
reasonable to say there's no point in that.
Therefore I'd suggest the change to make here is either this change or none
at all.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
