On Thu, Jun 22, 2017 at 10:50 AM, Sean Busbey <[email protected]> wrote: > I'm not sure on the jar-with-deps bit. It's super nice to just include > one known-deployed jar in your spark classpath instead of putting that > size into each application jar your run. Of course, to your point on > classpaths, right now they'd need to grab things besides that jar. > Maybe these should be shaded jars sooner rather than later?
Correcting myself here, Spark already has a mechanism to refer to a dependency that's in maven, so presuming that does caching maybe versions in the assembly aren't necessary after all?
