Today we include libraries that are needed to run in standalone mode. I like this balance. However, we might have missing libraries such as janino, that is needed for standalone execution.
Regards, Arnab.. On Wed, Jun 16, 2021, 19:50 Mark Dokter <mdok...@know-center.at> wrote: > Hey there! > > When testing the release candidate, Shafaq and I found jars without > which SystemDS crashes under certain conditions. > > * janino*.jar is needed for map() and for codegen. > * spark-core*.jar is needed for -exec hybrid when running locally > (otherwise provided by Spark) > > These problems do not occur when using the source distribution as Maven > pulls everything in that's needed. > > The safe solution is to include everything that Maven pulls into the lib > directory. But taking a look at the size of this directory shows 190 MB. > So aside from any legal redistribution issues (I hope there are none?) > the release artifacts would be blown up by quite a bit. > > Any thoughts? > > Regards, Mark > >