Hi everyone,

I'm using Zeppelin 0.6.1 with Spark 2.0.0 on Yarn (with master configured
as yarn-client). I have couple of jars stored locally which I'd like to use
in Spark interpreter. I've put these jars in `spark-defaults.conf` under
`spark.jars` (as described in https://zeppelin.apache.org/do
cs/0.6.1/interpreter/spark.html#2-loading-spark-properties).

Despite this these jars seem to be unavailable in Zeppelin's Spark
interpreter - when importing any classes from them I'm getting: "error:
object SOMEOBJECT is not a member of package SOMEPACKAGE"

I checked `spark.conf.getAll` (via the interpreter), and there's something
interesting: all my jars are listed under `spark.yarn.secondary.jars` and
`spark.yarn.dist.jars`. So it looks like they're available on the cluster,
but unavailable in the driver program.

Does anyone have any idea what's going on here? Have I missed some config
options?


Regards,
Arkadiusz

Reply via email to