Hello, I have a library I want to embed in Zeppelin.
I am using a build from Git yesterday, and Spark 1.6. Here is my conf/zeppelin-env.sh: export JAVA_HOME=/usr/lib/jvm/java-7-oracle export MASTER=yarn-client export HADOOP_CONF_DIR=/etc/hadoop/conf export ZEPPELIN_PORT=10080 export SPARK_HOME=/opt/spark export ZEPPELIN_JAVA_OPTS="-Dhdp.version=current -Dspark.jars=/home/zeppelin/jars/mylib.jar" Here is my /opt/spark/conf/spark-defaults.conf: spark.master yarn-client spark.dynamicAllocation.enabled true spark.shuffle.service.enabled true spark.driver.extraJavaOptions -Dhdp.version=current spark.yarn.am.extraJavaOptions -Dhdp.version=current Now, I try to run Zeppelin normally. When I then try to import something from my lib: import com.example._ I get: <console>:27: error: not found: value com I also tried with "--conf jars=..." and "--jars", to no avail - Zeppelin then won't start because of an "unrecognized option". When I do a "ps ax |grep java", the command line option seems to be passed correctly: 481 ? Sl 0:07 /usr/lib/jvm/java-7-oracle/bin/java -Dhdp.version=current -Dspark.jars=/home/zeppelin/jars/mylib.jar -Dfile.encoding=UTF-8 -Xms1024m -Xmx1024m -XX:MaxPermSize=512m -Dzeppelin.log.file=/home/zeppelin/incubator-zeppelin/logs/zeppelin--hadoop-frontend.log -cp ::/home/zeppelin/incubator-zeppelin/zeppelin-server/target/lib/*:/home/zeppelin/incubator-zeppelin/zeppelin-zengine/target/lib/*:/home/zeppelin/incubator-zeppelin/zeppelin-interpreter/target/lib/*:/home/zeppelin/incubator-zeppelin/lib/*:/home/zeppelin/incubator-zeppelin/*::/home/zeppelin/incubator-zeppelin/conf:/home/zeppelin/incubator-zeppelin/zeppelin-interpreter/target/classes:/home/zeppelin/incubator-zeppelin/zeppelin-zengine/target/classes:/home/zeppelin/incubator-zeppelin/zeppelin-server/target/classes org.apache.zeppelin.server.ZeppelinServer Even when I upload the mylib.jar to HDFS and use "sc.addJar", I cannot use it. What am I missing?