Lee moon soo created ZEPPELIN-339: ------------------------------------- Summary: --packages argument for spark-submit command does not apply in pyspark Key: ZEPPELIN-339 URL: https://issues.apache.org/jira/browse/ZEPPELIN-339 Project: Zeppelin Issue Type: Bug Reporter: Lee moon soo
When {{SPARK_HOME}} is exported in zeppelin-env.sh, {{--packages}} can be used to load additional libraries for the job, like {code} export SPARK_HOME=.... export SPARK_SUBMIT_OPTIONS="--packages org.apache.spark:spark-streaming-kafka_2.10:1.5.1" {code} The library loaded in this way is available in spark, but not available in pyspark. -- This message was sent by Atlassian JIRA (v6.3.4#6332)