I would like to use Spark with Kryo serialization.

From the command line spark-shell I would add:
--conf spark.serializer=org.apache.spark.serializer.KryoSerializer \
--conf spark.kryo.registrator=com.uebercomputing.mailrecord.MailRecordRegistrator \

Or I can add those to conf/spark-defaults.conf:
spark.serializer=org.apache.spark.serializer.KryoSerializer
spark.kryo.registrator=com.uebercomputing.mailrecord.MailRecordRegistrator

How can I set these properties for the Zeppelin-provided spark context?

Thanks for your help,
Markus

Reply via email to