Re: Using Spark with Kryo - how to set Spark configuration?

[M. Dale]

Anthony,
  That did the trick! Thank you so much for your quick reply.
It seems that conf/interpreter.json got changed and now saves my new 
interpreter. When I move to the next version of Zeppelin, is that what I 
need to copy to keep that interpreter as an option?

Thanks again for your help,
Markus

On 02/19/2015 10:46 AM, Anthony Corbacho wrote:

hello Markus,

in Zeppelin you can configure those option through the interpreters.

basically, you will have to create a new interpreter and set the 
serialization options (you will see that you can add custom options to 
spark interpreter) and then activate this interpreter in your notebook.

hope it help.

On Feb 20, 2015 12:41 AM, "M. Dale" <medal...@yahoo.com 
<mailto:medal...@yahoo.com>> wrote:

    I would like to use Spark with Kryo serialization.

    From the command line spark-shell I would add:
    --conf spark.serializer=org.apache.spark.serializer.KryoSerializer \
    --conf
    spark.kryo.registrator=com.uebercomputing.mailrecord.MailRecordRegistrator
    \

    Or I can add those to conf/spark-defaults.conf:
    spark.serializer=org.apache.spark.serializer.KryoSerializer
    spark.kryo.registrator=com.uebercomputing.mailrecord.MailRecordRegistrator

    How can I set these properties for the Zeppelin-provided spark
    context?

    Thanks for your help,
    Markus