Re: spark.kryo.classesToRegister

code: >> >> >> >> rdd.persist(StorageLevel.MEMORY_ONLY_SER()) >> >> conf.set("spark.serializer","org.apache.spark.serializer.KryoSerializer"); >> >> >> >> Do I compulsorily need to do anything via : spark.kryo.classesToRegister? >> >> Or the above code sufficient to achieve performance gain using Kryo >> serialization? >> >> >> >> Thanks >> >> Amit >> >

Re: spark.kryo.classesToRegister

lizer","org.apache.spark.serializer.KryoSerializer"); Do I compulsorily need to do anything via : spark.kryo.classesToRegister? Or the above code sufficient to achieve performance gain using Kryo serialization? Thanks Amit

Re: spark.kryo.classesToRegister

wrote: > This is what I have added in my code: > > > > rdd.persist(StorageLevel.MEMORY_ONLY_SER()) > > conf.set("spark.serializer","org.apache.spark.serializer.KryoSerializer"); > > > > Do I compulsorily need to do anything via : spark.kryo.cla

spark.kryo.classesToRegister

This is what I have added in my code: rdd.persist(StorageLevel.MEMORY_ONLY_SER()) conf.set("spark.serializer","org.apache.spark.serializer.KryoSerializer"); Do I compulsorily need to do anything via : spark.kryo.classesToRegister? Or the above code sufficient to achi