Hi,
My program cannot use Kyro Serializer after I update to Spark 0.8,
here is the error information
Exception in thread "main" java.lang.InstantiationException:
org.apache.spark.serializer.KryoRegistrator
at java.lang.Class.newInstance(Class.java:359)
at org.apache.spark.serializer.SerializerManager.get(SerializerManager.scala:55)
at
org.apache.spark.serializer.SerializerManager.setDefault(SerializerManager.scala:36)
at org.apache.spark.SparkEnv$.createFromSystemProperties(SparkEnv.scala:157)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:105)
at ibm.decaystream.test.LazyDecayTest$.main(LazyDecayTest.scala:35)
at ibm.decaystream.test.LazyDecayTest.main(LazyDecayTest.scala)
Here is how I set up Serializer:
System.setProperty("spark.serializer",
"org.apache.spark.serializer.KryoRegistrator")
System.setProperty("spark.kryo.registrator",
classOf[EdgeWithIDRegistrator].getName)
And the exception was thrown out when I try to create the SparkContext.
Is there any suggestions?
Thank you!
Best,
Wenlei
