Dan Burkert has posted comments on this change.
Change subject: KuduRDD.collect fails because of NoSerializableException
......................................................................
Patch Set 4: Code-Review-1
Hi Kousuke,
I'm not keen on adding io.Serializable to the java client classes due to
compatibility concerns with the Java Serializable API. I looked into this
issue, and it seems our biggest spark users are using Kryo serialization
instead of Java serialization, since it provides much better performance (and
it should be compatible with KuduRDD). Is it an option to use Kryo? Using it
should be as simple as setting the "spark.serializer" option on the SparkConf:
new SparkConf().set("spark.serializer",
"org.apache.spark.serializer.KryoSerializer")
--
To view, visit http://gerrit.cloudera.org:8080/5496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: If0463424481a33c66fd7464345c305062420cfe9
Gerrit-PatchSet: 4
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-Owner: Kousuke Saruta <[email protected]>
Gerrit-Reviewer: Dan Burkert <[email protected]>
Gerrit-Reviewer: Kudu Jenkins
Gerrit-HasComments: No
