wQ6AEwB2oVChMIn_iujpCGxgIVDZmICh3kYADW#v=onepage&q=spark%20shell%20register%20kryo%20serialization&f=false
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/How-to-set-Kryo
message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/How-to-set-KryoRegistrator-class-in-spark-shell-tp12498p23265.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> -
n_iujpCGxgIVDZmICh3kYADW#v=onepage&q=spark%20shell%20register%20kryo%20serialization&f=false
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-set-KryoRegistrator-class-in-spark-shell-tp12498p23265.html
Sent from the Apache Spark
t;
> --------------
> Date: Wed, 20 Aug 2014 12:25:14 -0700
> Subject: How to set KryoRegistrator class in spark-shell
> From: bewang.t...@gmail.com
> To: user@spark.apache.org
>
>
> I want to use opencsv's CSVParser to parse csv lines using a script like
>
commandline.
Date: Wed, 20 Aug 2014 12:25:14 -0700
Subject: How to set KryoRegistrator class in spark-shell
From: bewang.t...@gmail.com
To: user@spark.apache.org
I want to use opencsv's CSVParser to parse csv lines using a script like below
in spark-shell:
import au.com.bytecode.opencsv.CSVP
I want to use opencsv's CSVParser to parse csv lines using a script like
below in spark-shell:
import au.com.bytecode.opencsv.CSVParser;
import com.esotericsoftware.kryo.Kryo
import org.apache.spark.serializer.KryoRegistrator
import org.apache.hadoop.fs.{Path, FileSystem}
class MyKryoRegistrator