Re: FW: SequenceFile and object reuse

2015-11-18 Thread Jeff Zhang
Would this be an issue on the raw data ? I use the following simple code, and don't hit the issue you mentioned. Or it would be better to share your code. val rdd =sc.sequenceFile("/Users/hadoop/Temp/Seq", classOf[IntWritable], classOf[Text]) rdd.map{case (k,v) => (k.get(), v.toString)}.collect()

FW: SequenceFile and object reuse

2015-11-18 Thread jeff saremi
I sent this to the user forum. I got no responses. Could someone here please help? thanks jeff From: jeffsar...@hotmail.com To: u...@spark.apache.org Subject: SequenceFile and object reuse Date: Fri, 13 Nov 2015 13:29:58 -0500 So we tried reading a sequencefile in Spark and realized that all