test

2014-03-12 Thread Yishu Lin
why can’t I receive the email sent by myself ? … Anybody else can see it? Please let me know. Sorry for the spam ...

Re: sequenceFile and groupByKey

2014-03-10 Thread Yishu Lin
Need this to solve the problem: import org.apache.spark.SparkContext._ Yishu On Mar 10, 2014, at 2:46 PM, Yishu Lin wrote: > I have the same question and tried with 1, but get compilation error: > > [error] …. could not find implicit value for para

Fwd: test

2014-03-10 Thread Yishu Lin
-- Forwarded message -- From: Yishu Lin Date: Mon, Mar 10, 2014 at 2:47 PM Subject: test To: user@spark.apache.org please ignore if you can see it ...

test

2014-03-10 Thread Yishu Lin
please ignore if you can see it …

Re: sequenceFile and groupByKey

2014-03-10 Thread Yishu Lin
I have the same question and tried with 1, but get compilation error: [error] …. could not find implicit value for parameter kcf: () => org.apache.spark.WritableConverter[String] [error] val t2 = sc.sequenceFile[String, Int](“/test/data", 20) Yishu On Mar 9, 2014, at 12:21 AM, Shixiong Zhu

Is there a way to control where RDD partition physically go to?

2014-03-05 Thread Yishu Lin
Let’s say I have a RDD that represents user’s behavior data. I can shard the RDD to several partitions on user id by HashPartitioner. Is there any way that I can control to which machine each partition goes to? Or how does Spark distribute partitions onto each machine? Thanks! Yishu