Re: SCALA_HOME or SCALA_LIBRARY_PATH not set during build

2014-06-03 Thread Colin McCabe
Cool. Nice to not have to set this any more. best, Colin On Sun, Jun 1, 2014 at 11:21 AM, Patrick Wendell pwend...@gmail.com wrote: I went ahead and created a JIRA for this and back ported the improvement into branch-1.0. This wasn't a regression per-se because the behavior existed in all

Removing spark-debugger.md file from master?

2014-06-03 Thread Henry Saputra
Hi All, Seemed like the spark-debugger.md is no longer accurate (see http://spark.apache.org/docs/latest/spark-debugger.html) and since it was originally written Spark has evolved that makes the doc obsolete. There are already work pending for new replay debugging (I could not find the PR links

Re: Removing spark-debugger.md file from master?

2014-06-03 Thread Ankur Dave
I agree, let's go ahead and remove it. Ankur http://www.ankurdave.com/

Re: Removing spark-debugger.md file from master?

2014-06-03 Thread Henry Saputra
Cool, thanks Ankur, sounds good. PR is coming. - Henry On Tue, Jun 3, 2014 at 11:11 AM, Ankur Dave ankurd...@gmail.com wrote: I agree, let's go ahead and remove it. Ankur http://www.ankurdave.com/

Add my JIRA username (hsaputra) to Spark's contributor's list

2014-06-03 Thread Henry Saputra
Hi, Could someone with right karma kindly add my username (hsaputra) to Spark's contributor list? I was added before but somehow now I can no longer assign ticket to myself nor update tickets I am working on. Thanks, - Henry

Re: Add my JIRA username (hsaputra) to Spark's contributor's list

2014-06-03 Thread Matei Zaharia
Done. Looks like this was lost in the JIRA import. Matei On Jun 3, 2014, at 11:33 AM, Henry Saputra henry.sapu...@gmail.com wrote: Hi, Could someone with right karma kindly add my username (hsaputra) to Spark's contributor list? I was added before but somehow now I can no longer assign

Re: Add my JIRA username (hsaputra) to Spark's contributor's list

2014-06-03 Thread Kan Zhang
Same here please, username (kzhang). Thanks! On Tue, Jun 3, 2014 at 11:39 AM, Henry Saputra henry.sapu...@gmail.com wrote: Thanks Matei! - Henry On Tue, Jun 3, 2014 at 11:36 AM, Matei Zaharia matei.zaha...@gmail.com wrote: Done. Looks like this was lost in the JIRA import. Matei

Re: Add my JIRA username (hsaputra) to Spark's contributor's list

2014-06-03 Thread Nan Zhu
I think I lost that permission too? Patrick once helped to recover the permission, but I lost that permission again? username is CodingCat, or Nan Zhu (I’m not sure which one you use when doing this)? Best, -- Nan Zhu On Tuesday, June 3, 2014 at 2:39 PM, Henry Saputra wrote: Thanks

collectAsMap doesn't return a multiMap?

2014-06-03 Thread Doris Xin
Hey guys, Just wanted to check real quick if collectAsMap was by design not to return a multimap (so multiple values to the same key can overwrite the same entry). It seems like it's only used in some unit tests in the codebase. I added a warning in the comment saying not to expect a multimap.

Re: collectAsMap doesn't return a multiMap?

2014-06-03 Thread Matei Zaharia
Yup, it’s meant to be just a Map. You should probably use collect() and build a multimap instead if you’d like that. Matei On Jun 3, 2014, at 2:08 PM, Doris Xin doris.s@gmail.com wrote: Hey guys, Just wanted to check real quick if collectAsMap was by design not to return a multimap

What is the correct Spark version of master/branch-1.0?

2014-06-03 Thread Takuya UESHIN
Hi all, I'm wondering what is the correct Spark version of each HEAD of master and branch-1.0. current master HEAD (e8d93ee5284cb6a1d4551effe91ee8d233323329): - pom.xml: 1.0.0-SNAPSHOT - SparkBuild.scala: 1.1.0-SNAPSHOT It should be 1.1.0-SNAPSHOT? current branch-1.0 HEAD