How to add user local repository defined in localRepository in settings.xml into Spark SBT build

Hi, I customized MVN_HOME/conf/settings.xml's localRepository tag To manage maven local jars. F:/Java/maven-build/.m2/repository However when I build Spark with SBT, it seems that it still gets the default .m2 repository under Path.userHome + "/.m2/repository" How should I let SBT pick up my c

Re: What is the correct Spark version of master/branch-1.0?

Thank you for your reply. I've sent pull requests. Thanks. 2014-06-05 3:16 GMT+09:00 Patrick Wendell : > It should be 1.1-SNAPSHOT. Feel free to submit a PR to clean up any > inconsistencies. > > On Tue, Jun 3, 2014 at 8:33 PM, Takuya UESHIN wrote: >> Hi all, >> >> I'm wondering what is the c

Re: Announcing Spark 1.0.0

Hey Rahul, The v1.0.0 tag is correct. When we release Spark we create multiple candidates. One of the candidates is promoted to the full release. So rc11 is also the same as the official v1.0.0 release. - Patrick On Wed, Jun 4, 2014 at 8:29 PM, Rahul Singhal wrote: > Could someone please clarif

Re: Announcing Spark 1.0.0

Could someone please clarify my confusion or is this not an issue that we should be concerned about? Thanks, Rahul Singhal On 30/05/14 5:28 PM, "Rahul Singhal" wrote: >Is it intentional/ok that the tag v1.0.0 is behind tag v1.0.0-rc11? > > >Thanks, >Rahul Singhal > > > > > >On 30/05/14 3:43

Re: Add my JIRA username (hsaputra) to Spark's contributor's list

Uh,write my name wrong, right should be Guoqiang Li rather than Guoquiang Li -- Original -- From: "Kan Zhang";; Date: Wed, Jun 4, 2014 03:00 AM To: "dev"; Subject: Re: Add my JIRA username (hsaputra) to Spark's contributor's list Same here please, userna

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

Hey There, The best way is to use the v1.0.0 tag: https://github.com/apache/spark/releases/tag/v1.0.0 - Patrick On Wed, Jun 4, 2014 at 12:19 PM, Debasish Das wrote: > Hi Patrick, > > We maintain internal Spark mirror in sync with Spark github master... > > What's the way to get the 1.0.0 stable

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

Hi Patrick, We maintain internal Spark mirror in sync with Spark github master... What's the way to get the 1.0.0 stable release from github to deploy on our production cluster ? Is there a tag for 1.0.0 that I should use to deploy ? Thanks. Deb On Wed, Jun 4, 2014 at 10:49 AM, Patrick Wendel

Re: What is the correct Spark version of master/branch-1.0?

It should be 1.1-SNAPSHOT. Feel free to submit a PR to clean up any inconsistencies. On Tue, Jun 3, 2014 at 8:33 PM, Takuya UESHIN wrote: > Hi all, > > I'm wondering what is the correct Spark version of each HEAD of master > and branch-1.0. > > current master HEAD (e8d93ee5284cb6a1d4551effe91ee8d

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

Received! On Wed, Jun 4, 2014 at 10:47 AM, Tom Graves wrote: > Testing... Resending as it appears my message didn't go through last week. > > Tom > > > On Wednesday, May 28, 2014 4:12 PM, Tom Graves wrote: > > > > +1. Tested spark on yarn (cluster mode, client mode, pyspark, spark-shell) on > h

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

Testing... Resending as it appears my message didn't go through last week. Tom On Wednesday, May 28, 2014 4:12 PM, Tom Graves wrote: +1. Tested spark on yarn (cluster mode, client mode, pyspark, spark-shell) on hadoop 0.23 and 2.4.  Tom On Wednesday, May 28, 2014 3:07 PM, Sean McNamara

enable Spark on Mesos security delegation token transfer

Hi, Since spark 1.0 has security integretion with YARN, it enabled transfer credetials include delegation token from scheduler to executor side. It is done in startContainerRequest RPC call, a crendetial will be pass to the executor side, so that executor UserGroupInformation will load the crede