Re: Master build fails ?

2015-11-06 Thread Steve Loughran
> On 6 Nov 2015, at 17:35, Marcelo Vanzin wrote: > > On Fri, Nov 6, 2015 at 2:21 AM, Steve Loughran wrote: >> Maven's closest-first policy has a different flaw, namely that its not >> always obvious why a guava 14.0 that is two hops of transitiveness should >> take priority over a 16.0 versio

Re: Master build fails ?

2015-11-06 Thread Marcelo Vanzin
On Fri, Nov 6, 2015 at 2:21 AM, Steve Loughran wrote: > Maven's closest-first policy has a different flaw, namely that its not always > obvious why a guava 14.0 that is two hops of transitiveness should take > priority over a 16.0 version three hops away. Especially when that 0.14 > version sho

Re: Master build fails ?

2015-11-06 Thread Ted Yu
Since maven is the preferred build vehicle, ivy style dependencies policy would produce surprising results compared to today's behavior. I would suggest staying with current dependencies policy. My two cents. On Fri, Nov 6, 2015 at 6:25 AM, Koert Kuipers wrote: > if there is no strong preferen

Re: Master build fails ?

2015-11-06 Thread Koert Kuipers
if there is no strong preference for one dependencies policy over another, but consistency between the 2 systems is desired, then i believe maven can be made to behave like ivy pretty easily with a setting in the pom On Fri, Nov 6, 2015 at 5:21 AM, Steve Loughran wrote: > > > On 5 Nov 2015, at 2

Re: Master build fails ?

2015-11-06 Thread Steve Loughran
> On 5 Nov 2015, at 20:07, Marcelo Vanzin wrote: > > Man that command is slow. Anyway, it seems guava 16 is being brought > transitively by curator 2.6.0 which should have been overridden by the > explicit dependency on curator 2.4.0, but apparently, as Steve > mentioned, sbt/ivy decided to brea

Re: Master build fails ?

2015-11-05 Thread Marcelo Vanzin
;>>> One other thing, i was able to build fine with the above command up until >>>>> recently. I think i have stared >>>>> to have problem after SPARK-11073 where the HashCodes import was added. >>>>> >>>>> Regards, >>>>

Re: Master build fails ?

2015-11-05 Thread Marcelo Vanzin
thing, i was able to build fine with the above command up until >>>> recently. I think i have stared >>>> to have problem after SPARK-11073 where the HashCodes import was added. >>>> >>>> Regards, >>>> Dilip Biswal >>>> Tel: 408-

Re: Master build fails ?

2015-11-05 Thread Marcelo Vanzin
> >>> Regards, >>> Dilip Biswal >>> Tel: 408-463-4980 >>> dbis...@us.ibm.com >>> >>> >>> >>> From:Ted Yu >>> To:Dilip Biswal/Oakland/IBM@IBMUS >>> Cc:Jean-Baptiste Onofré , "

Re: Master build fails ?

2015-11-05 Thread Marcelo Vanzin
hCodes import was added. >> >> Regards, >> Dilip Biswal >> Tel: 408-463-4980 >> dbis...@us.ibm.com >> >> >> >> From:Ted Yu >> To:Dilip Biswal/Oakland/IBM@IBMUS >> Cc:Jean-Baptiste Onofré , "dev@spar

Re: Master build fails ?

2015-11-05 Thread Ted Yu
lip Biswal > Tel: 408-463-4980 > dbis...@us.ibm.com > > > > From:Ted Yu > To:Dilip Biswal/Oakland/IBM@IBMUS > Cc:Jean-Baptiste Onofré , "dev@spark.apache.org" > > Date:11/05/2015 10:46 AM > Subject:Re: Master build fail

Re: Master build fails ?

2015-11-05 Thread Dilip Biswal
Date: 11/05/2015 10:46 AM Subject: Re: Master build fails ? Dilip: Can you give the command you used ? Which release were you building ? What OS did you build on ? Cheers On Thu, Nov 5, 2015 at 10:21 AM, Dilip Biswal wrote: Hello, I am getting the same build error about not being ab

Re: Master build fails ?

2015-11-05 Thread Steve Loughran
SBT/ivy pulls in the most recent version of a JAR in, whereas maven pulls in the "closest", where closest is lowest distance/depth from the root. > On 5 Nov 2015, at 18:53, Marcelo Vanzin wrote: > > Seems like it's an sbt issue, not a maven one, so "dependency:tree" > might not help. Still, th

Re: Master build fails ?

2015-11-05 Thread Marcelo Vanzin
Seems like it's an sbt issue, not a maven one, so "dependency:tree" might not help. Still, the command line would be helpful. I use sbt and don't see this. On Thu, Nov 5, 2015 at 10:44 AM, Marcelo Vanzin wrote: > Hi Jeff, > > On Tue, Nov 3, 2015 at 2:50 AM, Jeff Zhang wrote: >> Looks like it's d

Re: Master build fails ?

2015-11-05 Thread Ted Yu
t; > Is there a solution to this ? > > Regards, > Dilip Biswal > Tel: 408-463-4980 > dbis...@us.ibm.com > > > > From:Jean-Baptiste Onofré > To:Ted Yu > Cc:"dev@spark.apache.org" > Date:

Re: Master build fails ?

2015-11-05 Thread Marcelo Vanzin
Hi Jeff, On Tue, Nov 3, 2015 at 2:50 AM, Jeff Zhang wrote: > Looks like it's due to guava version conflicts, I see both guava 14.0.1 and > 16.0.1 under lib_managed/bundles. Anyone meet this issue too ? What command line are you using to build? Can you run "mvn dependency:tree" (with all the othe

Re: Master build fails ?

2015-11-05 Thread Dilip Biswal
11/03/2015 07:20 AM Subject: Re: Master build fails ? Hi Ted, thanks for the update. The build with sbt is in progress on my box. Regards JB On 11/03/2015 03:31 PM, Ted Yu wrote: > Interesting, Sbt builds were not all failing: > > https://amplab.cs.berkeley.edu/jenkins/job/Spark-

Re: Master build fails ?

2015-11-04 Thread Jacek Laskowski
Hi, It appears it's time to switch to my lovely sbt then! Pozdrawiam, Jacek -- Jacek Laskowski | http://blog.japila.pl | http://blog.jaceklaskowski.pl Follow me at https://twitter.com/jaceklaskowski Upvote at http://stackoverflow.com/users/1305344/jacek-laskowski On Tue, Nov 3, 2015 at 2:58 PM

Re: Master build fails ?

2015-11-03 Thread Jean-Baptiste Onofré
Hi Ted, thanks for the update. The build with sbt is in progress on my box. Regards JB On 11/03/2015 03:31 PM, Ted Yu wrote: Interesting, Sbt builds were not all failing: https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-SBT/ FYI On Tue, Nov 3, 2015 at 5:58 AM, Jean-Baptiste Onofré ma

Re: Master build fails ?

2015-11-03 Thread Ted Yu
Interesting, Sbt builds were not all failing: https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-SBT/ FYI On Tue, Nov 3, 2015 at 5:58 AM, Jean-Baptiste Onofré wrote: > Hi Jacek, > > it works fine with mvn: the problem is with sbt. > > I suspect a different reactor order in sbt compare to

Re: Master build fails ?

2015-11-03 Thread Jean-Baptiste Onofré
Hi Jacek, it works fine with mvn: the problem is with sbt. I suspect a different reactor order in sbt compare to mvn. Regards JB On 11/03/2015 02:44 PM, Jacek Laskowski wrote: Hi, Just built the sources using the following command and it worked fine. ➜ spark git:(master) ✗ ./build/mvn -Pya

Re: Master build fails ?

2015-11-03 Thread Jacek Laskowski
Hi, Just built the sources using the following command and it worked fine. ➜ spark git:(master) ✗ ./build/mvn -Pyarn -Phadoop-2.6 -Dhadoop.version=2.7.1 -Dscala-2.11 -Phive -Phive-thriftserver -DskipTests clean install ... [INFO] --

Re: Master build fails ?

2015-11-03 Thread Jean-Baptiste Onofré
Thanks for the update, I used mvn to build but without hive profile. Let me try with mvn with the same options as you and sbt also. I keep you posted. Regards JB On 11/03/2015 12:55 PM, Jeff Zhang wrote: I found it is due to SPARK-11073. Here's the command I used to build build/sbt clean co

Re: Master build fails ?

2015-11-03 Thread Saisai Shao
Yeah, I also met this problem, just curious why jenkins test is OK. On Tue, Nov 3, 2015 at 7:55 PM, Jeff Zhang wrote: > I found it is due to SPARK-11073. > > Here's the command I used to build > > build/sbt clean compile -Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver > -Psparkr > > On Tue, Nov 3

Re: Master build fails ?

2015-11-03 Thread Jeff Zhang
I found it is due to SPARK-11073. Here's the command I used to build build/sbt clean compile -Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver -Psparkr On Tue, Nov 3, 2015 at 7:52 PM, Jean-Baptiste Onofré wrote: > Hi Jeff, > > it works for me (with skipping the tests). > > Let me try again, just

Re: Master build fails ?

2015-11-03 Thread Jean-Baptiste Onofré
Hi Jeff, it works for me (with skipping the tests). Let me try again, just to be sure. Regards JB On 11/03/2015 11:50 AM, Jeff Zhang wrote: Looks like it's due to guava version conflicts, I see both guava 14.0.1 and 16.0.1 under lib_managed/bundles. Anyone meet this issue too ? [error] /User

Master build fails ?

2015-11-03 Thread Jeff Zhang
Looks like it's due to guava version conflicts, I see both guava 14.0.1 and 16.0.1 under lib_managed/bundles. Anyone meet this issue too ? [error] /Users/jzhang/github/spark_apache/core/src/main/scala/org/apache/spark/SecurityManager.scala:26: object HashCodes is not a member of package com.google