Ganesh, Thanks for the info, a new data point ;-)
Do you run multiple compile jobs in parallel ? Do you use docker do containerize them ? Olaf > Am 24.11.2016 um 07:41 schrieb Ganesh Raju <[email protected]>: > > Thanks Olaf > Please let me know if you find anything. I am building on my local machine > and i am facing this issue. Weird for me too. > > Thanks, > Ganesh > > On Wed, Nov 23, 2016 at 3:22 PM, Olaf Flebbe <[email protected]> wrote: > >> Hi, >> >> looked into our slaves. docker-slave-06 had oom issues and a gigantic >> load, so i reduced its # of tasks from 8 to 6. >> >> However the failures had all been on slave-07, for instance debian. >> >> I double checked slave-07 bigtop/slaves:trunk-debian-8 and >> bigtop/slaves:trunk-ubuntu-16.04 images >> are up to date. >> >> In order to double-check I started a debian spark build on my local >> "server"... It suceeded. >> Something is wrong here. >> >> Olaf >> >> >> >> >> >> >> >>> Am 23.11.2016 um 12:45 schrieb MrAsanjar . <[email protected]>: >>> >>> olaf, >>> this is odd, we don't experience the same error with ppc64le, it is the >>> same code base, except slave-ubuntu-16.04 docker image. >>> https://ci.bigtop.apache.org/job/Bigtop-trunk-packages-ppc64le/ >>> >>> >>> On Wed, Nov 23, 2016 at 1:55 AM, Olaf Flebbe <[email protected]> wrote: >>> >>>> Thanks Ganesh, >>>> >>>> Not too sure about this. To me, it's smells a little bit of a >>>> infrastructure problem. I would like to gather more evidence and I >> think we >>>> will need some more scala knowhow maybe lurking on this list. >>>> >>>> Right now we do not have too much traffic on our dev list. I would say >> we >>>> keep the discussion on the list until a) it is clear it's a problem that >>>> may have a fix within git or b) someone complains. Not asking for that, >> of >>>> course ;-) >>>> >>>> Olaf >>>> >>>>> Am 23.11.2016 um 07:10 schrieb Ganesh Raju <[email protected]>: >>>>> >>>>> Thanks Olaf. >>>>> You want me to create a JIRA? >>>>> >>>>> Ganesh >>>>> >>>>> On Wed, Nov 23, 2016 at 12:05 AM, Olaf Flebbe <[email protected]> wrote: >>>>> >>>>>> Hi >>>>>> >>>>>> i checked the build log and I am very puzzled about this particular >>>> error >>>>>> message as well. The build error began after a build fix for spark1 on >>>>>> power which is imho unrelated, since this is in spark. >>>>>> >>>>>> Right now i am i thinking that maybe the zinc compiler has some kind >> of >>>>>> problem. >>>>>> >>>>>> unrelated to that, i looked at the ec2 console and saw that one volume >>>>>> attached to one of our instances had massive amount of readops >>>> (millions in >>>>>> 5 min) , but didn't investigate further. maybe one of our compile >>>> instance >>>>>> is swapping? >>>>>> >>>>>> i will try to look into the potential oom issue today >>>>>> >>>>>> olaf >>>>>> >>>>>>> Am 23.11.2016 um 05:40 schrieb Ganesh Raju <[email protected]>: >>>>>>> >>>>>>> Thanks Cos. >>>>>>> I was trying to build Spark 2.0. I will check the CI jobs. >>>>>>> >>>>>>> Thanks, >>>>>>> Ganesh >>>>>>> >>>>>>>> On Tue, Nov 22, 2016 at 10:38 PM, Konstantin Boudnik < >> [email protected]> >>>>>> wrote: >>>>>>>> >>>>>>>> So, which spark is it? Are you using the canonical BOM or an >>>>>> alternative? >>>>>>>> When it doubt, you always can refer to [1] to see if the official >>>>>> version >>>>>>>> of >>>>>>>> the build has the same issues. >>>>>>>> >>>>>>>> [1] https://ci.bigtop.apache.org/view/Packages/job/Bigtop- >>>>>> trunk-packages/ >>>>>>>> >>>>>>>> Cos >>>>>>>> >>>>>>>>> On Tue, Nov 22, 2016 at 10:04PM, Ganesh Raju wrote: >>>>>>>>> Hi, >>>>>>>>> >>>>>>>>> While building spark using BigTop, i am facing this error. Any >>>> pointers >>>>>>>> in >>>>>>>>> right direction will be greatly appreciated. I am building on >> debian >>>>>>>> jessie. >>>>>>>>> >>>>>>>>> [error] Required file not found: sbt-interface.jar. [error] See >> zinc >>>>>>>> -help >>>>>>>>> for information about locating necessary files. >>>>>>>>> >>>>>>>>> [ERROR] Failed to execute goal >>>>>>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile >>>>>>>>> (scala-compile-first) on project spark-tags_2.11: Execution >>>>>>>>> scala-compile-first of goal net.alchim31.maven:scala- >>>>>>>> maven-plugin:3.2.2:compile >>>>>>>>> failed. CompileFailed -> [Help 1] >>>>>>>>> >>>>>>>>> >>>>>>>>> Thanks, >>>>>>>>> Ganesh >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/ >>> t >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t >>>> >>>> >> >> > > > -- > IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
