Hi, looked into our slaves. docker-slave-06 had oom issues and a gigantic load, so i reduced its # of tasks from 8 to 6.
However the failures had all been on slave-07, for instance debian. I double checked slave-07 bigtop/slaves:trunk-debian-8 and bigtop/slaves:trunk-ubuntu-16.04 images are up to date. In order to double-check I started a debian spark build on my local "server"... It suceeded. Something is wrong here. Olaf > Am 23.11.2016 um 12:45 schrieb MrAsanjar . <[email protected]>: > > olaf, > this is odd, we don't experience the same error with ppc64le, it is the > same code base, except slave-ubuntu-16.04 docker image. > https://ci.bigtop.apache.org/job/Bigtop-trunk-packages-ppc64le/ > > > On Wed, Nov 23, 2016 at 1:55 AM, Olaf Flebbe <[email protected]> wrote: > >> Thanks Ganesh, >> >> Not too sure about this. To me, it's smells a little bit of a >> infrastructure problem. I would like to gather more evidence and I think we >> will need some more scala knowhow maybe lurking on this list. >> >> Right now we do not have too much traffic on our dev list. I would say we >> keep the discussion on the list until a) it is clear it's a problem that >> may have a fix within git or b) someone complains. Not asking for that, of >> course ;-) >> >> Olaf >> >>> Am 23.11.2016 um 07:10 schrieb Ganesh Raju <[email protected]>: >>> >>> Thanks Olaf. >>> You want me to create a JIRA? >>> >>> Ganesh >>> >>> On Wed, Nov 23, 2016 at 12:05 AM, Olaf Flebbe <[email protected]> wrote: >>> >>>> Hi >>>> >>>> i checked the build log and I am very puzzled about this particular >> error >>>> message as well. The build error began after a build fix for spark1 on >>>> power which is imho unrelated, since this is in spark. >>>> >>>> Right now i am i thinking that maybe the zinc compiler has some kind of >>>> problem. >>>> >>>> unrelated to that, i looked at the ec2 console and saw that one volume >>>> attached to one of our instances had massive amount of readops >> (millions in >>>> 5 min) , but didn't investigate further. maybe one of our compile >> instance >>>> is swapping? >>>> >>>> i will try to look into the potential oom issue today >>>> >>>> olaf >>>> >>>>> Am 23.11.2016 um 05:40 schrieb Ganesh Raju <[email protected]>: >>>>> >>>>> Thanks Cos. >>>>> I was trying to build Spark 2.0. I will check the CI jobs. >>>>> >>>>> Thanks, >>>>> Ganesh >>>>> >>>>>> On Tue, Nov 22, 2016 at 10:38 PM, Konstantin Boudnik <[email protected]> >>>> wrote: >>>>>> >>>>>> So, which spark is it? Are you using the canonical BOM or an >>>> alternative? >>>>>> When it doubt, you always can refer to [1] to see if the official >>>> version >>>>>> of >>>>>> the build has the same issues. >>>>>> >>>>>> [1] https://ci.bigtop.apache.org/view/Packages/job/Bigtop- >>>> trunk-packages/ >>>>>> >>>>>> Cos >>>>>> >>>>>>> On Tue, Nov 22, 2016 at 10:04PM, Ganesh Raju wrote: >>>>>>> Hi, >>>>>>> >>>>>>> While building spark using BigTop, i am facing this error. Any >> pointers >>>>>> in >>>>>>> right direction will be greatly appreciated. I am building on debian >>>>>> jessie. >>>>>>> >>>>>>> [error] Required file not found: sbt-interface.jar. [error] See zinc >>>>>> -help >>>>>>> for information about locating necessary files. >>>>>>> >>>>>>> [ERROR] Failed to execute goal >>>>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile >>>>>>> (scala-compile-first) on project spark-tags_2.11: Execution >>>>>>> scala-compile-first of goal net.alchim31.maven:scala- >>>>>> maven-plugin:3.2.2:compile >>>>>>> failed. CompileFailed -> [Help 1] >>>>>>> >>>>>>> >>>>>>> Thanks, >>>>>>> Ganesh >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t >>>> >>>> >>> >>> >>> -- >>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t >> >>
