Olaf
On Thu, Nov 24, 2016 at 12:48 AM, Olaf Flebbe <[email protected]> wrote: > Ganesh, > > Thanks for the info, a new data point ;-) > > Do you run multiple compile jobs in parallel ? Sometimes. But in this case, no. > > Do you use docker do containerize them ? > No. Not using docker. > > Olaf > > > > Am 24.11.2016 um 07:41 schrieb Ganesh Raju <[email protected]>: > > > > Thanks Olaf > > Please let me know if you find anything. I am building on my local > machine > > and i am facing this issue. Weird for me too. > > > > Thanks, > > Ganesh > > > > On Wed, Nov 23, 2016 at 3:22 PM, Olaf Flebbe <[email protected]> wrote: > > > >> Hi, > >> > >> looked into our slaves. docker-slave-06 had oom issues and a gigantic > >> load, so i reduced its # of tasks from 8 to 6. > >> > >> However the failures had all been on slave-07, for instance debian. > >> > >> I double checked slave-07 bigtop/slaves:trunk-debian-8 and > >> bigtop/slaves:trunk-ubuntu-16.04 images > >> are up to date. > >> > >> In order to double-check I started a debian spark build on my local > >> "server"... It suceeded. > >> Something is wrong here. > >> > >> Olaf > >> > >> > >> > >> > >> > >> > >> > >>> Am 23.11.2016 um 12:45 schrieb MrAsanjar . <[email protected]>: > >>> > >>> olaf, > >>> this is odd, we don't experience the same error with ppc64le, it is the > >>> same code base, except slave-ubuntu-16.04 docker image. > >>> https://ci.bigtop.apache.org/job/Bigtop-trunk-packages-ppc64le/ > >>> > >>> > >>> On Wed, Nov 23, 2016 at 1:55 AM, Olaf Flebbe <[email protected]> wrote: > >>> > >>>> Thanks Ganesh, > >>>> > >>>> Not too sure about this. To me, it's smells a little bit of a > >>>> infrastructure problem. I would like to gather more evidence and I > >> think we > >>>> will need some more scala knowhow maybe lurking on this list. > >>>> > >>>> Right now we do not have too much traffic on our dev list. I would say > >> we > >>>> keep the discussion on the list until a) it is clear it's a problem > that > >>>> may have a fix within git or b) someone complains. Not asking for > that, > >> of > >>>> course ;-) > >>>> > >>>> Olaf > >>>> > >>>>> Am 23.11.2016 um 07:10 schrieb Ganesh Raju <[email protected]>: > >>>>> > >>>>> Thanks Olaf. > >>>>> You want me to create a JIRA? > >>>>> > >>>>> Ganesh > >>>>> > >>>>> On Wed, Nov 23, 2016 at 12:05 AM, Olaf Flebbe <[email protected]> wrote: > >>>>> > >>>>>> Hi > >>>>>> > >>>>>> i checked the build log and I am very puzzled about this particular > >>>> error > >>>>>> message as well. The build error began after a build fix for spark1 > on > >>>>>> power which is imho unrelated, since this is in spark. > >>>>>> > >>>>>> Right now i am i thinking that maybe the zinc compiler has some kind > >> of > >>>>>> problem. > >>>>>> > >>>>>> unrelated to that, i looked at the ec2 console and saw that one > volume > >>>>>> attached to one of our instances had massive amount of readops > >>>> (millions in > >>>>>> 5 min) , but didn't investigate further. maybe one of our compile > >>>> instance > >>>>>> is swapping? > >>>>>> > >>>>>> i will try to look into the potential oom issue today > >>>>>> > >>>>>> olaf > >>>>>> > >>>>>>> Am 23.11.2016 um 05:40 schrieb Ganesh Raju <[email protected] > >: > >>>>>>> > >>>>>>> Thanks Cos. > >>>>>>> I was trying to build Spark 2.0. I will check the CI jobs. > >>>>>>> > >>>>>>> Thanks, > >>>>>>> Ganesh > >>>>>>> > >>>>>>>> On Tue, Nov 22, 2016 at 10:38 PM, Konstantin Boudnik < > >> [email protected]> > >>>>>> wrote: > >>>>>>>> > >>>>>>>> So, which spark is it? Are you using the canonical BOM or an > >>>>>> alternative? > >>>>>>>> When it doubt, you always can refer to [1] to see if the official > >>>>>> version > >>>>>>>> of > >>>>>>>> the build has the same issues. > >>>>>>>> > >>>>>>>> [1] https://ci.bigtop.apache.org/view/Packages/job/Bigtop- > >>>>>> trunk-packages/ > >>>>>>>> > >>>>>>>> Cos > >>>>>>>> > >>>>>>>>> On Tue, Nov 22, 2016 at 10:04PM, Ganesh Raju wrote: > >>>>>>>>> Hi, > >>>>>>>>> > >>>>>>>>> While building spark using BigTop, i am facing this error. Any > >>>> pointers > >>>>>>>> in > >>>>>>>>> right direction will be greatly appreciated. I am building on > >> debian > >>>>>>>> jessie. > >>>>>>>>> > >>>>>>>>> [error] Required file not found: sbt-interface.jar. [error] See > >> zinc > >>>>>>>> -help > >>>>>>>>> for information about locating necessary files. > >>>>>>>>> > >>>>>>>>> [ERROR] Failed to execute goal > >>>>>>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile > >>>>>>>>> (scala-compile-first) on project spark-tags_2.11: Execution > >>>>>>>>> scala-compile-first of goal net.alchim31.maven:scala- > >>>>>>>> maven-plugin:3.2.2:compile > >>>>>>>>> failed. CompileFailed -> [Help 1] > >>>>>>>>> > >>>>>>>>> > >>>>>>>>> Thanks, > >>>>>>>>> Ganesh > >>>>>>>> > >>>>>>> > >>>>>>> > >>>>>>> > >>>>>>> -- > >>>>>>> IRC: ganeshraju@#linaro on irc.freenode.ne < > http://irc.freenode.net/ > >>> t > >>>>>> > >>>>>> > >>>>> > >>>>> > >>>>> -- > >>>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/ > >t > >>>> > >>>> > >> > >> > > > > > > -- > > IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t > > -- IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
