Re: [Gluster-devel] All builds are failing with BUILD ERROR
On Wed, Jun 04, 2014 at 11:45:17AM +0530, Kaleb KEITHLEY wrote: > And since doing this, regression runs seem to be proceeding without issues. I remember that this used to be an issue when someone cancelled/stopped a running regression test through Jenkins. Maybe that was done? I don't know if anyone ever looked into solving that particular issue. Niels > > > > On 06/04/2014 09:59 AM, Kaleb KEITHLEY wrote: > >On 06/03/2014 04:42 PM, Pranith Kumar Karampuri wrote: > >>Guys its failing again with the same error: > >> > >>Please proceed with configuring, compiling, and installing. > >>rm: cannot remove `/build/install/var/run/gluster/patchy': Device or > >>resource busy > >>+ RET=1 > >>+ '[' 1 '!=' 0 ']' > >>+ VERDICT='BUILD FAILURE' > >> > > > >Has someone changed the way builds are cleaned up? > > > >Recent regressions are now failing with > > > >... > >Running automake... > >Running autogen.sh in argp-standalone ... > > > >Please proceed with configuring, compiling, and installing. > >configure: error: source directory already configured; run "make > >distclean" there first > >+ RET=1 > >+ '[' 1 '!=' 0 ']' > >+ VERDICT='BUILD FAILURE' > >... > > > > > > > >I looked and found that /var/lib/jenkins/jobs/regression/workspace > >contained what looked like a _previous_ successful regression build. > > > >I manually cleaned the directory (moved it and created a new workspace > >dir actually) and now a regression is running. > > > >What's going on? !!! > > > >-- > > > >Kaleb > > > > > > ___ > Gluster-devel mailing list > Gluster-devel@gluster.org > http://supercolony.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] All builds are failing with BUILD ERROR
And since doing this, regression runs seem to be proceeding without issues. On 06/04/2014 09:59 AM, Kaleb KEITHLEY wrote: On 06/03/2014 04:42 PM, Pranith Kumar Karampuri wrote: Guys its failing again with the same error: Please proceed with configuring, compiling, and installing. rm: cannot remove `/build/install/var/run/gluster/patchy': Device or resource busy + RET=1 + '[' 1 '!=' 0 ']' + VERDICT='BUILD FAILURE' Has someone changed the way builds are cleaned up? Recent regressions are now failing with ... Running automake... Running autogen.sh in argp-standalone ... Please proceed with configuring, compiling, and installing. configure: error: source directory already configured; run "make distclean" there first + RET=1 + '[' 1 '!=' 0 ']' + VERDICT='BUILD FAILURE' ... I looked and found that /var/lib/jenkins/jobs/regression/workspace contained what looked like a _previous_ successful regression build. I manually cleaned the directory (moved it and created a new workspace dir actually) and now a regression is running. What's going on? !!! -- Kaleb ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] All builds are failing with BUILD ERROR
On 06/03/2014 04:42 PM, Pranith Kumar Karampuri wrote: Guys its failing again with the same error: Please proceed with configuring, compiling, and installing. rm: cannot remove `/build/install/var/run/gluster/patchy': Device or resource busy + RET=1 + '[' 1 '!=' 0 ']' + VERDICT='BUILD FAILURE' Has someone changed the way builds are cleaned up? Recent regressions are now failing with ... Running automake... Running autogen.sh in argp-standalone ... Please proceed with configuring, compiling, and installing. configure: error: source directory already configured; run "make distclean" there first + RET=1 + '[' 1 '!=' 0 ']' + VERDICT='BUILD FAILURE' ... I looked and found that /var/lib/jenkins/jobs/regression/workspace contained what looked like a _previous_ successful regression build. I manually cleaned the directory (moved it and created a new workspace dir actually) and now a regression is running. What's going on? !!! -- Kaleb ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] All builds are failing with BUILD ERROR
On 06/03/2014 07:45 PM, Justin Clift wrote: On 03/06/2014, at 3:04 PM, Pranith Kumar Karampuri wrote: On 06/03/2014 07:00 PM, Justin Clift wrote: On 03/06/2014, at 12:12 PM, Pranith Kumar Karampuri wrote: Guys its failing again with the same error: Please proceed with configuring, compiling, and installing. rm: cannot remove `/build/install/var/run/gluster/patchy': Device or resource busy + RET=1 + '[' 1 '!=' 0 ']' + VERDICT='BUILD FAILURE' You have a login to build.gluster.org don't you? :) I only have login to launch builds. No permission to inspect the machine :-(. Just checked, and you're definitely in the sudo setup, with the same permissions as me. eg you can "sudo su -" to root If it asks for a password, its your own password. If you don't know it, let me know, and I'll set an initial one for you. :) Justin fixed the login for me. Feel free to reach out to me as well if there is any problem with build machine that anyone needs fixing. Pranith + Justin -- Open Source and Standards @ Red Hat twitter.com/realjustinclift ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] All builds are failing with BUILD ERROR
On 03/06/2014, at 3:04 PM, Pranith Kumar Karampuri wrote: > On 06/03/2014 07:00 PM, Justin Clift wrote: >> On 03/06/2014, at 12:12 PM, Pranith Kumar Karampuri wrote: >>> Guys its failing again with the same error: >>> >>> Please proceed with configuring, compiling, and installing. >>> rm: cannot remove `/build/install/var/run/gluster/patchy': Device or >>> resource busy >>> + RET=1 >>> + '[' 1 '!=' 0 ']' >>> + VERDICT='BUILD FAILURE' >> >> You have a login to build.gluster.org don't you? :) > I only have login to launch builds. No permission to inspect the machine :-(. Just checked, and you're definitely in the sudo setup, with the same permissions as me. eg you can "sudo su -" to root If it asks for a password, its your own password. If you don't know it, let me know, and I'll set an initial one for you. :) + Justin -- Open Source and Standards @ Red Hat twitter.com/realjustinclift ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] All builds are failing with BUILD ERROR
On 06/03/2014 07:00 PM, Justin Clift wrote: On 03/06/2014, at 12:12 PM, Pranith Kumar Karampuri wrote: Guys its failing again with the same error: Please proceed with configuring, compiling, and installing. rm: cannot remove `/build/install/var/run/gluster/patchy': Device or resource busy + RET=1 + '[' 1 '!=' 0 ']' + VERDICT='BUILD FAILURE' You have a login to build.gluster.org don't you? :) I only have login to launch builds. No permission to inspect the machine :-(. Pranith + Justin -- Open Source and Standards @ Red Hat twitter.com/realjustinclift ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] All builds are failing with BUILD ERROR
On 03/06/2014, at 12:12 PM, Pranith Kumar Karampuri wrote: > Guys its failing again with the same error: > > Please proceed with configuring, compiling, and installing. > rm: cannot remove `/build/install/var/run/gluster/patchy': Device or resource > busy > + RET=1 > + '[' 1 '!=' 0 ']' > + VERDICT='BUILD FAILURE' You have a login to build.gluster.org don't you? :) + Justin -- Open Source and Standards @ Red Hat twitter.com/realjustinclift ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] All builds are failing with BUILD ERROR
Guys its failing again with the same error: Please proceed with configuring, compiling, and installing. rm: cannot remove `/build/install/var/run/gluster/patchy': Device or resource busy + RET=1 + '[' 1 '!=' 0 ']' + VERDICT='BUILD FAILURE' Pranith On 06/02/2014 09:08 PM, Justin Clift wrote: On 02/06/2014, at 7:04 AM, Kaleb KEITHLEY wrote: someone cleaned the loopback devices. I deleted 500 unix domain sockets in /d/install/var/run and requeued the regressions. Interesting. The extra sockets problem is what prompted me to rewrite the cleanup function. The sockets are being created by glusterd during each test startup, but aren't removed by the existing cleanup function. (so, substantial build up over time) I'm not sure which of those two things was the solution. _Probably_ the loopback device thing. The extra sockets seem to be "messy" but (so far) I haven't seen them break anything. + Justin -- Open Source and Standards @ Red Hat twitter.com/realjustinclift ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] All builds are failing with BUILD ERROR
On 02/06/2014, at 7:04 AM, Kaleb KEITHLEY wrote: > someone cleaned the loopback devices. I deleted 500 unix domain sockets in > /d/install/var/run and requeued the regressions. Interesting. The extra sockets problem is what prompted me to rewrite the cleanup function. The sockets are being created by glusterd during each test startup, but aren't removed by the existing cleanup function. (so, substantial build up over time) > I'm not sure which of those two things was the solution. _Probably_ the loopback device thing. The extra sockets seem to be "messy" but (so far) I haven't seen them break anything. + Justin -- Open Source and Standards @ Red Hat twitter.com/realjustinclift ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] All builds are failing with BUILD ERROR
On 06/02/2014 10:58 AM, Vijay Bellur wrote: Seems to have been resolved now. Do you folks happen to know how it was fixed? someone cleaned the loopback devices. I deleted 500 unix domain sockets in /d/install/var/run and requeued the regressions. I'm not sure which of those two things was the solution. -- Kaleb ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] All builds are failing with BUILD ERROR
On 06/01/2014 04:13 PM, Justin Clift wrote: It _may_ be related to the new regression test cleanup function I'm working on: http://review.gluster.org/#/c/7937/ (possibly cleaned up / removed too much stuff) It also might not be, as it's only supposed to have run on the slaves. + Justin On 01/06/2014, at 9:18 AM, Pranith Kumar Karampuri wrote: I see that all builds that were submitted yesterday failed with BUILD FAILURE Here is the snippet of the log containing Failure: Please proceed with configuring, compiling, and installing. rm: cannot remove `/build/install/var/run/gluster/patchy': Device or resource busy + RET=1 + '[' 1 '!=' 0 ']' + VERDICT='BUILD FAILURE' Seems to have been resolved now. Do you folks happen to know how it was fixed? Thanks, Vijay ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] All builds are failing with BUILD ERROR
It _may_ be related to the new regression test cleanup function I'm working on: http://review.gluster.org/#/c/7937/ (possibly cleaned up / removed too much stuff) It also might not be, as it's only supposed to have run on the slaves. + Justin On 01/06/2014, at 9:18 AM, Pranith Kumar Karampuri wrote: > I see that all builds that were submitted yesterday failed with BUILD FAILURE > Here is the snippet of the log containing Failure: > Please proceed with configuring, compiling, and installing. > rm: cannot remove `/build/install/var/run/gluster/patchy': Device or resource > busy > + RET=1 > + '[' 1 '!=' 0 ']' > + VERDICT='BUILD FAILURE' > > Pranith > ___ > Gluster-devel mailing list > Gluster-devel@gluster.org > http://supercolony.gluster.org/mailman/listinfo/gluster-devel -- Open Source and Standards @ Red Hat twitter.com/realjustinclift ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-devel
