Re: [Gluster-infra] qcow2 images / jenkins machines

[Dan Lambright]

- Original Message -
> From: "Michael Scherer" 
> To: "Dan Lambright" 
> Cc: "gluster-infra" 
> Sent: Thursday, March 10, 2016 2:10:10 PM
> Subject: Re: [Gluster-infra] qcow2 images / jenkins machines
> 
> Le mercredi 09 mars 2016 à 11:49 -0500, Dan Lambright a écrit :
> > I would like to load onto openstack qcow2 images and profiles most closely
> > resembling what we run in jenkins, to recreate problems seen in
> > regression.
> > 
> > What are the OS levels do we use on Jenkins for testing? I see:
> > 
> > netbsd7
> > 
> > centos6
> > 
> > fedora22
> > 
> > and "nbslave", RHEL7 ?
> > 
> > This is a very cursory look. How much memory and cores are these images
> > given?
> > 
> > If anyone knows the answer to these questions, response is appreciated.
> 
> so we have mostly centos 6 and netbsd 7, running on rackspace
> 
> The centos 6 are
> 2g of ram, 2 core
> model name: Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz
> 
> Fedora 22 is just for smoke tests.
> Ther eis another Centos - who was here to validate the automated
> deployment, and a freebsd server for smoke test.
> 
> We do not use image based deployment, but mostly salt, using this
> states :
> https://github.com/gluster/gluster.org_salt_states/blob/master/jenkins/slave.sls
> 
> We will be converting this to ansible in the coming month, and
> Raghavendra Talur was working on a vagrant/ansible setup for testing too
> (hope we can unify both at some time in the future too)
> 
> No RHEL/Centos 7 yet, but we should.

I think RHEL/Centos7 would be a good thing from the point of view of testing.

> 
> --
> Michael Scherer
> Sysadmin, Community Infrastructure and Platform, OSAS
> 
> 
>
___
Gluster-infra mailing list
Gluster-infra@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-infra

[Gluster-infra] qcow2 images / jenkins machines

[Dan Lambright]

I would like to load onto openstack qcow2 images and profiles most closely 
resembling what we run in jenkins, to recreate problems seen in regression.

What are the OS levels do we use on Jenkins for testing? I see:

netbsd7

centos6

fedora22

and "nbslave", RHEL7 ?

This is a very cursory look. How much memory and cores are these images given?

If anyone knows the answer to these questions, response is appreciated. 

___
Gluster-infra mailing list
Gluster-infra@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-infra

Re: [Gluster-infra] tests/basic/tier/tier-file-create.t dumping core on Linux

[Dan Lambright]

- Original Message -
> From: "Niels de Vos" 
> To: "Dan Lambright" 
> Cc: "Krutika Dhananjay" , "Vijay Bellur" 
> , "Gluster Devel"
> , "Pranith Karampuri" , 
> "gluster-infra" ,
> "RHGS tiering mailing list" 
> Sent: Tuesday, March 8, 2016 12:36:58 PM
> Subject: Re: [Gluster-infra] tests/basic/tier/tier-file-create.t dumping core 
> on Linux
> 
> On Tue, Mar 08, 2016 at 08:45:12AM -0500, Dan Lambright wrote:
> > 
> > 
> > - Original Message -
> > > From: "Niels de Vos" 
> > > To: "Krutika Dhananjay" , "Vijay Bellur"
> > > 
> > > Cc: "Dan Lambright" , "Gluster Devel"
> > > , "Pranith Karampuri"
> > > , "gluster-infra" , "RHGS
> > > tiering mailing list"
> > > 
> > > Sent: Tuesday, March 8, 2016 8:37:14 AM
> > > Subject: Re: [Gluster-infra] tests/basic/tier/tier-file-create.t dumping
> > > core on Linux
> > > 
> > > On Tue, Mar 08, 2016 at 07:00:07PM +0530, Krutika Dhananjay wrote:
> > > > I did talk to the author and he is going to look into the issue.
> > > > 3.7.9 is round the corner and we certainly don't want bad tests to
> > > > block
> > > > patches that need to go in.
> > > 
> > > 3.7.9 has been delayed already. There is hardly a good reason for
> > > changes to delay the relase even more. 3.7.10 will be done in a few
> > > weeks at the end of March, anything non-regression should probably not
> > > be included at this point anymore.
> > > 
> > > Vijay is the release manager for 3.7.9 and .10, you'll need to come with
> > > extreme strong points for getting more patches included.
> > 
> > I've no desire to disrupt downstream releases and if we are indeed out
> > of time for 3.7.9, then thats life.
> 
> 3.7.x releases are planned for each 30th of the month, 3.7.9 was
> supposed to be tagged for relaese the end of February. We are trying to
> get back to this schdule, and are failing hard :-(
> 
> Upstream has a very strict schedule (that we fail to follow because the
> release managers are occupied elsewhere), downstream (RHGS) should be
> aware of that as is it documented on
> https://www.gluster.org/community/release-schedule/ . Please pass that
> link on to anyone that expects changes to get merged in certain upstream
> releases. In general a release needs a few days of preparation, so
> patches for a release need to be ready at least ~5 working days in
> advance.
> 
> > That said, obviously a test failure is a failure, and once its masked
> > it tends to be forgotton.
> 
> When a test is marked as bad_test, we require a bug to be filed for that
> test. It should not be forgotten, the component maintainers are expected
> to track (and eventually fix) the open bugs for their components.
> 
> > I suggest we do not mask this test upstream (does it happen there?)
> > and give some urgency to chasing it down.
> 
> I assumed this is all for upstream. Not sure why an internal Red Hat
> list (rhgs-tiering) was put on CC.

-1

> 
> HTH,
> Niels
> 
> 
> > 
> > 
> > > 
> > > Niels
> > > 
> > > 
> > > > 
> > > > -Krutika
> > > > 
> > > > On Tue, Mar 8, 2016 at 6:50 PM, Dan Lambright 
> > > > wrote:
> > > > 
> > > > >
> > > > >
> > > > > - Original Message -
> > > > > > From: "Krutika Dhananjay" 
> > > > > > To: "Pranith Karampuri" 
> > > > > > Cc: "gluster-infra" , "Gluster Devel" <
> > > > > gluster-de...@gluster.org>, "RHGS tiering mailing
> > > > > > list" , "Dan Lambright"
> > > > > > 
> > > > > > Sent: Tuesday, March 8, 2016 12:15:20 AM
> > > > > > Subject: Re: [Gluster-infra] tests/basic/tier/tier-file-create.t
> > > > > > dumping
> > > > > core on Linux
> > > > > >
> > > > > > It has been failing rather frequently.
> > > > > > Have reported a bug at
> > > > > https://bugzilla.redhat.com/show_bug.cgi?id=1315560
> > > > > > For now, have moved it to bad tests here:
> > > > > > http://review.gluster.org/#/c/13632/1
> > > > > >
> > > > >
> > > > >

Re: [Gluster-infra] tests/basic/tier/tier-file-create.t dumping core on Linux

[Dan Lambright]

- Original Message -
> From: "Niels de Vos" 
> To: "Krutika Dhananjay" , "Vijay Bellur" 
> 
> Cc: "Dan Lambright" , "Gluster Devel" 
> , "Pranith Karampuri"
> , "gluster-infra" , "RHGS 
> tiering mailing list"
> 
> Sent: Tuesday, March 8, 2016 8:37:14 AM
> Subject: Re: [Gluster-infra] tests/basic/tier/tier-file-create.t dumping core 
> on Linux
> 
> On Tue, Mar 08, 2016 at 07:00:07PM +0530, Krutika Dhananjay wrote:
> > I did talk to the author and he is going to look into the issue.
> > 3.7.9 is round the corner and we certainly don't want bad tests to block
> > patches that need to go in.
> 
> 3.7.9 has been delayed already. There is hardly a good reason for
> changes to delay the relase even more. 3.7.10 will be done in a few
> weeks at the end of March, anything non-regression should probably not
> be included at this point anymore.
> 
> Vijay is the release manager for 3.7.9 and .10, you'll need to come with
> extreme strong points for getting more patches included.

I've no desire to disrupt downstream releases and if we are indeed out of time 
for 3.7.9, then thats life.
That said, obviously a test failure is a failure, and once its masked it tends 
to be forgotton.
I suggest we do not mask this test upstream (does it happen there?) and give 
some urgency to chasing it down.


> 
> Niels
> 
> 
> > 
> > -Krutika
> > 
> > On Tue, Mar 8, 2016 at 6:50 PM, Dan Lambright  wrote:
> > 
> > >
> > >
> > > - Original Message -
> > > > From: "Krutika Dhananjay" 
> > > > To: "Pranith Karampuri" 
> > > > Cc: "gluster-infra" , "Gluster Devel" <
> > > gluster-de...@gluster.org>, "RHGS tiering mailing
> > > > list" , "Dan Lambright" 
> > > > Sent: Tuesday, March 8, 2016 12:15:20 AM
> > > > Subject: Re: [Gluster-infra] tests/basic/tier/tier-file-create.t
> > > > dumping
> > > core on Linux
> > > >
> > > > It has been failing rather frequently.
> > > > Have reported a bug at
> > > https://bugzilla.redhat.com/show_bug.cgi?id=1315560
> > > > For now, have moved it to bad tests here:
> > > > http://review.gluster.org/#/c/13632/1
> > > >
> > >
> > >
> > > Masking tests is a bad habit. It would be better to fix the problem, and
> > > it looks like a real bug.
> > > The author of the test should help chase this down.
> > >
> > > > -Krutika
> > > >
> > > > On Mon, Mar 7, 2016 at 4:17 PM, Krutika Dhananjay 
> > > > wrote:
> > > >
> > > > > +Pranith
> > > > >
> > > > > -Krutika
> > > > >
> > > > >
> > > > > On Sat, Mar 5, 2016 at 11:34 PM, Dan Lambright 
> > > > > wrote:
> > > > >
> > > > >>
> > > > >>
> > > > >> - Original Message -
> > > > >> > From: "Dan Lambright" 
> > > > >> > To: "Shyam" 
> > > > >> > Cc: "Krutika Dhananjay" , "Gluster Devel" <
> > > > >> gluster-de...@gluster.org>, "Rafi Kavungal Chundattu
> > > > >> > Parambil" , "Nithya Balachandran" <
> > > > >> nbala...@redhat.com>, "Joseph Fernandes"
> > > > >> > , "gluster-infra" 
> > > > >> > Sent: Friday, March 4, 2016 9:51:18 AM
> > > > >> > Subject: Re: [Gluster-infra] tests/basic/tier/tier-file-create.t
> > > > >> dumping core on Linux
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> > - Original Message -
> > > > >> > > From: "Shyam" 
> > > > >> > > To: "Krutika Dhananjay" , "Gluster Devel"
> > > > >> > > , "Rafi Kavungal Chundattu
> > > > >> > > Parambil" , "Nithya Balachandran"
> > > > >> > > , "Joseph Fernandes"
> > > > >> > > , "Dan Lambright" 
> > > > >> > > Cc: "gluster-infra" 
> > > > >> > > Sent: Friday, March 4, 2016 9:45:17 AM
> > > > >> > > Subject: Re: [Gluster-infra] tests/basic/ti

Re: [Gluster-infra] tests/basic/tier/tier-file-create.t dumping core on Linux

[Dan Lambright]

- Original Message -
> From: "Krutika Dhananjay" 
> To: "Pranith Karampuri" 
> Cc: "gluster-infra" , "Gluster Devel" 
> , "RHGS tiering mailing
> list" , "Dan Lambright" 
> Sent: Tuesday, March 8, 2016 12:15:20 AM
> Subject: Re: [Gluster-infra] tests/basic/tier/tier-file-create.t dumping core 
> on Linux
> 
> It has been failing rather frequently.
> Have reported a bug at https://bugzilla.redhat.com/show_bug.cgi?id=1315560
> For now, have moved it to bad tests here:
> http://review.gluster.org/#/c/13632/1
> 


Masking tests is a bad habit. It would be better to fix the problem, and it 
looks like a real bug.
The author of the test should help chase this down.

> -Krutika
> 
> On Mon, Mar 7, 2016 at 4:17 PM, Krutika Dhananjay 
> wrote:
> 
> > +Pranith
> >
> > -Krutika
> >
> >
> > On Sat, Mar 5, 2016 at 11:34 PM, Dan Lambright 
> > wrote:
> >
> >>
> >>
> >> - Original Message -
> >> > From: "Dan Lambright" 
> >> > To: "Shyam" 
> >> > Cc: "Krutika Dhananjay" , "Gluster Devel" <
> >> gluster-de...@gluster.org>, "Rafi Kavungal Chundattu
> >> > Parambil" , "Nithya Balachandran" <
> >> nbala...@redhat.com>, "Joseph Fernandes"
> >> > , "gluster-infra" 
> >> > Sent: Friday, March 4, 2016 9:51:18 AM
> >> > Subject: Re: [Gluster-infra] tests/basic/tier/tier-file-create.t
> >> dumping core on Linux
> >> >
> >> >
> >> >
> >> > - Original Message -
> >> > > From: "Shyam" 
> >> > > To: "Krutika Dhananjay" , "Gluster Devel"
> >> > > , "Rafi Kavungal Chundattu
> >> > > Parambil" , "Nithya Balachandran"
> >> > > , "Joseph Fernandes"
> >> > > , "Dan Lambright" 
> >> > > Cc: "gluster-infra" 
> >> > > Sent: Friday, March 4, 2016 9:45:17 AM
> >> > > Subject: Re: [Gluster-infra] tests/basic/tier/tier-file-create.t
> >> dumping
> >> > > core on Linux
> >> > >
> >> > > Facing the same problem in the following runs as well,
> >> > >
> >> > > 1)
> >> > >
> >> https://build.gluster.org/job/rackspace-regression-2GB-triggered/18767/console
> >> > > 2) https://build.gluster.org/job/regression-test-burn-in/546/console
> >> > > 3) https://build.gluster.org/job/regression-test-burn-in/547/console
> >> > > 4) https://build.gluster.org/job/regression-test-burn-in/549/console
> >> > >
> >> > > Last successful burn-in was: 545 (but do not see the test having been
> >> > > run here, so this is inconclusive)
> >> > >
> >> > > burn-in test 544 is hung on the same test here,
> >> > > https://build.gluster.org/job/regression-test-burn-in/544/console
> >> > >
> >> > > (and at this point I am stopping the hunt for when this last
> >> succeeded :) )
> >> > >
> >> > > Let's know if anyone is taking a peek at the cores.
> >> >
> >> > hm. Not familiar with this test. Written by Pranith? I'll look.
> >>
> >> We are doing lookup everywhere, and building up a dict of the extended
> >> attributes of a file as we traverse each sub volume across the hot and
> >> cold
> >> tiers. The length field of one of the EC keys is corrupted.
> >>
> >> Not clear why this is happening.. I see no tiering relationship as of
> >> yet, its possible the file is being demoted in parallel to the foreground
> >> script operation.
> >>
> >> The test runs fine on my machines.  Does this reproduce consistently on
> >> one of the Jenkins machines? If so, getting onto it would be the next
> >> step.
> >> I think that would be preferable to masking this test case.
> >>
> >>
> >> >
> >> > >
> >> > > Thanks,
> >> > > Shyam
> >> > >
> >> > >
> >> > >
> >> > > On 03/04/2016 07:40 AM, Krutika Dhananjay wrote:
> >> > > > Could someone from tiering dev team please take a look?
> >> > > >
> >> > > >
> >> https://build.gluster.org/job/rackspace-regression-2GB-triggered/18793/console
> >> > > >
> >> > > > -Krutika
> >> > > >
> >> > > >
> >> > > > ___
> >> > > > Gluster-infra mailing list
> >> > > > Gluster-infra@gluster.org
> >> > > > http://www.gluster.org/mailman/listinfo/gluster-infra
> >> > > >
> >> > >
> >> >
> >>
> >
> >
> 
___
Gluster-infra mailing list
Gluster-infra@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-infra

Re: [Gluster-infra] tests/basic/tier/tier-file-create.t dumping core on Linux

[Dan Lambright]

- Original Message -
> From: "Dan Lambright" 
> To: "Shyam" 
> Cc: "Krutika Dhananjay" , "Gluster Devel" 
> , "Rafi Kavungal Chundattu
> Parambil" , "Nithya Balachandran" , 
> "Joseph Fernandes"
> , "gluster-infra" 
> Sent: Friday, March 4, 2016 9:51:18 AM
> Subject: Re: [Gluster-infra] tests/basic/tier/tier-file-create.t dumping core 
> on Linux
> 
> 
> 
> - Original Message -
> > From: "Shyam" 
> > To: "Krutika Dhananjay" , "Gluster Devel"
> > , "Rafi Kavungal Chundattu
> > Parambil" , "Nithya Balachandran"
> > , "Joseph Fernandes"
> > , "Dan Lambright" 
> > Cc: "gluster-infra" 
> > Sent: Friday, March 4, 2016 9:45:17 AM
> > Subject: Re: [Gluster-infra] tests/basic/tier/tier-file-create.t dumping
> > core on Linux
> > 
> > Facing the same problem in the following runs as well,
> > 
> > 1)
> > https://build.gluster.org/job/rackspace-regression-2GB-triggered/18767/console
> > 2) https://build.gluster.org/job/regression-test-burn-in/546/console
> > 3) https://build.gluster.org/job/regression-test-burn-in/547/console
> > 4) https://build.gluster.org/job/regression-test-burn-in/549/console
> > 
> > Last successful burn-in was: 545 (but do not see the test having been
> > run here, so this is inconclusive)
> > 
> > burn-in test 544 is hung on the same test here,
> > https://build.gluster.org/job/regression-test-burn-in/544/console
> > 
> > (and at this point I am stopping the hunt for when this last succeeded :) )
> > 
> > Let's know if anyone is taking a peek at the cores.
> 
> hm. Not familiar with this test. Written by Pranith? I'll look.

We are doing lookup everywhere, and building up a dict of the extended 
attributes of a file as we traverse each sub volume across the hot and cold 
tiers. The length field of one of the EC keys is corrupted.

Not clear why this is happening.. I see no tiering relationship as of yet, its 
possible the file is being demoted in parallel to the foreground script 
operation. 

The test runs fine on my machines.  Does this reproduce consistently on one of 
the Jenkins machines? If so, getting onto it would be the next step. I think 
that would be preferable to masking this test case.


> 
> > 
> > Thanks,
> > Shyam
> > 
> > 
> > 
> > On 03/04/2016 07:40 AM, Krutika Dhananjay wrote:
> > > Could someone from tiering dev team please take a look?
> > >
> > > https://build.gluster.org/job/rackspace-regression-2GB-triggered/18793/console
> > >
> > > -Krutika
> > >
> > >
> > > ___
> > > Gluster-infra mailing list
> > > Gluster-infra@gluster.org
> > > http://www.gluster.org/mailman/listinfo/gluster-infra
> > >
> > 
> 
___
Gluster-infra mailing list
Gluster-infra@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-infra

Re: [Gluster-infra] tests/basic/tier/tier-file-create.t dumping core on Linux

[Dan Lambright]

- Original Message -
> From: "Shyam" 
> To: "Krutika Dhananjay" , "Gluster Devel" 
> , "Rafi Kavungal Chundattu
> Parambil" , "Nithya Balachandran" , 
> "Joseph Fernandes"
> , "Dan Lambright" 
> Cc: "gluster-infra" 
> Sent: Friday, March 4, 2016 9:45:17 AM
> Subject: Re: [Gluster-infra] tests/basic/tier/tier-file-create.t dumping core 
> on Linux
> 
> Facing the same problem in the following runs as well,
> 
> 1)
> https://build.gluster.org/job/rackspace-regression-2GB-triggered/18767/console
> 2) https://build.gluster.org/job/regression-test-burn-in/546/console
> 3) https://build.gluster.org/job/regression-test-burn-in/547/console
> 4) https://build.gluster.org/job/regression-test-burn-in/549/console
> 
> Last successful burn-in was: 545 (but do not see the test having been
> run here, so this is inconclusive)
> 
> burn-in test 544 is hung on the same test here,
> https://build.gluster.org/job/regression-test-burn-in/544/console
> 
> (and at this point I am stopping the hunt for when this last succeeded :) )
> 
> Let's know if anyone is taking a peek at the cores.

hm. Not familiar with this test. Written by Pranith? I'll look.

> 
> Thanks,
> Shyam
> 
> 
> 
> On 03/04/2016 07:40 AM, Krutika Dhananjay wrote:
> > Could someone from tiering dev team please take a look?
> >
> > https://build.gluster.org/job/rackspace-regression-2GB-triggered/18793/console
> >
> > -Krutika
> >
> >
> > ___
> > Gluster-infra mailing list
> > Gluster-infra@gluster.org
> > http://www.gluster.org/mailman/listinfo/gluster-infra
> >
> 
___
Gluster-infra mailing list
Gluster-infra@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-infra

[Gluster-infra] openstack "gluster cloud"

[Dan Lambright]

I have mentioned to a few people about an openstack cloud I've set up, which 
could assist in providing sundry cluster infra tasks and services.

It is at rhs-srv-06.gdev.lab.eng.bos.redhat.com. It is accessible via CLI. 
There is a rhel7 glance image, we could also put fedora or bsd, images there.

This server has 16 cores and just under 2TB of storage available. A "flavor" 
can be devised to give some amount of storage to each guest, I am using 
m1.small (20G) presently.

I expect we could easily run dozens on guests on this machine for any purpose. 
It is also possible to expand this "cloud" with more servers.

The process to set up guests is currently a little cumbersome as its via CLI, 
but this can be simplified / scripted. (boot image, assign floating IP address 
(10.19.101.161-192), login via pem file).

In short, this is an RFC to brainstorm ways to use our new "gluster cloud". 

Here are some ideas I've hard on how it could be used.

- engineering machines (dev, QE)

- expanding jenkins pool 

- certain scale-out tests


___
Gluster-infra mailing list
Gluster-infra@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-infra

Re: [Gluster-infra] tests failing on multiple slaves, having problems getting through regression

[Dan Lambright]

- Original Message -
> From: "Niels de Vos" 
> To: "Dan Lambright" 
> Cc: "Vijay Bellur" , "gluster-infra" 
> , "Mohammed Rafi K C"
> , "Vivek Agarwal" , "Rajesh Joseph" 
> , "Raghavendra
> Talur" , rhgs-tier...@redhat.com, "Nagaprasad 
> Sathyanarayana" 
> Sent: Wednesday, January 13, 2016 3:03:45 PM
> Subject: Re: tests failing on multiple slaves, having problems getting 
> through regression
> 
> On Wed, Jan 13, 2016 at 01:17:51PM -0500, Dan Lambright wrote:
> > 
> > 
> > > > > >>>
> > > > > >>> On 01/13/2016 10:21 PM, Vivek Agarwal wrote:
> > > > > >>>> On 01/13/2016 10:01 PM, Vivek Agarwal wrote:
> > > > > >>>>> On 01/13/2016 10:00 PM, Mohammed Rafi K C wrote:
> > > > > >>>>>> Hi All,
> > > > > >>>>>>
> > > > > >>>>>> The following patches need to be re-triggered (I don't have
> > > > > >>>>>> permission
> > > > > >>>>>> to re-trigger) urgently as it was expected to block 3.1.2 and
> > > > > >>>>>> need
> > > > > >>>>>> to be
> > > > > >>>>>> in for next build.
> > > > > >>>>>>
> > > > > >>>>>> 1)http://review.gluster.org/#/c/13224/
> > > > > >>>>>>   netbsd :
> > > > > >>>>>> https://build.gluster.org/job/rackspace-netbsd7-regression-triggered/13368/consoleFull
> > > > > >>>>>>
> > > > > >>>>>>
> > > > > >>>>>>   linux :
> > > > > >>>>>> https://build.gluster.org/job/rackspace-regression-2GB-triggered/17515/console
> > > > > >>>>>>
> > > > > >>>>>>
> > > > > >>>>>>
> > > > > >>>>>> 2) http://review.gluster.org/#/c/13225/
> > > > > >>>>>>
> > > > > >>>>>>linux :
> > > > > >>>>>> https://build.gluster.org/job/rackspace-regression-2GB-triggered/17543/console
> > > > > >>>>>>
> > > > > >>>>>>
> > > > > >>>
> > > > > >>>
> > > > > >>> Adding one more
> > > > > >>>
> > > > > >>> 3) http://review.gluster.org/#/c/11892/
> > > > > >>>  linux :
> > > > > >>> https://build.gluster.org/job/rackspace-regression-2GB-triggered/17537/consoleFull
> > > > > >>>
> > > > > >>>
> > > > > >>>>>>
> > > > > >>>>>> Thanks a lot for your help .
> > > > > >>>>> I have just retriggered all of them.
> > > > > >>>> Upon checking I see all the builds are not re-triggered.  Can
> > > > > >>>> some
> > > > > >>>> one
> > > > > >>>> else help why those were not re-triggered and/or re-trigger them
> > > > > >>>> ?
> > > > > >>
> > > > > >> retriggered
> > > > > >>
> > > > > >> so we have 13224, 13225, 11892
> > > > > >
> > > > > > Have marked slave46 as temporarily offline as it seemed to fail
> > > > > > launching regression tests.
> > > > > 
> > > > > 
> > > > > Thanks Vijay. Looks like salve slave21.cloud.gluster.org
> > > > > <https://build.gluster.org/computer/slave21.cloud.gluster.org> is
> > > > > also
> > > > > in bad state. Will rebooting work here ?
> > > > > 
> > > > 
> > > > 
> > > > Yes, that should help.
> > > > 
> > > > -Vijay
> > > > 
> > > 
> > > Have marked slave21 and slave25 as bad pending the reboot
> > 
> > Hello gluster-infra,
> > 
> > The following slaves keep failing tests. We have taken them offline:
> > 
> > slave21, slave25, and slave26.
> > 
> > They appear to require reboots? But it is unclear how they got into the
> > situation.
> > 
> > Can someone help figure out what went wrong with these machines? We have
> > some important fixes which need to be merged.
> 
> Is this the same error message as the one in this thread?
> 
>   http://thread.gmane.org/gmane.comp.file-systems.gluster.infra/775
> 
> Niels
> 

That looks different than what I saw.

___
Gluster-infra mailing list
Gluster-infra@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-infra

[Gluster-infra] tests failing on multiple slaves, having problems getting through regression

[Dan Lambright]

> > > >>>
> > > >>> On 01/13/2016 10:21 PM, Vivek Agarwal wrote:
> > >  On 01/13/2016 10:01 PM, Vivek Agarwal wrote:
> > > > On 01/13/2016 10:00 PM, Mohammed Rafi K C wrote:
> > > >> Hi All,
> > > >>
> > > >> The following patches need to be re-triggered (I don't have
> > > >> permission
> > > >> to re-trigger) urgently as it was expected to block 3.1.2 and need
> > > >> to be
> > > >> in for next build.
> > > >>
> > > >> 1)http://review.gluster.org/#/c/13224/
> > > >>   netbsd :
> > > >> https://build.gluster.org/job/rackspace-netbsd7-regression-triggered/13368/consoleFull
> > > >>
> > > >>
> > > >>   linux :
> > > >> https://build.gluster.org/job/rackspace-regression-2GB-triggered/17515/console
> > > >>
> > > >>
> > > >>
> > > >> 2) http://review.gluster.org/#/c/13225/
> > > >>
> > > >>linux :
> > > >> https://build.gluster.org/job/rackspace-regression-2GB-triggered/17543/console
> > > >>
> > > >>
> > > >>>
> > > >>>
> > > >>> Adding one more
> > > >>>
> > > >>> 3) http://review.gluster.org/#/c/11892/
> > > >>>  linux :
> > > >>> https://build.gluster.org/job/rackspace-regression-2GB-triggered/17537/consoleFull
> > > >>>
> > > >>>
> > > >>
> > > >> Thanks a lot for your help .
> > > > I have just retriggered all of them.
> > >  Upon checking I see all the builds are not re-triggered.  Can some
> > >  one
> > >  else help why those were not re-triggered and/or re-trigger them ?
> > > >>
> > > >> retriggered
> > > >>
> > > >> so we have 13224, 13225, 11892
> > > >
> > > > Have marked slave46 as temporarily offline as it seemed to fail
> > > > launching regression tests.
> > > 
> > > 
> > > Thanks Vijay. Looks like salve slave21.cloud.gluster.org
> > >  is also
> > > in bad state. Will rebooting work here ?
> > > 
> > 
> > 
> > Yes, that should help.
> > 
> > -Vijay
> > 
> 
> Have marked slave21 and slave25 as bad pending the reboot

Hello gluster-infra,

The following slaves keep failing tests. We have taken them offline:

slave21, slave25, and slave26.

They appear to require reboots? But it is unclear how they got into the 
situation.

Can someone help figure out what went wrong with these machines? We have some 
important fixes which need to be merged.

Dan 
___
Gluster-infra mailing list
Gluster-infra@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-infra

Re: [Gluster-infra] git.gluster.org sick?

[Dan Lambright]

- Original Message -
> From: "Kaleb Keithley" 
> To: "gluster-infra" 
> Sent: Saturday, December 19, 2015 1:14:38 PM
> Subject: [Gluster-infra] git.gluster.org sick?
> 
> 
> I'm getting "fatal: internal server error"when I try to clone from
> git.gluster.org

Also affects patch submittal, help needed here..

[root@rhs-cli-11 glusterfs]# ./rfc.sh

fatal: internal server error
fatal: The remote end hung up upon initial contact


> 
> --
> 
> Kaleb
> 
> ___
> Gluster-infra mailing list
> Gluster-infra@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-infra
> 
___
Gluster-infra mailing list
Gluster-infra@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-infra

[Gluster-infra] Instalation of jenkins plug-in

[Dan Lambright]

Recently we started running regression tests automatically [1]. Each time an 
automatic regression is run an email is generated subject "Jenkins: 
regression-test-burn-in #xx".  It would be nice if the email contained a list 
of failed regression tests. Such functionality appears to be possible with an 
"email plug-in" to jenkins. The plug-in allows a script to be run after the 
build scripts complete.

For example, you could add a rule:

// only send an email if the word {{ERROR}} is found in build logs
build.logFile.text.readLines().any { it =~ /.*ERROR.*/ }

I plan to install this plug-in tomorrow using [2]. I've been told it is 
non-disruptive; please let me know if you are aware otherwise.

[1]
https://build.gluster.org/job/regression-test-burn-in/configure

[2]
https://build.gluster.org/pluginManager/available
___
Gluster-infra mailing list
Gluster-infra@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-infra

[Gluster-infra] request for build machine to reproduce regression problem

[Dan Lambright]

Hello,

One of our fixes is failing regression, but we cannot recreate the failure on 
our machines. Its a somewhat important fix.

Can someone loan me a jenkins machine I can use to reproduce the problem? For 
one day, should be fine.

Thanks
Dan
___
Gluster-infra mailing list
Gluster-infra@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-infra

Re: [Gluster-infra] regression failures on freeBSD

[Dan Lambright]

Introduced fix 12155 for the problem.
thanks,
Dan

- Original Message -
> From: "Michael Scherer" 
> To: gluster-infra@gluster.org
> Sent: Thursday, September 10, 2015 12:54:51 PM
> Subject: Re: [Gluster-infra] regression failures on freeBSD
> 
> Le jeudi 10 septembre 2015 à 12:24 -0400, Dan Lambright a écrit :
> > Hello,
> > 
> > We are getting smoke errors are freeBSD, missing sqlite
> > 
> > /usr/home/jenkins/root/workspace/freebsd-smoke/libglusterfs/src/gfdb/gfdb_sqlite3.h:15:10:
> > fatal error: 'sqlite3.h' file not found
> > 
> > https://build.gluster.org/job/freebsd-smoke/9859/console
> > 
> > Can the sqlite package please be loaded on the freeBSD regression machines?
> > 
> > Please let me know,
> 
> It did install it, but it was already installed:
> 
> [root@freebsd0 ~]# pkg install sqlite3
> Updating FreeBSD repository catalogue...
> Fetching meta.txz: 100%944 B   0.9kB/s00:01
> Fetching packagesite.txz: 100%5 MiB   2.7MB/s00:02
> Processing entries: 100%
> FreeBSD repository update completed. 24553 packages processed.
> The following 1 package(s) will be affected (of 0 checked):
> 
> Installed packages to be UPGRADED:
>   sqlite3: 3.8.8.2 -> 3.8.11.1
> 
> The operation will free 173 KiB.
> 578 KiB to be downloaded.
> 
> Proceed with this action? [y/N]: y
> Fetching sqlite3-3.8.11.1.txz: 100%  578 KiB 591.8kB/s00:01
> Checking integrity... done (0 conflicting)
> [1/1] Upgrading sqlite3 from 3.8.8.2 to 3.8.11.1...
> [1/1] Extracting sqlite3-3.8.11.1: 100%
> 
> 
> and the file is here:
> [root@freebsd0 ~]# ls -l /usr/local/include/sqlite3.h
> -rw-r--r--  1 root  wheel  380214 Aug 27
> 01:12 /usr/local/include/sqlite3.h
> 
> I suspect the autodetection fail on freebsd, ie, that's a bug to
> correct, or the build script is wrong.
> 
> 
> --
> Michael Scherer
> Sysadmin, Community Infrastructure and Platform, OSAS
> 
> 
> ___
> Gluster-infra mailing list
> Gluster-infra@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-infra
___
Gluster-infra mailing list
Gluster-infra@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-infra

Re: [Gluster-infra] regression failures on freeBSD

[Dan Lambright]

Yup, ok, I see the problem. I'll try to fix it, or Joseph will, not later than 
this AM IST.

- Original Message -
> From: "Niels de Vos" 
> To: "Dan Lambright" 
> Cc: gluster-infra@gluster.org
> Sent: Thursday, September 10, 2015 2:12:28 PM
> Subject: Re: [Gluster-infra] regression failures on freeBSD
> 
> On Thu, Sep 10, 2015 at 12:24:29PM -0400, Dan Lambright wrote:
> > Hello,
> > 
> > We are getting smoke errors are freeBSD, missing sqlite
> > 
> > /usr/home/jenkins/root/workspace/freebsd-smoke/libglusterfs/src/gfdb/gfdb_sqlite3.h:15:10:
> > fatal error: 'sqlite3.h' file not found
> > 
> > https://build.gluster.org/job/freebsd-smoke/9859/console
> > 
> > Can the sqlite package please be loaded on the freeBSD regression machines?
> > 
> > Please let me know,
> 
> This has been introduced by a change in tier.h. More details here:
> 
>   http://review.gluster.org/#/c/12031/6/xlators/cluster/dht/src/tier.h
> 
> Please fix this ASAP, all FreeBSD smoke tests are now failing.
> 
> Thanks,
> Niels
> 
> 
___
Gluster-infra mailing list
Gluster-infra@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-infra

[Gluster-infra] regression failures on freeBSD

[Dan Lambright]

Hello,

We are getting smoke errors are freeBSD, missing sqlite 

/usr/home/jenkins/root/workspace/freebsd-smoke/libglusterfs/src/gfdb/gfdb_sqlite3.h:15:10:
 fatal error: 'sqlite3.h' file not found

https://build.gluster.org/job/freebsd-smoke/9859/console

Can the sqlite package please be loaded on the freeBSD regression machines?

Please let me know,

Thanks,
Dan
___
Gluster-infra mailing list
Gluster-infra@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-infra