Re: [Gluster-devel] regressions on release-3.7 ?

2015-04-21 Thread Vijay Bellur
On 04/21/2015 01:00 AM, Jeff Darcy wrote: Another option would be to maintain a file with this list in the tests directory. run-tests.sh can lookup this file to determine whether it should continue or bail out. Alternatively^2, I could modify http://review.gluster.org/#/c/10277/ to run such tes

Re: [Gluster-devel] regressions on release-3.7 ?

2015-04-20 Thread Emmanuel Dreyfus
Vijay Bellur wrote: > Another option would be to maintain a file with this list in the tests > directory. run-tests.sh can lookup this file to determine whether it > should continue or bail out. NetBSD's /opt/qa/regression.sh does this: # Disable always-failing cases for i in ./tests/basic/afr

Re: [Gluster-devel] regressions on release-3.7 ?

2015-04-20 Thread Jeff Darcy
> Another option would be to maintain a file with this list in the tests > directory. run-tests.sh can lookup this file to determine whether it > should continue or bail out. Alternatively^2, I could modify http://review.gluster.org/#/c/10277/ to run such tests and ignore the results instead of sk

Re: [Gluster-devel] regressions on release-3.7 ?

2015-04-20 Thread Justin Clift
On 20 Apr 2015, at 20:02, Vijay Bellur wrote: > On 04/21/2015 12:19 AM, Justin Clift wrote: >> On 20 Apr 2015, at 18:53, Jeff Darcy wrote: I propose that we don't drop test units but provide an ack to patches that have known regression failures. >>> >>> IIRC maintainers have had permis

Re: [Gluster-devel] regressions on release-3.7 ?

2015-04-20 Thread Vijay Bellur
On 04/21/2015 12:19 AM, Justin Clift wrote: On 20 Apr 2015, at 18:53, Jeff Darcy wrote: I propose that we don't drop test units but provide an ack to patches that have known regression failures. IIRC maintainers have had permission to issue such overrides since a community meeting some months

Re: [Gluster-devel] regressions on release-3.7 ?

2015-04-20 Thread Justin Clift
On 20 Apr 2015, at 18:53, Jeff Darcy wrote: >> I propose that we don't drop test units but provide an ack to patches >> that have known regression failures. > > IIRC maintainers have had permission to issue such overrides since a > community meeting some months ago, but such overrides have remain

Re: [Gluster-devel] regressions on release-3.7 ?

2015-04-20 Thread Jeff Darcy
> I propose that we don't drop test units but provide an ack to patches > that have known regression failures. IIRC maintainers have had permission to issue such overrides since a community meeting some months ago, but such overrides have remained rare. What should we do to ensure that currently

Re: [Gluster-devel] regressions on release-3.7 ?

2015-04-20 Thread Jeff Darcy
> IMO, if we start skipping test cases we may not be able to > uncover bugs. Thoughts? The purpose of a regression test is to catch unanticipated problems related to new changes. Once a problem is already known, a series of tradeoffs must be evaluated. * What new information is gained by contin

Re: [Gluster-devel] regressions on release-3.7 ?

2015-04-20 Thread Vijay Bellur
On 04/20/2015 10:39 PM, Jeff Darcy wrote: Are you meaning deleting the tests temporarily (to let other stuff pass without being held up by it), or permanently? Kind of both. I think the tests should be deleted so they don't interfere with other work, but that means we'll have features without

Re: [Gluster-devel] regressions on release-3.7 ?

2015-04-20 Thread Jeff Darcy
> Are you meaning deleting the tests temporarily (to let other stuff > pass without being held up by it), or permanently? Kind of both. I think the tests should be deleted so they don't interfere with other work, but that means we'll have features without tests. Lack of a test should be consider

Re: [Gluster-devel] regressions on release-3.7 ?

2015-04-20 Thread Atin Mukherjee
On 04/20/2015 06:44 PM, Jeff Darcy wrote: >> The same problems that affect mainline are affecting release-3.7 too. We >> need to get over this soon. > > I think it's time to start skipping (or even deleting) some tests. For > example, volume-snapshot-clone.t alone is responsible for a huge numb

Re: [Gluster-devel] regressions on release-3.7 ?

2015-04-20 Thread Justin Clift
On 20 Apr 2015, at 14:14, Jeff Darcy wrote: >> The same problems that affect mainline are affecting release-3.7 too. We >> need to get over this soon. > > I think it's time to start skipping (or even deleting) some tests. For > example, volume-snapshot-clone.t alone is responsible for a huge num

Re: [Gluster-devel] regressions on release-3.7 ?

2015-04-20 Thread Jeff Darcy
> The same problems that affect mainline are affecting release-3.7 too. We > need to get over this soon. I think it's time to start skipping (or even deleting) some tests. For example, volume-snapshot-clone.t alone is responsible for a huge number of spurious failures. It's for a feature that pe

Re: [Gluster-devel] regressions on release-3.7 ?

2015-04-19 Thread Vijay Bellur
On 04/19/2015 05:39 PM, Emmanuel Dreyfus wrote: Hi Is it possible at all to pass regression on release-3.7? I retry, rebase, but I still get failures unrelated to my changes. The same problems that affect mainline are affecting release-3.7 too. We need to get over this soon. Thanks, Vijay

[Gluster-devel] regressions on release-3.7 ?

2015-04-19 Thread Emmanuel Dreyfus
Hi Is it possible at all to pass regression on release-3.7? I retry, rebase, but I still get failures unrelated to my changes. -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz m...@netbsd.org ___ Gluster-devel mailing list Gluster-devel@gluster.org http: