I think we should compare n-1th week report with nth and any common tests out of that comparison having more than or equal to 3 instances of failures SHOULD immediately marked as bad and any component having more than 5 bad tests should be BLOCKED for further merges till bad tests are fixed. What do others think about it?
On Wednesday 3 August 2016, Vijay Bellur <vbel...@redhat.com> wrote: > [Thanks to Jeff Darcy, Poornima G and Raghavendra Talur for > extras/failed-tests.py which generates this summary] > > Found cores: > > Component: [u'glusterfs-1879.core'] > Regression Link: > https://build.gluster.org/job/regression-test-burn-in/1451/consoleFull > > ./tests/performance/open-behind.t ; Failed 3 times > Regression Links: > https://build.gluster.org/job/regression-test-burn-in/1443/consoleFull > Regression Links: > https://build.gluster.org/job/regression-test-burn-in/1426/consoleFull > Regression Links: > https://build.gluster.org/job/regression-test-burn-in/1425/consoleFull > > ./tests/bugs/glusterd/bug-963541.t ; Failed 1 times > Regression Links: > https://build.gluster.org/job/regression-test-burn-in/1431/consoleFull > > ./tests/basic/ec/ec-new-entry.t ; Failed 1 times > Regression Links: > https://build.gluster.org/job/regression-test-burn-in/1451/consoleFull > > ./tests/bugs/bug-1110262.t ; Failed 2 times > Regression Links: > https://build.gluster.org/job/regression-test-burn-in/1424/consoleFull > Regression Links: > https://build.gluster.org/job/regression-test-burn-in/1418/consoleFull > > ./tests/bugs/glusterd/bug-1089668.t ; Failed 2 times > Regression Links: > https://build.gluster.org/job/regression-test-burn-in/1447/consoleFull > Regression Links: > https://build.gluster.org/job/regression-test-burn-in/1435/consoleFull > > ./tests/basic/volume-snapshot.t ; Failed 1 times > Regression Links: > https://build.gluster.org/job/regression-test-burn-in/1429/consoleFull > > ./tests/basic/gfapi/bug1291259.t ; Failed 1 times > Regression Links: > https://build.gluster.org/job/regression-test-burn-in/1450/consoleFull > > ./tests/bugs/quick-read/bug-846240.t ; Failed 1 times > Regression Links: > https://build.gluster.org/job/regression-test-burn-in/1416/consoleFull > > ./tests/bugs/gfapi/bug-1093594.t ; Failed 1 times > Regression Links: > https://build.gluster.org/job/regression-test-burn-in/1423/consoleFull > > maintainers & owners of above tests - can we please address these failures? > > Thanks, > Vijay > -- --Atin
_______________________________________________ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel