On Sun, Feb 23, 2020 at 5:20 PM Xi Ruoyao via lfs-dev <lfs-dev@lists.linuxfromscratch.org> wrote: > We don't consider XPASS a failure. There are many XPASS in LFS packages (>20 > in > total, I think) and it does not make sense to document them one by one. > > I'd never seen a XPASS which is a "bad thing". Once a grep maintainer > believed > "XPASS is bad" so he made the entire test suite to FAIL if there was any > XPASS. > Then after a Glibc upgrading, a XPASS in grep forced us to use "-k" for grep > "make check". It's stupid IMO - a test suite should not be a fragile "status > change detector".
Very interesting. So, XPASS here does not mean something that is really expected to fail as in the unit test "test to open a lock with the wrong key", which is expected to fail and with an XPASS really means something goes wrong? > We can add a discussion about the meaning of PASS/FAIL/XPASS/XFAIL in "4.6 > About > the Test Suites", though. Seconded, and please include the case of "test to open a lock with the wrong key" to define the semantics of XPASS. Thank you. > -- > Xi Ruoyao <xry...@mengyan1223.wang> > School of Aerospace Science and Technology, Xidian University -- Best regards, Tadeus -- http://lists.linuxfromscratch.org/listinfo/lfs-dev FAQ: http://www.linuxfromscratch.org/faq/ Unsubscribe: See the above information page
