This has to do how surefire counts such tests. If you run them in the IDE you will see the correct stats.
Running single unit tests in Idea I always use a little debug-suite.xml which I configure for the testng runner: ---- <suite name="JSR-346-TCK debug" verbose="2" configfailurepolicy="continue"> <test name="JSR-346 TCK debug"> <groups> <run> <exclude name="integration" /> <exclude name="javaee-full" /> </run> </groups> <packages> <!-- <package name="org.jboss.cdi.tck.tests.*"> <include name="org.jboss.cdi.tck.tests.context.alterable"/> <include name="org.jboss.cdi.tck.tests.implementation.producer.field.definition"/> <include name="org.jboss.cdi.tck.tests.implementation.disposal.method.definition.broken.unresolvedMethod"/> <include name="org.jboss.cdi.tck.tests.implementation.disposal.method.definition.broken.validation.ambiguous"/> <include name="org.jboss.cdi.tck.tests.implementation.disposal.method.definition.broken.interceptor"/> </package> --> </packages> <classes> <class name="org.jboss.cdi.tck.tests.context.alterable.AlterableContextTest"> <!-- <methods> <include name="testNothingHappensIfNoInstanceToDestroy"/> </methods> --> </class> </classes> </test> </suite> ---- LieGrue, strub > On Saturday, 28 June 2014, 11:56, Romain Manni-Bucau <[email protected]> > wrote: > > Hi Mark > > I have: > > Tests run: 1167, Failures: 158, Errors: 0, Skipped: 250 > > What do I miss? > > BTW I should get few cycle to help tonight (or this afternoon) > > > > Romain Manni-Bucau > Twitter: @rmannibucau > Blog: http://rmannibucau.wordpress.com/ > LinkedIn: http://fr.linkedin.com/in/rmannibucau > Github: https://github.com/rmannibucau > > > > 2014-06-28 10:27 GMT+02:00 Mark Struberg <[email protected]>: > >> current state after yesterday nights hacking: we are at just 66 broken TCK >> tests left from almost 1000. >> C'm on guys, could need some help! >> >> LieGrue, >> strub >> >> >> >> > On Saturday, 7 June 2014, 7:56, Mark Struberg > <[email protected]> wrote: >> > > Hi! >> > >> > I've upgraded trunk to the latest CDI-1.2 TCK test and did all the >> necessary >> > configuration. >> > >> > I started with passing 134 tests and am not at 732. Still a few miles > to >> go >> > though... >> > >> > LieGrue, >> > strub >> > >> >
