Re: Intermittent testing errors in TestSystemPropertiesInvariantRule

2012-03-21 Thread Dawid Weiss
This one is a larger report from Carrot2/head test (quick, hence so many assumption-ignored tests): http://goo.gl/ObzE8 Dawid On Wed, Mar 21, 2012 at 10:04 PM, Erick Erickson wrote: > Oh, my goodness, that will be sweet. > > And my problem is...my problem. Had ICUFoldingFilterFactory in my core

Re: Intermittent testing errors in TestSystemPropertiesInvariantRule

2012-03-21 Thread Dawid Weiss
> Thanks for cleaning stuff up, although I'm perfectly willing to live > with it, I've just got to learn what's "real" and what's not No, I agree with you that looking at console output should tell you right away where the problem was (even by skimming quickly). Currently lots of tests emit SEVERE

Re: Intermittent testing errors in TestSystemPropertiesInvariantRule

2012-03-21 Thread Erick Erickson
Oh, my goodness, that will be sweet. And my problem is...my problem. Had ICUFoldingFilterFactory in my core schema.xml by mistake, had meant to take it out. So, of all things, ShowFileReqeustHandlerTest was failing. because ICUFFF couldn't be found by the classloader. Thanks for cleaning stuf

Re: Intermittent testing errors in TestSystemPropertiesInvariantRule

2012-03-21 Thread Chris Hostetter
: OK, I need some basic tutoring here. What constitutes a _real_ failure? : And is there a simple way to find them? Assuming you don't customize the junit test output writer you can do something like... find -name TEST\*xml | xargs grep -L 'errors="0" failures="0"' ...which will give you all t

Re: Intermittent testing errors in TestSystemPropertiesInvariantRule

2012-03-21 Thread Dawid Weiss
Cleaned up those suites, Erick so these won't be confusing any more, hopefully. Dawid On Wed, Mar 21, 2012 at 9:37 PM, Dawid Weiss wrote: >> "grep FAILED" on the test results? That found what's below, but is >> it sufficient to find them all? > > The definite answer is each suite's summary line

Re: Intermittent testing errors in TestSystemPropertiesInvariantRule

2012-03-21 Thread Dawid Weiss
> "grep FAILED" on the test results? That found what's below, but is > it sufficient to find them all? The definite answer is each suite's summary line -- number of failures/ errors being non-zero. I will silence those framework tests to make life simpler. > But I'd have gone ahead and checked it

Re: Intermittent testing errors in TestSystemPropertiesInvariantRule

2012-03-21 Thread Erick Erickson
gt; http://www.thetaphi.de > eMail: [email protected] > > >> -Original Message- >> From: Erick Erickson [mailto:[email protected]] >> Sent: Wednesday, March 21, 2012 8:48 PM >> To: [email protected] >> Subject: Re: Intermittent testing er

RE: Intermittent testing errors in TestSystemPropertiesInvariantRule

2012-03-21 Thread Uwe Schindler
Original Message- > From: Erick Erickson [mailto:[email protected]] > Sent: Wednesday, March 21, 2012 8:48 PM > To: [email protected] > Subject: Re: Intermittent testing errors in TestSystemPropertiesInvariantRule > > These are build-failing errors as far as I can tell

Re: Intermittent testing errors in TestSystemPropertiesInvariantRule

2012-03-21 Thread Erick Erickson
These are build-failing errors as far as I can tell. My touch-stone is that I get BUILD FAILED at the end of the run... On Wed, Mar 21, 2012 at 3:03 PM, Dawid Weiss wrote: > Hi Erick, > > These are not build-failing errors, are they? What you're seeing on > the console  is most likely what's a s

Re: Intermittent testing errors in TestSystemPropertiesInvariantRule

2012-03-21 Thread Dawid Weiss
Hi Erick, These are not build-failing errors, are they? What you're seeing on the console is most likely what's a side effect of running these test suites as part of another test; the way it works is I have some suites that test the testing framework itself so they launch another suite (nested cl

Intermittent testing errors in TestSystemPropertiesInvariantRule

2012-03-21 Thread Erick Erickson
I'm rather consistently getting errors when I run "ant clean test" on Solr 3.x. Not saying that these area NOT on trunk, but I'm on 3.x at the moment. e.g. ant test -Dtestcase=InTestMethod -Dtestmethod=testMethod2 -Dtests.seed=-3b454f200cdffb4d:4d3124ee9a92369a:286699633a5841fc -Dargs="-Dfile.enc