No, I don't use IntelliJ. I also don't know how they run their tests but I suspect they use some hackish way to plug into junit runner (a non-standard listener or something)?
My syspicion is that they pass Description objects as filters and expect identical Description objects to appear on the listener's output. This doesn't need to be the case and is not a contract anywhere. Hard to tell, really. I files an issue for this - https://github.com/carrotsearch/randomizedtesting/issues/83 Dawid On Tue, Apr 17, 2012 at 6:56 PM, Steven A Rowe <[email protected]> wrote: > JetBrains has 7 issues in their issue tracker for IntelliJ IDEA that mention > "Wrong test finished." - all are marked closed & fixed. > > http://youtrack.jetbrains.com/issues/IDEA?q=%22Wrong+test+finished%22 > > AFAICT, the problems mentioned in the above reports are of two main types: > > 1. Problem running concurrent tests (IDEA-54745). > 2. Problem with exception thrown in @BeforeClass (IDEA-49505; IDEA-38287; > IDEA-36591) > > I tried adding "-Dtests.jvms=1" to the run configuration for the > analyzers-common module's tests, and IntelliJ still had the same problem > (some tests didn't run & "Wrong test finished"), so I don't think the problem > is #1. > > Steve > > -----Original Message----- > From: Steven A Rowe [mailto:[email protected]] > Sent: Tuesday, April 17, 2012 12:05 PM > To: [email protected] > Subject: Problem running all of a module's tests under IntelliJ: "Wrong test > finished." > > Hi Dawid :) > > Do you use IntelliJ? There appears to be some form of bad interaction > between the new RandomizedTesting library additions and IntelliJ's test > runner. > > When I try to run all of an IntelliJ module's tests under IntelliJ, e.g. > analyzers-common or lucene (including core and test-framework), not all tests > run; those that don't run are reported as "not started". The external test > process reports "Wrong test finished." (???) and then returns exit code -1. > > This behavior is relatively new - I don't think the modules/*->lucene/ move > is the culprit (the IntelliJ lucene+test-framework module didn't move and it > has this issue). > > Here's the output from running all analyzers-common tests: > > ---------- > "C:\Program Files\Java\jdk1.6.0_21\bin\java" -ea -DtempDir=temp > -Didea.launcher.port=7541 "-Didea.launcher.bin.path=C:\Program Files > (x86)\JetBrains\IntelliJ IDEA 11.1\bin" -Dfile.encoding=UTF-8 -classpath > "C:\Program Files (x86)\JetBrains\IntelliJ IDEA > 11.1\lib\idea_rt.jar;C:\Program Files (x86)\JetBrains\IntelliJ IDEA > 11.1\plugins\junit\lib\junit-rt.jar;C:\Program > Files\Java\jdk1.6.0_21\jre\lib\alt-rt.jar;C:\Program > Files\Java\jdk1.6.0_21\jre\lib\charsets.jar;C:\Program > Files\Java\jdk1.6.0_21\jre\lib\deploy.jar;C:\Program > Files\Java\jdk1.6.0_21\jre\lib\javaws.jar;C:\Program > Files\Java\jdk1.6.0_21\jre\lib\jce.jar;C:\Program > Files\Java\jdk1.6.0_21\jre\lib\jsse.jar;C:\Program > Files\Java\jdk1.6.0_21\jre\lib\management-agent.jar;C:\Program > Files\Java\jdk1.6.0_21\jre\lib\plugin.jar;C:\Program > Files\Java\jdk1.6.0_21\jre\lib\resources.jar;C:\Program > Files\Java\jdk1.6.0_21\jre\lib\rt.jar;C:\Program > Files\Java\jdk1.6.0_21\jre\lib\ext\dnsns.jar;C:\Program > Files\Java\jdk1.6.0_21\jre\lib\ext\localedata.jar;C:\Program > Files\Java\jdk1.6.0_21\jre\lib\ext\sunjce_provider.jar;C:\svn\lucene\dev\trunk\lucene\build\analysis\analyzers-common\classes\test;C:\svn\lucene\dev\trunk\lucene\build\analysis\analyzers-common\classes\java;C:\svn\lucene\dev\trunk\lucene\test-framework\lib\junit-4.10.jar;C:\svn\lucene\dev\trunk\lucene\test-framework\lib\randomizedtesting-runner-1.2.0.jar;C:\svn\lucene\dev\trunk\lucene\build\lucene-idea\classes\test;C:\svn\lucene\dev\trunk\lucene\build\lucene-idea\classes\java;C:\svn\lucene\dev\trunk\lucene\test-framework\lib\ant-1.7.1.jar;C:\svn\lucene\dev\trunk\lucene\test-framework\lib\ant-junit-1.7.1.jar" > com.intellij.rt.execution.application.AppMain > com.intellij.rt.execution.junit.JUnitStarter -ideVersion5 > @C:\Users\sarowe\AppData\Local\Temp\idea_junit3377604973713774012.tmp > -socket53790 > > Test '.<default package>.WordBreakTestUnicode_6_0_0' ignored Test > 'org.apache.lucene.analysis.pattern.TestPatternReplaceCharFilter.testNastyPattern' > ignored > > Wrong test finished. Last started: [] stopped: > testNastyPattern(org.apache.lucene.analysis.pattern.TestPatternReplaceCharFilter); > class org.junit.runner.Description > > Process finished with exit code -1 > ---------- > > > Steve > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] For additional > commands, e-mail: [email protected] > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
