[ 
https://issues.apache.org/jira/browse/SOLR-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16705517#comment-16705517
 ] 

Hoss Man commented on SOLR-12932:
---------------------------------

bq. Skimming the logs from jenkins.thetaphi.de #23277, the suite failures 
mostly seem to fall into 2 types...

I completley overlooked this initially (because i was focused on the "fails") 
but in that jenkins.thetaphi.de #23277 build (which used java10) it seems that 
every test that didn't have a suite level failure was just skipping all of the 
test methods.

>From the #23277 logs...

{noformat}
...
   [junit4] Completed [2/837 (1!)] on J2 in 16.95s, 9 tests, 2 errors <<< 
FAILURES!
   [junit4] 
   [junit4] Suite: org.apache.solr.DistributedIntervalFacetingTest
   [junit4] Completed [3/837 (1!)] on J2 in 0.00s, 1 test, 1 skipped
   [junit4] 
   [junit4] Suite: 
org.apache.solr.rest.schema.TestDynamicFieldCollectionResource
   [junit4] Completed [4/837 (1!)] on J2 in 0.00s, 5 tests, 5 skipped
   [junit4] 
   [junit4] Suite: org.apache.solr.index.UninvertDocValuesMergePolicyTest
   [junit4] Completed [5/837 (1!)] on J2 in 0.00s, 2 tests, 2 skipped
   [junit4] 
   [junit4] Suite: org.apache.solr.core.TestCodecSupport
   [junit4] Completed [6/837 (1!)] on J2 in 0.00s, 8 tests, 8 skipped
   [junit4] 
   [junit4] Suite: 
org.apache.solr.update.PeerSyncWithLeaderAndIndexFingerprintCachingTest
   [junit4] Completed [7/837 (1!)] on J2 in 0.00s, 1 test, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.solr.request.RegexBytesRefFilterTest
   [junit4] Completed [8/837 (1!)] on J2 in 0.00s, 1 test, 1 skipped
   [junit4] 
   [junit4] Suite: org.apache.solr.legacy.TestNumericRangeQuery32
   [junit4] Completed [9/837 (1!)] on J2 in 0.00s, 18 tests, 18 skipped
...
{noformat}

...that last {{TestNumericRangeQuery32}} subclasses LuceneTestCase directly, 
and doesn't use any solr code or test-framework code ... so it shouldn't really 
be possible it's inheriting any assumption/annotation that would cause it to be 
skipped ... so WTF????

----

i see similar behavior myself when i run with java11 locally (fewer suite level 
failures, but what doesn't fail says it's being skipped) but can't wrap my head 
around what might be causing this...

{noformat}
hossman@tray:~/lucene/dev/solr/core [master] $ ant test 
-Dtests.seed=A28FAA62F9DF8AD7
...
BUILD FAILED
/home/hossman/lucene/dev/solr/common-build.xml:558: The following error 
occurred while executing this line:
/home/hossman/lucene/dev/lucene/common-build.xml:1567: The following error 
occurred while executing this line:
/home/hossman/lucene/dev/lucene/common-build.xml:1092: There were test 
failures: 837 suites (7 ignored), 4121 tests, 7 suite-level errors, 3954 
ignored (128 assumptions) [seed: A28FAA62F9DF8AD7]

Total time: 1 minute 36 seconds
{noformat}

... i can't reproduce this "java11 skips almost every test" wonkiness if i 
rollback to 81c092d8262a68dfda3994e790f2e1f3fdf275e2 (last master commit before 
75b1831967982)


> ant test (without badapples=false) should pass easily for developers.
> ---------------------------------------------------------------------
>
>                 Key: SOLR-12932
>                 URL: https://issues.apache.org/jira/browse/SOLR-12932
>             Project: Solr
>          Issue Type: Sub-task
>      Security Level: Public(Default Security Level. Issues are Public) 
>          Components: Tests
>            Reporter: Mark Miller
>            Assignee: Mark Miller
>            Priority: Major
>
> If we fix the tests we will end up here anyway, but we can shortcut this.
> Once I get my first patch in, anyone who mentions a test that fails locally 
> for them at any time (not jenkins), I will fix it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to