Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-8.x/52/

10 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.api.collections.HdfsCollectionsAPIDistributedZkTest

Error Message:
Suite timeout exceeded (>= 3600000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 3600000 msec).
        at __randomizedtesting.SeedInfo.seed([715B84D13F108889]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.api.collections.HdfsCollectionsAPIDistributedZkTest

Error Message:
Captured an uncaught exception in thread: Thread[id=153908, 
name=HttpClient@25b0a438-scheduler, state=RUNNABLE, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=153908, name=HttpClient@25b0a438-scheduler, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.api.collections.HdfsCollectionsAPIDistributedZkTest

Error Message:
Captured an uncaught exception in thread: Thread[id=153630, 
name=zkCallback-74228-thread-1, state=RUNNABLE, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=153630, name=zkCallback-74228-thread-1, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.api.collections.HdfsCollectionsAPIDistributedZkTest

Error Message:
Captured an uncaught exception in thread: Thread[id=150828, name=IPC Parameter 
Sending Thread #9, state=RUNNABLE, group=TGRP-MoveReplicaHDFSTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=150828, name=IPC Parameter Sending Thread #9, 
state=RUNNABLE, group=TGRP-MoveReplicaHDFSTest]
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.api.collections.HdfsCollectionsAPIDistributedZkTest

Error Message:
Captured an uncaught exception in thread: Thread[id=150012, name=IPC Server 
handler 9 on 41647, state=RUNNABLE, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=150012, name=IPC Server handler 9 on 41647, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.api.collections.HdfsCollectionsAPIDistributedZkTest

Error Message:
Captured an uncaught exception in thread: Thread[id=150062, name=IPC Server 
handler 5 on 44529, state=RUNNABLE, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=150062, name=IPC Server handler 5 on 44529, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded


FAILED:  
org.apache.solr.uninverting.TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit

Error Message:
this IndexWriter is closed

Stack Trace:
org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
        at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681)
        at org.apache.lucene.index.IndexWriter.getConfig(IndexWriter.java:1007)
        at 
org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5116)
        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1597)
        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1213)
        at 
org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:191)
        at 
org.apache.solr.uninverting.TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit(TestDocTermOrdsUninvertLimit.java:65)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
        at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:84)
        at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:57)
        at 
org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:168)
        at 
org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:154)
        at 
org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:141)
        at 
org.apache.lucene.store.RateLimitedIndexOutput.writeBytes(RateLimitedIndexOutput.java:73)
        at org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
        at 
org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:96)
        at 
org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:5010)
        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4523)
        at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4054)
        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)


FAILED:  org.apache.solr.cloud.UnloadDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:40019: ADDREPLICA failed to create replica

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:40019: ADDREPLICA failed to create replica
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:649)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
        at 
org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
        at 
org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1055)
        at 
org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:830)
        at 
org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:763)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
        at 
org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:120)
        at 
org.apache.solr.cloud.UnloadDistributedZkTest.test(UnloadDistributedZkTest.java:70)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1082)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1054)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.api.collections.HdfsCollectionsAPIDistributedZkTest.testCollectionsAPI

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
        at __randomizedtesting.SeedInfo.seed([715B84D13F108889]:0)


FAILED:  org.apache.solr.schema.TestCloudSchemaless.test

Error Message:
Error from server at http://127.0.0.1:46095/collection1: Async exception during 
distributed update: java.util.concurrent.TimeoutException: idle_timeout

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:46095/collection1: Async exception during 
distributed update: java.util.concurrent.TimeoutException: idle_timeout
        at 
__randomizedtesting.SeedInfo.seed([715B84D13F108889:F90FBB0B91ECE571]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:649)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
        at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:106)
        at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:71)
        at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:85)
        at 
org.apache.solr.schema.TestCloudSchemaless.test(TestCloudSchemaless.java:114)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1082)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1054)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13307 lines...]
   [junit4] Suite: org.apache.solr.uninverting.TestDocTermOrdsUninvertLimit
   [junit4]   2> ??? 25, 2019 2:27:06 PM 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Lucene Merge 
Thread #503,5,TGRP-TestDocTermOrdsUninvertLimit]
   [junit4]   2> org.apache.lucene.index.MergePolicy$MergeException: 
org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: 
this IndexWriter hit an unrecoverable exception
   [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([715B84D13F108889]:0)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:704)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:684)
   [junit4]   2> Caused by: org.apache.lucene.store.AlreadyClosedException: 
refusing to delete any files: this IndexWriter hit an unrecoverable exception
   [junit4]   2>        at 
org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:349)
   [junit4]   2>        at 
org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:669)
   [junit4]   2>        at 
org.apache.lucene.index.IndexFileDeleter.deleteNewFiles(IndexFileDeleter.java:664)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.deleteNewFiles(IndexWriter.java:5030)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4545)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4054)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
   [junit4]   2> Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]   2>        at 
org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:84)
   [junit4]   2>        at 
org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:57)
   [junit4]   2>        at 
org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:168)
   [junit4]   2>        at 
org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:154)
   [junit4]   2>        at 
org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:141)
   [junit4]   2>        at 
org.apache.lucene.store.RateLimitedIndexOutput.writeBytes(RateLimitedIndexOutput.java:73)
   [junit4]   2>        at 
org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
   [junit4]   2>        at 
org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:96)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:5010)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4523)
   [junit4]   2>        ... 3 more
   [junit4]   2> 
   [junit4]   2> ??? 25, 2019 2:27:06 PM 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Lucene Merge 
Thread #466,5,TGRP-TestDocTermOrdsUninvertLimit]
   [junit4]   2> org.apache.lucene.index.MergePolicy$MergeException: 
org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: 
this IndexWriter hit an unrecoverable exception
   [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([715B84D13F108889]:0)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:704)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:684)
   [junit4]   2> Caused by: org.apache.lucene.store.AlreadyClosedException: 
refusing to delete any files: this IndexWriter hit an unrecoverable exception
   [junit4]   2>        at 
org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:349)
   [junit4]   2>        at 
org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:669)
   [junit4]   2>        at 
org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:589)
   [junit4]   2>        at 
org.apache.lucene.index.IndexFileDeleter.checkpoint(IndexFileDeleter.java:531)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.checkpoint(IndexWriter.java:2563)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.publishFlushedSegment(IndexWriter.java:2641)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.lambda$publishFlushedSegments$10(IndexWriter.java:5079)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriterFlushQueue.innerPurge(DocumentsWriterFlushQueue.java:115)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriterFlushQueue.forcePurge(DocumentsWriterFlushQueue.java:136)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriter.purgeFlushTickets(DocumentsWriter.java:199)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.publishFlushedSegments(IndexWriter.java:5059)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.rollbackInternalNoCommit(IndexWriter.java:2292)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2266)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.maybeCloseOnTragicEvent(IndexWriter.java:4907)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.tragicEvent(IndexWriter.java:4897)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4080)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
   [junit4]   2> Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]   2>        at 
org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:84)
   [junit4]   2>        at 
org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:57)
   [junit4]   2>        at 
org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:168)
   [junit4]   2>        at 
org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:154)
   [junit4]   2>        at 
org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:141)
   [junit4]   2>        at 
org.apache.lucene.store.RateLimitedIndexOutput.writeBytes(RateLimitedIndexOutput.java:73)
   [junit4]   2>        at 
org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
   [junit4]   2>        at 
org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:96)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:5010)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4523)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4054)
   [junit4]   2>        ... 2 more
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestDocTermOrdsUninvertLimit -Dtests.method=testTriggerUnInvertLimit 
-Dtests.seed=715B84D13F108889 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/test-data/enwiki.random.lines.txt
 -Dtests.locale=be -Dtests.timezone=Asia/Dhaka -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR    146s J1 | 
TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit <<<
   [junit4]    > Throwable #1: org.apache.lucene.store.AlreadyClosedException: 
this IndexWriter is closed
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.getConfig(IndexWriter.java:1007)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5116)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1597)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1213)
   [junit4]    >        at 
org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:191)
   [junit4]    >        at 
org.apache.solr.uninverting.TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit(TestDocTermOrdsUninvertLimit.java:65)
   [junit4]    >        at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]    >        at 
org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:84)
   [junit4]    >        at 
org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:57)
   [junit4]    >        at 
org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:168)
   [junit4]    >        at 
org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:154)
   [junit4]    >        at 
org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:141)
   [junit4]    >        at 
org.apache.lucene.store.RateLimitedIndexOutput.writeBytes(RateLimitedIndexOutput.java:73)
   [junit4]    >        at 
org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
   [junit4]    >        at 
org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:96)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:5010)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4523)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4054)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)Throwable
 #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
uncaught exception in thread: Thread[id=5539, name=Lucene Merge Thread #503, 
state=RUNNABLE, group=TGRP-TestDocTermOrdsUninvertLimit]
   [junit4]    > Caused by: org.apache.lucene.index.MergePolicy$MergeException: 
org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: 
this IndexWriter hit an unrecoverable exception
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([715B84D13F108889]:0)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:704)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:684)
   [junit4]    > Caused by: org.apache.lucene.store.AlreadyClosedException: 
refusing to delete any files: this IndexWriter hit an unrecoverable exception
   [junit4]    >        at 
org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:349)
   [junit4]    >        at 
org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:669)
   [junit4]    >        at 
org.apache.lucene.index.IndexFileDeleter.deleteNewFiles(IndexFileDeleter.java:664)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.deleteNewFiles(IndexWriter.java:5030)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4545)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4054)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]    >        at 
org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:84)
   [junit4]    >        at 
org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:57)
   [junit4]    >        at 
org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:168)
   [junit4]    >        at 
org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:154)
   [junit4]    >        at 
org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:141)
   [junit4]    >        at 
org.apache.lucene.store.RateLimitedIndexOutput.writeBytes(RateLimitedIndexOutput.java:73)
   [junit4]    >        at 
org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
   [junit4]    >        at 
org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:96)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:5010)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4523)
   [junit4]    >        ... 3 moreThrowable #3: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=5502, name=Lucene Merge Thread #466, 
state=RUNNABLE, group=TGRP-TestDocTermOrdsUninvertLimit]
   [junit4]    > Caused by: org.apache.lucene.index.MergePolicy$MergeException: 
org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: 
this IndexWriter hit an unrecoverable exception
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([715B84D13F108889]:0)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:704)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:684)
   [junit4]    > Caused by: org.apache.lucene.store.AlreadyClosedException: 
refusing to delete any files: this IndexWriter hit an unrecoverable exception
   [junit4]    >        at 
org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:349)
   [junit4]    >        at 
org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:669)
   [junit4]    >        at 
org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:589)
   [junit4]    >        at 
org.apache.lucene.index.IndexFileDeleter.checkpoint(IndexFileDeleter.java:531)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.checkpoint(IndexWriter.java:2563)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.publishFlushedSegment(IndexWriter.java:2641)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.lambda$publishFlushedSegments$10(IndexWriter.java:5079)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriterFlushQueue.innerPurge(DocumentsWriterFlushQueue.java:115)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriterFlushQueue.forcePurge(DocumentsWriterFlushQueue.java:136)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriter.purgeFlushTickets(DocumentsWriter.java:199)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.publishFlushedSegments(IndexWriter.java:5059)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.rollbackInternalNoCommit(IndexWriter.java:2292)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2266)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.maybeCloseOnTragicEvent(IndexWriter.java:4907)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.tragicEvent(IndexWriter.java:4897)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4080)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]    >        at 
org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:84)
   [junit4]    >        at 
org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:57)
   [junit4]    >        at 
org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:168)
   [junit4]    >        at 
org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:154)
   [junit4]    >        at 
org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:141)
   [junit4]    >        at 
org.apache.lucene.store.RateLimitedIndexOutput.writeBytes(RateLimitedIndexOutput.java:73)
   [junit4]    >        at 
org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
   [junit4]    >        at 
org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:96)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:5010)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4523)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4054)
   [junit4]    >        ... 2 more
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): 
{field=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))},
 docValues:{}, maxPointsInLeafNode=1751, maxMBSortInHeap=5.488058123900393, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@90e9db4),
 locale=be, timezone=Asia/Dhaka
   [junit4]   2> NOTE: Linux 4.4.0-137-generic amd64/Oracle Corporation 
1.8.0_191 (64-bit)/cpus=4,threads=1,free=95889880,total=477626368
   [junit4]   2> NOTE: All tests run in this JVM: 
[TestMultiValuedNumericRangeQuery, 
PeerSyncWithLeaderAndIndexFingerprintCachingTest, CSVRequestHandlerTest, 
TestOnReconnectListenerSupport, BasicFunctionalityTest, StatsComponentTest, 
ReturnFieldsTest, TestStressLucene, RequestLoggingTest, CollectionReloadTest, 
TestCloudPhrasesIdentificationComponent, TestSkipOverseerOperations, 
CursorMarkTest, LeaderVoteWaitTimeoutTest, DeleteShardTest, TestNumericTerms64, 
ZkStateReaderTest, BaseCdcrDistributedZkTest, TestJsonFacetsWithNestedObjects, 
TestBinaryResponseWriter, ChaosMonkeyNothingIsSafeTest, 
TestDocTermOrdsUninvertLimit]
   [junit4] Completed [72/845 (1!)] on J1 in 145.82s, 1 test, 1 error <<< 
FAILURES!

[...truncated 729 lines...]
   [junit4] Suite: org.apache.solr.schema.TestCloudSchemaless
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/init-core-data-001
   [junit4]   2> 1102594 INFO  
(SUITE-TestCloudSchemaless-seed#[715B84D13F108889]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1102596 INFO  
(SUITE-TestCloudSchemaless-seed#[715B84D13F108889]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 1102596 INFO  
(SUITE-TestCloudSchemaless-seed#[715B84D13F108889]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1102596 INFO  
(SUITE-TestCloudSchemaless-seed#[715B84D13F108889]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1102611 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1102616 INFO  (ZkTestServer Run Thread) [    ] 
o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1102616 INFO  (ZkTestServer Run Thread) [    ] 
o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1102715 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:38463
   [junit4]   2> 1102716 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:38463
   [junit4]   2> 1102716 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1 38463
   [junit4]   2> 1102720 INFO  (zkConnectionManagerCallback-64553-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1102723 INFO  (zkConnectionManagerCallback-64555-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1102725 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-schemaless.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 1102726 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema-add-schema-fields-update-processor.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 1102727 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1102728 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 1102729 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 1102730 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 1102731 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1102733 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1102734 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1102735 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1102736 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkTestServer put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 1102737 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly 
asked otherwise
   [junit4]   2> 1102924 WARN  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 1102925 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 1102925 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 1102925 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] o.e.j.s.Server 
jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_191-b12
   [junit4]   2> 1102928 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] o.e.j.s.session 
DefaultSessionIdManager workerName=node0
   [junit4]   2> 1102928 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] o.e.j.s.session 
No SessionScavenger set, using defaults
   [junit4]   2> 1102928 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] o.e.j.s.session 
node0 Scavenging every 660000ms
   [junit4]   2> 1102929 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@4b0ad9d8{/,null,AVAILABLE}
   [junit4]   2> 1102933 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@244afed1{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:38434}
   [junit4]   2> 1102933 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] o.e.j.s.Server 
Started @1103049ms
   [junit4]   2> 1102934 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/tempDir-001/control/data,
 replicaType=NRT, hostContext=/, hostPort=38434, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/control-001/cores}
   [junit4]   2> 1102934 ERROR 
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1102934 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1102934 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.1.0
   [junit4]   2> 1102934 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1102934 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1102935 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-03-25T08:37:32.711Z
   [junit4]   2> 1102944 INFO  (zkConnectionManagerCallback-64557-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1102946 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1102946 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/control-001/solr.xml
   [junit4]   2> 1102951 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay 
is ignored
   [junit4]   2> 1102951 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter 
autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1102953 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@3f5ce44e, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1103062 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 1103068 WARN  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@4890c1d1[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1103073 WARN  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@ea99ba8[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1103074 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38463/solr
   [junit4]   2> 1103076 INFO  (zkConnectionManagerCallback-64564-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1103078 INFO  (zkConnectionManagerCallback-64566-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1103190 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [n:127.0.0.1:38434_    
] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38434_
   [junit4]   2> 1103191 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [n:127.0.0.1:38434_    
] o.a.s.c.Overseer Overseer 
(id=73016897395359748-127.0.0.1:38434_-n_0000000000) starting
   [junit4]   2> 1103210 INFO  (zkConnectionManagerCallback-64573-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1103217 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [n:127.0.0.1:38434_    
] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38463/solr ready
   [junit4]   2> 1103236 INFO  
(OverseerStateUpdate-73016897395359748-127.0.0.1:38434_-n_0000000000) 
[n:127.0.0.1:38434_    ] o.a.s.c.Overseer Starting to work on the main queue : 
127.0.0.1:38434_
   [junit4]   2> 1103247 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [n:127.0.0.1:38434_    
] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:38434_
   [junit4]   2> 1103260 INFO  (zkCallback-64572-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1103267 INFO  (zkCallback-64565-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1103328 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [n:127.0.0.1:38434_    
] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics 
history in memory.
   [junit4]   2> 1103374 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [n:127.0.0.1:38434_    
] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 
'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f5ce44e
   [junit4]   2> 1103401 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [n:127.0.0.1:38434_    
] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f5ce44e
   [junit4]   2> 1103402 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [n:127.0.0.1:38434_    
] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f5ce44e
   [junit4]   2> 1103415 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [n:127.0.0.1:38434_    
] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/control-001/cores
   [junit4]   2> 1103500 INFO  (zkConnectionManagerCallback-64579-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1103508 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1103509 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38463/solr ready
   [junit4]   2> 1103512 INFO  (qtp65666522-122813) [n:127.0.0.1:38434_    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:38434_&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1103515 INFO  
(OverseerThreadFactory-8435-thread-1-processing-n:127.0.0.1:38434_) 
[n:127.0.0.1:38434_    ] o.a.s.c.a.c.CreateCollectionCmd Create collection 
control_collection
   [junit4]   2> 1103640 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_    
x:control_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1103640 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_    
x:control_collection_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault 
Allocating transient cache for 4 transient cores
   [junit4]   2> 1104669 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.1.0
   [junit4]   2> 1104695 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but 
managed schema resource managed-schema not found - loading non-managed schema 
schema.xml instead
   [junit4]   2> 1104698 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema 
name=add-schema-fields-update-processor
   [junit4]   2> 1104708 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.IndexSchema Loaded schema add-schema-fields-update-processor/1.6 with 
uniqueid field id
   [junit4]   2> 1104710 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at 
/configs/conf1/managed-schema
   [junit4]   2> 1104712 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in 
ZooKeeper, renamed the non-managed schema /configs/conf1/schema.xml to 
/configs/conf1/schema.xml.bak
   [junit4]   2> 1104712 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' 
using configuration from collection control_collection, trusted=true
   [junit4]   2> 1104713 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.control_collection.shard1.replica_n1' (registry 
'solr.core.control_collection.shard1.replica_n1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@3f5ce44e
   [junit4]   2> 1104713 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore 
at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/control-001/cores/control_collection_shard1_replica_n1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 1104717 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=19, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=30.052734375, 
floorSegmentMB=1.2958984375, forceMergeDeletesPctAllowed=13.785234636560128, 
segmentsPerTier=38.0, maxCFSSegmentSizeMB=1.0869140625, 
noCFSRatio=0.6064694932786028, deletesPctAllowed=23.797887148532332
   [junit4]   2> 1104797 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1104797 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1104800 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1104800 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1104801 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.MockRandomMergePolicy: 
org.apache.lucene.index.MockRandomMergePolicy@aaa74ba
   [junit4]   2> 1104802 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@5c96d9a6[control_collection_shard1_replica_n1] main]
   [junit4]   2> 1104803 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1104804 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1104804 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at 
/configs/conf1/managed-schema
   [junit4]   2> 1104804 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1104805 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1104805 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1628966018960326656
   [junit4]   2> 1104808 INFO  
(searcherExecutor-8440-thread-1-processing-n:127.0.0.1:38434_ 
x:control_collection_shard1_replica_n1 c:control_collection s:shard1) 
[n:127.0.0.1:38434_ c:control_collection s:shard1  
x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore 
[control_collection_shard1_replica_n1] Registered new searcher 
Searcher@5c96d9a6[control_collection_shard1_replica_n1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1104812 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ZkShardTerms Successful update of terms at 
/collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, 
version=0}
   [junit4]   2> 1104812 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContextBase make sure parent is created 
/collections/control_collection/leaders/shard1
   [junit4]   2> 1104815 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1104815 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1104815 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:38434/control_collection_shard1_replica_n1/
   [junit4]   2> 1104816 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1104816 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SyncStrategy 
http://127.0.0.1:38434/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 1104816 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node 
/collections/control_collection/leaders/shard1/leader after winning as 
/collections/control_collection/leader_elect/shard1/election/73016897395359748-core_node2-n_0000000000
   [junit4]   2> 1104818 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:38434/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 1104920 INFO  (zkCallback-64565-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/control_collection/state.json] for collection 
[control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1104920 INFO  (zkCallback-64565-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/control_collection/state.json] for collection 
[control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1104921 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1104924 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_ 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=1284
   [junit4]   2> 1104928 INFO  (qtp65666522-122813) [n:127.0.0.1:38434_    ] 
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
45 seconds. Check all shard replicas
   [junit4]   2> 1105024 INFO  (zkCallback-64565-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/control_collection/state.json] for collection 
[control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1105024 INFO  (zkCallback-64565-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/control_collection/state.json] for collection 
[control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1105025 INFO  (qtp65666522-122813) [n:127.0.0.1:38434_    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:38434_&wt=javabin&version=2}
 status=0 QTime=1513
   [junit4]   2> 1105025 INFO  (zkCallback-64565-thread-3) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/control_collection/state.json] for collection 
[control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1105029 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x103687b37da0006, likely client has closed socket
   [junit4]   2> 1105032 INFO  (zkConnectionManagerCallback-64585-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1105033 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1105036 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38463/solr ready
   [junit4]   2> 1105036 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection 
loss:false
   [junit4]   2> 1105037 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=4&createNodeSet=&stateFormat=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1105041 INFO  
(OverseerThreadFactory-8435-thread-2-processing-n:127.0.0.1:38434_) 
[n:127.0.0.1:38434_    ] o.a.s.c.a.c.CreateCollectionCmd Create collection 
collection1
   [junit4]   2> 1105041 INFO  
(OverseerCollectionConfigSetProcessor-73016897395359748-127.0.0.1:38434_-n_0000000000)
 [n:127.0.0.1:38434_    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 1105247 WARN  
(OverseerThreadFactory-8435-thread-2-processing-n:127.0.0.1:38434_) 
[n:127.0.0.1:38434_    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to 
create a collection (collection1) without cores.
   [junit4]   2> 1105249 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_    ] 
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
45 seconds. Check all shard replicas
   [junit4]   2> 1105249 INFO  (qtp65666522-122812) [n:127.0.0.1:38434_    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=4&createNodeSet=&stateFormat=2&wt=javabin&version=2}
 status=0 QTime=212
   [junit4]   2> 1105250 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances 
pullReplicaCount=0 numOtherReplicas=8
   [junit4]   2> 1105482 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/shard-1-001
 of type NRT
   [junit4]   2> 1105492 WARN  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 1105492 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 1105492 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 1105492 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_191-b12
   [junit4]   2> 1105606 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1105606 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1105606 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1105627 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@45e597a{/,null,AVAILABLE}
   [junit4]   2> 1105628 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@271999e1{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:45967}
   [junit4]   2> 1105628 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.Server Started @1105743ms
   [junit4]   2> 1105628 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/tempDir-001/jetty1,
 replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=45967, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/shard-1-001/cores}
   [junit4]   2> 1105628 ERROR (closeThreadPool-64586-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1105628 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1105628 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.1.0
   [junit4]   2> 1105628 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1105628 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1105628 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-03-25T08:37:35.404Z
   [junit4]   2> 1105664 INFO  (zkConnectionManagerCallback-64588-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1105675 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1105675 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/shard-1-001/solr.xml
   [junit4]   2> 1105680 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay 
is ignored
   [junit4]   2> 1105680 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter 
autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1105681 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@3f5ce44e, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1105700 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/shard-2-001
 of type NRT
   [junit4]   2> 1105724 WARN  (closeThreadPool-64586-thread-2) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 1105725 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 1105725 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 1105725 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_191-b12
   [junit4]   2> 1105736 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1105736 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1105736 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1105737 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@796a8dc4{/,null,AVAILABLE}
   [junit4]   2> 1105744 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@696e1723{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:44691}
   [junit4]   2> 1105744 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.e.j.s.Server Started @1105859ms
   [junit4]   2> 1105744 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/tempDir-001/jetty2,
 replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=44691, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/shard-2-001/cores}
   [junit4]   2> 1105744 ERROR (closeThreadPool-64586-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1105744 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1105744 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.1.0
   [junit4]   2> 1105745 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1105745 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1105745 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-03-25T08:37:35.521Z
   [junit4]   2> 1105791 INFO  (zkConnectionManagerCallback-64591-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1105792 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1105793 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/shard-2-001/solr.xml
   [junit4]   2> 1105797 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay 
is ignored
   [junit4]   2> 1105797 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter 
autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1105799 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@3f5ce44e, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1105983 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 1105984 WARN  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@4189403b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1105989 WARN  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@b3ea52f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1105990 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38463/solr
   [junit4]   2> 1106003 INFO  (zkConnectionManagerCallback-64598-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1106063 INFO  (zkConnectionManagerCallback-64600-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1106069 INFO  (closeThreadPool-64586-thread-1) 
[n:127.0.0.1:45967_    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1106073 INFO  (closeThreadPool-64586-thread-1) 
[n:127.0.0.1:45967_    ] o.a.s.c.ZkController Publish node=127.0.0.1:45967_ as 
DOWN
   [junit4]   2> 1106074 INFO  (closeThreadPool-64586-thread-1) 
[n:127.0.0.1:45967_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 4 transient cores
   [junit4]   2> 1106074 INFO  (closeThreadPool-64586-thread-1) 
[n:127.0.0.1:45967_    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45967_
   [junit4]   2> 1106075 INFO  (zkCallback-64572-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1106075 INFO  (zkCallback-64565-thread-3) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1106089 INFO  (zkCallback-64584-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1106102 INFO  (zkCallback-64599-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1106104 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/shard-3-001
 of type NRT
   [junit4]   2> 1106116 WARN  (closeThreadPool-64586-thread-3) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 1106117 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 1106117 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 1106117 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_191-b12
   [junit4]   2> 1106127 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1106127 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1106127 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1106136 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@29e2bb6c{/,null,AVAILABLE}
   [junit4]   2> 1106140 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@43aac029{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:36918}
   [junit4]   2> 1106140 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.e.j.s.Server Started @1106255ms
   [junit4]   2> 1106140 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/tempDir-001/jetty3,
 replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=36918, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/shard-3-001/cores}
   [junit4]   2> 1106140 ERROR (closeThreadPool-64586-thread-3) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1106140 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1106140 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.1.0
   [junit4]   2> 1106140 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1106140 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1106140 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-03-25T08:37:35.916Z
   [junit4]   2> 1106141 INFO  (zkConnectionManagerCallback-64607-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1106143 INFO  (closeThreadPool-64586-thread-1) 
[n:127.0.0.1:45967_    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 1106144 INFO  (closeThreadPool-64586-thread-1) 
[n:127.0.0.1:45967_    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
127.0.0.1:38463/solr ready
   [junit4]   2> 1106156 INFO  (closeThreadPool-64586-thread-1) 
[n:127.0.0.1:45967_    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, 
keeping metrics history in memory.
   [junit4]   2> 1106171 INFO  (zkConnectionManagerCallback-64609-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1106173 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1106173 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/shard-3-001/solr.xml
   [junit4]   2> 1106178 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay 
is ignored
   [junit4]   2> 1106178 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter 
autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1106180 INFO  (closeThreadPool-64586-thread-3) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@3f5ce44e, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1106217 INFO  (closeThreadPool-64586-thread-1) 
[n:127.0.0.1:45967_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@3f5ce44e
   [junit4]   2> 1106259 INFO  (closeThreadPool-64586-thread-1) 
[n:127.0.0.1:45967_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@3f5ce44e
   [junit4]   2> 1106272 INFO  (closeThreadPool-64586-thread-1) 
[n:127.0.0.1:45967_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@3f5ce44e
   [junit4]   2> 1106273 INFO  (closeThreadPool-64586-thread-1) 
[n:127.0.0.1:45967_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions 
underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/shard-1-001/cores
   [junit4]   2> 1106317 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 1106328 WARN  (closeThreadPool-64586-thread-2) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@4de412ad[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1106370 WARN  (closeThreadPool-64586-thread-2) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@287dd5d7[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1106371 INFO  (closeThreadPool-64586-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38463/solr
   [junit4]   2> 1106390 INFO  
(TEST-TestCloudSchemaless.test-seed#[715B84D13F108889]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/shard-4-001
 of type NRT
   [junit4]   2> 1106391 WARN  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 1106391 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 1106391 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 1106391 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_191-b12
   [junit4]   2> 1106410 INFO  (zkConnectionManagerCallback-64617-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1106423 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1106423 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1106423 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1106444 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@7bb32b11{/,null,AVAILABLE}
   [junit4]   2> 1106444 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@ba146d0{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:46095}
   [junit4]   2> 1106444 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.e.j.s.Server Started @1106560ms
   [junit4]   2> 1106444 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/tempDir-001/jetty4,
 solrconfig=solrconfig.xml, hostContext=/, hostPort=46095, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/shard-4-001/cores}
   [junit4]   2> 1106445 ERROR (closeThreadPool-64586-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1106445 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1106445 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.1.0
   [junit4]   2> 1106445 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1106445 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1106445 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-03-25T08:37:36.221Z
   [junit4]   2> 1106469 INFO  (zkConnectionManagerCallback-64619-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1106473 INFO  (closeThreadPool-64586-thread-2) 
[n:127.0.0.1:44691_    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 1106474 INFO  (zkConnectionManagerCallback-64621-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1106475 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1106475 INFO  (closeThreadPool-64586-thread-1) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J1/temp/solr.schema.TestCloudSchemaless_715B84D13F108889-001/shard-4-001/solr.xml
   [junit4]   2> 1106477 INFO  (closeThreadPool-64586-thread-2) [n:127.0.0.1:

[...truncated too long message...]

)
   [junit4]   2>         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   [junit4]   2>         at 
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   [junit4]   2>         at 
org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:288)
   [junit4]   2>         at 
org.apache.hadoop.ipc.Server$Handler.run(Server.java:2668)
   [junit4]   2>   71) Thread[id=150051, name=Socket Reader #1 for port 44529, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
   [junit4]   2>         at java.util.HashMap$KeySet.iterator(HashMap.java:917)
   [junit4]   2>         at java.util.HashSet.iterator(HashSet.java:173)
   [junit4]   2>         at sun.nio.ch.Util$3.iterator(Util.java:324)
   [junit4]   2>         at 
org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:1099)
   [junit4]   2>         at 
org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1076)
   [junit4]   2>   72) Thread[id=150137, name=IPC Server handler 9 on 34596, 
state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   [junit4]   2>         at 
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
   [junit4]   2>         at 
org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:288)
   [junit4]   2>         at 
org.apache.hadoop.ipc.Server$Handler.run(Server.java:2668)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): 
{_root_=PostingsFormat(name=Asserting), id=FSTOrd50}, docValues:{}, 
maxPointsInLeafNode=1669, maxMBSortInHeap=6.686131306442266, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@7fc57a8d),
 locale=zh, timezone=Africa/Cairo
   [junit4]   2> NOTE: Linux 4.4.0-137-generic amd64/Oracle Corporation 
1.8.0_191 (64-bit)/cpus=4,threads=85,free=61957792,total=477626368
   [junit4]   2> NOTE: All tests run in this JVM: 
[TestMultiValuedNumericRangeQuery, 
PeerSyncWithLeaderAndIndexFingerprintCachingTest, CSVRequestHandlerTest, 
TestOnReconnectListenerSupport, BasicFunctionalityTest, StatsComponentTest, 
ReturnFieldsTest, TestStressLucene, RequestLoggingTest, CollectionReloadTest, 
TestCloudPhrasesIdentificationComponent, TestSkipOverseerOperations, 
CursorMarkTest, LeaderVoteWaitTimeoutTest, DeleteShardTest, TestNumericTerms64, 
ZkStateReaderTest, BaseCdcrDistributedZkTest, TestJsonFacetsWithNestedObjects, 
TestBinaryResponseWriter, ChaosMonkeyNothingIsSafeTest, 
TestDocTermOrdsUninvertLimit, PreAnalyzedFieldManagedSchemaCloudTest, 
SpatialFilterTest, TestEmbeddedSolrServerConstructors, HttpTriggerListenerTest, 
TestRawTransformer, AnalysisErrorHandlingTest, TestFieldCacheWithThreads, 
BitVectorTest, MoveReplicaHDFSTest, DisMaxRequestHandlerTest, 
CoreAdminCreateDiscoverTest, DistributedVersionInfoTest, 
CdcrVersionReplicationTest, TriggerEventQueueTest, 
DistributedFacetPivotLongTailTest, TestStressLiveNodes, TestStressUserVersions, 
TestGraphTermsQParserPlugin, DirectoryFactoryTest, TestConfigSetsAPIZkFailure, 
DistributedFacetPivotWhiteBoxTest, TestNonDefinedSimilarityFactory, 
ClassificationUpdateProcessorTest, DirectSolrConnectionTest, 
TestSolrCloudWithSecureImpersonation, OverseerTest, V2ApiIntegrationTest, 
SystemLogListenerTest, TestSimNodeLostTrigger, ScheduledTriggerTest, 
ZkControllerTest, DistributedSuggestComponentTest, ResponseHeaderTest, 
TestMissingGroups, SolrMetricReporterTest, TestCursorMarkWithoutUniqueKey, 
TestReRankQParserPlugin, ForceLeaderWithTlogReplicasTest, 
TestOverriddenPrefixQueryForCustomFieldType, SuggesterWFSTTest, 
SaslZkACLProviderTest, StatelessScriptUpdateProcessorFactoryTest, 
TestComplexPhraseLeadingWildcard, FileUtilsTest, CreateCollectionCleanupTest, 
TestSegmentSorting, EnumFieldTest, TestFastOutputStream, 
TestSimGenericDistributedQueue, TestFieldCacheSort, TestCloudSchemaless, 
UnloadDistributedZkTest, TestZkChroot, StatsReloadRaceTest, UpdateLogTest, 
ZookeeperStatusHandlerTest, TestRandomFaceting, DirectUpdateHandlerTest, 
SpatialHeatmapFacetsTest, TestBlobHandler, TestScoreJoinQPScore, 
TestClusterProperties, TestRebalanceLeaders, 
HdfsWriteToMultipleCollectionsTest, BasicDistributedZk2Test, 
TestExtendedDismaxParser, PeerSyncTest, RequestHandlersTest, 
ShardsWhitelistTest, TestXmlQParserPlugin, TestCoreBackup, TestCloudRecovery, 
AddSchemaFieldsUpdateProcessorFactoryTest, TestRecoveryHdfs, TestRestoreCore, 
TestSweetSpotSimilarityFactory, TestBinaryField, SpellCheckCollatorTest, 
TestDFISimilarityFactory, MultiThreadedOCPTest, ZkShardTermsTest, 
PluginInfoTest, MetricsConfigTest, TestSystemIdResolver, 
LeaderElectionContextKeyTest, BlobRepositoryCloudTest, 
TestSimClusterStateProvider, HighlighterMaxOffsetTest, 
TestBlendedInfixSuggestions, TestFilteredDocIdSet, 
DistributedQueryComponentOptimizationTest, TestSearchPerf, TimeZoneUtilsTest, 
ReplicaListTransformerTest, AnalyticsMergeStrategyTest, 
HdfsChaosMonkeySafeLeaderTest, TestInPlaceUpdatesRequiredField, 
TestManagedSchemaThreadSafety, TestTrieFacet, TestCustomSort, TestSmileRequest, 
InfixSuggestersTest, TestSolrQueryParser, HLLSerializationTest, 
TestLocalFSCloudBackupRestore, OverriddenZkACLAndCredentialsProvidersTest, 
TestCloudNestedDocsSort, TestSolrCloudWithHadoopAuthPlugin, 
TestInfoStreamLogging, MetricsHandlerTest, TestShardHandlerFactory, 
TestInitQParser, TestSolrCoreParser, CollectionsAPIDistributedZkTest, 
TestLeaderElectionZkExpiry, SharedFSAutoReplicaFailoverTest, 
RestartWhileUpdatingTest, DeleteLastCustomShardedReplicaTest, DeleteStatusTest, 
DistribCursorPagingTest, FullSolrCloudDistribCmdsTest, HealthCheckHandlerTest, 
HttpPartitionTest, ShardRoutingCustomTest, SolrCLIZkUtilsTest, 
SolrCloudExampleTest, TestAuthenticationFramework, TestCloudConsistency, 
TestCryptoKeys, TestPullReplica, TestPullReplicaErrorHandling, 
TestTolerantUpdateProcessorCloud, TestUtilizeNode, ZkFailoverTest, 
ZkSolrClientTest, CollectionTooManyReplicasTest, CustomCollectionTest, 
HdfsCollectionsAPIDistributedZkTest]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=HdfsCollectionsAPIDistributedZkTest -Dtests.seed=715B84D13F108889 
-Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/test-data/enwiki.random.lines.txt
 -Dtests.locale=zh -Dtests.timezone=Africa/Cairo -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | HdfsCollectionsAPIDistributedZkTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 
3600000 msec).
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([715B84D13F108889]:0)Throwable #2: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=153908, name=HttpClient@25b0a438-scheduler, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: GC overhead limit 
exceededThrowable #3: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=153630, name=zkCallback-74228-thread-1, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: GC overhead limit 
exceededThrowable #4: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=150828, name=IPC Parameter Sending Thread #9, 
state=RUNNABLE, group=TGRP-MoveReplicaHDFSTest]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: GC overhead limit 
exceededThrowable #5: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=150012, name=IPC Server handler 9 on 41647, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: GC overhead limit 
exceededThrowable #6: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=150062, name=IPC Server handler 5 on 44529, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: GC overhead limit 
exceeded
   [junit4] Completed [845/845 (4!)] on J1 in 3617.53s, 15 tests, 7 errors <<< 
FAILURES!

[...truncated 1 lines...]
   [junit4] JVM J1: stdout was not empty, see: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/temp/junit4-J1-20190325_081909_5606224702928459879406.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/heapdumps/java_pid3157.hprof
 ...
   [junit4] Heap dump file created [444986427 bytes in 1.468 secs]
   [junit4] <<< JVM J1: EOF ----

[...truncated 8968 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/build.xml:651:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/build.xml:585:
 Some of the tests produced a heap dump, but did not fail. Maybe a suppressed 
OutOfMemoryError? Dumps created:
* java_pid3157.hprof

Total time: 308 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to