Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1247/

5 tests failed.
FAILED:  org.apache.lucene.index.TestDuelingCodecsAtNight.testBigEquals

Error Message:
GC overhead limit exceeded

Stack Trace:
java.lang.OutOfMemoryError: GC overhead limit exceeded
        at org.apache.lucene.util.BytesRef.<init>(BytesRef.java:76)
        at 
org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutputs.java:129)
        at 
org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutputs.java:35)
        at org.apache.lucene.util.fst.FST.readNextRealArc(FST.java:979)
        at org.apache.lucene.util.fst.NodeHash.hash(NodeHash.java:111)
        at org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:128)
        at org.apache.lucene.util.fst.Builder.compileNode(Builder.java:200)
        at org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:296)
        at org.apache.lucene.util.fst.Builder.add(Builder.java:400)
        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finishTerm(MemoryPostingsFormat.java:245)
        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.access$300(MemoryPostingsFormat.java:104)
        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$MemoryFieldsConsumer.write(MemoryPostingsFormat.java:386)
        at 
org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.write(PerFieldPostingsFormat.java:140)
        at 
org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:109)
        at 
org.apache.lucene.index.DefaultIndexingChain.flush(DefaultIndexingChain.java:163)
        at 
org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:444)
        at 
org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:539)
        at 
org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.java:396)
        at 
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:499)
        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1324)
        at 
org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:171)
        at 
org.apache.lucene.index.TestDuelingCodecs.createRandomIndex(TestDuelingCodecs.java:139)
        at 
org.apache.lucene.index.TestDuelingCodecsAtNight.testBigEquals(TestDuelingCodecsAtNight.java:34)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)


FAILED:  org.apache.lucene.search.TestFuzzyQuery.testRandom

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
        at __randomizedtesting.SeedInfo.seed([2279865B45AB59A9]:0)


FAILED:  junit.framework.TestSuite.org.apache.lucene.search.TestFuzzyQuery

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([2279865B45AB59A9]:0)


FAILED:  org.apache.solr.cloud.MissingSegmentRecoveryTest.testLeaderRecovery

Error Message:
Expected a collection with one shard and two replicas null Last available 
state: 
DocCollection(MissingSegmentRecoveryTest//collections/MissingSegmentRecoveryTest/state.json/7)={
   "replicationFactor":"2",   "shards":{"shard1":{       
"range":"80000000-7fffffff",       "state":"active",       "replicas":{         
"core_node1":{           "core":"MissingSegmentRecoveryTest_shard1_replica2",   
        "base_url":"http://127.0.0.1:53224/solr";,           
"node_name":"127.0.0.1:53224_solr",           "state":"active",           
"leader":"true"},         "core_node2":{           
"core":"MissingSegmentRecoveryTest_shard1_replica1",           
"base_url":"http://127.0.0.1:44586/solr";,           
"node_name":"127.0.0.1:44586_solr",           "state":"down"}}}},   
"router":{"name":"compositeId"},   "maxShardsPerNode":"1",   
"autoAddReplicas":"false"}

Stack Trace:
java.lang.AssertionError: Expected a collection with one shard and two replicas
null
Last available state: 
DocCollection(MissingSegmentRecoveryTest//collections/MissingSegmentRecoveryTest/state.json/7)={
  "replicationFactor":"2",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node1":{
          "core":"MissingSegmentRecoveryTest_shard1_replica2",
          "base_url":"http://127.0.0.1:53224/solr";,
          "node_name":"127.0.0.1:53224_solr",
          "state":"active",
          "leader":"true"},
        "core_node2":{
          "core":"MissingSegmentRecoveryTest_shard1_replica1",
          "base_url":"http://127.0.0.1:44586/solr";,
          "node_name":"127.0.0.1:44586_solr",
          "state":"down"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"1",
  "autoAddReplicas":"false"}
        at 
__randomizedtesting.SeedInfo.seed([24476FD2E1B70732:7412F7D1B896B12F]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:265)
        at 
org.apache.solr.cloud.MissingSegmentRecoveryTest.testLeaderRecovery(MissingSegmentRecoveryTest.java:105)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:58627/ies: Error CREATEing SolrCore 
'test_unload_shard_and_collection_1': Unable to create core 
[test_unload_shard_and_collection_1] Caused by: Direct buffer memory

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:58627/ies: Error CREATEing SolrCore 
'test_unload_shard_and_collection_1': Unable to create core 
[test_unload_shard_and_collection_1] Caused by: Direct buffer memory
        at 
__randomizedtesting.SeedInfo.seed([24476FD2E1B70732:AC1350084F4B6ACA]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:627)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:125)
        at 
org.apache.solr.cloud.UnloadDistributedZkTest.test(UnloadDistributedZkTest.java:70)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 736 lines...]
   [junit4] Suite: org.apache.lucene.index.TestDuelingCodecsAtNight
   [junit4]   2> Shk 25, 2017 1:28:47 MD 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Lucene Merge 
Thread #30,5,TGRP-TestDuelingCodecsAtNight]
   [junit4]   2> org.apache.lucene.index.MergePolicy$MergeException: 
java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([2279865B45AB59A9]:0)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
   [junit4]   2> Caused by: java.lang.OutOfMemoryError: GC overhead limit 
exceeded
   [junit4]   2>        at 
org.apache.lucene.util.fst.PairOutputs.newPair(PairOutputs.java:90)
   [junit4]   2>        at 
org.apache.lucene.util.fst.PairOutputs.add(PairOutputs.java:140)
   [junit4]   2>        at 
org.apache.lucene.util.fst.PairOutputs.add(PairOutputs.java:32)
   [junit4]   2>        at 
org.apache.lucene.util.fst.FSTEnum.pushFirst(FSTEnum.java:488)
   [junit4]   2>        at 
org.apache.lucene.util.fst.FSTEnum.doNext(FSTEnum.java:111)
   [junit4]   2>        at 
org.apache.lucene.util.fst.BytesRefFSTEnum.next(BytesRefFSTEnum.java:57)
   [junit4]   2>        at 
org.apache.lucene.codecs.simpletext.SimpleTextFieldsReader$SimpleTextTermsEnum.next(SimpleTextFieldsReader.java:170)
   [junit4]   2>        at 
org.apache.lucene.index.MultiTermsEnum.pushTop(MultiTermsEnum.java:275)
   [junit4]   2>        at 
org.apache.lucene.index.MultiTermsEnum.next(MultiTermsEnum.java:301)
   [junit4]   2>        at 
org.apache.lucene.index.FilterLeafReader$FilterTermsEnum.next(FilterLeafReader.java:196)
   [junit4]   2>        at 
org.apache.lucene.codecs.simpletext.SimpleTextFieldsWriter.write(SimpleTextFieldsWriter.java:101)
   [junit4]   2>        at 
org.apache.lucene.codecs.simpletext.SimpleTextFieldsWriter.write(SimpleTextFieldsWriter.java:60)
   [junit4]   2>        at 
org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
   [junit4]   2>        at 
org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:216)
   [junit4]   2>        at 
org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:101)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4338)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3915)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
   [junit4]   2> 
   [junit4]   2> Shk 25, 2017 1:28:47 MD 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Lucene Merge 
Thread #4,5,TGRP-TestDuelingCodecsAtNight]
   [junit4]   2> org.apache.lucene.index.MergePolicy$MergeException: 
java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([2279865B45AB59A9]:0)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
   [junit4]   2> Caused by: java.lang.OutOfMemoryError: GC overhead limit 
exceeded
   [junit4]   2>        at 
org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutputs.java:129)
   [junit4]   2>        at 
org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutputs.java:35)
   [junit4]   2>        at 
org.apache.lucene.util.fst.FST.readNextRealArc(FST.java:979)
   [junit4]   2>        at 
org.apache.lucene.util.fst.NodeHash.hash(NodeHash.java:111)
   [junit4]   2>        at 
org.apache.lucene.util.fst.NodeHash.addNew(NodeHash.java:148)
   [junit4]   2>        at 
org.apache.lucene.util.fst.NodeHash.rehash(NodeHash.java:169)
   [junit4]   2>        at 
org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:133)
   [junit4]   2>        at 
org.apache.lucene.util.fst.Builder.compileNode(Builder.java:200)
   [junit4]   2>        at 
org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:296)
   [junit4]   2>        at 
org.apache.lucene.util.fst.Builder.add(Builder.java:400)
   [junit4]   2>        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finishTerm(MemoryPostingsFormat.java:245)
   [junit4]   2>        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.access$300(MemoryPostingsFormat.java:104)
   [junit4]   2>        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$MemoryFieldsConsumer.write(MemoryPostingsFormat.java:386)
   [junit4]   2>        at 
org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
   [junit4]   2>        at 
org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:164)
   [junit4]   2>        at 
org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:216)
   [junit4]   2>        at 
org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:101)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4338)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3915)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
   [junit4]   2> 
   [junit4]   2> Shk 25, 2017 1:28:47 MD 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Lucene Merge 
Thread #2,5,TGRP-TestDuelingCodecsAtNight]
   [junit4]   2> org.apache.lucene.index.MergePolicy$MergeException: 
java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([2279865B45AB59A9]:0)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
   [junit4]   2> Caused by: java.lang.OutOfMemoryError: GC overhead limit 
exceeded
   [junit4]   2>        at 
org.apache.lucene.util.fst.BytesStore.skipBytes(BytesStore.java:307)
   [junit4]   2>        at org.apache.lucene.util.fst.FST.addNode(FST.java:707)
   [junit4]   2>        at 
org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:126)
   [junit4]   2>        at 
org.apache.lucene.util.fst.Builder.compileNode(Builder.java:200)
   [junit4]   2>        at 
org.apache.lucene.util.fst.Builder.finish(Builder.java:483)
   [junit4]   2>        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:258)
   [junit4]   2>        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$MemoryFieldsConsumer.write(MemoryPostingsFormat.java:391)
   [junit4]   2>        at 
org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
   [junit4]   2>        at 
org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:164)
   [junit4]   2>        at 
org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:216)
   [junit4]   2>        at 
org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:101)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4338)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3915)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestDuelingCodecsAtNight -Dtests.method=testBigEquals 
-Dtests.seed=2279865B45AB59A9 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
 -Dtests.locale=sq-AL -Dtests.timezone=Africa/Nairobi -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR    357s J0 | TestDuelingCodecsAtNight.testBigEquals <<<
   [junit4]    > Throwable #1: java.lang.OutOfMemoryError: GC overhead limit 
exceeded
   [junit4]    >        at 
org.apache.lucene.util.BytesRef.<init>(BytesRef.java:76)
   [junit4]    >        at 
org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutputs.java:129)
   [junit4]    >        at 
org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutputs.java:35)
   [junit4]    >        at 
org.apache.lucene.util.fst.FST.readNextRealArc(FST.java:979)
   [junit4]    >        at 
org.apache.lucene.util.fst.NodeHash.hash(NodeHash.java:111)
   [junit4]    >        at 
org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:128)
   [junit4]    >        at 
org.apache.lucene.util.fst.Builder.compileNode(Builder.java:200)
   [junit4]    >        at 
org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:296)
   [junit4]    >        at 
org.apache.lucene.util.fst.Builder.add(Builder.java:400)
   [junit4]    >        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finishTerm(MemoryPostingsFormat.java:245)
   [junit4]    >        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.access$300(MemoryPostingsFormat.java:104)
   [junit4]    >        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$MemoryFieldsConsumer.write(MemoryPostingsFormat.java:386)
   [junit4]    >        at 
org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.write(PerFieldPostingsFormat.java:140)
   [junit4]    >        at 
org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:109)
   [junit4]    >        at 
org.apache.lucene.index.DefaultIndexingChain.flush(DefaultIndexingChain.java:163)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:444)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:539)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.java:396)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:499)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1579)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1324)
   [junit4]    >        at 
org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:171)
   [junit4]    >        at 
org.apache.lucene.index.TestDuelingCodecs.createRandomIndex(TestDuelingCodecs.java:139)
   [junit4]    >        at 
org.apache.lucene.index.TestDuelingCodecsAtNight.testBigEquals(TestDuelingCodecsAtNight.java:34)Throwable
 #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
uncaught exception in thread: Thread[id=3853, name=Lucene Merge Thread #30, 
state=RUNNABLE, group=TGRP-TestDuelingCodecsAtNight]
   [junit4]    > Caused by: org.apache.lucene.index.MergePolicy$MergeException: 
java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([2279865B45AB59A9]:0)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: GC overhead limit 
exceeded
   [junit4]    >        at 
org.apache.lucene.util.fst.PairOutputs.newPair(PairOutputs.java:90)
   [junit4]    >        at 
org.apache.lucene.util.fst.PairOutputs.add(PairOutputs.java:140)
   [junit4]    >        at 
org.apache.lucene.util.fst.PairOutputs.add(PairOutputs.java:32)
   [junit4]    >        at 
org.apache.lucene.util.fst.FSTEnum.pushFirst(FSTEnum.java:488)
   [junit4]    >        at 
org.apache.lucene.util.fst.FSTEnum.doNext(FSTEnum.java:111)
   [junit4]    >        at 
org.apache.lucene.util.fst.BytesRefFSTEnum.next(BytesRefFSTEnum.java:57)
   [junit4]    >        at 
org.apache.lucene.codecs.simpletext.SimpleTextFieldsReader$SimpleTextTermsEnum.next(SimpleTextFieldsReader.java:170)
   [junit4]    >        at 
org.apache.lucene.index.MultiTermsEnum.pushTop(MultiTermsEnum.java:275)
   [junit4]    >        at 
org.apache.lucene.index.MultiTermsEnum.next(MultiTermsEnum.java:301)
   [junit4]    >        at 
org.apache.lucene.index.FilterLeafReader$FilterTermsEnum.next(FilterLeafReader.java:196)
   [junit4]    >        at 
org.apache.lucene.codecs.simpletext.SimpleTextFieldsWriter.write(SimpleTextFieldsWriter.java:101)
   [junit4]    >        at 
org.apache.lucene.codecs.simpletext.SimpleTextFieldsWriter.write(SimpleTextFieldsWriter.java:60)
   [junit4]    >        at 
org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
   [junit4]    >        at 
org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:216)
   [junit4]    >        at 
org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:101)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4338)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3915)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)Throwable
 #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
uncaught exception in thread: Thread[id=3856, name=Lucene Merge Thread #2, 
state=RUNNABLE, group=TGRP-TestDuelingCodecsAtNight]
   [junit4]    > Caused by: org.apache.lucene.index.MergePolicy$MergeException: 
java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([2279865B45AB59A9]:0)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: GC overhead limit 
exceeded
   [junit4]    >        at 
org.apache.lucene.util.fst.BytesStore.skipBytes(BytesStore.java:307)
   [junit4]    >        at org.apache.lucene.util.fst.FST.addNode(FST.java:707)
   [junit4]    >        at 
org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:126)
   [junit4]    >        at 
org.apache.lucene.util.fst.Builder.compileNode(Builder.java:200)
   [junit4]    >        at 
org.apache.lucene.util.fst.Builder.finish(Builder.java:483)
   [junit4]    >        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finish(MemoryPostingsFormat.java:258)
   [junit4]    >        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$MemoryFieldsConsumer.write(MemoryPostingsFormat.java:391)
   [junit4]    >        at 
org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
   [junit4]    >        at 
org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:164)
   [junit4]    >        at 
org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:216)
   [junit4]    >        at 
org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:101)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4338)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3915)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)Throwable
 #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
uncaught exception in thread: Thread[id=3858, name=Lucene Merge Thread #4, 
state=RUNNABLE, group=TGRP-TestDuelingCodecsAtNight]
   [junit4]    > Caused by: org.apache.lucene.index.MergePolicy$MergeException: 
java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([2279865B45AB59A9]:0)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: GC overhead limit 
exceeded
   [junit4]    >        at 
org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutputs.java:129)
   [junit4]    >        at 
org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutputs.java:35)
   [junit4]    >        at 
org.apache.lucene.util.fst.FST.readNextRealArc(FST.java:979)
   [junit4]    >        at 
org.apache.lucene.util.fst.NodeHash.hash(NodeHash.java:111)
   [junit4]    >        at 
org.apache.lucene.util.fst.NodeHash.addNew(NodeHash.java:148)
   [junit4]    >        at 
org.apache.lucene.util.fst.NodeHash.rehash(NodeHash.java:169)
   [junit4]    >        at 
org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:133)
   [junit4]    >        at 
org.apache.lucene.util.fst.Builder.compileNode(Builder.java:200)
   [junit4]    >        at 
org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:296)
   [junit4]    >        at 
org.apache.lucene.util.fst.Builder.add(Builder.java:400)
   [junit4]    >        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finishTerm(MemoryPostingsFormat.java:245)
   [junit4]    >        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.access$300(MemoryPostingsFormat.java:104)
   [junit4]    >        at 
org.apache.lucene.codecs.memory.MemoryPostingsFormat$MemoryFieldsConsumer.write(MemoryPostingsFormat.java:386)
   [junit4]    >        at 
org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
   [junit4]    >        at 
org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:164)
   [junit4]    >        at 
org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:216)
   [junit4]    >        at 
org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:101)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4338)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3915)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/core/test/J0/temp/lucene.index.TestDuelingCodecsAtNight_2279865B45AB59A9-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), 
sim=RandomSimilarity(queryNorm=false): {titleTokenized=DFR GB2, body=DFR 
I(ne)B1}, locale=sq-AL, timezone=Africa/Nairobi
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_121 (64-bit)/cpus=4,threads=1,free=99384176,total=411566080
   [junit4]   2> NOTE: All tests run in this JVM: [TestIndexWriterForceMerge, 
TestByteArrayDataInput, TestDocValuesIndexing, 
TestPersistentSnapshotDeletionPolicy, TestSloppyPhraseQuery, 
TestIndexableField, TestMultiPhraseEnum, TestPagedBytes, 
TestDirectoryReaderReopen, TestPointQueries, TestTotalHitCountCollector, 
TestIndexWriterConfig, TestMatchAllDocsQuery, TestSingleInstanceLockFactory, 
TestSimilarityProvider, TestBytesStore, TestLucene50TermVectorsFormat, 
TestNRTCachingDirectory, TestTermsEnum, TestDocsAndPositions, 
TestAutomatonQuery, TestIndexWriterExceptions2, Test4GBStoredFields, 
TestOrdinalMap, TestDeterminizeLexicon, TestTimSorter, TestMultiPhraseQuery, 
TestTopFieldCollector, TestSimpleExplanations, TestTermVectorsWriter, 
TestUniqueTermCount, TestThreadedForceMerge, TestDateTools, TestUnicodeUtil, 
TestIndexInput, TestLiveFieldValues, TestNeverDelete, TestBoolean2, TestRegExp, 
TestApproximationSearchEquivalence, Test2BBinaryDocValues, TestSort, 
TestLucene62SegmentInfoFormat, TestDuelingCodecsAtNight]
   [junit4] Completed [154/448 (1!)] on J0 in 381.03s, 3 tests, 1 error <<< 
FAILURES!

[...truncated 1132 lines...]
   [junit4] Suite: org.apache.lucene.search.TestFuzzyQuery
   [junit4]   2> f?vr. 25, 2017 8:47:38 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
   [junit4]   2> WARNING: Suite execution timed out: 
org.apache.lucene.search.TestFuzzyQuery
   [junit4]   2>    1) Thread[id=7378, 
name=SUITE-TestFuzzyQuery-seed#[2279865B45AB59A9], state=RUNNABLE, 
group=TGRP-TestFuzzyQuery]
   [junit4]   2>         at java.lang.Thread.getStackTrace(Thread.java:1556)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:696)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:693)
   [junit4]   2>         at java.security.AccessController.doPrivileged(Native 
Method)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.getStackTrace(ThreadLeakControl.java:693)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.getThreadsWithTraces(ThreadLeakControl.java:709)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:689)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:65)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:415)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:678)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:140)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:598)
   [junit4]   2>    2) Thread[id=1, name=main, state=WAITING, group=main]
   [junit4]   2>         at java.lang.Object.wait(Native Method)
   [junit4]   2>         at java.lang.Thread.join(Thread.java:1249)
   [junit4]   2>         at java.lang.Thread.join(Thread.java:1323)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:608)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:457)
   [junit4]   2>         at 
com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:244)
   [junit4]   2>         at 
com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
   [junit4]   2>         at 
com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
   [junit4]   2>    3) Thread[id=7379, 
name=TEST-TestFuzzyQuery.testRandom-seed#[2279865B45AB59A9], state=RUNNABLE, 
group=TGRP-TestFuzzyQuery]
   [junit4]   2>         at 
org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:748)
   [junit4]   2>         at 
org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
   [junit4]   2>         at 
org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
   [junit4]   2>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>         at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>         at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>         at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2>    4) Thread[id=9, name=JUnit4-serializer-daemon, 
state=TIMED_WAITING, group=main]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at 
com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:50)
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFuzzyQuery 
-Dtests.method=testRandom -Dtests.seed=2279865B45AB59A9 -Dtests.multiplier=2 
-Dtests.nightly=true -Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
 -Dtests.locale=fr-CA -Dtests.timezone=America/Porto_Velho -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   7200s J0 | TestFuzzyQuery.testRandom <<<
   [junit4]    > Throwable #1: java.lang.Exception: Test abandoned because 
suite timeout was reached.
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([2279865B45AB59A9]:0)
   [junit4]   2> f?vr. 25, 2017 8:47:38 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> f?vr. 25, 2017 8:47:59 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at 
org.apache.lucene.search.TestFuzzyQuery: 
   [junit4]   2>    1) Thread[id=7379, 
name=TEST-TestFuzzyQuery.testRandom-seed#[2279865B45AB59A9], state=RUNNABLE, 
group=TGRP-TestFuzzyQuery]
   [junit4]   2>         at java.util.WeakHashMap.getTable(WeakHashMap.java:350)
   [junit4]   2>         at java.util.WeakHashMap.getEntry(WeakHashMap.java:427)
   [junit4]   2>         at 
java.util.WeakHashMap.containsKey(WeakHashMap.java:417)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:258)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
   [junit4]   2>         at 
org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:748)
   [junit4]   2>         at 
org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
   [junit4]   2>         at 
org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
   [junit4]   2>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>         at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>         at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>         at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> f?vr. 25, 2017 8:47:59 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=7379, 
name=TEST-TestFuzzyQuery.testRandom-seed#[2279865B45AB59A9], state=RUNNABLE, 
group=TGRP-TestFuzzyQuery]
   [junit4]   2> f?vr. 25, 2017 8:48:02 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be 
terminated:
   [junit4]   2>    1) Thread[id=7379, 
name=TEST-TestFuzzyQuery.testRandom-seed#[2279865B45AB59A9], state=RUNNABLE, 
group=TGRP-TestFuzzyQuery]
   [junit4]   2>         at java.lang.Object.hashCode(Native Method)
   [junit4]   2>         at java.util.WeakHashMap.hash(WeakHashMap.java:298)
   [junit4]   2>         at java.util.WeakHashMap.get(WeakHashMap.java:396)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedContext.getPerThread(RandomizedContext.java:319)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedContext.getRandomness(RandomizedContext.java:92)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedContext.getRandom(RandomizedContext.java:114)
   [junit4]   2>         at 
org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:748)
   [junit4]   2>         at 
org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:503)
   [junit4]   2>         at 
org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
   [junit4]   2>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>         at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>         at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>         at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), 
sim=RandomSimilarity(queryNorm=true): {}, locale=fr-CA, 
timezone=America/Porto_Velho
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_121 (64-bit)/cpus=4,threads=2,free=165761096,total=411041792
   [junit4]   2> NOTE: All tests run in this JVM: [TestIndexWriterForceMerge, 
TestByteArrayDataInput, TestDocValuesIndexing, 
TestPersistentSnapshotDeletionPolicy, TestSloppyPhraseQuery, 
TestIndexableField, TestMultiPhraseEnum, TestPagedBytes, 
TestDirectoryReaderReopen, TestPointQueries, TestTotalHitCountCollector, 
TestIndexWriterConfig, TestMatchAllDocsQuery, TestSingleInstanceLockFactory, 
TestSimilarityProvider, TestBytesStore, TestLucene50TermVectorsFormat, 
TestNRTCachingDirectory, TestTermsEnum, TestDocsAndPositions, 
TestAutomatonQuery, TestIndexWriterExceptions2, Test4GBStoredFields, 
TestOrdinalMap, TestDeterminizeLexicon, TestTimSorter, TestMultiPhraseQuery, 
TestTopFieldCollector, TestSimpleExplanations, TestTermVectorsWriter, 
TestUniqueTermCount, TestThreadedForceMerge, TestDateTools, TestUnicodeUtil, 
TestIndexInput, TestLiveFieldValues, TestNeverDelete, TestBoolean2, TestRegExp, 
TestApproximationSearchEquivalence, Test2BBinaryDocValues, TestSort, 
TestLucene62SegmentInfoFormat, TestDuelingCodecsAtNight, TestUTF32ToUTF8, 
TestFixedBitDocIdSet, TestDocInverterPerFieldErrorInfo, 
TestCrashCausesCorruptIndex, TestSpanOrQuery, Test2BPoints, TestFilterSpans, 
TestLucene70NormsFormat, TestIndexingSequenceNumbers, 
TestBooleanQueryVisitSubscorers, TestNotDocIdSet, TestFlex, 
TestNearSpansOrdered, TestDeletionPolicy, TestLucene50CompoundFormat, 
TestIndexWriterExceptions, TestMatchNoDocsQuery, TestIndexSearcher, 
TestRateLimiter, TestQueryBuilder, TestSpanContainQuery, TestFieldReuse, 
TestMultiThreadTermVectors, TestBytesRef, TestForceMergeForever, TestCodecs, 
TestIndexWriter, TestInPlaceMergeSorter, TestStressDeletes, 
TestBooleanRewrites, TestTopDocsMerge, TestSnapshotDeletionPolicy, 
TestNRTReaderWithThreads, TestPerFieldPostingsFormat, TestDirectoryReader, 
TestLockFactory, TestSegmentMerger, TestCollectionUtil, TestOmitNorms, 
TestFixedBitSet, TestTransactions, TestCrash, TestSegmentTermDocs, 
TestMultiDocValues, TestToken, TestFieldsReader, TestSimpleSearchEquivalence, 
TestCustomSearcherSort, TestHugeRamFile, TestBooleanMinShouldMatch, 
TestTermsEnum2, TestIndexWriterOnDiskFull, TestFuzzyQuery]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFuzzyQuery 
-Dtests.seed=2279865B45AB59A9 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
 -Dtests.locale=fr-CA -Dtests.timezone=America/Porto_Velho -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | TestFuzzyQuery (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 
7200000 msec).
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([2279865B45AB59A9]:0)
   [junit4] Completed [448/448 (2!)] on J0 in 7223.09s, 2 tests, 2 errors <<< 
FAILURES!

[...truncated 1 lines...]
   [junit4] JVM J0: stdout was not empty, see: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/core/test/temp/junit4-J0-20170225_100833_1583846647856942843690.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] Dumping heap to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/heapdumps/java_pid23943.hprof
 ...
   [junit4] Heap dump file created [430529117 bytes in 0.628 secs]
   [junit4] <<< JVM J0: EOF ----

[...truncated 9971 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_24476FD2E1B70732-001/init-core-data-001
   [junit4]   2> 613761 INFO  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using TrieFields
   [junit4]   2> 613762 INFO  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 613762 INFO  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /ies/
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 613802 WARN  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 613810 WARN  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 613812 INFO  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 613825 INFO  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_55473_hdfs____w63yu2/webapp
   [junit4]   2> 614218 INFO  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:55473
   [junit4]   2> 614379 WARN  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 614380 INFO  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 614390 INFO  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_58748_datanode____.slbj5/webapp
   [junit4]   2> 614891 INFO  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:58748
   [junit4]   2> 614973 WARN  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 614974 INFO  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 614983 INFO  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_56221_datanode____d5fp93/webapp
   [junit4]   2> 615128 INFO  (IPC Server handler 3 on 56059) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-e6ac0cef-8c53-4ad0-9d39-4343fdd5924d node 
DatanodeRegistration(127.0.0.1:33878, 
datanodeUuid=b44b3547-77ee-4ecb-8f30-f4c02396e694, infoPort=34919, 
infoSecurePort=0, ipcPort=56414, 
storageInfo=lv=-56;cid=testClusterID;nsid=275081903;c=0), blocks: 0, 
hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 615128 INFO  (IPC Server handler 3 on 56059) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-37f14335-7ad4-48b4-a6ba-3bccd1ce3697 node 
DatanodeRegistration(127.0.0.1:33878, 
datanodeUuid=b44b3547-77ee-4ecb-8f30-f4c02396e694, infoPort=34919, 
infoSecurePort=0, ipcPort=56414, 
storageInfo=lv=-56;cid=testClusterID;nsid=275081903;c=0), blocks: 0, 
hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 615405 INFO  
(SUITE-HdfsUnloadDistributedZkTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:56221
   [junit4]   2> 615574 INFO  (IPC Server handler 5 on 56059) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-cb1b130e-c867-440b-9fec-844fc0b08b10 node 
DatanodeRegistration(127.0.0.1:59880, 
datanodeUuid=aa00d148-acae-4d18-abf7-f13cd248efa3, infoPort=59421, 
infoSecurePort=0, ipcPort=59132, 
storageInfo=lv=-56;cid=testClusterID;nsid=275081903;c=0), blocks: 0, 
hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 615574 INFO  (IPC Server handler 5 on 56059) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-e39c9cb9-f572-431f-a821-eb6a22637b42 node 
DatanodeRegistration(127.0.0.1:59880, 
datanodeUuid=aa00d148-acae-4d18-abf7-f13cd248efa3, infoPort=59421, 
infoSecurePort=0, ipcPort=59132, 
storageInfo=lv=-56;cid=testClusterID;nsid=275081903;c=0), blocks: 0, 
hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 615816 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 615816 INFO  (Thread-1139) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 615816 INFO  (Thread-1139) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 615916 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:45178
   [junit4]   2> 615933 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 615934 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 615935 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 615936 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 615937 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 615938 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 615939 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 615939 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 615940 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 615941 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 615942 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 616079 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_24476FD2E1B70732-001/control-001/cores/collection1
   [junit4]   2> 616081 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 616084 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@1cf14788{/ies,null,AVAILABLE}
   [junit4]   2> 616084 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@7d92a476{HTTP/1.1,[http/1.1]}{127.0.0.1:45074}
   [junit4]   2> 616084 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.e.j.s.Server Started @619359ms
   [junit4]   2> 616084 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:56059/hdfs__localhost_56059__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-master_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsUnloadDistributedZkTest_24476FD2E1B70732-001_tempDir-002_control_data,
 hostContext=/ies, hostPort=45074, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_24476FD2E1B70732-001/control-001/cores}
   [junit4]   2> 616085 ERROR 
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 616085 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.0.0
   [junit4]   2> 616085 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 616085 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 616085 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-02-25T14:46:20.752Z
   [junit4]   2> 616089 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 616089 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_24476FD2E1B70732-001/control-001/solr.xml
   [junit4]   2> 616095 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45178/solr
   [junit4]   2> 616121 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) 
[n:127.0.0.1:45074_ies    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 616122 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) 
[n:127.0.0.1:45074_ies    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:45074_ies
   [junit4]   2> 616122 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) 
[n:127.0.0.1:45074_ies    ] o.a.s.c.Overseer Overseer 
(id=97519794944999428-127.0.0.1:45074_ies-n_0000000000) starting
   [junit4]   2> 616137 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) 
[n:127.0.0.1:45074_ies    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45074_ies
   [junit4]   2> 616138 INFO  
(zkCallback-2376-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 616256 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) 
[n:127.0.0.1:45074_ies    ] o.a.s.c.CorePropertiesLocator Found 1 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_24476FD2E1B70732-001/control-001/cores
   [junit4]   2> 616256 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) 
[n:127.0.0.1:45074_ies    ] o.a.s.c.CorePropertiesLocator Cores are: 
[collection1]
   [junit4]   2> 616271 INFO  
(OverseerStateUpdate-97519794944999428-127.0.0.1:45074_ies-n_0000000000) 
[n:127.0.0.1:45074_ies    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 617273 WARN  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] o.a.s.c.Config 
Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> 
instead.
   [junit4]   2> 617274 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 617285 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 617371 WARN  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.s.IndexSchema [collection1] default search field in schema is text. 
WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 617373 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 617398 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
collection control_collection
   [junit4]   2> 617410 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost:56059/solr_hdfs_home
   [junit4]   2> 617410 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 617411 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] o.a.s.c.SolrCore 
[[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_24476FD2E1B70732-001/control-001/cores/collection1],
 
dataDir=[hdfs://localhost:56059/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 617411 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3202fcd3
   [junit4]   2> 617411 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:56059/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
   [junit4]   2> 617426 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct 
memory allocation set to [true]
   [junit4]   2> 617426 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of 
[8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 617426 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 617914 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 617919 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:56059/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 617945 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:56059/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 617951 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct 
memory allocation set to [true]
   [junit4]   2> 617951 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of 
[8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 617951 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 617963 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 617964 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=6, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.5078474487904397]
   [junit4]   2> 618006 INFO  (IPC Server handler 8 on 56059) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33878 is 
added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-cb1b130e-c867-440b-9fec-844fc0b08b10:NORMAL:127.0.0.1:59880|RBW],
 
ReplicaUC[[DISK]DS-37f14335-7ad4-48b4-a6ba-3bccd1ce3697:NORMAL:127.0.0.1:33878|FINALIZED]]}
 size 0
   [junit4]   2> 618006 INFO  (IPC Server handler 9 on 56059) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59880 is 
added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-37f14335-7ad4-48b4-a6ba-3bccd1ce3697:NORMAL:127.0.0.1:33878|FINALIZED],
 
ReplicaUC[[DISK]DS-e39c9cb9-f572-431f-a821-eb6a22637b42:NORMAL:127.0.0.1:59880|FINALIZED]]}
 size 0
   [junit4]   2> 618031 WARN  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 618067 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 618067 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 618067 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
   [junit4]   2> 618077 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 618077 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 618079 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=15, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=30.365234375, 
floorSegmentMB=0.435546875, forceMergeDeletesPctAllowed=16.399156366641176, 
segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 618154 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@3bb375e0[collection1] main]
   [junit4]   2> 618155 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 618156 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 618158 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 618162 INFO  
(searcherExecutor-2337-thread-1-processing-n:127.0.0.1:45074_ies x:collection1 
c:control_collection) [n:127.0.0.1:45074_ies c:control_collection   
x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@3bb375e0[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 618175 INFO  
(coreLoadExecutor-2336-thread-1-processing-n:127.0.0.1:45074_ies) 
[n:127.0.0.1:45074_ies c:control_collection   x:collection1] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1560316721592532992
   [junit4]   2> 618184 INFO  
(coreZkRegister-2329-thread-1-processing-n:127.0.0.1:45074_ies x:collection1 
c:control_collection) [n:127.0.0.1:45074_ies c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas 
found to continue.
   [junit4]   2> 618184 INFO  
(coreZkRegister-2329-thread-1-processing-n:127.0.0.1:45074_ies x:collection1 
c:control_collection) [n:127.0.0.1:45074_ies c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new 
leader - try and sync
   [junit4]   2> 618184 INFO  
(coreZkRegister-2329-thread-1-processing-n:127.0.0.1:45074_ies x:collection1 
c:control_collection) [n:127.0.0.1:45074_ies c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:45074/ies/collection1/
   [junit4]   2> 618184 INFO  
(coreZkRegister-2329-thread-1-processing-n:127.0.0.1:45074_ies x:collection1 
c:control_collection) [n:127.0.0.1:45074_ies c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync 
replicas to me
   [junit4]   2> 618184 INFO  
(coreZkRegister-2329-thread-1-processing-n:127.0.0.1:45074_ies x:collection1 
c:control_collection) [n:127.0.0.1:45074_ies c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
http://127.0.0.1:45074/ies/collection1/ has no replicas
   [junit4]   2> 618185 INFO  
(coreZkRegister-2329-thread-1-processing-n:127.0.0.1:45074_ies x:collection1 
c:control_collection) [n:127.0.0.1:45074_ies c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Found all 
replicas participating in election, clear LIR
   [junit4]   2> 618187 INFO  
(coreZkRegister-2329-thread-1-processing-n:127.0.0.1:45074_ies x:collection1 
c:control_collection) [n:127.0.0.1:45074_ies c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new 
leader: http://127.0.0.1:45074/ies/collection1/ shard1
   [junit4]   2> 618337 INFO  
(coreZkRegister-2329-thread-1-processing-n:127.0.0.1:45074_ies x:collection1 
c:control_collection) [n:127.0.0.1:45074_ies c:control_collection s:shard1 
r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery 
necessary
   [junit4]   2> 618394 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 618395 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45178/solr ready
   [junit4]   2> 618395 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection 
loss:false
   [junit4]   2> 618395 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 618486 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_24476FD2E1B70732-001/shard-1-001/cores/collection1
   [junit4]   2> 618486 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_24476FD2E1B70732-001/shard-1-001
   [junit4]   2> 618487 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 618488 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@1b6bb0a6{/ies,null,AVAILABLE}
   [junit4]   2> 618488 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@7cddd679{HTTP/1.1,[http/1.1]}{127.0.0.1:58627}
   [junit4]   2> 618493 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.e.j.s.Server Started @621768ms
   [junit4]   2> 618493 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:56059/hdfs__localhost_56059__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-master_checkout_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsUnloadDistributedZkTest_24476FD2E1B70732-001_tempDir-002_jetty1,
 solrconfig=solrconfig.xml, hostContext=/ies, hostPort=58627, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_24476FD2E1B70732-001/shard-1-001/cores}
   [junit4]   2> 618493 ERROR 
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 618494 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.0.0
   [junit4]   2> 618494 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 618494 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 618494 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-02-25T14:46:23.161Z
   [junit4]   2> 618496 INFO  
(TEST-HdfsUnloadDistributedZkTest.test-seed#[24476FD2E1B70732]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 618496 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#

[...truncated too long message...]

ction(MissingSegmentRecoveryTest//collections/MissingSegmentRecoveryTest/state.json/7)={
   [junit4]    >   "replicationFactor":"2",
   [junit4]    >   "shards":{"shard1":{
   [junit4]    >       "range":"80000000-7fffffff",
   [junit4]    >       "state":"active",
   [junit4]    >       "replicas":{
   [junit4]    >         "core_node1":{
   [junit4]    >           "core":"MissingSegmentRecoveryTest_shard1_replica2",
   [junit4]    >           "base_url":"http://127.0.0.1:53224/solr";,
   [junit4]    >           "node_name":"127.0.0.1:53224_solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "leader":"true"},
   [junit4]    >         "core_node2":{
   [junit4]    >           "core":"MissingSegmentRecoveryTest_shard1_replica1",
   [junit4]    >           "base_url":"http://127.0.0.1:44586/solr";,
   [junit4]    >           "node_name":"127.0.0.1:44586_solr",
   [junit4]    >           "state":"down"}}}},
   [junit4]    >   "router":{"name":"compositeId"},
   [junit4]    >   "maxShardsPerNode":"1",
   [junit4]    >   "autoAddReplicas":"false"}
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([24476FD2E1B70732:7412F7D1B896B12F]:0)
   [junit4]    >        at 
org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:265)
   [junit4]    >        at 
org.apache.solr.cloud.MissingSegmentRecoveryTest.testLeaderRecovery(MissingSegmentRecoveryTest.java:105)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2647514 INFO  (jetty-closer-1819-thread-2) [    ] 
o.e.j.s.AbstractConnector Stopped 
ServerConnector@2d3f734a{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2647515 INFO  (jetty-closer-1819-thread-2) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1057763130
   [junit4]   2> 2647520 INFO  (jetty-closer-1819-thread-2) [    ] 
o.a.s.c.Overseer Overseer 
(id=97519921748246534-127.0.0.1:53224_solr-n_0000000000) closing
   [junit4]   2> 2647520 INFO  (jetty-closer-1819-thread-1) [    ] 
o.e.j.s.AbstractConnector Stopped 
ServerConnector@3f28cc19{HTTP/1.1,[http/1.1]}{127.0.0.1:44586}
   [junit4]   2> 2647520 INFO  
(OverseerStateUpdate-97519921748246534-127.0.0.1:53224_solr-n_0000000000) 
[n:127.0.0.1:53224_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:53224_solr
   [junit4]   2> 2647522 INFO  (jetty-closer-1819-thread-1) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1432069275
   [junit4]   2> 2647523 INFO  
(zkCallback-1841-thread-3-processing-n:127.0.0.1:44586_solr) 
[n:127.0.0.1:44586_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:44586_solr
   [junit4]   2> 2647524 INFO  
(zkCallback-1841-thread-4-processing-n:127.0.0.1:44586_solr) 
[n:127.0.0.1:44586_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (1)
   [junit4]   2> 2649023 WARN  
(zkCallback-1830-thread-16-processing-n:127.0.0.1:53224_solr) 
[n:127.0.0.1:53224_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2649023 INFO  (jetty-closer-1819-thread-2) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 2649024 INFO  (jetty-closer-1819-thread-2) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@134e640d{/solr,null,UNAVAILABLE}
   [junit4]   2> 2649032 WARN  
(zkCallback-1841-thread-4-processing-n:127.0.0.1:44586_solr) 
[n:127.0.0.1:44586_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2649032 INFO  (jetty-closer-1819-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 2649033 INFO  (jetty-closer-1819-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@6fa11df1{/solr,null,UNAVAILABLE}
   [junit4]   2> 2649034 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:53711 53711
   [junit4]   2> 2649122 INFO  (Thread-21056) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:53711 53711
   [junit4]   2> 2649123 WARN  (Thread-21056) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/aliases.json
   [junit4]   2>        4       /solr/clusterprops.json
   [junit4]   2>        3       /solr/security.json
   [junit4]   2>        2       /solr/configs/conf
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/clusterstate.json
   [junit4]   2>        4       
/solr/collections/MissingSegmentRecoveryTest/state.json
   [junit4]   2>        2       
/solr/overseer_elect/election/97519921748246534-127.0.0.1:53224_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        93      /solr/overseer/collection-queue-work
   [junit4]   2>        13      /solr/overseer/queue
   [junit4]   2>        4       /solr/collections
   [junit4]   2>        4       /solr/overseer/queue-work
   [junit4]   2>        3       /solr/live_nodes
   [junit4]   2> 
   [junit4]   2> 2649123 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[24476FD2E1B70732]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.MissingSegmentRecoveryTest_24476FD2E1B70732-001
   [junit4]   2> Feb 25, 2017 3:20:13 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): 
{_version_=PostingsFormat(name=Memory), 
id=PostingsFormat(name=LuceneFixedGap)}, docValues:{}, 
maxPointsInLeafNode=1550, maxMBSortInHeap=6.71678823894384, 
sim=RandomSimilarity(queryNorm=false): {}, locale=el-GR, 
timezone=America/Argentina/Catamarca
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_121 (64-bit)/cpus=4,threads=1,free=228711456,total=511705088
   [junit4]   2> NOTE: All tests run in this JVM: [TestJsonRequest, 
FullHLLTest, TestBM25SimilarityFactory, BufferStoreTest, 
TestPerFieldSimilarity, RemoteQueryErrorTest, BlockJoinFacetDistribTest, 
TestTrie, TestCustomDocTransformer, ExitableDirectoryReaderTest, 
DocumentBuilderTest, StressHdfsTest, TestConfigSetProperties, 
CdcrVersionReplicationTest, TestSweetSpotSimilarityFactory, SolrInfoMBeanTest, 
TestDocBasedVersionConstraints, TestMiniSolrCloudCluster, 
TestInPlaceUpdatesDistrib, TestFieldTypeCollectionResource, SoftAutoCommitTest, 
TestIntervalFaceting, TestSystemCollAutoCreate, 
UUIDUpdateProcessorFallbackTest, DistributedMLTComponentTest, TestCustomStream, 
TestBackupRepositoryFactory, ClusterStateUpdateTest, TestCollectionAPI, 
ParsingFieldUpdateProcessorsTest, TestStressRecovery, TestObjectReleaseTracker, 
TestFiltering, TestFieldCacheSanityChecker, ResponseHeaderTest, 
TestExpandComponent, JavabinLoaderTest, TestEmbeddedSolrServerConstructors, 
TestTolerantUpdateProcessorRandomCloud, TestHighFrequencyDictionaryFactory, 
TestConfigSetsAPIZkFailure, CloneFieldUpdateProcessorFactoryTest, 
SpatialFilterTest, TestSchemaManager, JsonLoaderTest, HttpPartitionTest, 
TestFastLRUCache, TestWordDelimiterFilterFactory, MetricsHandlerTest, 
TestCopyFieldCollectionResource, ZkCLITest, TemplateUpdateProcessorTest, 
ClassificationUpdateProcessorFactoryTest, DocValuesTest, 
ChaosMonkeyNothingIsSafeTest, SOLR749Test, TestCloudDeleteByQuery, 
SortSpecParsingTest, HdfsChaosMonkeyNothingIsSafeTest, TestReqParamsAPI, 
TestSolrCoreSnapshots, TestQueryUtils, DistributedSuggestComponentTest, 
TestReloadDeadlock, StatsReloadRaceTest, 
HdfsTlogReplayBufferedWhileIndexingTest, FileUtilsTest, VersionInfoTest, 
TestConfigsApi, SchemaVersionSpecificBehaviorTest, JSONWriterTest, 
SharedFSAutoReplicaFailoverUtilsTest, TestDocumentBuilder, RulesTest, 
BigEndianAscendingWordSerializerTest, RestartWhileUpdatingTest, 
TestReloadAndDeleteDocs, DateRangeFieldTest, 
TestPerFieldSimilarityWithDefaultOverride, TestElisionMultitermQuery, 
TestFuzzyAnalyzedSuggestions, TestDynamicFieldResource, 
CachingDirectoryFactoryTest, ReplicaListTransformerTest, 
TestOnReconnectListenerSupport, TimeZoneUtilsTest, 
CollectionsAPIDistributedZkTest, HdfsNNFailoverTest, SortByFunctionTest, 
TestPostingsSolrHighlighter, TestSlowCompositeReaderWrapper, 
DistributedExpandComponentTest, IndexSchemaRuntimeFieldTest, SparseHLLTest, 
CreateCollectionCleanupTest, HighlighterTest, DistributedTermsComponentTest, 
ActionThrottleTest, LeaderFailureAfterFreshStartTest, 
WordBreakSolrSpellCheckerTest, TestSmileRequest, OverseerTaskQueueTest, 
TestOverriddenPrefixQueryForCustomFieldType, TestChildDocTransformer, 
MigrateRouteKeyTest, SpellCheckComponentTest, TestSQLHandlerNonCloud, 
QueryParsingTest, HdfsRestartWhileUpdatingTest, TestManagedSchemaAPI, 
DistributedIntervalFacetingTest, OpenExchangeRatesOrgProviderTest, 
ConnectionManagerTest, DeleteLastCustomShardedReplicaTest, DeleteNodeTest, 
DeleteShardTest, DeleteStatusTest, DistribDocExpirationUpdateProcessorTest, 
LeaderElectionContextKeyTest, MissingSegmentRecoveryTest]
   [junit4] Completed [516/693 (2!)] on J1 in 98.87s, 1 test, 1 failure <<< 
FAILURES!

[...truncated 12297 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:783:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:727:
 Some of the tests produced a heap dump, but did not fail. Maybe a suppressed 
OutOfMemoryError? Dumps created:
* java_pid23943.hprof

Total time: 345 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to