I’ll take a look at it. - Mark
http://about.me/markrmiller > On Aug 29, 2014, at 12:41 PM, Timothy Potter <[email protected]> wrote: > > This test doesn't even create any cores (other than what's created by > the parent class). Will AwaitFix it for now. > > > On Fri, Aug 29, 2014 at 6:58 AM, Policeman Jenkins Server > <[email protected]> wrote: >> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/11000/ >> Java: 32bit/ibm-j9-jdk7 >> -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;} >> >> 3 tests failed. >> FAILED: >> junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage >> >> Error Message: >> SolrCore.getOpenCount()==2 >> >> Stack Trace: >> java.lang.RuntimeException: SolrCore.getOpenCount()==2 >> at __randomizedtesting.SeedInfo.seed([3D29A7E887ADDD9A]:0) >> at org.apache.solr.util.TestHarness.close(TestHarness.java:332) >> at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:620) >> at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:183) >> at sun.reflect.GeneratedMethodAccessor41.invoke(Unknown Source) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) >> at java.lang.reflect.Method.invoke(Method.java:619) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) >> at >> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) >> at >> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) >> at >> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) >> at >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) >> at >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43) >> at >> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >> at >> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) >> at >> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) >> at java.lang.Thread.run(Thread.java:853) >> >> >> FAILED: >> junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage >> >> Error Message: >> 5 threads leaked from SUITE scope at >> org.apache.solr.rest.TestManagedResourceStorage: 1) Thread[id=1680, >> name=coreZkRegister-743-thread-1, state=WAITING, >> group=TGRP-TestManagedResourceStorage] at >> sun.misc.Unsafe.park(Native Method) at >> java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> at java.lang.Thread.run(Thread.java:853) 2) Thread[id=1674, >> name=OverseerHdfsCoreFailoverThread-92361197477494787-188.138.97.18:_-n_0000000000, >> state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] >> at java.lang.Thread.sleep(Native Method) at >> java.lang.Thread.sleep(Thread.java:977) at >> org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:136) >> at java.lang.Thread.run(Thread.java:853) 3) Thread[id=1678, >> name=Thread-509, state=WAITING, group=TGRP-TestManagedResourceStorage] >> at java.lang.Object.wait(Native Method) at >> java.lang.Object.wait(Object.java:172) at >> org.apache.solr.core.CloserThread.run(CoreContainer.java:905) 4) >> Thread[id=1677, name=searcherExecutor-749-thread-1, state=WAITING, >> group=TGRP-TestManagedResourceStorage] at >> sun.misc.Unsafe.park(Native Method) at >> java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> at java.lang.Thread.run(Thread.java:853) 5) Thread[id=1672, >> name=OverseerStateUpdate-92361197477494787-188.138.97.18:_-n_0000000000, >> state=TIMED_WAITING, group=Overseer state updater.] at >> java.lang.Object.wait(Native Method) at >> java.lang.Object.wait(Object.java:201) at >> org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:266) >> at >> org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:309) >> at >> org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:582) >> at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560) >> at >> org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:219) >> at java.lang.Thread.run(Thread.java:853) >> >> Stack Trace: >> com.carrotsearch.randomizedtesting.ThreadLeakError: 5 threads leaked from >> SUITE scope at org.apache.solr.rest.TestManagedResourceStorage: >> 1) Thread[id=1680, name=coreZkRegister-743-thread-1, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> at sun.misc.Unsafe.park(Native Method) >> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) >> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> at java.lang.Thread.run(Thread.java:853) >> 2) Thread[id=1674, >> name=OverseerHdfsCoreFailoverThread-92361197477494787-188.138.97.18:_-n_0000000000, >> state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] >> at java.lang.Thread.sleep(Native Method) >> at java.lang.Thread.sleep(Thread.java:977) >> at >> org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:136) >> at java.lang.Thread.run(Thread.java:853) >> 3) Thread[id=1678, name=Thread-509, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> at java.lang.Object.wait(Native Method) >> at java.lang.Object.wait(Object.java:172) >> at org.apache.solr.core.CloserThread.run(CoreContainer.java:905) >> 4) Thread[id=1677, name=searcherExecutor-749-thread-1, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> at sun.misc.Unsafe.park(Native Method) >> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) >> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> at java.lang.Thread.run(Thread.java:853) >> 5) Thread[id=1672, >> name=OverseerStateUpdate-92361197477494787-188.138.97.18:_-n_0000000000, >> state=TIMED_WAITING, group=Overseer state updater.] >> at java.lang.Object.wait(Native Method) >> at java.lang.Object.wait(Object.java:201) >> at >> org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:266) >> at >> org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:309) >> at >> org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:582) >> at >> org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560) >> at >> org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:219) >> at java.lang.Thread.run(Thread.java:853) >> at __randomizedtesting.SeedInfo.seed([3D29A7E887ADDD9A]:0) >> >> >> FAILED: >> junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage >> >> Error Message: >> There are still zombie threads that couldn't be terminated: 1) >> Thread[id=1680, name=coreZkRegister-743-thread-1, state=WAITING, >> group=TGRP-TestManagedResourceStorage] at >> sun.misc.Unsafe.park(Native Method) at >> java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> at java.lang.Thread.run(Thread.java:853) 2) Thread[id=1674, >> name=OverseerHdfsCoreFailoverThread-92361197477494787-188.138.97.18:_-n_0000000000, >> state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.] at >> org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:138) >> at java.lang.Thread.run(Thread.java:853) 3) Thread[id=1678, >> name=Thread-509, state=WAITING, group=TGRP-TestManagedResourceStorage] >> at java.lang.Object.wait(Native Method) at >> java.lang.Object.wait(Object.java:172) at >> org.apache.solr.core.CloserThread.run(CoreContainer.java:905) 4) >> Thread[id=1677, name=searcherExecutor-749-thread-1, state=WAITING, >> group=TGRP-TestManagedResourceStorage] at >> sun.misc.Unsafe.park(Native Method) at >> java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> at java.lang.Thread.run(Thread.java:853) >> >> Stack Trace: >> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie >> threads that couldn't be terminated: >> 1) Thread[id=1680, name=coreZkRegister-743-thread-1, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> at sun.misc.Unsafe.park(Native Method) >> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) >> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> at java.lang.Thread.run(Thread.java:853) >> 2) Thread[id=1674, >> name=OverseerHdfsCoreFailoverThread-92361197477494787-188.138.97.18:_-n_0000000000, >> state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.] >> at >> org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:138) >> at java.lang.Thread.run(Thread.java:853) >> 3) Thread[id=1678, name=Thread-509, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> at java.lang.Object.wait(Native Method) >> at java.lang.Object.wait(Object.java:172) >> at org.apache.solr.core.CloserThread.run(CoreContainer.java:905) >> 4) Thread[id=1677, name=searcherExecutor-749-thread-1, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> at sun.misc.Unsafe.park(Native Method) >> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) >> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> at java.lang.Thread.run(Thread.java:853) >> at __randomizedtesting.SeedInfo.seed([3D29A7E887ADDD9A]:0) >> >> >> >> >> Build Log: >> [...truncated 11503 lines...] >> [junit4] Suite: org.apache.solr.rest.TestManagedResourceStorage >> [junit4] 2> Creating dataDir: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-3D29A7E887ADDD9A-001/init-core-data-001 >> [junit4] 2> 633713 T1658 oas.SolrTestCaseJ4.buildSSLConfig Randomized >> ssl (true) and clientAuth (true) >> [junit4] 2> 633714 T1658 oasc.ZkTestServer.run STARTING ZK TEST SERVER >> [junit4] 1> client port:0.0.0.0/0.0.0.0:0 >> [junit4] 2> 633715 T1659 oasc.ZkTestServer$ZKServerMain.runFromConfig >> Starting server >> [junit4] 2> 633815 T1658 oasc.ZkTestServer.run start zk server on >> port:57977 >> [junit4] 2> 633816 T1658 oascc.ConnectionManager.waitForConnected >> Waiting for client to connect to ZooKeeper >> [junit4] 2> 633819 T1665 oascc.ConnectionManager.process Watcher >> org.apache.solr.common.cloud.ConnectionManager@f94d8c4d >> name:ZooKeeperConnection Watcher:127.0.0.1:57977 got event WatchedEvent >> state:SyncConnected type:None path:null path:null type:None >> [junit4] 2> 633819 T1658 oascc.ConnectionManager.waitForConnected Client >> is connected to ZooKeeper >> [junit4] 2> 633819 T1658 oascc.SolrZkClient.makePath makePath: /solr >> [junit4] 2> 633822 T1658 oascc.ConnectionManager.waitForConnected >> Waiting for client to connect to ZooKeeper >> [junit4] 2> 633827 T1667 oascc.ConnectionManager.process Watcher >> org.apache.solr.common.cloud.ConnectionManager@f56fd6a0 >> name:ZooKeeperConnection Watcher:127.0.0.1:57977/solr got event WatchedEvent >> state:SyncConnected type:None path:null path:null type:None >> [junit4] 2> 633827 T1658 oascc.ConnectionManager.waitForConnected Client >> is connected to ZooKeeper >> [junit4] 2> 633828 T1658 oascc.SolrZkClient.makePath makePath: >> /collections/collection1 >> [junit4] 2> 633830 T1658 oascc.SolrZkClient.makePath makePath: >> /collections/collection1/shards >> [junit4] 2> 633832 T1658 oascc.SolrZkClient.makePath makePath: >> /collections/control_collection >> [junit4] 2> 633833 T1658 oascc.SolrZkClient.makePath makePath: >> /collections/control_collection/shards >> [junit4] 2> 633834 T1658 oasc.AbstractZkTestCase.putConfig put >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.xml >> to /configs/conf1/solrconfig.xml >> [junit4] 2> 633835 T1658 oascc.SolrZkClient.makePath makePath: >> /configs/conf1/solrconfig.xml >> [junit4] 2> 633837 T1658 oasc.AbstractZkTestCase.putConfig put >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml >> to /configs/conf1/schema.xml >> [junit4] 2> 633838 T1658 oascc.SolrZkClient.makePath makePath: >> /configs/conf1/schema.xml >> [junit4] 2> 633840 T1658 oasc.AbstractZkTestCase.putConfig put >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml >> to /configs/conf1/solrconfig.snippet.randomindexconfig.xml >> [junit4] 2> 633840 T1658 oascc.SolrZkClient.makePath makePath: >> /configs/conf1/solrconfig.snippet.randomindexconfig.xml >> [junit4] 2> 633842 T1658 oasc.AbstractZkTestCase.putConfig put >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt >> to /configs/conf1/stopwords.txt >> [junit4] 2> 633842 T1658 oascc.SolrZkClient.makePath makePath: >> /configs/conf1/stopwords.txt >> [junit4] 2> 633844 T1658 oasc.AbstractZkTestCase.putConfig put >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt >> to /configs/conf1/protwords.txt >> [junit4] 2> 633844 T1658 oascc.SolrZkClient.makePath makePath: >> /configs/conf1/protwords.txt >> [junit4] 2> 633846 T1658 oasc.AbstractZkTestCase.putConfig put >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml >> to /configs/conf1/currency.xml >> [junit4] 2> 633846 T1658 oascc.SolrZkClient.makePath makePath: >> /configs/conf1/currency.xml >> [junit4] 2> 633848 T1658 oasc.AbstractZkTestCase.putConfig put >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml >> to /configs/conf1/enumsConfig.xml >> [junit4] 2> 633848 T1658 oascc.SolrZkClient.makePath makePath: >> /configs/conf1/enumsConfig.xml >> [junit4] 2> 633850 T1658 oasc.AbstractZkTestCase.putConfig put >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json >> to /configs/conf1/open-exchange-rates.json >> [junit4] 2> 633850 T1658 oascc.SolrZkClient.makePath makePath: >> /configs/conf1/open-exchange-rates.json >> [junit4] 2> 633852 T1658 oasc.AbstractZkTestCase.putConfig put >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt >> to /configs/conf1/mapping-ISOLatin1Accent.txt >> [junit4] 2> 633852 T1658 oascc.SolrZkClient.makePath makePath: >> /configs/conf1/mapping-ISOLatin1Accent.txt >> [junit4] 2> 633854 T1658 oasc.AbstractZkTestCase.putConfig put >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt >> to /configs/conf1/old_synonyms.txt >> [junit4] 2> 633854 T1658 oascc.SolrZkClient.makePath makePath: >> /configs/conf1/old_synonyms.txt >> [junit4] 2> 633856 T1658 oasc.AbstractZkTestCase.putConfig put >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt >> to /configs/conf1/synonyms.txt >> [junit4] 2> 633856 T1658 oascc.SolrZkClient.makePath makePath: >> /configs/conf1/synonyms.txt >> [junit4] 2> 633858 T1658 oas.SolrTestCaseJ4.initCore ####initCore >> [junit4] 2> 633859 T1658 oasc.SolrResourceLoader.<init> new >> SolrResourceLoader for directory: >> '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/' >> [junit4] 2> 633859 T1658 oasc.SolrResourceLoader.replaceClassLoader >> Adding >> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/lib/.svn/' >> to classloader >> [junit4] 2> 633860 T1658 oasc.SolrResourceLoader.replaceClassLoader >> Adding >> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes/' >> to classloader >> [junit4] 2> 633860 T1658 oasc.SolrResourceLoader.replaceClassLoader >> Adding >> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/lib/README' >> to classloader >> [junit4] 2> 633901 T1658 oasc.SolrConfig.<init> Using Lucene >> MatchVersion: 4.11.0 >> [junit4] 2> 633950 T1658 oasc.SolrConfig.<init> Loaded SolrConfig: >> solrconfig.xml >> [junit4] 2> 633951 T1658 oass.IndexSchema.readSchema Reading Solr Schema >> from schema.xml >> [junit4] 2> 633957 T1658 oass.IndexSchema.readSchema [null] Schema >> name=test >> [junit4] 2> 634402 T1658 oass.ByteField.init WARN ByteField is >> deprecated and will be removed in 5.0. You should use TrieIntField instead. >> [junit4] 2> 634402 T1658 oass.ShortField.init WARN ShortField is >> deprecated and will be removed in 5.0. You should use TrieIntField instead. >> [junit4] 2> 634403 T1658 oass.OpenExchangeRatesOrgProvider.init >> Initialized with rates=open-exchange-rates.json, refreshInterval=1440. >> [junit4] 2> 634409 T1658 oass.IndexSchema.readSchema default search >> field in schema is text >> [junit4] 2> 634412 T1658 oass.IndexSchema.readSchema unique key field: id >> [junit4] 2> 634422 T1658 oass.FileExchangeRateProvider.reload Reloading >> exchange rates from file currency.xml >> [junit4] 2> 634427 T1658 oass.FileExchangeRateProvider.reload Reloading >> exchange rates from file currency.xml >> [junit4] 2> 634432 T1658 oass.OpenExchangeRatesOrgProvider.reload >> Reloading exchange rates from open-exchange-rates.json >> [junit4] 2> 634433 T1658 >> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key >> IMPORTANT NOTE >> [junit4] 2> 634434 T1658 >> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected >> key, got STRING >> [junit4] 2> 634434 T1658 oass.OpenExchangeRatesOrgProvider.reload >> Reloading exchange rates from open-exchange-rates.json >> [junit4] 2> 634435 T1658 >> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key >> IMPORTANT NOTE >> [junit4] 2> 634436 T1658 >> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected >> key, got STRING >> [junit4] 2> 634436 T1658 oasc.SolrResourceLoader.locateSolrHome JNDI not >> configured for solr (NoInitialContextEx) >> [junit4] 2> 634437 T1658 oasc.SolrResourceLoader.locateSolrHome using >> system property solr.solr.home: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr >> [junit4] 2> 634437 T1658 oasc.SolrResourceLoader.<init> new >> SolrResourceLoader for directory: >> '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/' >> [junit4] 2> 634502 T1658 oasc.CoreContainer.<init> New CoreContainer >> -970425498 >> [junit4] 2> 634503 T1658 oasc.CoreContainer.load Loading cores into >> CoreContainer >> [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/] >> [junit4] 2> 634505 T1658 oashc.HttpShardHandlerFactory.getParameter >> Setting socketTimeout to: 0 >> [junit4] 2> 634505 T1658 oashc.HttpShardHandlerFactory.getParameter >> Setting urlScheme to: null >> [junit4] 2> 634506 T1658 oashc.HttpShardHandlerFactory.getParameter >> Setting connTimeout to: 0 >> [junit4] 2> 634506 T1658 oashc.HttpShardHandlerFactory.getParameter >> Setting maxConnectionsPerHost to: 20 >> [junit4] 2> 634506 T1658 oashc.HttpShardHandlerFactory.getParameter >> Setting corePoolSize to: 0 >> [junit4] 2> 634507 T1658 oashc.HttpShardHandlerFactory.getParameter >> Setting maximumPoolSize to: 2147483647 >> [junit4] 2> 634507 T1658 oashc.HttpShardHandlerFactory.getParameter >> Setting maxThreadIdleTime to: 5 >> [junit4] 2> 634507 T1658 oashc.HttpShardHandlerFactory.getParameter >> Setting sizeOfQueue to: -1 >> [junit4] 2> 634508 T1658 oashc.HttpShardHandlerFactory.getParameter >> Setting fairnessPolicy to: false >> [junit4] 2> 634510 T1658 oasu.UpdateShardHandler.<init> Creating >> UpdateShardHandler HTTP client with params: >> socketTimeout=30000&connTimeout=30000&retry=false >> [junit4] 2> 634513 T1658 oasl.LogWatcher.createWatcher SLF4J impl is >> org.slf4j.impl.Log4jLoggerFactory >> [junit4] 2> 634513 T1658 oasl.LogWatcher.newRegisteredLogWatcher >> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] >> [junit4] 2> 634514 T1658 oasc.CoreContainer.load Host Name: >> [junit4] 2> 634514 T1658 oasc.ZkContainer.initZooKeeper Zookeeper >> client=127.0.0.1:57977/solr >> [junit4] 2> 634515 T1658 oasc.ZkController.checkChrootPath zkHost >> includes chroot >> [junit4] 2> 634516 T1658 oascc.ConnectionManager.waitForConnected >> Waiting for client to connect to ZooKeeper >> [junit4] 2> 634517 T1669 oascc.ConnectionManager.process Watcher >> org.apache.solr.common.cloud.ConnectionManager@6ee43f3c >> name:ZooKeeperConnection Watcher:127.0.0.1:57977 got event WatchedEvent >> state:SyncConnected type:None path:null path:null type:None >> [junit4] 2> 634517 T1658 oascc.ConnectionManager.waitForConnected Client >> is connected to ZooKeeper >> [junit4] 2> 634519 T1658 oascc.ConnectionManager.waitForConnected >> Waiting for client to connect to ZooKeeper >> [junit4] 2> 634520 T1671 oascc.ConnectionManager.process Watcher >> org.apache.solr.common.cloud.ConnectionManager@ca2215f9 >> name:ZooKeeperConnection Watcher:127.0.0.1:57977/solr got event WatchedEvent >> state:SyncConnected type:None path:null path:null type:None >> [junit4] 2> 634520 T1658 oascc.ConnectionManager.waitForConnected Client >> is connected to ZooKeeper >> [junit4] 2> 634522 T1658 oascc.SolrZkClient.makePath makePath: >> /overseer/queue >> [junit4] 2> 634525 T1658 oascc.SolrZkClient.makePath makePath: >> /overseer/collection-queue-work >> [junit4] 2> 634528 T1658 oascc.SolrZkClient.makePath makePath: >> /overseer/collection-map-running >> [junit4] 2> 634530 T1658 oascc.SolrZkClient.makePath makePath: >> /overseer/collection-map-completed >> [junit4] 2> 634534 T1658 oascc.SolrZkClient.makePath makePath: >> /overseer/collection-map-failure >> [junit4] 2> 634538 T1658 oascc.SolrZkClient.makePath makePath: >> /live_nodes >> [junit4] 2> 634539 T1658 oasc.ZkController.createEphemeralLiveNode >> Register node as live in ZooKeeper:/live_nodes/188.138.97.18:_ >> [junit4] 2> 634540 T1658 oascc.SolrZkClient.makePath makePath: >> /live_nodes/188.138.97.18:_ >> [junit4] 2> 634543 T1658 oascc.SolrZkClient.makePath makePath: >> /overseer_elect >> [junit4] 2> 634545 T1658 oascc.SolrZkClient.makePath makePath: >> /overseer_elect/election >> [junit4] 2> 634547 T1658 oasc.Overseer.close Overseer (id=null) closing >> [junit4] 2> 634549 T1658 oasc.OverseerElectionContext.runLeaderProcess I >> am going to be the leader 188.138.97.18:_ >> [junit4] 2> 634550 T1658 oascc.SolrZkClient.makePath makePath: >> /overseer_elect/leader >> [junit4] 2> 634552 T1658 oasc.Overseer.start Overseer >> (id=92361197477494787-188.138.97.18:_-n_0000000000) starting >> [junit4] 2> 634555 T1658 oascc.SolrZkClient.makePath makePath: >> /overseer/queue-work >> [junit4] 2> 634563 T1658 oasc.OverseerAutoReplicaFailoverThread.<init> >> Starting OverseerAutoReplicaFailoverThread >> autoReplicaFailoverWorkLoopDelay=10000 >> autoReplicaFailoverWaitAfterExpiration=30000 >> autoReplicaFailoverBadNodeExpiration=60000 >> [junit4] 2> 634565 T1673 oasc.OverseerCollectionProcessor.run Process >> current queue of collection creations >> [junit4] 2> 634565 T1658 oascc.SolrZkClient.makePath makePath: >> /clusterstate.json >> [junit4] 2> 634567 T1658 oascc.SolrZkClient.makePath makePath: >> /aliases.json >> [junit4] 2> 634569 T1658 >> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster >> state from ZooKeeper... >> [junit4] 2> 634571 T1672 oasc.Overseer$ClusterStateUpdater.run Starting >> to work on the main queue >> [junit4] 2> 634575 T1675 oasc.ZkController.publish publishing >> core=collection1 state=down collection=collection1 >> [junit4] 2> 634576 T1675 oasc.ZkController.publish numShards not found >> on descriptor - reading it from system property >> [junit4] 2> 634576 T1675 oasc.ZkController.waitForShardId waiting to >> find shard id in clusterstate for collection1 >> [junit4] 2> 634576 T1676 oasc.DistributedQueue$LatchChildWatcher.process >> LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type >> NodeChildrenChanged >> [junit4] 2> 634578 T1672 oasc.Overseer$ClusterStateUpdater.updateState >> Update state numShards=null message={ >> [junit4] 2> "node_name":"188.138.97.18:_", >> [junit4] 2> "core":"collection1", >> [junit4] 2> "collection":"collection1", >> [junit4] 2> "operation":"state", >> [junit4] 2> "base_url":"http://188.138.97.18:";, >> [junit4] 2> "core_node_name":"188.138.97.18:__collection1", >> [junit4] 2> "roles":null, >> [junit4] 2> "shard":"shard1", >> [junit4] 2> "state":"down"} >> [junit4] 2> 634580 T1676 oascc.ZkStateReader$2.process A cluster state >> change: WatchedEvent state:SyncConnected type:NodeDataChanged >> path:/clusterstate.json, has occurred - updating... (live nodes size: 1) >> [junit4] 2> 635577 T1675 oasc.ZkController.createCollectionZkNode Check >> for collection zkNode:collection1 >> [junit4] 2> 635578 T1675 oasc.ZkController.createCollectionZkNode >> Collection zkNode exists >> [junit4] 2> 635578 T1675 oascc.ZkStateReader.readConfigName Load >> collection config from:/collections/collection1 >> [junit4] 2> 635579 T1675 oascc.ZkStateReader.readConfigName >> path=/collections/collection1 configName=conf1 specified config exists in >> ZooKeeper >> [junit4] 2> 635579 T1675 oasc.SolrResourceLoader.<init> new >> SolrResourceLoader for directory: >> '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/' >> [junit4] 2> 635580 T1675 oasc.SolrResourceLoader.replaceClassLoader >> Adding >> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/lib/.svn/' >> to classloader >> [junit4] 2> 635580 T1675 oasc.SolrResourceLoader.replaceClassLoader >> Adding >> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes/' >> to classloader >> [junit4] 2> 635581 T1675 oasc.SolrResourceLoader.replaceClassLoader >> Adding >> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/lib/README' >> to classloader >> [junit4] 2> 635625 T1675 oasc.SolrConfig.<init> Using Lucene >> MatchVersion: 4.11.0 >> [junit4] 2> 635673 T1675 oasc.SolrConfig.<init> Loaded SolrConfig: >> solrconfig.xml >> [junit4] 2> 635674 T1675 oass.IndexSchema.readSchema Reading Solr Schema >> from schema.xml >> [junit4] 2> 635680 T1675 oass.IndexSchema.readSchema [collection1] >> Schema name=test >> [junit4] 2> 636033 T1675 oass.ByteField.init WARN ByteField is >> deprecated and will be removed in 5.0. You should use TrieIntField instead. >> [junit4] 2> 636033 T1675 oass.ShortField.init WARN ShortField is >> deprecated and will be removed in 5.0. You should use TrieIntField instead. >> [junit4] 2> 636034 T1675 oass.OpenExchangeRatesOrgProvider.init >> Initialized with rates=open-exchange-rates.json, refreshInterval=1440. >> [junit4] 2> 636039 T1675 oass.IndexSchema.readSchema default search >> field in schema is text >> [junit4] 2> 636041 T1675 oass.IndexSchema.readSchema unique key field: id >> [junit4] 2> 636052 T1675 oass.FileExchangeRateProvider.reload Reloading >> exchange rates from file currency.xml >> [junit4] 2> 636056 T1675 oass.FileExchangeRateProvider.reload Reloading >> exchange rates from file currency.xml >> [junit4] 2> 636060 T1675 oass.OpenExchangeRatesOrgProvider.reload >> Reloading exchange rates from open-exchange-rates.json >> [junit4] 2> 636061 T1675 >> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key >> IMPORTANT NOTE >> [junit4] 2> 636061 T1675 >> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected >> key, got STRING >> [junit4] 2> 636061 T1675 oass.OpenExchangeRatesOrgProvider.reload >> Reloading exchange rates from open-exchange-rates.json >> [junit4] 2> 636062 T1675 >> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key >> IMPORTANT NOTE >> [junit4] 2> 636062 T1675 >> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected >> key, got STRING >> [junit4] 2> 636063 T1675 oasc.CoreContainer.create Creating SolrCore >> 'collection1' using configuration from collection collection1 >> [junit4] 2> 636063 T1675 oasc.SolrCore.initDirectoryFactory >> org.apache.solr.core.MockDirectoryFactory >> [junit4] 2> 636063 T1675 oasc.SolrCore.<init> [collection1] Opening new >> SolrCore at >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/, >> >> dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-3D29A7E887ADDD9A-001/init-core-data-001/ >> [junit4] 2> 636064 T1675 oasc.JmxMonitoredMap.<init> JMX monitoring is >> enabled. Adding Solr mbeans to JMX Server: >> com.sun.jmx.mbeanserver.JmxMBeanServer@1687810e >> [junit4] 2> 636065 T1675 oasc.CachingDirectoryFactory.get return new >> directory for >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-3D29A7E887ADDD9A-001/init-core-data-001 >> [junit4] 2> 636065 T1675 oasc.SolrCore.getNewIndexDir New index >> directory detected: old=null >> new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-3D29A7E887ADDD9A-001/init-core-data-001/index/ >> [junit4] 2> 636065 T1675 oasc.SolrCore.initIndex WARN [collection1] Solr >> index directory >> '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-3D29A7E887ADDD9A-001/init-core-data-001/index' >> doesn't exist. Creating new index... >> [junit4] 2> 636066 T1675 oasc.CachingDirectoryFactory.get return new >> directory for >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-3D29A7E887ADDD9A-001/init-core-data-001/index >> [junit4] 2> 636066 T1675 oasu.RandomMergePolicy.<init> RandomMergePolicy >> wrapping class org.apache.lucene.index.LogDocMergePolicy: >> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=19, >> maxMergeSize=9223372036854775807, >> maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, >> maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, >> noCFSRatio=0.7535620011195773] >> [junit4] 2> 636067 T1675 oasc.SolrDeletionPolicy.onCommit >> SolrDeletionPolicy.onCommit: commits: num=1 >> [junit4] 2> >> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@3d7afa6f >> >> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@632b2f03)),segFN=segments_1,generation=1} >> [junit4] 2> 636067 T1675 oasc.SolrDeletionPolicy.updateCommits newest >> commit generation = 1 >> [junit4] 2> 636068 T1675 oasc.SolrCore.initWriters created xml: >> solr.XMLResponseWriter >> [junit4] 2> 636070 T1675 oasup.UpdateRequestProcessorChain.init creating >> updateRequestProcessorChain "dedupe" >> [junit4] 2> 636070 T1675 oasup.UpdateRequestProcessorChain.init >> inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain >> "dedupe" >> [junit4] 2> 636071 T1675 oasup.UpdateRequestProcessorChain.init creating >> updateRequestProcessorChain "dedupe-allfields" >> [junit4] 2> 636071 T1675 oasup.UpdateRequestProcessorChain.init >> inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain >> "dedupe-allfields" >> [junit4] 2> 636071 T1675 oasup.UpdateRequestProcessorChain.init creating >> updateRequestProcessorChain "stored_sig" >> [junit4] 2> 636072 T1675 oasup.UpdateRequestProcessorChain.init >> inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain >> "stored_sig" >> [junit4] 2> 636072 T1675 oasup.UpdateRequestProcessorChain.init creating >> updateRequestProcessorChain "uniq-fields" >> [junit4] 2> 636072 T1675 oasup.UniqFieldsUpdateProcessorFactory.init >> WARN Use of the 'fields' init param in UniqFieldsUpdateProcessorFactory is >> deprecated, please use 'fieldName' (or another >> FieldMutatingUpdateProcessorFactory selector option) instead >> [junit4] 2> 636073 T1675 oasup.UniqFieldsUpdateProcessorFactory.init >> Replacing 'fields' init param with (individual) 'fieldName' params >> [junit4] 2> 636073 T1675 oasup.UpdateRequestProcessorChain.init >> inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain >> "uniq-fields" >> [junit4] 2> 636073 T1675 oasup.UpdateRequestProcessorChain.init creating >> updateRequestProcessorChain "distrib-dup-test-chain-explicit" >> [junit4] 2> 636074 T1675 oasup.UpdateRequestProcessorChain.init creating >> updateRequestProcessorChain "distrib-dup-test-chain-implicit" >> [junit4] 2> 636074 T1675 oasup.UpdateRequestProcessorChain.init >> inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain >> "distrib-dup-test-chain-implicit" >> [junit4] 2> 636075 T1675 oasc.SolrCore.loadUpdateProcessorChains no >> updateRequestProcessorChain defined as default, creating implicit default >> [junit4] 2> 636075 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created /update: org.apache.solr.handler.UpdateRequestHandler >> [junit4] 2> 636076 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created /update/json: org.apache.solr.handler.UpdateRequestHandler >> [junit4] 2> 636076 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created /update/csv: org.apache.solr.handler.UpdateRequestHandler >> [junit4] 2> 636077 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler >> [junit4] 2> 636077 T1675 oasc.RequestHandlers.initHandlersFromConfig >> adding lazy requestHandler: solr.ReplicationHandler >> [junit4] 2> 636077 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created /replication: solr.ReplicationHandler >> [junit4] 2> 636078 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created standard: solr.StandardRequestHandler >> [junit4] 2> 636078 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created /get: solr.RealTimeGetHandler >> [junit4] 2> 636078 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created dismax: solr.SearchHandler >> [junit4] 2> 636079 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler >> [junit4] 2> 636079 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created /admin/: org.apache.solr.handler.admin.AdminHandlers >> [junit4] 2> 636080 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created /admin/file: solr.admin.ShowFileRequestHandler >> [junit4] 2> 636080 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created defaults: solr.StandardRequestHandler >> [junit4] 2> 636080 T1675 oasc.RequestHandlers.initHandlersFromConfig >> adding lazy requestHandler: solr.StandardRequestHandler >> [junit4] 2> 636081 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created lazy: solr.StandardRequestHandler >> [junit4] 2> 636081 T1675 oasc.RequestHandlers.initHandlersFromConfig >> WARN Multiple requestHandler registered to the same name: /update ignoring: >> org.apache.solr.handler.UpdateRequestHandler >> [junit4] 2> 636081 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created /update: solr.UpdateRequestHandler >> [junit4] 2> 636082 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created /terms: org.apache.solr.handler.component.SearchHandler >> [junit4] 2> 636082 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler >> [junit4] 2> 636083 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created spellCheckCompRH_Direct: >> org.apache.solr.handler.component.SearchHandler >> [junit4] 2> 636083 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created spellCheckWithWordbreak: >> org.apache.solr.handler.component.SearchHandler >> [junit4] 2> 636083 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created spellCheckWithWordbreak_Direct: >> org.apache.solr.handler.component.SearchHandler >> [junit4] 2> 636084 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler >> [junit4] 2> 636084 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created mltrh: org.apache.solr.handler.component.SearchHandler >> [junit4] 2> 636085 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created tvrh: org.apache.solr.handler.component.SearchHandler >> [junit4] 2> 636085 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created /mlt: solr.MoreLikeThisHandler >> [junit4] 2> 636085 T1675 oasc.RequestHandlers.initHandlersFromConfig >> created /debug/dump: solr.DumpRequestHandler >> [junit4] 2> 636087 T1675 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 >> [junit4] 2> 636088 T1675 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 >> [junit4] 2> 636089 T1675 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 >> [junit4] 2> 636090 T1675 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 >> [junit4] 2> 636092 T1675 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 >> [junit4] 2> 636093 T1675 oasc.SolrCore.initDeprecatedSupport WARN >> solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your >> config to use the ShowFileRequestHandler. >> [junit4] 2> 636095 T1675 oasu.CommitTracker.<init> Hard AutoCommit: >> disabled >> [junit4] 2> 636095 T1675 oasu.CommitTracker.<init> Soft AutoCommit: >> disabled >> [junit4] 2> 636095 T1675 oasu.RandomMergePolicy.<init> RandomMergePolicy >> wrapping class org.apache.lucene.index.TieredMergePolicy: >> [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=20, >> maxMergedSegmentMB=59.3701171875, floorSegmentMB=0.4775390625, >> forceMergeDeletesPctAllowed=5.561084628997817, segmentsPerTier=29.0, >> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0 >> [junit4] 2> 636096 T1675 oasc.SolrDeletionPolicy.onInit >> SolrDeletionPolicy.onInit: commits: num=1 >> [junit4] 2> >> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@3d7afa6f >> >> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@632b2f03)),segFN=segments_1,generation=1} >> [junit4] 2> 636096 T1675 oasc.SolrDeletionPolicy.updateCommits newest >> commit generation = 1 >> [junit4] 2> 636097 T1675 oass.SolrIndexSearcher.<init> Opening >> Searcher@10fbf6fe[collection1] main >> [junit4] 2> 636097 T1675 oascc.ZkStateReader.readConfigName Load >> collection config from:/collections/collection1 >> [junit4] 2> 636098 T1675 oascc.ZkStateReader.readConfigName >> path=/collections/collection1 configName=conf1 specified config exists in >> ZooKeeper >> [junit4] 2> 636098 T1675 oasr.RestManager.init Initializing RestManager >> with initArgs: >> {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO} >> [junit4] 2> 636098 T1675 oasr.ManagedResourceStorage.load Reading >> _rest_managed.json using InMemoryStorage >> [junit4] 2> 636099 T1675 oasr.ManagedResource.reloadFromStorage WARN No >> stored data found for /rest/managed >> [junit4] 2> 636099 T1675 oasr.ManagedResourceStorage$JsonStorage.store >> Saved JSON object to path _rest_managed.json using InMemoryStorage >> [junit4] 2> 636099 T1675 oasr.RestManager.init Initializing 0 registered >> ManagedResources >> [junit4] 2> 636099 T1675 oashc.SpellCheckComponent.inform Initializing >> spell checkers >> [junit4] 2> 636215 T1675 oass.DirectSolrSpellChecker.init init: >> {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3} >> [junit4] 2> 636241 T1677 oasc.SolrCore.registerSearcher [collection1] >> Registered new searcher Searcher@10fbf6fe[collection1] >> main{StandardDirectoryReader(segments_1:1:nrt)} >> [junit4] 2> 636245 T1675 oasc.CoreContainer.registerCore registering >> core: collection1 >> [junit4] 2> 636245 T1680 oasc.ZkController.register Register replica - >> core:collection1 address:http://188.138.97.18: collection:collection1 >> shard:shard1 >> [junit4] 2> 636246 T1680 oascc.SolrZkClient.makePath makePath: >> /collections/collection1/leader_elect/shard1/election >> [junit4] 2> 636247 T1658 oas.SolrTestCaseJ4.initCore ####initCore end >> [junit4] 2> 636250 T1680 >> oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process >> for shard shard1 >> [junit4] 2> 636250 T1658 oas.SolrTestCaseJ4.setUp ###Starting >> testFileBasedJsonStorage >> [junit4] 2> 636251 T1658 oasc.SolrResourceLoader.<init> new >> SolrResourceLoader for directory: >> '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-3D29A7E887ADDD9A-001/json-storage-001/' >> [junit4] 2> 636251 T1676 oasc.DistributedQueue$LatchChildWatcher.process >> LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type >> NodeChildrenChanged >> [junit4] 2> 636252 T1680 >> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas >> found to continue. >> [junit4] 2> 636252 T1680 >> oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - >> try and sync >> [junit4] 2> 636252 T1680 >> oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: >> http://188.138.97.18:/collection1/ shard1 >> [junit4] 2> 636253 T1680 oascc.SolrZkClient.makePath makePath: >> /collections/collection1/leaders/shard1 >> [junit4] 2> 636257 T1676 oascc.ZkStateReader$2.process A cluster state >> change: WatchedEvent state:SyncConnected type:NodeDataChanged >> path:/clusterstate.json, has occurred - updating... (live nodes size: 1) >> [junit4] 2> 636261 T1658 >> oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage >> initialized to use dir: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-3D29A7E887ADDD9A-001/json-storage-001/managed >> [junit4] 2> 636261 T1676 oasc.DistributedQueue$LatchChildWatcher.process >> LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type >> NodeChildrenChanged >> [junit4] 2> 636262 T1676 oascc.ZkStateReader$2.process A cluster state >> change: WatchedEvent state:SyncConnected type:NodeDataChanged >> path:/clusterstate.json, has occurred - updating... (live nodes size: 1) >> [junit4] 2> 636262 T1658 oasr.ManagedResourceStorage$JsonStorage.store >> Saved JSON object to path _test_foo.json using >> file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-3D29A7E887ADDD9A-001/json-storage-001/managed >> [junit4] 2> 636271 T1658 oasr.ManagedResourceStorage.load Reading >> _test_foo.json using >> file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-3D29A7E887ADDD9A-001/json-storage-001/managed >> [junit4] 2> 636271 T1658 oasr.ManagedResourceStorage.load Loaded >> LinkedHashMap at path _test_foo.json using >> file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-3D29A7E887ADDD9A-001/json-storage-001/managed >> [junit4] 2> 636272 T1658 oasr.ManagedResourceStorage$JsonStorage.store >> Saved JSON object to path _test_foo.json using >> file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-3D29A7E887ADDD9A-001/json-storage-001/managed >> [junit4] 2> 636273 T1658 oasr.ManagedResourceStorage.load Reading >> _test_foo.json using >> file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-3D29A7E887ADDD9A-001/json-storage-001/managed >> [junit4] 2> 636274 T1658 oasr.ManagedResourceStorage.load Loaded >> LinkedHashMap at path _test_foo.json using >> file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.rest.TestManagedResourceStorage-3D29A7E887ADDD9A-001/json-storage-001/managed >> [junit4] 2> 636274 T1658 oas.SolrTestCaseJ4.tearDown ###Ending >> testFileBasedJsonStorage >> [junit4] 2> 636279 T1658 oas.SolrTestCaseJ4.setUp ###Starting >> testZkBasedJsonStorage >> [junit4] 2> 636279 T1658 oasc.SolrResourceLoader.<init> new >> SolrResourceLoader for directory: './' >> [junit4] 2> 636289 T1658 oascc.SolrZkClient.makePath makePath: /test >> [junit4] 2> 636290 T1658 >> oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured >> ZooKeeperStorageIO with znodeBase: /test >> [junit4] 2> 636291 T1658 oascc.SolrZkClient.makePath makePath: >> /test/_test_foo.json >> [junit4] 2> 636292 T1658 >> oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 136 bytes to >> new znode /test/_test_foo.json >> [junit4] 2> 636292 T1658 oasr.ManagedResourceStorage$JsonStorage.store >> Saved JSON object to path _test_foo.json using ZooKeeperStorageIO:path=/test >> [junit4] 2> 636293 T1658 oasr.ManagedResourceStorage.load Reading >> _test_foo.json using ZooKeeperStorageIO:path=/test >> [junit4] 2> 636294 T1658 >> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 136 >> bytes from znode /test/_test_foo.json >> [junit4] 2> 636294 T1658 oasr.ManagedResourceStorage.load Loaded >> LinkedHashMap at path _test_foo.json using ZooKeeperStorageIO:path=/test >> [junit4] 2> 636296 T1658 >> oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 175 bytes to >> existing znode /test/_test_foo.json >> [junit4] 2> 636296 T1658 oasr.ManagedResourceStorage$JsonStorage.store >> Saved JSON object to path _test_foo.json using ZooKeeperStorageIO:path=/test >> [junit4] 2> 636296 T1658 oasr.ManagedResourceStorage.load Reading >> _test_foo.json using ZooKeeperStorageIO:path=/test >> [junit4] 2> 636297 T1658 >> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 175 >> bytes from znode /test/_test_foo.json >> [junit4] 2> 636298 T1658 oasr.ManagedResourceStorage.load Loaded >> LinkedHashMap at path _test_foo.json using ZooKeeperStorageIO:path=/test >> [junit4] 2> 636299 T1658 oas.SolrTestCaseJ4.tearDown ###Ending >> testZkBasedJsonStorage >> [junit4] 2> 636301 T1671 oaz.ClientCnxn$EventThread.processEvent ERROR >> Error while calling watcher >> java.util.concurrent.RejectedExecutionException: Task >> java.util.concurrent.FutureTask@a6f452e7 rejected from >> java.util.concurrent.ThreadPoolExecutor@f59d68cc[Terminated, pool size = 0, >> active threads = 0, queued tasks = 0, completed tasks = 6] >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2114) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:852) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1415) >> [junit4] 2> at >> java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:121) >> [junit4] 2> at >> org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:207) >> [junit4] 2> at >> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522) >> [junit4] 2> at >> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498) >> [junit4] 2> >> [junit4] 2> 636302 T1658 oasc.ZkTestServer.send4LetterWord connecting to >> 127.0.0.1:57977 57977 >> [junit4] 2> 636309 T1680 oasc.ZkController.register We are >> http://188.138.97.18:/collection1/ and leader is >> http://188.138.97.18:/collection1/ >> [junit4] 2> 636567 T1673 oasc.OverseerCollectionProcessor.amILeader >> org.apache.zookeeper.KeeperException$SessionExpiredException: >> KeeperErrorCode = Session expired for /overseer_elect/leader >> [junit4] 2> at >> org.apache.zookeeper.KeeperException.create(KeeperException.java:127) >> [junit4] 2> at >> org.apache.zookeeper.KeeperException.create(KeeperException.java:51) >> [junit4] 2> at >> org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155) >> [junit4] 2> at >> org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:308) >> [junit4] 2> at >> org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:305) >> [junit4] 2> at >> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74) >> [junit4] 2> at >> org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:305) >> [junit4] 2> at >> org.apache.solr.cloud.OverseerCollectionProcessor.amILeader(OverseerCollectionProcessor.java:514) >> [junit4] 2> at >> org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:272) >> [junit4] 2> at java.lang.Thread.run(Thread.java:853) >> [junit4] 2> >> [junit4] 2> 636860 T1659 oasc.ZkTestServer.send4LetterWord connecting to >> 127.0.0.1:57977 57977 >> [junit4] 2> 636860 T1680 oasc.ZkController.register No LogReplay needed >> for core=collection1 baseURL=http://188.138.97.18: >> [junit4] 2> 636861 T1673 oasc.OverseerCollectionProcessor.amILeader >> According to ZK I (id=92361197477494787-188.138.97.18:_-n_0000000000) am no >> longer a leader. >> [junit4] 2> 636862 T1658 oas.SolrTestCaseJ4.deleteCore ###deleteCore >> [junit4] 2> 636862 T1680 oasc.ZkController.checkRecovery WARN Skipping >> recovery according to sys prop solrcloud.skip.autorecovery >> [junit4] 2> 636863 T1680 oasc.ZkController.publish publishing >> core=collection1 state=active collection=collection1 >> [junit4] 2> 636863 T1680 oasc.ZkController.publish numShards not found >> on descriptor - reading it from system property >> [junit4] 2> 636864 T1680 >> oasc.ZkController.getLeaderInitiatedRecoveryState WARN Unable to read >> /collections/collection1/leader_initiated_recovery/shard1/188.138.97.18:__collection1 >> due to: org.apache.zookeeper.KeeperException$SessionExpiredException: >> KeeperErrorCode = Session expired for >> /collections/collection1/leader_initiated_recovery/shard1/188.138.97.18:__collection1 >> [junit4] 2> 636864 T1680 oasc.ZkController.publish publishing >> core=collection1 state=down collection=collection1 >> [junit4] 2> 636864 T1680 oasc.ZkController.publish numShards not found >> on descriptor - reading it from system property >> [junit4] 2> 636865 T1680 oasc.ZkContainer$2.run ERROR >> org.apache.zookeeper.KeeperException$SessionExpiredException: >> KeeperErrorCode = Session expired for /overseer/queue/qn- >> [junit4] 2> at >> org.apache.zookeeper.KeeperException.create(KeeperException.java:127) >> [junit4] 2> at >> org.apache.zookeeper.KeeperException.create(KeeperException.java:51) >> [junit4] 2> at >> org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) >> [junit4] 2> at >> org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:274) >> [junit4] 2> at >> org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:271) >> [junit4] 2> at >> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74) >> [junit4] 2> at >> org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:271) >> [junit4] 2> at >> org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:369) >> [junit4] 2> at >> org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:353) >> [junit4] 2> at >> org.apache.solr.cloud.ZkController.publish(ZkController.java:1120) >> [junit4] 2> at >> org.apache.solr.cloud.ZkController.publish(ZkController.java:1038) >> [junit4] 2> at >> org.apache.solr.cloud.ZkController.publish(ZkController.java:1034) >> [junit4] 2> at >> org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:228) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1176) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> [junit4] 2> at java.lang.Thread.run(Thread.java:853) >> [junit4] 2> >> [junit4] 2> 636865 T1680 oasc.SolrException.log ERROR >> :org.apache.zookeeper.KeeperException$SessionExpiredException: >> KeeperErrorCode = Session expired for /overseer/queue/qn- >> [junit4] 2> at >> org.apache.zookeeper.KeeperException.create(KeeperException.java:127) >> [junit4] 2> at >> org.apache.zookeeper.KeeperException.create(KeeperException.java:51) >> [junit4] 2> at >> org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) >> [junit4] 2> at >> org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:274) >> [junit4] 2> at >> org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:271) >> [junit4] 2> at >> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74) >> [junit4] 2> at >> org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:271) >> [junit4] 2> at >> org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:369) >> [junit4] 2> at >> org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:353) >> [junit4] 2> at >> org.apache.solr.cloud.ZkController.publish(ZkController.java:1120) >> [junit4] 2> at >> org.apache.solr.cloud.ZkController.publish(ZkController.java:1038) >> [junit4] 2> at >> org.apache.solr.cloud.ZkController.publish(ZkController.java:1034) >> [junit4] 2> at >> org.apache.solr.cloud.ZkController.register(ZkController.java:849) >> [junit4] 2> at >> org.apache.solr.cloud.ZkController.register(ZkController.java:763) >> [junit4] 2> at >> org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:221) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1176) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> [junit4] 2> at java.lang.Thread.run(Thread.java:853) >> [junit4] 2> >> [junit4] 2> 3608 T1657 ccr.ThreadLeakControl.checkThreadLeaks WARNING >> Will linger awaiting termination of 5 leaked thread(s). >> [junit4] 2> 23684 T1657 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 5 >> threads leaked from SUITE scope at >> org.apache.solr.rest.TestManagedResourceStorage: >> [junit4] 2> 1) Thread[id=1680, >> name=coreZkRegister-743-thread-1, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> [junit4] 2> at sun.misc.Unsafe.park(Native Method) >> [junit4] 2> at >> java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) >> [junit4] 2> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> [junit4] 2> at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> [junit4] 2> at java.lang.Thread.run(Thread.java:853) >> [junit4] 2> 2) Thread[id=1674, >> name=OverseerHdfsCoreFailoverThread-92361197477494787-188.138.97.18:_-n_0000000000, >> state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] >> [junit4] 2> at java.lang.Thread.sleep(Native Method) >> [junit4] 2> at java.lang.Thread.sleep(Thread.java:977) >> [junit4] 2> at >> org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:136) >> [junit4] 2> at java.lang.Thread.run(Thread.java:853) >> [junit4] 2> 3) Thread[id=1678, name=Thread-509, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> [junit4] 2> at java.lang.Object.wait(Native Method) >> [junit4] 2> at java.lang.Object.wait(Object.java:172) >> [junit4] 2> at >> org.apache.solr.core.CloserThread.run(CoreContainer.java:905) >> [junit4] 2> 4) Thread[id=1677, >> name=searcherExecutor-749-thread-1, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> [junit4] 2> at sun.misc.Unsafe.park(Native Method) >> [junit4] 2> at >> java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) >> [junit4] 2> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> [junit4] 2> at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> [junit4] 2> at java.lang.Thread.run(Thread.java:853) >> [junit4] 2> 5) Thread[id=1672, >> name=OverseerStateUpdate-92361197477494787-188.138.97.18:_-n_0000000000, >> state=TIMED_WAITING, group=Overseer state updater.] >> [junit4] 2> at java.lang.Object.wait(Native Method) >> [junit4] 2> at java.lang.Object.wait(Object.java:201) >> [junit4] 2> at >> org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:266) >> [junit4] 2> at >> org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:309) >> [junit4] 2> at >> org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:582) >> [junit4] 2> at >> org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560) >> [junit4] 2> at >> org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:219) >> [junit4] 2> at java.lang.Thread.run(Thread.java:853) >> [junit4] 2> 23685 T1657 ccr.ThreadLeakControl.tryToInterruptAll Starting >> to interrupt leaked threads: >> [junit4] 2> 1) Thread[id=1680, >> name=coreZkRegister-743-thread-1, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> [junit4] 2> 2) Thread[id=1674, >> name=OverseerHdfsCoreFailoverThread-92361197477494787-188.138.97.18:_-n_0000000000, >> state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] >> [junit4] 2> 3) Thread[id=1678, name=Thread-509, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> [junit4] 2> 4) Thread[id=1677, >> name=searcherExecutor-749-thread-1, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> [junit4] 2> 5) Thread[id=1672, >> name=OverseerStateUpdate-92361197477494787-188.138.97.18:_-n_0000000000, >> state=TIMED_WAITING, group=Overseer state updater.] >> [junit4] 2> 657399 T1672 oasc.Overseer$ClusterStateUpdater.run Overseer >> Loop exiting : 188.138.97.18:_ >> [junit4] 2> 657400 T1681 >> oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read >> the data org.apache.zookeeper.KeeperException$SessionExpiredException: >> KeeperErrorCode = Session expired for /overseer_elect/leader >> [junit4] 2> at >> org.apache.zookeeper.KeeperException.create(KeeperException.java:127) >> [junit4] 2> at >> org.apache.zookeeper.KeeperException.create(KeeperException.java:51) >> [junit4] 2> at >> org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155) >> [junit4] 2> at >> org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:308) >> [junit4] 2> at >> org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:305) >> [junit4] 2> at >> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74) >> [junit4] 2> at >> org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:305) >> [junit4] 2> at >> org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320) >> [junit4] 2> at >> org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89) >> [junit4] 2> at >> org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292) >> [junit4] 2> >> [junit4] 2> 26708 T1657 ccr.ThreadLeakControl.tryToInterruptAll SEVERE >> There are still zombie threads that couldn't be terminated: >> [junit4] 2> 1) Thread[id=1680, >> name=coreZkRegister-743-thread-1, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> [junit4] 2> at sun.misc.Unsafe.park(Native Method) >> [junit4] 2> at >> java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) >> [junit4] 2> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> [junit4] 2> at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> [junit4] 2> at java.lang.Thread.run(Thread.java:853) >> [junit4] 2> 2) Thread[id=1674, >> name=OverseerHdfsCoreFailoverThread-92361197477494787-188.138.97.18:_-n_0000000000, >> state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.] >> [junit4] 2> at >> org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:138) >> [junit4] 2> at java.lang.Thread.run(Thread.java:853) >> [junit4] 2> 3) Thread[id=1678, name=Thread-509, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> [junit4] 2> at java.lang.Object.wait(Native Method) >> [junit4] 2> at java.lang.Object.wait(Object.java:172) >> [junit4] 2> at >> org.apache.solr.core.CloserThread.run(CoreContainer.java:905) >> [junit4] 2> 4) Thread[id=1677, >> name=searcherExecutor-749-thread-1, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> [junit4] 2> at sun.misc.Unsafe.park(Native Method) >> [junit4] 2> at >> java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) >> [junit4] 2> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> [junit4] 2> at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> [junit4] 2> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> [junit4] 2> at java.lang.Thread.run(Thread.java:853) >> [junit4] 2> NOTE: test params are: codec=Asserting(Lucene410), >> sim=DefaultSimilarity, locale=en_CA, timezone=CET >> [junit4] 2> NOTE: Linux 3.13.0-34-generic x86/IBM Corporation 1.7.0 >> (32-bit)/cpus=8,threads=5,free=56465976,total=296484864 >> [junit4] 2> NOTE: All tests run in this JVM: [MoreLikeThisHandlerTest, >> InfoHandlerTest, BasicDistributedZkTest, DirectUpdateHandlerTest, >> CoreAdminRequestStatusTest, UpdateParamsTest, AnalysisErrorHandlingTest, >> TestManagedStopFilterFactory, TestNonDefinedSimilarityFactory, >> TestCodecSupport, QueryEqualityTest, OverseerCollectionProcessorTest, >> StatelessScriptUpdateProcessorFactoryTest, TestLeaderElectionZkExpiry, >> TestArbitraryIndexDir, TestDocBasedVersionConstraints, >> TestLMJelinekMercerSimilarityFactory, ReturnFieldsTest, >> DistribCursorPagingTest, TestExceedMaxTermLength, TestTolerantSearch, >> QueryResultKeyTest, TestCollationFieldDocValues, IndexSchemaTest, >> TestJmxMonitoredMap, RecoveryZkTest, TestCollationKeyRangeQueries, >> EchoParamsTest, WordBreakSolrSpellCheckerTest, TestCloudPivotFacet, >> PathHierarchyTokenizerFactoryTest, SuggestComponentTest, NoCacheHeaderTest, >> SuggesterTSTTest, TestSolrJ, TestFieldCollectionResource, >> HdfsRecoveryZkTest, TestFuzzyAnalyzedSuggestions, >> DocumentAnalysisRequestHandlerTest, TestStressReorder, TestStressRecovery, >> DistributedQueryComponentOptimizationTest, TestDFRSimilarityFactory, >> LeaderElectionTest, MinimalSchemaTest, TestManagedResourceStorage] >> [junit4] 2> NOTE: reproduce with: ant test >> -Dtestcase=TestManagedResourceStorage -Dtests.seed=3D29A7E887ADDD9A >> -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_CA >> -Dtests.timezone=CET -Dtests.file.encoding=UTF-8 >> [junit4] ERROR 0.00s J0 | TestManagedResourceStorage (suite) <<< >> [junit4] > Throwable #1: java.lang.RuntimeException: >> SolrCore.getOpenCount()==2 >> [junit4] > at >> __randomizedtesting.SeedInfo.seed([3D29A7E887ADDD9A]:0) >> [junit4] > at >> org.apache.solr.util.TestHarness.close(TestHarness.java:332) >> [junit4] > at >> org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:620) >> [junit4] > at >> org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:183) >> [junit4] > at java.lang.Thread.run(Thread.java:853)Throwable #2: >> com.carrotsearch.randomizedtesting.ThreadLeakError: 5 threads leaked from >> SUITE scope at org.apache.solr.rest.TestManagedResourceStorage: >> [junit4] > 1) Thread[id=1680, name=coreZkRegister-743-thread-1, >> state=WAITING, group=TGRP-TestManagedResourceStorage] >> [junit4] > at sun.misc.Unsafe.park(Native Method) >> [junit4] > at >> java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) >> [junit4] > at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> [junit4] > at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> [junit4] > at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> [junit4] > at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> [junit4] > at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> [junit4] > at java.lang.Thread.run(Thread.java:853) >> [junit4] > 2) Thread[id=1674, >> name=OverseerHdfsCoreFailoverThread-92361197477494787-188.138.97.18:_-n_0000000000, >> state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] >> [junit4] > at java.lang.Thread.sleep(Native Method) >> [junit4] > at java.lang.Thread.sleep(Thread.java:977) >> [junit4] > at >> org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:136) >> [junit4] > at java.lang.Thread.run(Thread.java:853) >> [junit4] > 3) Thread[id=1678, name=Thread-509, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> [junit4] > at java.lang.Object.wait(Native Method) >> [junit4] > at java.lang.Object.wait(Object.java:172) >> [junit4] > at >> org.apache.solr.core.CloserThread.run(CoreContainer.java:905) >> [junit4] > 4) Thread[id=1677, name=searcherExecutor-749-thread-1, >> state=WAITING, group=TGRP-TestManagedResourceStorage] >> [junit4] > at sun.misc.Unsafe.park(Native Method) >> [junit4] > at >> java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) >> [junit4] > at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> [junit4] > at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> [junit4] > at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> [junit4] > at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> [junit4] > at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> [junit4] > at java.lang.Thread.run(Thread.java:853) >> [junit4] > 5) Thread[id=1672, >> name=OverseerStateUpdate-92361197477494787-188.138.97.18:_-n_0000000000, >> state=TIMED_WAITING, group=Overseer state updater.] >> [junit4] > at java.lang.Object.wait(Native Method) >> [junit4] > at java.lang.Object.wait(Object.java:201) >> [junit4] > at >> org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:266) >> [junit4] > at >> org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:309) >> [junit4] > at >> org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:582) >> [junit4] > at >> org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560) >> [junit4] > at >> org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:219) >> [junit4] > at java.lang.Thread.run(Thread.java:853) >> [junit4] > at >> __randomizedtesting.SeedInfo.seed([3D29A7E887ADDD9A]:0)Throwable #3: >> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie >> threads that couldn't be terminated: >> [junit4] > 1) Thread[id=1680, name=coreZkRegister-743-thread-1, >> state=WAITING, group=TGRP-TestManagedResourceStorage] >> [junit4] > at sun.misc.Unsafe.park(Native Method) >> [junit4] > at >> java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) >> [junit4] > at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> [junit4] > at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> [junit4] > at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> [junit4] > at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> [junit4] > at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> [junit4] > at java.lang.Thread.run(Thread.java:853) >> [junit4] > 2) Thread[id=1674, >> name=OverseerHdfsCoreFailoverThread-92361197477494787-188.138.97.18:_-n_0000000000, >> state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.] >> [junit4] > at >> org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:138) >> [junit4] > at java.lang.Thread.run(Thread.java:853) >> [junit4] > 3) Thread[id=1678, name=Thread-509, state=WAITING, >> group=TGRP-TestManagedResourceStorage] >> [junit4] > at java.lang.Object.wait(Native Method) >> [junit4] > at java.lang.Object.wait(Object.java:172) >> [junit4] > at >> org.apache.solr.core.CloserThread.run(CoreContainer.java:905) >> [junit4] > 4) Thread[id=1677, name=searcherExecutor-749-thread-1, >> state=WAITING, group=TGRP-TestManagedResourceStorage] >> [junit4] > at sun.misc.Unsafe.park(Native Method) >> [junit4] > at >> java.util.concurrent.locks.LockSupport.park(LockSupport.java:197) >> [junit4] > at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054) >> [junit4] > at >> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453) >> [junit4] > at >> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1099) >> [junit4] > at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161) >> [junit4] > at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) >> [junit4] > at java.lang.Thread.run(Thread.java:853) >> [junit4] > at >> __randomizedtesting.SeedInfo.seed([3D29A7E887ADDD9A]:0) >> [junit4] Completed on J0 in 26.78s, 2 tests, 3 errors <<< FAILURES! >> >> [...truncated 964 lines...] >> BUILD FAILED >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:485: The >> following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:478: The >> following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:61: The following >> error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:39: The >> following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The >> following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:494: >> The following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1344: >> The following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:959: >> There were test failures: 419 suites, 1734 tests, 3 suite-level errors, >> 1102 ignored (11 assumptions) >> >> Total time: 81 minutes 18 seconds >> Build step 'Invoke Ant' marked build as failure >> [description-setter] Description set: Java: 32bit/ibm-j9-jdk7 >> -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;} >> Archiving artifacts >> Recording test results >> Email was triggered for: Failure - Any >> Sending email for trigger: Failure - Any >> >> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
