Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/2164/
1 tests failed. REGRESSION: org.apache.solr.cloud.DeleteReplicaTest.testDistribSearch Error Message: No live SolrServers available to handle this request:[http://127.0.0.1:51595, http://127.0.0.1:51649, http://127.0.0.1:51608, http://127.0.0.1:51584, http://127.0.0.1:51589] Stack Trace: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:51595, http://127.0.0.1:51649, http://127.0.0.1:51608, http://127.0.0.1:51584, http://127.0.0.1:51589] at __randomizedtesting.SeedInfo.seed([A984496287D2D1C:8B7ECA8E5F224D20]:0) at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:332) at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880) at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658) at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601) at org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:172) at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:145) at org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:89) at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not remove replica : delLiveColl/shard1/core_node1 at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:570) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211) at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:353) at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:312) ... 47 more Build Log: [...truncated 11576 lines...] [junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest [junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/init-core-data-001 [junit4] 2> 1746501 T24929 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false) [junit4] 2> 1746502 T24929 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: / [junit4] 2> 1746508 T24929 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch [junit4] 2> 1746509 T24929 oasc.ZkTestServer.run STARTING ZK TEST SERVER [junit4] 1> client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 1746510 T24930 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server [junit4] 2> 1746610 T24929 oasc.ZkTestServer.run start zk server on port:51451 [junit4] 2> 1746611 T24929 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1746612 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1746616 T24936 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a8561f0 name:ZooKeeperConnection Watcher:127.0.0.1:51451 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1746616 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1746617 T24929 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1746617 T24929 oascc.SolrZkClient.makePath makePath: /solr [junit4] 2> 1746620 T24929 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1746622 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1746623 T24938 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52a92d33 name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1746624 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1746624 T24929 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1746624 T24929 oascc.SolrZkClient.makePath makePath: /collections/collection1 [junit4] 2> 1746627 T24929 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards [junit4] 2> 1746629 T24929 oascc.SolrZkClient.makePath makePath: /collections/control_collection [junit4] 2> 1746630 T24929 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards [junit4] 2> 1746632 T24929 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 1746633 T24929 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml [junit4] 2> 1746635 T24929 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4] 2> 1746636 T24929 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml [junit4] 2> 1746738 T24929 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1746739 T24929 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1746740 T24929 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 1746741 T24929 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt [junit4] 2> 1746743 T24929 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 1746744 T24929 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt [junit4] 2> 1746745 T24929 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 1746746 T24929 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml [junit4] 2> 1746748 T24929 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 1746749 T24929 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 1746750 T24929 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 1746751 T24929 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 1746753 T24929 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 1746753 T24929 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 1746755 T24929 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 1746756 T24929 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 1746757 T24929 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 1746758 T24929 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt [junit4] 2> 1748394 T24929 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 1748399 T24929 oejs.AbstractConnector.doStart Started [email protected]:51584 [junit4] 2> 1748400 T24929 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 1748400 T24929 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1748400 T24929 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002 [junit4] 2> 1748401 T24929 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/' [junit4] 2> 1748457 T24929 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/solr.xml [junit4] 2> 1748499 T24929 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002 [junit4] 2> 1748499 T24929 oasc.CoreContainer.<init> New CoreContainer 230586081 [junit4] 2> 1748500 T24929 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/] [junit4] 2> 1748501 T24929 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 1748501 T24929 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 1748501 T24929 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 1748501 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 1748501 T24929 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 1748502 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 1748502 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 1748502 T24929 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 1748502 T24929 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 1748503 T24929 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 1748503 T24929 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1748503 T24929 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1748504 T24929 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 1748504 T24929 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51451/solr [junit4] 2> 1748504 T24929 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 1748504 T24929 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1748505 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1748506 T24949 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@536eb4d3 name:ZooKeeperConnection Watcher:127.0.0.1:51451 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1748507 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1748508 T24929 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1748510 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1748510 T24951 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4dad8dde name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1748510 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1748512 T24929 oascc.SolrZkClient.makePath makePath: /overseer/queue [junit4] 2> 1748514 T24929 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work [junit4] 2> 1748516 T24929 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running [junit4] 2> 1748517 T24929 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed [junit4] 2> 1748519 T24929 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure [junit4] 2> 1748521 T24929 oascc.SolrZkClient.makePath makePath: /live_nodes [junit4] 2> 1748522 T24929 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51584_ [junit4] 2> 1748522 T24929 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51584_ [junit4] 2> 1748524 T24929 oascc.SolrZkClient.makePath makePath: /overseer_elect [junit4] 2> 1748525 T24929 oascc.SolrZkClient.makePath makePath: /overseer_elect/election [junit4] 2> 1748526 T24929 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 1748527 T24929 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:51584_ [junit4] 2> 1748527 T24929 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader [junit4] 2> 1748529 T24929 oasc.Overseer.start Overseer (id=92593852723822595-127.0.0.1:51584_-n_0000000000) starting [junit4] 2> 1748530 T24929 oascc.SolrZkClient.makePath makePath: /overseer/queue-work [junit4] 2> 1748535 T24929 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 1748536 T24953 oasc.OverseerCollectionProcessor.run Process current queue of collection creations [junit4] 2> 1748536 T24929 oascc.SolrZkClient.makePath makePath: /clusterstate.json [junit4] 2> 1748537 T24929 oascc.SolrZkClient.makePath makePath: /aliases.json [junit4] 2> 1748538 T24929 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1748540 T24952 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue [junit4] 2> 1748542 T24929 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002 [junit4] 2> 1748544 T24929 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/conf/ [junit4] 2> 1749575 T24929 oasc.CorePropertiesLocator.discover Found 1 core definitions [junit4] 2> 1749576 T24929 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0 [junit4] 2> 1749577 T24929 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 1749577 T24929 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1749578 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1749579 T24957 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e390df name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1749580 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1749580 T24929 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1749582 T24929 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1749584 T24929 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 1749585 T24929 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2 [junit4] 2> 1749585 T24929 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1749586 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1749587 T24959 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22a05cea name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1749587 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1749587 T24929 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1749590 T24960 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1749592 T24952 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: collection1 [junit4] 2> 1749593 T24952 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2] [junit4] 2> 1749593 T24952 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2 [junit4] 2> 1749595 T24952 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/collection1/state.json [junit4] 2> 1749596 T24960 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1749596 T24961 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1750764 T24929 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 [junit4] 2> 1750765 T24929 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 1750768 T24929 oejs.AbstractConnector.doStart Started [email protected]:51589 [junit4] 2> 1750769 T24929 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 1750769 T24929 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1750769 T24929 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003 [junit4] 2> 1750769 T24929 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/' [junit4] 2> 1750804 T24929 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/solr.xml [junit4] 2> 1750857 T24929 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003 [junit4] 2> 1750858 T24929 oasc.CoreContainer.<init> New CoreContainer 292044262 [junit4] 2> 1750858 T24929 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/] [junit4] 2> 1750859 T24929 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 1750859 T24929 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 1750860 T24929 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 1750860 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 1750860 T24929 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 1750860 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 1750860 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 1750861 T24929 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 1750861 T24929 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 1750861 T24929 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 1750862 T24929 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1750862 T24929 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1750862 T24929 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 1750862 T24929 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51451/solr [junit4] 2> 1750863 T24929 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 1750863 T24929 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1750864 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1750865 T24972 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52b7cff7 name:ZooKeeperConnection Watcher:127.0.0.1:51451 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1750866 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1750866 T24929 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1750868 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1750869 T24974 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@409c76d6 name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1750869 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1750874 T24929 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1751877 T24929 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51589_ [junit4] 2> 1751878 T24929 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51589_ [junit4] 2> 1751881 T24929 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 1751885 T24929 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003 [junit4] 2> 1751896 T24929 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/conf/ [junit4] 2> 1753099 T24929 oasc.CorePropertiesLocator.discover Found 1 core definitions [junit4] 2> 1753103 T24929 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0 [junit4] 2> 1753103 T24929 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 1754018 T24929 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 [junit4] 2> 1754019 T24929 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 1754022 T24929 oejs.AbstractConnector.doStart Started [email protected]:51595 [junit4] 2> 1754022 T24929 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 1754023 T24929 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1754023 T24929 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-004 [junit4] 2> 1754023 T24929 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-004/' [junit4] 2> 1754055 T24929 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-004/solr.xml [junit4] 2> 1754100 T24929 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-004 [junit4] 2> 1754100 T24929 oasc.CoreContainer.<init> New CoreContainer 208789375 [junit4] 2> 1754101 T24929 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-004/] [junit4] 2> 1754102 T24929 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 1754102 T24929 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 1754102 T24929 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 1754102 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 1754102 T24929 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 1754103 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 1754103 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 1754103 T24929 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 1754103 T24929 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 1754104 T24929 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 1754104 T24929 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1754104 T24929 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1754105 T24929 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 1754105 T24929 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51451/solr [junit4] 2> 1754105 T24929 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 1754105 T24929 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1754106 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1754107 T24987 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@808113b name:ZooKeeperConnection Watcher:127.0.0.1:51451 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1754108 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1754109 T24929 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1754111 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1754112 T24989 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21778113 name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1754112 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1754116 T24929 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1755120 T24929 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51595_ [junit4] 2> 1755121 T24929 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51595_ [junit4] 2> 1755125 T24929 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 1755129 T24929 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-004 [junit4] 2> 1755870 T24929 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-004/conf/ [junit4] 2> 1755986 T24929 oasc.CorePropertiesLocator.discover Found 1 core definitions [junit4] 2> 1755987 T24929 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0 [junit4] 2> 1755988 T24929 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 1756884 T24929 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3 [junit4] 2> 1756885 T24929 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 1756888 T24929 oejs.AbstractConnector.doStart Started [email protected]:51608 [junit4] 2> 1756888 T24929 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 1756889 T24929 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1756889 T24929 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005 [junit4] 2> 1756889 T24929 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005/' [junit4] 2> 1756919 T24929 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005/solr.xml [junit4] 2> 1756980 T24929 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005 [junit4] 2> 1756980 T24929 oasc.CoreContainer.<init> New CoreContainer 1097821943 [junit4] 2> 1756981 T24929 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005/] [junit4] 2> 1756982 T24929 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 1756982 T24929 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 1756983 T24929 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 1756983 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 1756983 T24929 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 1756984 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 1756984 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 1756984 T24929 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 1756985 T24929 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 1756985 T24929 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 1756986 T24929 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1756986 T24929 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1756986 T24929 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 1756987 T24929 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51451/solr [junit4] 2> 1756987 T24929 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 1756988 T24929 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1756989 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1756990 T25002 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ade3bb0 name:ZooKeeperConnection Watcher:127.0.0.1:51451 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1756991 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1756991 T24929 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1756993 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1756995 T25004 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ad8e96a name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1756995 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1757000 T24929 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1758004 T24929 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51608_ [junit4] 2> 1758005 T24929 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51608_ [junit4] 2> 1758009 T24929 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 1758013 T24929 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005 [junit4] 2> 1759066 T24929 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005/conf/ [junit4] 2> 1759080 T24929 oasc.CorePropertiesLocator.discover Found 1 core definitions [junit4] 2> 1759081 T24929 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0 [junit4] 2> 1759082 T24929 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 1760248 T24929 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4 [junit4] 2> 1760248 T24929 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 1760251 T24929 oejs.AbstractConnector.doStart Started [email protected]:51649 [junit4] 2> 1760252 T24929 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 1760252 T24929 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1760252 T24929 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006 [junit4] 2> 1760252 T24929 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/' [junit4] 2> 1760283 T24929 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/solr.xml [junit4] 2> 1760327 T24929 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006 [junit4] 2> 1760327 T24929 oasc.CoreContainer.<init> New CoreContainer 133676098 [junit4] 2> 1760327 T24929 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/] [junit4] 2> 1760328 T24929 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 1760328 T24929 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 1760329 T24929 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 1760329 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 1760329 T24929 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 1760329 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 1760330 T24929 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 1760330 T24929 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 1760330 T24929 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 1760331 T24929 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 1760331 T24929 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1760331 T24929 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1760331 T24929 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 1760332 T24929 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51451/solr [junit4] 2> 1760332 T24929 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 1760332 T24929 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1760333 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1760334 T25017 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19689524 name:ZooKeeperConnection Watcher:127.0.0.1:51451 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1760335 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1760336 T24929 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1760338 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1760339 T25019 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d7c72bb name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1760339 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1760343 T24929 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1761347 T24929 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51649_ [junit4] 2> 1761348 T24929 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51649_ [junit4] 2> 1761352 T24929 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 1761357 T24929 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006 [junit4] 2> 1761385 T24929 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/conf/ [junit4] 2> 1762648 T24929 oasc.CorePropertiesLocator.discover Found 1 core definitions [junit4] 2> 1762649 T24929 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0 [junit4] 2> 1762649 T24929 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 1762651 T24929 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1762651 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1762652 T25023 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79bdecc1 name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1762653 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1762653 T24929 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1762655 T24929 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1762656 T24929 oasc.AbstractFullDistribZkTestBase.createCollection Creating collection with stateFormat=2: delLiveColl [junit4] 2> 1762656 T24929 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1762657 T24929 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1762658 T25025 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e44ef88 name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1762658 T24929 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1762658 T24929 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1762659 T24929 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1762663 T25009 oasha.CollectionsHandler.handleCreateAction Creating Collection : wt=javabin&numShards=2&name=delLiveColl&stateFormat=2&version=2&maxShardsPerNode=2&replicationFactor=2&action=CREATE [junit4] 2> 1762664 T24960 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged [junit4] 2> 1762664 T24953 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{ [junit4] 2> "operation":"create", [junit4] 2> "fromApi":"true", [junit4] 2> "name":"delLiveColl", [junit4] 2> "replicationFactor":"2", [junit4] 2> "numShards":"2", [junit4] 2> "maxShardsPerNode":"2", [junit4] 2> "stateFormat":"2"} [junit4] 2> 1762665 T25026 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , { [junit4] 2> "operation":"create", [junit4] 2> "fromApi":"true", [junit4] 2> "name":"delLiveColl", [junit4] 2> "replicationFactor":"2", [junit4] 2> "numShards":"2", [junit4] 2> "maxShardsPerNode":"2", [junit4] 2> "stateFormat":"2"} [junit4] 2> 1762666 T25026 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1 [junit4] 2> 1762667 T25026 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/delLiveColl [junit4] 2> 1762667 T25026 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl [junit4] 2> 1762669 T24960 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1762671 T24952 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: delLiveColl [junit4] 2> 1762671 T24952 oasc.Overseer$ClusterStateUpdater.createCollection Create collection delLiveColl with shards [shard1, shard2] [junit4] 2> 1762672 T24952 oasc.Overseer$ClusterStateUpdater.createCollection state version delLiveColl 2 [junit4] 2> 1762673 T24952 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/delLiveColl/state.json [junit4] 2> 1762674 T24960 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1762674 T24990 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1762674 T25028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1762674 T25005 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1762674 T25027 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1762674 T24961 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1762674 T25020 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1762674 T24975 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 1762769 T25026 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection delLiveColl, shardNames [shard1, shard2] , replicationFactor : 2 [junit4] 2> 1762770 T25026 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica1 as part of slice shard1 of collection delLiveColl on 127.0.0.1:51589_ [junit4] 2> 1762770 T25026 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica2 as part of slice shard1 of collection delLiveColl on 127.0.0.1:51584_ [junit4] 2> 1762772 T25026 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica1 as part of slice shard2 of collection delLiveColl on 127.0.0.1:51649_ [junit4] 2> 1762773 T25026 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica2 as part of slice shard2 of collection delLiveColl on 127.0.0.1:51608_ [junit4] 2> 1762773 T24967 oasha.CoreAdminHandler.handleCreateAction core create command wt=javabin&qt=/admin/cores&numShards=2&collection.configName=conf1&name=delLiveColl_shard1_replica1&version=2&collection=delLiveColl&shard=shard1&action=CREATE [junit4] 2> 1762773 T24945 oasha.CoreAdminHandler.handleCreateAction core create command wt=javabin&qt=/admin/cores&numShards=2&collection.configName=conf1&name=delLiveColl_shard1_replica2&version=2&collection=delLiveColl&shard=shard1&action=CREATE [junit4] 2> 1762774 T25010 oasha.CoreAdminHandler.handleCreateAction core create command wt=javabin&qt=/admin/cores&numShards=2&collection.configName=conf1&name=delLiveColl_shard2_replica1&version=2&collection=delLiveColl&shard=shard2&action=CREATE [junit4] 2> 1762775 T24996 oasha.CoreAdminHandler.handleCreateAction core create command wt=javabin&qt=/admin/cores&numShards=2&collection.configName=conf1&name=delLiveColl_shard2_replica2&version=2&collection=delLiveColl&shard=shard2&action=CREATE [junit4] 2> 1762776 T24945 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica2 state=down collection=delLiveColl [junit4] 2> 1762776 T24967 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica1 state=down collection=delLiveColl [junit4] 2> 1762777 T24960 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1762778 T24996 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica2 state=down collection=delLiveColl [junit4] 2> 1762778 T24945 oasc.ZkController.preRegister Registering watch for external collection delLiveColl [junit4] 2> 1762778 T25010 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica1 state=down collection=delLiveColl [junit4] 2> 1762778 T24967 oasc.ZkController.preRegister Registering watch for external collection delLiveColl [junit4] 2> 1762779 T24967 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl [junit4] 2> 1762779 T24967 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper... [junit4] 2> 1762780 T24996 oasc.ZkController.preRegister Registering watch for external collection delLiveColl [junit4] 2> 1762780 T24996 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl [junit4] 2> 1762780 T25010 oasc.ZkController.preRegister Registering watch for external collection delLiveColl [junit4] 2> 1762780 T24952 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={ [junit4] 2> "roles":null, [junit4] 2> "numShards":"2", [junit4] 2> "node_name":"127.0.0.1:51584_", [junit4] 2> "operation":"state", [junit4] 2> "collection":"delLiveColl", [junit4] 2> "base_url":"http://127.0.0.1:51584", [junit4] 2> "state":"down", [junit4] 2> "shard":"shard1", [junit4] 2> "core":"delLiveColl_shard1_replica2"} [junit4] 2> 1762780 T25010 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl [junit4] 2> 1762780 T24996 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper... [junit4] 2> 1762780 T24967 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 0 [junit4] 2> 1762781 T25010 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper... [junit4] 2> 1762781 T24967 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 1762782 T24996 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 0 [junit4] 2> 1762782 T24996 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 1762782 T25010 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 0 [junit4] 2> 1762782 T25010 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 1762785 T24952 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json [junit4] 2> 1762785 T24975 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762785 T25020 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762785 T25005 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762786 T25020 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1 [junit4] 2> 1762786 T24975 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1 [junit4] 2> 1762786 T25005 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1 [junit4] 2> 1762786 T24945 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl [junit4] 2> 1762787 T24945 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper... [junit4] 2> 1762788 T24945 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1 [junit4] 2> 1762788 T24945 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 1762788 T24945 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica2 [junit4] 2> 1762788 T24945 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl [junit4] 2> 1762789 T24945 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 1762789 T24945 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl [junit4] 2> 1762790 T24945 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1762790 T24952 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1 [junit4] 2> 1762790 T24945 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/delLiveColl_shard1_replica2/' [junit4] 2> 1762790 T24952 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={ [junit4] 2> "roles":null, [junit4] 2> "numShards":"2", [junit4] 2> "node_name":"127.0.0.1:51589_", [junit4] 2> "operation":"state", [junit4] 2> "collection":"delLiveColl", [junit4] 2> "base_url":"http://127.0.0.1:51589", [junit4] 2> "state":"down", [junit4] 2> "shard":"shard1", [junit4] 2> "core":"delLiveColl_shard1_replica1"} [junit4] 2> 1762792 T24960 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1762792 T24952 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json [junit4] 2> 1762792 T24960 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762792 T24975 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762792 T25005 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762792 T25020 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762793 T24975 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 [junit4] 2> 1762793 T25020 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 [junit4] 2> 1762793 T25005 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 [junit4] 2> 1762794 T24960 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 [junit4] 2> 1762796 T24952 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 [junit4] 2> 1762796 T24952 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={ [junit4] 2> "roles":null, [junit4] 2> "numShards":"2", [junit4] 2> "node_name":"127.0.0.1:51608_", [junit4] 2> "operation":"state", [junit4] 2> "collection":"delLiveColl", [junit4] 2> "base_url":"http://127.0.0.1:51608", [junit4] 2> "state":"down", [junit4] 2> "shard":"shard2", [junit4] 2> "core":"delLiveColl_shard2_replica2"} [junit4] 2> 1762797 T24960 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1762798 T24952 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json [junit4] 2> 1762798 T24975 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762798 T25020 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762798 T24960 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762798 T25005 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762800 T25020 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 [junit4] 2> 1762799 T24975 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 [junit4] 2> 1762800 T25005 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 [junit4] 2> 1762801 T24960 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 [junit4] 2> 1762803 T24952 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 [junit4] 2> 1762803 T24952 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={ [junit4] 2> "roles":null, [junit4] 2> "numShards":"2", [junit4] 2> "node_name":"127.0.0.1:51649_", [junit4] 2> "operation":"state", [junit4] 2> "collection":"delLiveColl", [junit4] 2> "base_url":"http://127.0.0.1:51649", [junit4] 2> "state":"down", [junit4] 2> "shard":"shard2", [junit4] 2> "core":"delLiveColl_shard2_replica1"} [junit4] 2> 1762804 T24960 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1762804 T24952 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json [junit4] 2> 1762805 T25020 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762805 T25005 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762805 T24960 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762805 T25020 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4 [junit4] 2> 1762805 T24975 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1762806 T25005 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4 [junit4] 2> 1762806 T24975 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4 [junit4] 2> 1762806 T24960 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4 [junit4] 2> 1762900 T24945 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 1762940 T24945 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 1762941 T24945 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml [junit4] 2> 1762949 T24945 oass.IndexSchema.readSchema [delLiveColl_shard1_replica2] Schema name=test [junit4] 2> 1763256 T24945 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 1763265 T24945 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 1763267 T24945 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 1763275 T24945 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1763278 T24945 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1763281 T24945 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1763282 T24945 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 1763284 T24945 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 1763284 T24945 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1763285 T24945 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 1763285 T24945 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 1763285 T24945 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard1_replica2' using configuration from collection delLiveColl [junit4] 2> 1763286 T24945 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory [junit4] 2> 1763286 T24945 oasc.SolrCore.<init> [delLiveColl_shard1_replica2] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/delLiveColl_shard1_replica2/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/delLiveColl_shard1_replica2/data/ [junit4] 2> 1763286 T24945 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@65a20e1a [junit4] 2> 1763287 T24945 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/delLiveColl_shard1_replica2/data [junit4] 2> 1763287 T24945 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/delLiveColl_shard1_replica2/data/index/ [junit4] 2> 1763288 T24945 oasc.SolrCore.initIndex WARN [delLiveColl_shard1_replica2] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/delLiveColl_shard1_replica2/data/index' doesn't exist. Creating new index... [junit4] 2> 1763288 T24945 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/delLiveColl_shard1_replica2/data/index [junit4] 2> 1763288 T24945 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=34, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6717345245057039] [junit4] 2> 1763289 T24945 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-bc3f98a)),segFN=segments_1,generation=1} [junit4] 2> 1763289 T24945 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 1763293 T24945 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 1763293 T24945 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 1763293 T24945 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 1763294 T24945 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 1763294 T24945 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 1763294 T24945 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 1763294 T24945 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1763295 T24945 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1763295 T24945 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 1763295 T24945 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1763296 T24945 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1763296 T24945 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1763297 T24945 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 1763297 T24945 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 1763297 T24945 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 1763298 T24945 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 1763298 T24945 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 1763298 T24945 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 1763299 T24945 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 1763299 T24945 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 1763319 T24945 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1763320 T24945 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1763322 T24945 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1763323 T24945 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1763329 T24945 oasu.CommitTracker.<init> Hard AutoCommit: disabled [junit4] 2> 1763329 T24945 oasu.CommitTracker.<init> Soft AutoCommit: disabled [junit4] 2> 1763329 T24945 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=45, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0] [junit4] 2> 1763330 T24945 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-bc3f98a)),segFN=segments_1,generation=1} [junit4] 2> 1763330 T24945 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 1763330 T24945 oass.SolrIndexSearcher.<init> Opening Searcher@4d01e87f[delLiveColl_shard1_replica2] main [junit4] 2> 1763331 T24945 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl [junit4] 2> 1763331 T24945 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1763332 T24945 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 1763332 T24945 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 1763332 T24945 oasr.RestManager.init Initializing RestManager with initArgs: {} [junit4] 2> 1763332 T24945 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1763333 T24945 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 1763333 T24945 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1763334 T24945 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json [junit4] 2> 1763335 T24945 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json [junit4] 2> 1763335 T24945 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1763336 T24945 oasr.RestManager.init Initializing 0 registered ManagedResources [junit4] 2> 1763338 T25033 oasc.SolrCore.registerSearcher [delLiveColl_shard1_replica2] Registered new searcher Searcher@4d01e87f[delLiveColl_shard1_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 1763340 T24945 oasc.CoreContainer.registerCore registering core: delLiveColl_shard1_replica2 [junit4] 2> 1763340 T24945 oasc.ZkController.register Register replica - core:delLiveColl_shard1_replica2 address:http://127.0.0.1:51584 collection:delLiveColl shard:shard1 [junit4] 2> 1763341 T24945 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl/leader_elect/shard1/election [junit4] 2> 1763345 T24945 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1 [junit4] 2> 1763346 T24960 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1763347 T24945 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=7.0177747E15ms [junit4] 2> 1763349 T24952 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4 [junit4] 2> 1763351 T24952 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json [junit4] 2> 1763351 T24960 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1763351 T25020 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1763351 T24975 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1763351 T25005 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 1763352 T25020 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 5 [junit4] 2> 1763352 T25005 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 5 [junit4] 2> 1763352 T24975 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 5 [junit4] 2> 1763352 T24960 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 5 [junit4] 2> 1763782 T24996 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica2 [junit4] 2> 1763782 T24967 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica1 [junit4] 2> 1763783 T24996 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl [junit4] 2> 1763783 T25010 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica1 [junit4] 2> 1763784 T24996 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 1763783 T24967 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl [junit4] 2> 1763784 T24996 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl [junit4] 2> 1763784 T25010 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl [junit4] 2> 1763785 T24967 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 1763785 T25010 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 1763785 T24996 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1763786 T25010 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl [junit4] 2> 1763785 T24967 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl [junit4] 2> 1763786 T24996 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005/delLiveColl_shard2_replica2/' [junit4] 2> 1763787 T25010 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1763787 T24967 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1763787 T25010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/delLiveColl_shard2_replica1/' [junit4] 2> 1763787 T24967 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/delLiveColl_shard1_replica1/' [junit4] 2> 1763830 T24996 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 1763857 T24967 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 1763861 T25010 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 1763881 T24996 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 1763897 T24967 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 1763919 T25010 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 1763982 T24996 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml [junit4] 2> 1763989 T24996 oass.IndexSchema.readSchema [delLiveColl_shard2_replica2] Schema name=test [junit4] 2> 1763998 T24967 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml [junit4] 2> 1764005 T24967 oass.IndexSchema.readSchema [delLiveColl_shard1_replica1] Schema name=test [junit4] 2> 1764027 T25010 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml [junit4] 2> 1764040 T25010 oass.IndexSchema.readSchema [delLiveColl_shard2_replica1] Schema name=test [junit4] 2> 1764341 T24967 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 1764346 T24967 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 1764348 T24967 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 1764357 T24967 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1764360 T24967 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1764363 T24996 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 1764364 T24967 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1764364 T24967 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 1764365 T24967 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 1764365 T24967 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1764366 T24967 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 1764366 T24967 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 1764366 T24967 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard1_replica1' using configuration from collection delLiveColl [junit4] 2> 1764366 T24967 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory [junit4] 2> 1764367 T24967 oasc.SolrCore.<init> [delLiveColl_shard1_replica1] Opening new SolrCore at ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/delLiveColl_shard1_replica1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/delLiveColl_shard1_replica1/data/ [junit4] 2> 1764367 T24967 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@65a20e1a [junit4] 2> 1764367 T24996 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 1764368 T24967 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/delLiveColl_shard1_replica1/data [junit4] 2> 1764368 T24967 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/delLiveColl_shard1_replica1/data/index/ [junit4] 2> 1764368 T24967 oasc.SolrCore.initIndex WARN [delLiveColl_shard1_replica1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/delLiveColl_shard1_replica1/data/index' doesn't exist. Creating new index... [junit4] 2> 1764369 T24967 oasc.CachingDirecto [...truncated too long message...] [junit4] 2> 1965134 T24929 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter [junit4] 2> 1965134 T24929 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser [junit4] 2> 1965137 T24929 oasc.SolrCore.closeSearcher [delLiveColl_shard2_replica1] Closing main searcher on request. [junit4] 2> 1965137 T24929 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked [junit4] 2> 1965138 T24929 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/delLiveColl_shard2_replica1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/delLiveColl_shard2_replica1/data/index;done=false>>] [junit4] 2> 1965138 T24929 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/delLiveColl_shard2_replica1/data/index [junit4] 2> 1965138 T24929 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/delLiveColl_shard2_replica1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/delLiveColl_shard2_replica1/data;done=false>>] [junit4] 2> 1965139 T24929 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/delLiveColl_shard2_replica1/data [junit4] 2> 1965140 T24929 oasc.Overseer.close Overseer (id=92593852723822605-127.0.0.1:51649_-n_0000000004) closing [junit4] 2> 1965140 T25080 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:51649_ [junit4] 2> 1965144 T25020 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK [junit4] 2> 1965145 T24929 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null} [junit4] 2> 1970111 T24929 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch [junit4] 2> 1970114 T24929 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51451 51451 [junit4] 2> 1970200 T24930 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51451 51451 [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DeleteReplicaTest -Dtests.method=testDistribSearch -Dtests.seed=A984496287D2D1C -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=pt_BR -Dtests.timezone=Asia/Tehran -Dtests.file.encoding=US-ASCII [junit4] ERROR 224s J0 | DeleteReplicaTest.testDistribSearch <<< [junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:51595, http://127.0.0.1:51649, http://127.0.0.1:51608, http://127.0.0.1:51584, http://127.0.0.1:51589] [junit4] > at __randomizedtesting.SeedInfo.seed([A984496287D2D1C:8B7ECA8E5F224D20]:0) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:332) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601) [junit4] > at org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:172) [junit4] > at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:145) [junit4] > at org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:89) [junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not remove replica : delLiveColl/shard1/core_node1 [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:570) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:353) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:312) [junit4] > ... 47 more [junit4] 2> 1970271 T24929 oas.SolrTestCaseJ4.deleteCore ###deleteCore [junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001 [junit4] 2> 223776 T24928 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s). [junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {}, docValues:{}, sim=DefaultSimilarity, locale=pt_BR, timezone=Asia/Tehran [junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=168501032,total=534249472 [junit4] 2> NOTE: All tests run in this JVM: [DistributedSuggestComponentTest, TestFuzzyAnalyzedSuggestions, TestPhraseSuggestions, SuggestComponentTest, DistributedExpandComponentTest, TestHighFrequencyDictionaryFactory, TestExtendedDismaxParser, LeaderInitiatedRecoveryOnCommitTest, SOLR749Test, TestDistributedSearch, SimpleFacetsTest, HardAutoCommitTest, TestExceedMaxTermLength, TestFiltering, ClusterStateUpdateTest, TestQuerySenderListener, IndexSchemaRuntimeFieldTest, OutputWriterTest, FileUtilsTest, FullSolrCloudDistribCmdsTest, HttpPartitionTest, MBeansHandlerTest, OverriddenZkACLAndCredentialsProvidersTest, XmlUpdateRequestHandlerTest, DateRangeFieldTest, TestFaceting, TestValueSourceCache, PreAnalyzedUpdateProcessorTest, PluginInfoTest, TestBinaryResponseWriter, DOMUtilTest, TestDocSet, TestWordDelimiterFilterFactory, TestCopyFieldCollectionResource, SearchHandlerTest, IndexBasedSpellCheckerTest, TestClassNameShortening, TestDistributedGrouping, DeleteLastCustomShardedReplicaTest, TestElisionMultitermQuery, SpellCheckCollatorTest, TestDocBasedVersionConstraints, TestInitParams, ResourceLoaderTest, TestCharFilters, PathHierarchyTokenizerFactoryTest, FileBasedSpellCheckerTest, CollectionsAPIAsyncDistributedZkTest, PeerSyncTest, TestQueryTypes, TestStressVersions, SpellingQueryConverterTest, TestLuceneMatchVersion, TestZkChroot, MultiThreadedOCPTest, DistributedIntervalFacetingTest, TestManagedSchemaDynamicFieldResource, LeaderElectionIntegrationTest, TermVectorComponentDistributedTest, DeleteReplicaTest] [junit4] Completed on J0 in 224.07s, 1 test, 1 error <<< FAILURES! [...truncated 537 lines...] BUILD FAILED /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:524: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:472: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:61: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/extra-targets.xml:39: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:189: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:496: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1360: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:962: There were test failures: 437 suites, 1785 tests, 1 error, 58 ignored (23 assumptions) Total time: 58 minutes 30 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts Sending artifact delta relative to Lucene-Solr-Tests-5.x-Java7 #2162 Archived 5 artifacts Archive block size is 32768 Received 0 blocks and 156493687 bytes Compression is 0.0% Took 29 sec Recording test results Email was triggered for: Failure Sending email for trigger: Failure
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
