Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/656/
1 tests failed. REGRESSION: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDistribSearch Error Message: IOException occured when talking to server at: http://127.0.0.1:13373/w/d/collection1 Stack Trace: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:13373/w/d/collection1 at __randomizedtesting.SeedInfo.seed([7E0577D042F3955E:FFE3F9C835ACF562]:0) at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:583) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211) at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91) at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301) at org.apache.solr.cloud.CloudInspectUtil.compareResults(CloudInspectUtil.java:223) at org.apache.solr.cloud.CloudInspectUtil.compareResults(CloudInspectUtil.java:165) at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrServer(FullSolrCloudDistribCmdsTest.java:414) at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.doTest(FullSolrCloudDistribCmdsTest.java:144) at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at java.lang.Thread.run(Thread.java:745) Caused by: java.net.SocketException: Broken pipe at java.net.SocketOutputStream.socketWrite0(Native Method) at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113) at java.net.SocketOutputStream.write(SocketOutputStream.java:159) at org.apache.http.impl.io.AbstractSessionOutputBuffer.flushBuffer(AbstractSessionOutputBuffer.java:159) at org.apache.http.impl.io.AbstractSessionOutputBuffer.writeLine(AbstractSessionOutputBuffer.java:258) at org.apache.http.impl.io.HttpRequestWriter.writeHeadLine(HttpRequestWriter.java:59) at org.apache.http.impl.io.HttpRequestWriter.writeHeadLine(HttpRequestWriter.java:46) at org.apache.http.impl.io.AbstractMessageWriter.write(AbstractMessageWriter.java:109) at org.apache.http.impl.AbstractHttpClientConnection.sendRequestHeader(AbstractHttpClientConnection.java:254) at org.apache.http.impl.conn.DefaultClientConnection.sendRequestHeader(DefaultClientConnection.java:270) at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestHeader(ManagedClientConnectionImpl.java:209) at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:203) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:121) at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486) at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57) at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:465) ... 49 more Build Log: [...truncated 12079 lines...] [junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest [junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/init-core-data-001 [junit4] 2> 1922968 T11190 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /w/d [junit4] 2> 1922975 T11190 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch [junit4] 2> 1922976 T11190 oasc.ZkTestServer.run STARTING ZK TEST SERVER [junit4] 1> client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 1922977 T11191 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server [junit4] 2> 1923077 T11190 oasc.ZkTestServer.run start zk server on port:13370 [junit4] 2> 1923078 T11190 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1923079 T11190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1923084 T11197 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@27fc461a name:ZooKeeperConnection Watcher:127.0.0.1:13370 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1923085 T11190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1923085 T11190 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1923085 T11190 oascc.SolrZkClient.makePath makePath: /solr [junit4] 2> 1923090 T11190 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1923093 T11190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1923094 T11199 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ac27f8 name:ZooKeeperConnection Watcher:127.0.0.1:13370/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1923095 T11190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1923095 T11190 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1923095 T11190 oascc.SolrZkClient.makePath makePath: /collections/collection1 [junit4] 2> 1923097 T11190 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards [junit4] 2> 1923099 T11190 oascc.SolrZkClient.makePath makePath: /collections/control_collection [junit4] 2> 1923100 T11190 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards [junit4] 2> 1923103 T11190 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 1923103 T11190 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml [junit4] 2> 1923106 T11190 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml [junit4] 2> 1923107 T11190 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml [junit4] 2> 1923209 T11190 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1923210 T11190 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1923212 T11190 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 1923212 T11190 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt [junit4] 2> 1923215 T11190 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 1923215 T11190 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt [junit4] 2> 1923217 T11190 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 1923218 T11190 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml [junit4] 2> 1923220 T11190 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 1923220 T11190 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 1923222 T11190 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 1923223 T11190 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 1923225 T11190 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 1923225 T11190 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 1923227 T11190 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 1923228 T11190 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 1923230 T11190 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 1923231 T11190 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt [junit4] 2> 1924528 T11190 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 1924538 T11190 oejs.AbstractConnector.doStart Started [email protected]:13373 [junit4] 2> 1924539 T11190 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 1924540 T11190 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1924540 T11190 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-002 [junit4] 2> 1924541 T11190 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-002/' [junit4] 2> 1924586 T11190 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-002/solr.xml [junit4] 2> 1924668 T11190 oasc.CoreContainer.<init> New CoreContainer 1536505534 [junit4] 2> 1924669 T11190 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-002/] [junit4] 2> 1924670 T11190 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 1924670 T11190 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 1924671 T11190 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 1924671 T11190 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 1924671 T11190 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 1924672 T11190 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 1924672 T11190 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 1924672 T11190 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 1924673 T11190 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 1924673 T11190 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 1924674 T11190 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 1924674 T11190 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1924675 T11190 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1924675 T11190 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 1924675 T11190 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13370/solr [junit4] 2> 1924676 T11190 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 1924676 T11190 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1924677 T11190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1924678 T11210 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@213d22eb name:ZooKeeperConnection Watcher:127.0.0.1:13370 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1924680 T11190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1924681 T11190 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1924682 T11190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1924683 T11212 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a0e824d name:ZooKeeperConnection Watcher:127.0.0.1:13370/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1924683 T11190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1924684 T11190 oascc.SolrZkClient.makePath makePath: /overseer/queue [junit4] 2> 1924686 T11190 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work [junit4] 2> 1924687 T11190 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running [junit4] 2> 1924689 T11190 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed [junit4] 2> 1924691 T11190 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure [junit4] 2> 1924692 T11190 oascc.SolrZkClient.makePath makePath: /live_nodes [junit4] 2> 1924693 T11190 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:13373_w%2Fd [junit4] 2> 1924694 T11190 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:13373_w%2Fd [junit4] 2> 1924695 T11190 oascc.SolrZkClient.makePath makePath: /overseer_elect [junit4] 2> 1924696 T11190 oascc.SolrZkClient.makePath makePath: /overseer_elect/election [junit4] 2> 1924698 T11190 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 1924699 T11190 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:13373_w%2Fd [junit4] 2> 1924699 T11190 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader [junit4] 2> 1924700 T11190 oasc.Overseer.start Overseer (id=92619499739611139-127.0.0.1:13373_w%2Fd-n_0000000000) starting [junit4] 2> 1924702 T11190 oascc.SolrZkClient.makePath makePath: /overseer/queue-work [junit4] 2> 1924706 T11190 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 1924707 T11214 oasc.OverseerCollectionProcessor.run Process current queue of collection creations [junit4] 2> 1924707 T11190 oascc.SolrZkClient.makePath makePath: /clusterstate.json [junit4] 2> 1924708 T11190 oascc.SolrZkClient.makePath makePath: /aliases.json [junit4] 2> 1924709 T11190 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1924711 T11213 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue [junit4] 2> 1924715 T11216 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection [junit4] 2> 1924715 T11216 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 1924716 T11216 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 1924716 T11217 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1924718 T11213 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={ [junit4] 2> "numShards":"1", [junit4] 2> "roles":null, [junit4] 2> "node_name":"127.0.0.1:13373_w%2Fd", [junit4] 2> "collection":"control_collection", [junit4] 2> "core":"collection1", [junit4] 2> "operation":"state", [junit4] 2> "shard":null, [junit4] 2> "state":"down", [junit4] 2> "base_url":"http://127.0.0.1:13373/w/d"} [junit4] 2> 1924718 T11213 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1] [junit4] 2> 1924718 T11213 oasc.Overseer$ClusterStateUpdater.createCollection state version control_collection 1 [junit4] 2> 1924718 T11213 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1 [junit4] 2> 1924720 T11217 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1925716 T11216 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 [junit4] 2> 1925717 T11216 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection [junit4] 2> 1925718 T11216 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 1925718 T11216 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection [junit4] 2> 1925719 T11216 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1925719 T11216 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-002/collection1/' [junit4] 2> 1925721 T11216 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-002/collection1/lib/README' to classloader [junit4] 2> 1925722 T11216 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-002/collection1/lib/classes/' to classloader [junit4] 2> 1925723 T11216 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-002/collection1/lib/.svn/' to classloader [junit4] 2> 1925787 T11216 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0 [junit4] 2> 1925832 T11216 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 1925934 T11216 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml [junit4] 2> 1925963 T11216 oass.IndexSchema.readSchema [collection1] Schema name=test [junit4] 2> 1926305 T11216 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 1926308 T11216 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 1926309 T11216 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1926314 T11216 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1926332 T11216 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection [junit4] 2> 1926333 T11216 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory [junit4] 2> 1926333 T11216 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-002/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/control/data/ [junit4] 2> 1926333 T11216 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@598d4938 [junit4] 2> 1926334 T11216 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/control/data [junit4] 2> 1926334 T11216 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/control/data/index/ [junit4] 2> 1926334 T11216 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/control/data/index' doesn't exist. Creating new index... [junit4] 2> 1926335 T11216 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/control/data/index [junit4] 2> 1926335 T11216 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=31.3515625, floorSegmentMB=0.287109375, forceMergeDeletesPctAllowed=17.871216511253312, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 1926336 T11216 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-fa290c5)),segFN=segments_1,generation=1} [junit4] 2> 1926336 T11216 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 1926339 T11216 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 1926340 T11216 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 1926340 T11216 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 1926340 T11216 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 1926340 T11216 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 1926341 T11216 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 1926341 T11216 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1926341 T11216 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1926342 T11216 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 1926342 T11216 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1926343 T11216 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1926343 T11216 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1926344 T11216 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 1926344 T11216 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 1926344 T11216 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 1926344 T11216 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 1926345 T11216 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 1926345 T11216 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 1926345 T11216 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 1926346 T11216 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 1926365 T11216 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1926367 T11216 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1926369 T11216 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1926371 T11216 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1926376 T11216 oasu.CommitTracker.<init> Hard AutoCommit: disabled [junit4] 2> 1926376 T11216 oasu.CommitTracker.<init> Soft AutoCommit: disabled [junit4] 2> 1926377 T11216 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=33, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4275883296971833] [junit4] 2> 1926378 T11216 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-fa290c5)),segFN=segments_1,generation=1} [junit4] 2> 1926378 T11216 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 1926378 T11216 oass.SolrIndexSearcher.<init> Opening Searcher@614a1823[collection1] main [junit4] 2> 1926379 T11216 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection [junit4] 2> 1926379 T11216 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1926380 T11216 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 1926380 T11216 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 1926380 T11216 oasr.RestManager.init Initializing RestManager with initArgs: {} [junit4] 2> 1926381 T11216 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1926381 T11216 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 1926381 T11216 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1926382 T11216 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json [junit4] 2> 1926384 T11216 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json [junit4] 2> 1926384 T11216 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1926384 T11216 oasr.RestManager.init Initializing 0 registered ManagedResources [junit4] 2> 1926387 T11218 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@614a1823[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 1926388 T11216 oasc.CoreContainer.registerCore registering core: collection1 [junit4] 2> 1926389 T11221 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:13373/w/d collection:control_collection shard:shard1 [junit4] 2> 1926389 T11190 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0 [junit4] 2> 1926389 T11190 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 1926389 T11221 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election [junit4] 2> 1926390 T11190 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1926391 T11190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1926392 T11223 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14bed9b4 name:ZooKeeperConnection Watcher:127.0.0.1:13370/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1926393 T11190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1926393 T11190 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1926394 T11190 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1926395 T11221 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1 [junit4] 2> 1926396 T11217 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1926396 T11221 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue. [junit4] 2> 1926397 T11221 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync [junit4] 2> ASYNC NEW_CORE C2964 name=collection1 org.apache.solr.core.SolrCore@90b7e7c url=http://127.0.0.1:13373/w/d/collection1 node=127.0.0.1:13373_w%2Fd C2964_STATE=coll:control_collection core:collection1 props:{node_name=127.0.0.1:13373_w%2Fd, core=collection1, state=down, base_url=http://127.0.0.1:13373/w/d} [junit4] 2> 1926397 T11221 C2964 P13373 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:13373/w/d/collection1/ [junit4] 2> 1926397 T11221 C2964 P13373 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me [junit4] 2> 1926397 T11190 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 1926397 T11221 C2964 P13373 oasc.SyncStrategy.syncToMe http://127.0.0.1:13373/w/d/collection1/ has no replicas [junit4] 2> 1926398 T11221 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:13373/w/d/collection1/ shard1 [junit4] 2> 1926398 T11221 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1 [junit4] 2> 1926400 T11217 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1926400 T11224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1926406 T11217 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1926406 T11217 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1926406 T11224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1926453 T11221 oasc.ZkController.register We are http://127.0.0.1:13373/w/d/collection1/ and leader is http://127.0.0.1:13373/w/d/collection1/ [junit4] 2> 1926454 T11221 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:13373/w/d [junit4] 2> 1926454 T11221 oasc.ZkController.checkRecovery I am the leader, no recovery necessary [junit4] 2> 1926454 T11221 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection [junit4] 2> 1926454 T11221 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 1926456 T11217 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1926459 T11213 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "numShards":"3", [junit4] 2> "roles":null, [junit4] 2> "node_name":"127.0.0.1:13373_w%2Fd", [junit4] 2> "collection":"control_collection", [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "operation":"state", [junit4] 2> "shard":"shard1", [junit4] 2> "state":"active", [junit4] 2> "base_url":"http://127.0.0.1:13373/w/d"} [junit4] 2> 1926562 T11217 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1926562 T11224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1927625 T11190 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 [junit4] 2> 1927626 T11190 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 1927630 T11190 oejs.AbstractConnector.doStart Started [email protected]:13381 [junit4] 2> 1927630 T11190 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 1927631 T11190 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1927631 T11190 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-003 [junit4] 2> 1927632 T11190 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-003/' [junit4] 2> 1927676 T11190 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-003/solr.xml [junit4] 2> 1927763 T11190 oasc.CoreContainer.<init> New CoreContainer 1411907026 [junit4] 2> 1927763 T11190 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-003/] [junit4] 2> 1927765 T11190 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 1927765 T11190 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 1927765 T11190 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 1927766 T11190 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 1927766 T11190 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 1927766 T11190 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 1927767 T11190 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 1927767 T11190 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 1927767 T11190 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 1927768 T11190 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 1927768 T11190 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 1927769 T11190 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1927769 T11190 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1927770 T11190 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 1927770 T11190 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13370/solr [junit4] 2> 1927770 T11190 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 1927771 T11190 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1927772 T11190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1927773 T11235 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d891128 name:ZooKeeperConnection Watcher:127.0.0.1:13370 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1927775 T11190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1927775 T11190 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1927777 T11190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1927779 T11237 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@772fa434 name:ZooKeeperConnection Watcher:127.0.0.1:13370/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1927779 T11190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1927783 T11190 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1928787 T11190 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:13381_w%2Fd [junit4] 2> 1928788 T11190 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:13381_w%2Fd [junit4] 2> 1928790 T11190 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 1928795 T11239 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1 [junit4] 2> 1928796 T11239 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 1928796 T11217 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1928797 T11239 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 1928798 T11213 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "numShards":"3", [junit4] 2> "roles":null, [junit4] 2> "node_name":"127.0.0.1:13381_w%2Fd", [junit4] 2> "collection":"collection1", [junit4] 2> "core":"collection1", [junit4] 2> "operation":"state", [junit4] 2> "shard":null, [junit4] 2> "state":"down", [junit4] 2> "base_url":"http://127.0.0.1:13381/w/d"} [junit4] 2> 1928798 T11213 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3] [junit4] 2> 1928799 T11213 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 1 [junit4] 2> 1928799 T11213 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2 [junit4] 2> 1928801 T11217 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 1928801 T11224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 1928801 T11238 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 1929797 T11239 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 [junit4] 2> 1929798 T11239 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1 [junit4] 2> 1929798 T11239 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 1929799 T11239 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 [junit4] 2> 1929799 T11239 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1929799 T11239 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-003/collection1/' [junit4] 2> 1929801 T11239 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-003/collection1/lib/README' to classloader [junit4] 2> 1929801 T11239 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-003/collection1/lib/.svn/' to classloader [junit4] 2> 1929802 T11239 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-003/collection1/lib/classes/' to classloader [junit4] 2> 1929853 T11239 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0 [junit4] 2> 1929887 T11239 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 1929988 T11239 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml [junit4] 2> 1929995 T11239 oass.IndexSchema.readSchema [collection1] Schema name=test [junit4] 2> 1930355 T11239 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 1930359 T11239 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 1930360 T11239 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1930365 T11239 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1930383 T11239 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1 [junit4] 2> 1930384 T11239 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory [junit4] 2> 1930384 T11239 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-003/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/jetty1/ [junit4] 2> 1930384 T11239 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@598d4938 [junit4] 2> 1930385 T11239 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/jetty1 [junit4] 2> 1930385 T11239 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/jetty1/index/ [junit4] 2> 1930386 T11239 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/jetty1/index' doesn't exist. Creating new index... [junit4] 2> 1930388 T11239 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/jetty1/index [junit4] 2> 1930388 T11239 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=31.3515625, floorSegmentMB=0.287109375, forceMergeDeletesPctAllowed=17.871216511253312, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 1930389 T11239 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-4875a97b)),segFN=segments_1,generation=1} [junit4] 2> 1930390 T11239 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 1930393 T11239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 1930393 T11239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 1930393 T11239 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 1930394 T11239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 1930394 T11239 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 1930394 T11239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 1930395 T11239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1930395 T11239 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1930395 T11239 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 1930396 T11239 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1930396 T11239 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1930397 T11239 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1930397 T11239 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 1930398 T11239 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 1930398 T11239 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 1930398 T11239 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 1930398 T11239 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 1930399 T11239 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 1930399 T11239 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 1930400 T11239 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 1930424 T11239 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1930426 T11239 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1930428 T11239 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1930430 T11239 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1930435 T11239 oasu.CommitTracker.<init> Hard AutoCommit: disabled [junit4] 2> 1930435 T11239 oasu.CommitTracker.<init> Soft AutoCommit: disabled [junit4] 2> 1930436 T11239 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=33, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4275883296971833] [junit4] 2> 1930436 T11239 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-4875a97b)),segFN=segments_1,generation=1} [junit4] 2> 1930437 T11239 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 1930437 T11239 oass.SolrIndexSearcher.<init> Opening Searcher@4f637b4f[collection1] main [junit4] 2> 1930437 T11239 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 [junit4] 2> 1930438 T11239 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1930438 T11239 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 1930439 T11239 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 1930439 T11239 oasr.RestManager.init Initializing RestManager with initArgs: {} [junit4] 2> 1930439 T11239 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1930440 T11239 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json [junit4] 2> 1930441 T11239 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1930441 T11239 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed [junit4] 2> 1930441 T11239 oasr.RestManager.init Initializing 0 registered ManagedResources [junit4] 2> 1930444 T11240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f637b4f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 1930447 T11239 oasc.CoreContainer.registerCore registering core: collection1 [junit4] 2> 1930448 T11243 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:13381/w/d collection:collection1 shard:shard2 [junit4] 2> 1930448 T11190 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0 [junit4] 2> 1930449 T11190 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 1930449 T11243 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election [junit4] 2> 1930454 T11243 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2 [junit4] 2> 1930455 T11217 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1930456 T11243 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue. [junit4] 2> 1930456 T11243 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync [junit4] 2> ASYNC NEW_CORE C2965 name=collection1 org.apache.solr.core.SolrCore@50aaa1fb url=http://127.0.0.1:13381/w/d/collection1 node=127.0.0.1:13381_w%2Fd C2965_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:13381_w%2Fd, core=collection1, state=down, base_url=http://127.0.0.1:13381/w/d} [junit4] 2> 1930456 T11243 C2965 P13381 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:13381/w/d/collection1/ [junit4] 2> 1930456 T11243 C2965 P13381 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me [junit4] 2> 1930457 T11243 C2965 P13381 oasc.SyncStrategy.syncToMe http://127.0.0.1:13381/w/d/collection1/ has no replicas [junit4] 2> 1930457 T11243 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:13381/w/d/collection1/ shard2 [junit4] 2> 1930457 T11243 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2 [junit4] 2> 1930460 T11238 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 1930460 T11224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 1930460 T11217 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 1930466 T11217 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1930467 T11217 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 1930467 T11224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 1930467 T11238 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 1930512 T11243 oasc.ZkController.register We are http://127.0.0.1:13381/w/d/collection1/ and leader is http://127.0.0.1:13381/w/d/collection1/ [junit4] 2> 1930513 T11243 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:13381/w/d [junit4] 2> 1930513 T11243 oasc.ZkController.checkRecovery I am the leader, no recovery necessary [junit4] 2> 1930513 T11243 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1 [junit4] 2> 1930513 T11243 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 1930515 T11217 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1930517 T11213 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "numShards":"3", [junit4] 2> "roles":null, [junit4] 2> "node_name":"127.0.0.1:13381_w%2Fd", [junit4] 2> "collection":"collection1", [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "operation":"state", [junit4] 2> "shard":"shard2", [junit4] 2> "state":"active", [junit4] 2> "base_url":"http://127.0.0.1:13381/w/d"} [junit4] 2> 1930621 T11224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 1930621 T11217 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 1930621 T11238 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 1932495 T11190 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 [junit4] 2> 1932496 T11190 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 1932502 T11190 oejs.AbstractConnector.doStart Started [email protected]:13389 [junit4] 2> 1932503 T11190 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 1932503 T11190 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1932503 T11190 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-004 [junit4] 2> 1932504 T11190 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-004/' [junit4] 2> 1932554 T11190 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-004/solr.xml [junit4] 2> 1932670 T11190 oasc.CoreContainer.<init> New CoreContainer 1818097372 [junit4] 2> 1932670 T11190 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-004/] [junit4] 2> 1932671 T11190 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 1932672 T11190 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 1932672 T11190 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 1932673 T11190 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 1932673 T11190 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 1932673 T11190 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 1932673 T11190 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 1932674 T11190 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 1932674 T11190 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 1932674 T11190 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 1932675 T11190 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 1932676 T11190 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1932676 T11190 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1932676 T11190 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 1932677 T11190 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13370/solr [junit4] 2> 1932677 T11190 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 1932677 T11190 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 1932678 T11190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1932680 T11254 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cfa1d19 name:ZooKeeperConnection Watcher:127.0.0.1:13370 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1932682 T11190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1932682 T11190 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 1932684 T11190 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 1932685 T11256 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e58e7b5 name:ZooKeeperConnection Watcher:127.0.0.1:13370/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1932685 T11190 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 1932691 T11190 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 1933695 T11190 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:13389_w%2Fd [junit4] 2> 1933696 T11190 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:13389_w%2Fd [junit4] 2> 1933699 T11190 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 1933706 T11258 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1 [junit4] 2> 1933706 T11258 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 1933707 T11217 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1933707 T11258 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 1933709 T11213 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "numShards":"3", [junit4] 2> "roles":null, [junit4] 2> "node_name":"127.0.0.1:13389_w%2Fd", [junit4] 2> "collection":"collection1", [junit4] 2> "core":"collection1", [junit4] 2> "operation":"state", [junit4] 2> "shard":null, [junit4] 2> "state":"down", [junit4] 2> "base_url":"http://127.0.0.1:13389/w/d"} [junit4] 2> 1933709 T11213 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3 [junit4] 2> 1933709 T11213 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3 [junit4] 2> 1933712 T11224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1933712 T11238 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1933712 T11217 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1933712 T11257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1934707 T11258 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 [junit4] 2> 1934708 T11258 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1 [junit4] 2> 1934709 T11258 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 1934709 T11258 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 [junit4] 2> 1934710 T11258 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1934710 T11258 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-004/collection1/' [junit4] 2> 1934711 T11258 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-004/collection1/lib/.svn/' to classloader [junit4] 2> 1934712 T11258 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-004/collection1/lib/README' to classloader [junit4] 2> 1934713 T11258 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-004/collection1/lib/classes/' to classloader [junit4] 2> 1934778 T11258 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0 [junit4] 2> 1934823 T11258 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 1934924 T11258 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml [junit4] 2> 1934933 T11258 oass.IndexSchema.readSchema [collection1] Schema name=test [junit4] 2> 1935285 T11258 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 1935287 T11258 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 1935289 T11258 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1935294 T11258 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 1935314 T11258 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1 [junit4] 2> 1935314 T11258 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory [junit4] 2> 1935314 T11258 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-004/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/jetty2/ [junit4] 2> 1935315 T11258 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@598d4938 [junit4] 2> 1935315 T11258 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/jetty2 [junit4] 2> 1935316 T11258 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/jetty2/index/ [junit4] 2> 1935316 T11258 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/jetty2/index' doesn't exist. Creating new index... [junit4] 2> 1935324 T11258 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-001/jetty2/index [junit4] 2> 1935325 T11258 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=31.3515625, floorSegmentMB=0.287109375, forceMergeDeletesPctAllowed=17.871216511253312, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 1935326 T11258 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-52659d83)),segFN=segments_1,generation=1} [junit4] 2> 1935326 T11258 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 1935330 T11258 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 1935330 T11258 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 1935330 T11258 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 1935331 T11258 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 1935331 T11258 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 1935331 T11258 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 1935332 T11258 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1935332 T11258 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1935332 T11258 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 1935333 T11258 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1935333 T11258 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1935334 T11258 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 1935334 T11258 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 1935335 T11258 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 1935335 T11258 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 1935335 T11258 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 1935336 T11258 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 1935336 T11258 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 1935337 T11258 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 1935337 T11258 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 1935360 T11258 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1935363 T11258 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1935365 T11258 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1935367 T11258 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 1935372 T11258 oasu.CommitTracker.<init> Hard AutoCommit: disabled [junit4] 2> 1935372 T11258 oasu.CommitTracker.<init> Soft AutoCommit: disabled [junit4] 2> 1935373 T11258 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=33, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4275883296971833] [junit4] 2> 1935373 T11258 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-52659d83)),segFN=segments_1,generation=1} [junit4] 2> 1935374 T11258 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 1935374 T11258 oass.SolrIndexSearcher.<init> Opening Searcher@6c534461[collection1] main [junit4] 2> 1935374 T11258 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 [junit4] 2> 1935375 T11258 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1935375 T11258 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 1935376 T11258 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 1935376 T11258 oasr.RestManager.init Initializing RestManager with initArgs: {} [junit4] 2> 1935376 T11258 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1935377 T11258 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json [junit4] 2> 1935377 T11258 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1935378 T11258 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed [junit4] 2> 1935378 T11258 oasr.RestManager.init Initializing 0 registered ManagedResources [junit4] 2> 1935381 T11259 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6c534461[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 1935383 T11258 oasc.CoreContainer.registerCore registering core: collection1 [junit4] 2> 1935384 T11262 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:13389/w/d collection:collection1 shard:shard3 [junit4] 2> 1935384 T11190 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0 [junit4] 2> 1935385 T11190 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 1935385 T11262 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election [junit4] 2> 1935389 T11262 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3 [junit4] 2> 1935391 T11217 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1935391 T11262 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue. [junit4] 2> 1935392 T11262 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync [junit4] 2> ASYNC NEW_CORE C2966 name=collection1 org.apache.solr.core.SolrCore@509a9835 url=http://127.0.0.1:13389/w/d/collection1 node=127.0.0.1:13389_w%2Fd C2966_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:13389_w%2Fd, core=collection1, state=down, base_url=http://127.0.0.1:13389/w/d} [junit4] 2> 1935392 T11262 C2966 P13389 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:13389/w/d/collection1/ [junit4] 2> 1935392 T11262 C2966 P13389 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me [junit4] 2> 1935392 T11262 C2966 P13389 oasc.SyncStrategy.syncToMe http://127.0.0.1:13389/w/d/collection1/ has no replicas [junit4] 2> 1935393 T11262 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:13389/w/d/collection1/ shard3 [junit4] 2> 1935393 T11262 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3 [junit4] 2> 1935396 T11217 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1935396 T11224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1935396 T11257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1935396 T11238 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1935401 T11217 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1935402 T11257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1935402 T11238 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1935402 T11224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1935402 T11217 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1935448 T11262 oasc.ZkController.register We are http://127.0.0.1:13389/w/d/collection1/ and leader is http://127.0.0.1:13389/w/d/collection1/ [junit4] 2> 1935448 T11262 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:13389/w/d [junit4] 2> 1935448 T11262 oasc.ZkController.checkRecovery I am the leader, no recovery necessary [junit4] 2> 1935448 T11262 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1 [junit4] 2> 1935449 T11262 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 1935450 T11217 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 1935452 T11213 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "numShards":"3", [junit4] 2> "roles":null, [junit4] 2> "node_name":"127.0.0.1:13389_w%2Fd", [junit4] 2> "collection":"collection1", [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node2", [junit4] 2> "operation":"state", [junit4] 2> "shard":"shard3", [junit4] 2> "state":"active", [junit4] 2> "base_url":"http://127.0.0.1:13389/w/d"} [junit4] 2> 1935556 T11217 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1935556 T11224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1935556 T11257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1935556 T11238 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 1937289 T11190 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3 [junit4] 2> 1937290 T11190 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 1937296 T11190 oejs.AbstractConnector.doStart Started [email protected]:13395 [junit4] 2> 1937296 T11190 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 1937297 T11190 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1937297 T11190 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-005 [junit4] 2> 1937298 T11190 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-005/' [junit4] 2> 1937360 T11190 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest-7E0577D042F3955E-001/tempDir-005/solr.xml [junit4] 2> 1937466 T11190 oasc.CoreContainer.<init> New CoreContainer 2023977510 [junit4] 2> 1937467 T11190 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDis [...truncated too long message...] ne41VarGapFixedInterval), 3child1_s=PostingsFormat(name=Asserting), 25parent_f1_s=FSTOrd41, 11grand5_s=FSTOrd41, 10grand7_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 47parent_f1_s=FSTOrd41, 8parent_f2_s=FSTOrd41, 9parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 3parent_f2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 44parent_f1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 10grand0_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 12parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 47parent_f2_s=PostingsFormat(name=Asserting), 55parent_f2_s=FSTOrd41, 11grand7_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 5parent_f2_s=PostingsFormat(name=Asserting), 37parent_f1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 7parent_f1_s=FSTOrd41, 10grand4_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 6grand4_s=PostingsFormat(name=Asserting), 10parent_f1_s=FSTOrd41, 17parent_f1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 57parent_f1_s=PostingsFormat(name=Asserting), 5parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), text_t=PostingsFormat(name=Lucene41VarGapFixedInterval), 45parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 42parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 38parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 4child2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 10grand6_s=FSTOrd41, 10grand8_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 3grand2_s=FSTOrd41, 38parent_f2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 1grand0_s=FSTOrd41, 6child2_s=PostingsFormat(name=Asserting), 5grand3_s=PostingsFormat(name=Asserting), 14parent_f1_s=FSTOrd41, 29parent_f1_s=FSTOrd41, 2grand0_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 40parent_f1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 6child3_s=FSTOrd41, 36parent_f1_s=FSTOrd41, 2child1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 11grand4_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 56parent_f2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 5child1_s=PostingsFormat(name=Asserting), 11grand9_s=FSTOrd41, 23parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 6grand1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 31parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 50parent_f1_s=FSTOrd41, 16parent_f2_s=PostingsFormat(name=Asserting), 27parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 54parent_f1_s=FSTOrd41, 8parent_f1_s=PostingsFormat(name=Asserting), 3child2_s=FSTOrd41, 30parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 29parent_f2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 6child4_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 18parent_f1_s=FSTOrd41, 35parent_f1_s=PostingsFormat(name=Asserting), type_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 7grand6_s=FSTOrd41, 0parent_f1_s=PostingsFormat(name=Asserting), 51parent_f2_s=FSTOrd41, 4parent_f2_s=FSTOrd41, 9grand4_s=FSTOrd41, 40parent_f2_s=FSTOrd41, 4child1_s=FSTOrd41, 33parent_f1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 54parent_f2_s=PostingsFormat(name=Asserting), 21parent_f2_s=PostingsFormat(name=Asserting), 50parent_f2_s=PostingsFormat(name=Asserting), 32parent_f1_s=FSTOrd41, 32parent_f2_s=PostingsFormat(name=Asserting), 4grand0_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 49parent_f2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 53parent_f1_s=PostingsFormat(name=Asserting), 8grand2_s=PostingsFormat(name=Asserting), 8grand1_s=FSTOrd41, 11grand10_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 48parent_f1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 19parent_f2_s=FSTOrd41, 31parent_f1_s=PostingsFormat(name=Asserting), 3grand0_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 11grand2_s=PostingsFormat(name=Asserting), 13parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 5grand1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 48parent_f2_s=FSTOrd41, 30parent_f2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 12parent_f2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 4parent_f1_s=PostingsFormat(name=Asserting), 41parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 8grand7_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 53parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 10grand1_s=PostingsFormat(name=Asserting), 36parent_f2_s=PostingsFormat(name=Asserting), 15parent_f2_s=FSTOrd41, 3child0_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 34parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 49parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 11grand1_s=FSTOrd41, 7grand4_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 33parent_f2_s=FSTOrd41, 4child3_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 2grand1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 46parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 9grand6_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 10grand9_s=PostingsFormat(name=Asserting), rnd_b=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), 51parent_f1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 5grand0_s=FSTOrd41, _version_=PostingsFormat(name=Lucene41VarGapFixedInterval)}, docValues:{}, sim=DefaultSimilarity, locale=es_PE, timezone=America/Knox_IN [junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=182300440,total=477102080 [junit4] 2> NOTE: All tests run in this JVM: [TestTrie, TestCloudSchemaless, TestCursorMarkWithoutUniqueKey, TestRequestStatusCollectionAPI, BlockCacheTest, TestReplicationHandlerBackup, TestSimpleQParserPlugin, TestValueSourceCache, TestIBSimilarityFactory, TestDistribDocBasedVersion, TriLevelCompositeIdRoutingTest, DirectSolrConnectionTest, CSVRequestHandlerTest, PrimUtilsTest, TestSolrXml, HdfsCollectionsAPIDistributedZkTest, AlternateDirectoryTest, TestUtils, MoreLikeThisHandlerTest, DistributedFacetPivotSmallTest, IndexSchemaRuntimeFieldTest, CacheHeaderTest, TestSolrDeletionPolicy2, TestWriterPerf, DistributedQueryElevationComponentTest, SoftAutoCommitTest, ConnectionManagerTest, CoreAdminCreateDiscoverTest, BasicDistributedZkTest, TestBinaryResponseWriter, TestStressReorder, ParsingFieldUpdateProcessorsTest, ChangedSchemaMergeTest, TestBulkSchemaConcurrent, DistanceFunctionTest, TestReRankQParserPlugin, MultiThreadedOCPTest, ZkSolrClientTest, TestArbitraryIndexDir, SolrCmdDistributorTest, ReturnFieldsTest, TestDefaultSimilarityFactory, TestDefaultSearchFieldResource, TestOrdValues, DistributedSpellCheckComponentTest, DateRangeFieldTest, SynonymTokenizerTest, TestWordDelimiterFilterFactory, BadComponentTest, HdfsBasicDistributedZkTest, MinimalSchemaTest, TestSolrDeletionPolicy1, TestRestManager, MigrateRouteKeyTest, TestFileDictionaryLookup, CollectionsAPIDistributedZkTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest] [junit4] Completed on J0 in 150.69s, 1 test, 1 error <<< FAILURES! [...truncated 801 lines...] BUILD FAILED /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:531: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:472: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:189: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:496: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1359: The following error occurred while executing this line: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:961: There were test failures: 437 suites, 1784 tests, 1 error, 53 ignored (9 assumptions) Total time: 240 minutes 58 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts Sending artifact delta relative to Lucene-Solr-NightlyTests-trunk #651 Archived 5 artifacts Archive block size is 32768 Received 0 blocks and 685462704 bytes Compression is 0.0% Took 2 min 2 sec Recording test results Email was triggered for: Failure Sending email for trigger: Failure
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
