Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.4-Linux/126/
Java: 32bit/jdk-9-ea+158 -client -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.HttpPartitionTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=2007, 
name=SocketProxy-Response-32874:49790, state=RUNNABLE, 
group=TGRP-HttpPartitionTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=2007, name=SocketProxy-Response-32874:49790, 
state=RUNNABLE, group=TGRP-HttpPartitionTest]
        at 
__randomizedtesting.SeedInfo.seed([2C617D978245810C:A435424D2CB9ECF4]:0)
Caused by: java.lang.RuntimeException: java.net.SocketException: Socket is 
closed
        at __randomizedtesting.SeedInfo.seed([2C617D978245810C]:0)
        at 
org.apache.solr.cloud.SocketProxy$Bridge$Pump.run(SocketProxy.java:347)
Caused by: java.net.SocketException: Socket is closed
        at java.base/java.net.Socket.setSoTimeout(Socket.java:1137)
        at 
org.apache.solr.cloud.SocketProxy$Bridge$Pump.run(SocketProxy.java:344)




Build Log:
[...truncated 11063 lines...]
   [junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
   [junit4]   2> Creating dataDir: 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/init-core-data-001
   [junit4]   2> 155803 INFO  
(SUITE-HttpPartitionTest-seed#[2C617D978245810C]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776";)
   [junit4]   2> 155803 INFO  
(SUITE-HttpPartitionTest-seed#[2C617D978245810C]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 155804 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 155804 INFO  (Thread-336) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 155805 INFO  (Thread-336) [    ] o.a.s.c.ZkTestServer Starting 
server
   [junit4]   2> 155905 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:33001
   [junit4]   2> 155911 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 155914 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 155916 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 155918 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 155920 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 155922 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 155924 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 155926 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 155928 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 155930 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 155932 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 156797 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/control-001/cores/collection1
   [junit4]   2> 156800 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] o.e.j.s.Server 
jetty-9.3.14.v20161028
   [junit4]   2> 156801 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@132d423{/,null,AVAILABLE}
   [junit4]   2> 156805 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@562fa2{HTTP/1.1,[http/1.1]}{127.0.0.1:32874}
   [junit4]   2> 156805 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] o.e.j.s.Server 
Started @158765ms
   [junit4]   2> 156805 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, 
solr.data.dir=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/tempDir-001/control/data,
 hostPort=33520, 
coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/control-001/cores}
   [junit4]   2> 156805 ERROR 
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 156805 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.4.2
   [junit4]   2> 156805 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 156805 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 156805 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-03-03T14:24:08.647694Z
   [junit4]   2> 156809 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 156809 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/control-001/solr.xml
   [junit4]   2> 156819 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 156820 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33001/solr
   [junit4]   2> 156838 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33520_
   [junit4]   2> 156839 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] o.a.s.c.Overseer 
Overseer (id=97553681458790404-127.0.0.1:33520_-n_0000000000) starting
   [junit4]   2> 156843 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:33520_
   [junit4]   2> 156844 INFO  (zkCallback-316-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 156930 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/control-001/cores
   [junit4]   2> 156930 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 156932 INFO  
(OverseerStateUpdate-97553681458790404-127.0.0.1:33520_-n_0000000000) [    ] 
o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 157945 WARN  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use 
<mergePolicyFactory> instead.
   [junit4]   2> 157946 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.2
   [junit4]   2> 157962 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 158065 WARN  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.s.IndexSchema [collection1] default search field in schema is text. 
WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 158068 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 158080 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
collection control_collection
   [junit4]   2> 158080 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/control-001/cores/collection1],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/control-001/cores/collection1/data/]
   [junit4]   2> 158081 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@195bc
   [junit4]   2> 158082 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=23, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=63.849609375, 
floorSegmentMB=0.62109375, forceMergeDeletesPctAllowed=19.653036131467424, 
segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 158089 WARN  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 158104 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 158104 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 158109 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 158110 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 158110 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=33, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=54.92578125, 
floorSegmentMB=1.4228515625, forceMergeDeletesPctAllowed=4.506987706237508, 
segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 158110 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@1d9d011[collection1] main]
   [junit4]   2> 158111 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 158111 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 158111 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 158113 INFO  (searcherExecutor-608-thread-1) [    ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@1d9d011[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 158113 INFO  (coreLoadExecutor-607-thread-1) [    ] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1560858905757614080
   [junit4]   2> 158120 INFO  (coreZkRegister-600-thread-1) [    ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 158120 INFO  (coreZkRegister-600-thread-1) [    ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 158120 INFO  (coreZkRegister-600-thread-1) [    ] 
o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33520/collection1/
   [junit4]   2> 158120 INFO  (coreZkRegister-600-thread-1) [    ] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 158120 INFO  (coreZkRegister-600-thread-1) [    ] 
o.a.s.c.SyncStrategy http://127.0.0.1:33520/collection1/ has no replicas
   [junit4]   2> 158124 INFO  (coreZkRegister-600-thread-1) [    ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:33520/collection1/ shard1
   [junit4]   2> 158275 INFO  (coreZkRegister-600-thread-1) [    ] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 158521 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 158521 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33001/solr ready
   [junit4]   2> 158521 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection 
loss:false
   [junit4]   2> 158522 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 159567 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-1-001/cores/collection1
   [junit4]   2> 159569 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-1-001
   [junit4]   2> 159570 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] o.e.j.s.Server 
jetty-9.3.14.v20161028
   [junit4]   2> 159571 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@fc018b{/,null,AVAILABLE}
   [junit4]   2> 159572 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@1a5e1c4{HTTP/1.1,[http/1.1]}{127.0.0.1:38629}
   [junit4]   2> 159572 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] o.e.j.s.Server 
Started @161532ms
   [junit4]   2> 159572 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, 
solrconfig=solrconfig.xml, 
solr.data.dir=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/tempDir-001/jetty1,
 hostPort=45697, 
coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-1-001/cores}
   [junit4]   2> 159572 ERROR 
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 159572 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.4.2
   [junit4]   2> 159572 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 159572 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 159572 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-03-03T14:24:11.414752Z
   [junit4]   2> 159576 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 159576 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-1-001/solr.xml
   [junit4]   2> 159583 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 159585 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33001/solr
   [junit4]   2> 159592 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 159595 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45697_
   [junit4]   2> 159596 INFO  (zkCallback-320-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 159597 INFO  (zkCallback-316-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 159601 INFO  (zkCallback-326-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 159870 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-1-001/cores
   [junit4]   2> 159870 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 159876 INFO  
(OverseerStateUpdate-97553681458790404-127.0.0.1:33520_-n_0000000000) [    ] 
o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 159988 INFO  (zkCallback-326-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [2])
   [junit4]   2> 160889 WARN  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use 
<mergePolicyFactory> instead.
   [junit4]   2> 160889 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.2
   [junit4]   2> 160899 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 160957 WARN  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.s.IndexSchema [collection1] default search field in schema is text. 
WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 160959 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 160966 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
collection collection1
   [junit4]   2> 160966 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-1-001/cores/collection1],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-1-001/cores/collection1/data/]
   [junit4]   2> 160966 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@195bc
   [junit4]   2> 160967 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=23, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=63.849609375, 
floorSegmentMB=0.62109375, forceMergeDeletesPctAllowed=19.653036131467424, 
segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 160972 WARN  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 160982 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 160982 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 160985 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 160985 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 160986 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=33, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=54.92578125, 
floorSegmentMB=1.4228515625, forceMergeDeletesPctAllowed=4.506987706237508, 
segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 160986 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@895702[collection1] main]
   [junit4]   2> 160987 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 160987 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 160987 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 160989 INFO  (searcherExecutor-619-thread-1) [    ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@895702[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 160990 INFO  (coreLoadExecutor-618-thread-1) [    ] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1560858908773318656
   [junit4]   2> 160995 INFO  (coreZkRegister-613-thread-1) [    ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 160995 INFO  (coreZkRegister-613-thread-1) [    ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 160995 INFO  (coreZkRegister-613-thread-1) [    ] 
o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45697/collection1/
   [junit4]   2> 160995 INFO  (coreZkRegister-613-thread-1) [    ] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 160995 INFO  (coreZkRegister-613-thread-1) [    ] 
o.a.s.c.SyncStrategy http://127.0.0.1:45697/collection1/ has no replicas
   [junit4]   2> 160997 INFO  (coreZkRegister-613-thread-1) [    ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:45697/collection1/ shard2
   [junit4]   2> 161099 INFO  (zkCallback-326-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [2])
   [junit4]   2> 161148 INFO  (coreZkRegister-613-thread-1) [    ] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 161251 INFO  (zkCallback-326-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [2])
   [junit4]   2> 161824 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/cores/collection1
   [junit4]   2> 161825 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001
   [junit4]   2> 161826 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] o.e.j.s.Server 
jetty-9.3.14.v20161028
   [junit4]   2> 161827 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@1e15ac4{/,null,AVAILABLE}
   [junit4]   2> 161827 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@8793ae{HTTP/1.1,[http/1.1]}{127.0.0.1:36026}
   [junit4]   2> 161827 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] o.e.j.s.Server 
Started @163788ms
   [junit4]   2> 161827 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, 
solrconfig=solrconfig.xml, 
solr.data.dir=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/tempDir-001/jetty2,
 hostPort=46336, 
coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/cores}
   [junit4]   2> 161827 ERROR 
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 161828 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.4.2
   [junit4]   2> 161828 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 161828 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 161828 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-03-03T14:24:13.670183Z
   [junit4]   2> 161831 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 161831 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/solr.xml
   [junit4]   2> 161837 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 161839 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33001/solr
   [junit4]   2> 161845 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 161847 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:46336_
   [junit4]   2> 161848 INFO  (zkCallback-320-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 161848 INFO  (zkCallback-316-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 161848 INFO  (zkCallback-326-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 161848 INFO  (zkCallback-332-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 161917 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/cores
   [junit4]   2> 161917 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 161919 INFO  
(OverseerStateUpdate-97553681458790404-127.0.0.1:33520_-n_0000000000) [    ] 
o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 162020 INFO  (zkCallback-326-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 162020 INFO  (zkCallback-332-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 162926 WARN  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use 
<mergePolicyFactory> instead.
   [junit4]   2> 162927 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.2
   [junit4]   2> 162940 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 162993 WARN  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.s.IndexSchema [collection1] default search field in schema is text. 
WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 162996 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 163002 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
collection collection1
   [junit4]   2> 163003 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/cores/collection1],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/cores/collection1/data/]
   [junit4]   2> 163003 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@195bc
   [junit4]   2> 163004 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=23, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=63.849609375, 
floorSegmentMB=0.62109375, forceMergeDeletesPctAllowed=19.653036131467424, 
segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 163009 WARN  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 163021 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 163021 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 163024 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 163024 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 163025 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=33, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=54.92578125, 
floorSegmentMB=1.4228515625, forceMergeDeletesPctAllowed=4.506987706237508, 
segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 163025 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@ce9655[collection1] main]
   [junit4]   2> 163026 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 163026 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 163026 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 163027 INFO  (searcherExecutor-630-thread-1) [    ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@ce9655[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 163027 INFO  (coreLoadExecutor-629-thread-1) [    ] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1560858910910316544
   [junit4]   2> 163032 INFO  (coreZkRegister-624-thread-1) [    ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 163032 INFO  (coreZkRegister-624-thread-1) [    ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 163032 INFO  (coreZkRegister-624-thread-1) [    ] 
o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46336/collection1/
   [junit4]   2> 163032 INFO  (coreZkRegister-624-thread-1) [    ] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 163032 INFO  (coreZkRegister-624-thread-1) [    ] 
o.a.s.c.SyncStrategy http://127.0.0.1:46336/collection1/ has no replicas
   [junit4]   2> 163033 INFO  (coreZkRegister-624-thread-1) [    ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:46336/collection1/ shard1
   [junit4]   2> 163135 INFO  (zkCallback-332-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 163135 INFO  (zkCallback-326-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 163184 INFO  (coreZkRegister-624-thread-1) [    ] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 163290 INFO  (zkCallback-326-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 163290 INFO  (zkCallback-332-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 164352 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/cores/collection1
   [junit4]   2> 164354 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001
   [junit4]   2> 164354 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] o.e.j.s.Server 
jetty-9.3.14.v20161028
   [junit4]   2> 164355 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@e1ab35{/,null,AVAILABLE}
   [junit4]   2> 164356 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@7dc250{HTTP/1.1,[http/1.1]}{127.0.0.1:36998}
   [junit4]   2> 164356 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] o.e.j.s.Server 
Started @166316ms
   [junit4]   2> 164356 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, 
solrconfig=solrconfig.xml, 
solr.data.dir=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/tempDir-001/jetty3,
 hostPort=40875, 
coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/cores}
   [junit4]   2> 164356 ERROR 
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 164356 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.4.2
   [junit4]   2> 164356 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 164356 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 164356 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-03-03T14:24:16.198742Z
   [junit4]   2> 164359 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 164359 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/solr.xml
   [junit4]   2> 164366 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 164367 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33001/solr
   [junit4]   2> 164375 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 164388 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:40875_
   [junit4]   2> 164390 INFO  (zkCallback-316-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 164390 INFO  (zkCallback-326-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 164391 INFO  (zkCallback-338-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 164390 INFO  (zkCallback-332-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 164391 INFO  (zkCallback-320-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 164493 INFO  (zkCallback-326-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 164493 INFO  (zkCallback-332-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 164504 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath 
/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/cores
   [junit4]   2> 164504 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 164518 INFO  
(OverseerStateUpdate-97553681458790404-127.0.0.1:33520_-n_0000000000) [    ] 
o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 164620 INFO  (zkCallback-338-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 164620 INFO  (zkCallback-332-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 164620 INFO  (zkCallback-326-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 165529 WARN  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use 
<mergePolicyFactory> instead.
   [junit4]   2> 165530 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.2
   [junit4]   2> 165545 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 165643 WARN  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.s.IndexSchema [collection1] default search field in schema is text. 
WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 165646 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 165654 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
collection collection1
   [junit4]   2> 165654 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/cores/collection1],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/cores/collection1/data/]
   [junit4]   2> 165654 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@195bc
   [junit4]   2> 165656 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=23, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=63.849609375, 
floorSegmentMB=0.62109375, forceMergeDeletesPctAllowed=19.653036131467424, 
segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 165661 WARN  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 165672 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 165672 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 165675 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 165675 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 165676 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=33, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=54.92578125, 
floorSegmentMB=1.4228515625, forceMergeDeletesPctAllowed=4.506987706237508, 
segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 165676 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@14cb4bf[collection1] main]
   [junit4]   2> 165677 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 165677 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 165677 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 165678 INFO  (searcherExecutor-641-thread-1) [    ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@14cb4bf[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 165678 INFO  (coreLoadExecutor-640-thread-1) [    ] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1560858913690091520
   [junit4]   2> 165681 INFO  (coreZkRegister-635-thread-1) [    ] 
o.a.s.c.ZkController Core needs to recover:collection1
   [junit4]   2> 165681 INFO  (updateExecutor-335-thread-1) [    ] 
o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 165682 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 165682 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 165682 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1]
   [junit4]   2> 165682 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, 
tlog=null}
   [junit4]   2> 165682 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, 
leader is [http://127.0.0.1:45697/collection1/] and I am 
[http://127.0.0.1:40875/collection1/]
   [junit4]   2> 165685 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.c.RecoveryStrategy Sending prep recovery command to 
[http://127.0.0.1:45697]; [WaitForState: 
action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:40875_&coreNodeName=core_node3&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 165687 INFO  (SocketProxy-Acceptor-45697) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=49486,localport=45697], receiveBufferSize:531000
   [junit4]   2> 165690 INFO  (SocketProxy-Acceptor-45697) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=38629,localport=50502], receiveBufferSize=530904
   [junit4]   2> 165697 INFO  (qtp28947811-1540) [    ] 
o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node3, state: 
recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
   [junit4]   2> 165698 INFO  (qtp28947811-1540) [    ] 
o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 
(shard2 of collection1) have state: recovering
   [junit4]   2> 165698 INFO  (qtp28947811-1540) [    ] 
o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, 
shard=shard2, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? 
true, live=true, checkLive=true, currentState=down, localState=active, 
nodeName=127.0.0.1:40875_, coreNodeName=core_node3, 
onlyIfActiveCheckResult=false, nodeProps: 
core_node3:{"core":"collection1","base_url":"http://127.0.0.1:40875","node_name":"127.0.0.1:40875_","state":"down"}
   [junit4]   2> 165785 INFO  (zkCallback-326-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 165785 INFO  (zkCallback-332-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 165785 INFO  (zkCallback-338-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 166124 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 166124 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase Wait for recoveries to finish - wait 
30000 for each attempt
   [junit4]   2> 166124 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: 
collection1 failOnTimeout:true timeout (sec):30000
   [junit4]   2> 166698 INFO  (qtp28947811-1540) [    ] 
o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, 
shard=shard2, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? 
true, live=true, checkLive=true, currentState=recovering, localState=active, 
nodeName=127.0.0.1:40875_, coreNodeName=core_node3, 
onlyIfActiveCheckResult=false, nodeProps: 
core_node3:{"core":"collection1","base_url":"http://127.0.0.1:40875","node_name":"127.0.0.1:40875_","state":"recovering"}
   [junit4]   2> 166699 INFO  (qtp28947811-1540) [    ] 
o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node3, state: recovering, 
checkLive: true, onlyIfLeader: true for: 1 seconds.
   [junit4]   2> 166699 INFO  (qtp28947811-1540) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={nodeName=127.0.0.1:40875_&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node3&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2}
 status=0 QTime=1001
   [junit4]   2> 173699 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.c.RecoveryStrategy Attempting to PeerSync from 
[http://127.0.0.1:45697/collection1/] - recoveringAfterStartup=[true]
   [junit4]   2> 173700 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.u.PeerSync PeerSync: core=collection1 url=http://127.0.0.1:40875 START 
replicas=[http://127.0.0.1:45697/collection1/] nUpdates=100
   [junit4]   2> 173701 INFO  (SocketProxy-Acceptor-45697) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=49518,localport=45697], receiveBufferSize:531000
   [junit4]   2> 173702 INFO  (SocketProxy-Acceptor-45697) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=38629,localport=50534], receiveBufferSize=530904
   [junit4]   2> 173703 INFO  (qtp28947811-1540) [    ] 
o.a.s.u.IndexFingerprint IndexFingerprint millis:0.0 
result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, 
maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0}
   [junit4]   2> 173703 INFO  (qtp28947811-1540) [    ] o.a.s.c.S.Request 
[collection1]  webapp= path=/get 
params={distrib=false&qt=/get&getFingerprint=9223372036854775807&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 173704 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.u.IndexFingerprint IndexFingerprint millis:0.0 
result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, 
maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0}
   [junit4]   2> 173704 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.u.PeerSync We are already in sync. No need to do a PeerSync 
   [junit4]   2> 173704 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 173704 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 173704 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 173704 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.c.RecoveryStrategy PeerSync stage of recovery was successful.
   [junit4]   2> 173704 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.c.RecoveryStrategy Replaying updates buffered during PeerSync.
   [junit4]   2> 173704 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.c.RecoveryStrategy No replay needed.
   [junit4]   2> 173704 INFO  (recoveryExecutor-336-thread-1) [    ] 
o.a.s.c.RecoveryStrategy Registering as Active after recovery.
   [junit4]   2> 173706 INFO  (zkCallback-326-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 173706 INFO  (zkCallback-338-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 173706 INFO  (zkCallback-332-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 174128 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: collection1
   [junit4]   2> 174129 INFO  (SocketProxy-Acceptor-33520) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=48890,localport=33520], receiveBufferSize:531000
   [junit4]   2> 174132 INFO  (SocketProxy-Acceptor-33520) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=32874,localport=52554], receiveBufferSize=530904
   [junit4]   2> 174133 INFO  (qtp1505883-1503) [    ] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 174133 INFO  (qtp1505883-1503) [    ] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 174133 INFO  (qtp1505883-1503) [    ] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 174134 INFO  (qtp1505883-1503) [    ] 
o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update 
params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=}
 0 0
   [junit4]   2> 174135 INFO  (SocketProxy-Acceptor-46336) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=43876,localport=46336], receiveBufferSize:531000
   [junit4]   2> 174136 INFO  (SocketProxy-Acceptor-46336) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=36026,localport=56818], receiveBufferSize=530904
   [junit4]   2> 174140 INFO  (SocketProxy-Acceptor-46336) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=43880,localport=46336], receiveBufferSize:531000
   [junit4]   2> 174140 INFO  (SocketProxy-Acceptor-40875) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=42294,localport=40875], receiveBufferSize:531000
   [junit4]   2> 174140 INFO  (SocketProxy-Acceptor-45697) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=49538,localport=45697], receiveBufferSize:531000
   [junit4]   2> 174140 INFO  (SocketProxy-Acceptor-40875) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=36998,localport=46852], receiveBufferSize=530904
   [junit4]   2> 174141 INFO  (SocketProxy-Acceptor-45697) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=38629,localport=50554], receiveBufferSize=530904
   [junit4]   2> 174144 INFO  (SocketProxy-Acceptor-46336) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=36026,localport=56824], receiveBufferSize=530904
   [junit4]   2> 174146 INFO  (qtp28947811-1537) [    ] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 174146 INFO  (qtp20220018-1565) [    ] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 174146 INFO  (qtp28947811-1537) [    ] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 174147 INFO  (qtp20220018-1565) [    ] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 174148 INFO  (qtp20220018-1565) [    ] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 174148 INFO  (qtp1920943-1598) [    ] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 174148 INFO  (qtp28947811-1537) [    ] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 174149 INFO  (qtp1920943-1598) [    ] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 174149 INFO  (qtp28947811-1537) [    ] 
o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update 
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:46336/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 3
   [junit4]   2> 174149 INFO  (qtp1920943-1598) [    ] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 174149 INFO  (qtp1920943-1598) [    ] 
o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update 
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:46336/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 2
   [junit4]   2> 174148 INFO  (qtp20220018-1565) [    ] 
o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update 
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:46336/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 2
   [junit4]   2> 174150 INFO  (qtp20220018-1569) [    ] 
o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update 
params={_stateVer_=collection1:11&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=}
 0 11
   [junit4]   2> 174152 INFO  (SocketProxy-Acceptor-45697) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=49542,localport=45697], receiveBufferSize:531000
   [junit4]   2> 174152 INFO  (SocketProxy-Acceptor-45697) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=38629,localport=50558], receiveBufferSize=530904
   [junit4]   2> 174157 INFO  (qtp28947811-1540) [    ] o.a.s.c.S.Request 
[collection1]  webapp= path=/select 
params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2}
 hits=0 status=0 QTime=1
   [junit4]   2> 174159 INFO  (SocketProxy-Acceptor-40875) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=42308,localport=40875], receiveBufferSize:531000
   [junit4]   2> 174161 INFO  (SocketProxy-Acceptor-40875) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=36998,localport=46864], receiveBufferSize=530904
   [junit4]   2> 174162 INFO  (qtp1920943-1594) [    ] o.a.s.c.S.Request 
[collection1]  webapp= path=/select 
params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2}
 hits=0 status=0 QTime=0
   [junit4]   2> 174164 INFO  (SocketProxy-Acceptor-46336) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=43900,localport=46336], receiveBufferSize:531000
   [junit4]   2> 174169 INFO  (SocketProxy-Acceptor-46336) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=36026,localport=56842], receiveBufferSize=530904
   [junit4]   2> 174171 INFO  (qtp20220018-1571) [    ] o.a.s.c.S.Request 
[collection1]  webapp= path=/select 
params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2}
 hits=0 status=0 QTime=0
   [junit4]   2> 176174 INFO  (SocketProxy-Acceptor-46336) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=43970,localport=46336], receiveBufferSize:531000
   [junit4]   2> 176175 INFO  (SocketProxy-Acceptor-46336) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=36026,localport=56912], receiveBufferSize=530904
   [junit4]   2> 176176 INFO  (qtp20220018-1569) [    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=2&maxShardsPerNode=1&name=c8n_crud_1x2&action=CREATE&numShards=1&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 176178 INFO  (OverseerThreadFactory-605-thread-1) [    ] 
o.a.s.c.CreateCollectionCmd Create collection c8n_crud_1x2
   [junit4]   2> 176178 INFO  (OverseerThreadFactory-605-thread-1) [    ] 
o.a.s.c.CreateCollectionCmd Only one config set found in zk - using it:conf1
   [junit4]   2> 176282 INFO  (SocketProxy-Acceptor-46336) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=43982,localport=46336], receiveBufferSize:531000
   [junit4]   2> 176282 INFO  (SocketProxy-Acceptor-40875) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=42394,localport=40875], receiveBufferSize:531000
   [junit4]   2> 176282 INFO  (SocketProxy-Acceptor-46336) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=36026,localport=56926], receiveBufferSize=530904
   [junit4]   2> 176283 INFO  (SocketProxy-Acceptor-40875) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=36998,localport=46954], receiveBufferSize=530904
   [junit4]   2> 176283 INFO  (qtp20220018-1564) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf1&newCollection=true&name=c8n_crud_1x2_shard1_replica1&action=CREATE&numShards=1&collection=c8n_crud_1x2&shard=shard1&wt=javabin&version=2
   [junit4]   2> 176286 INFO  (qtp1920943-1598) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf1&newCollection=true&name=c8n_crud_1x2_shard1_replica2&action=CREATE&numShards=1&collection=c8n_crud_1x2&shard=shard1&wt=javabin&version=2
   [junit4]   2> 176988 INFO  (zkCallback-338-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 176988 INFO  (zkCallback-332-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 177895 WARN  (qtp1920943-1598) [    ] o.a.s.c.Config Beginning 
with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 177897 INFO  (qtp1920943-1598) [    ] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 6.4.2
   [junit4]   2> 177898 WARN  (qtp20220018-1564) [    ] o.a.s.c.Config 
Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> 
instead.
   [junit4]   2> 177899 INFO  (qtp20220018-1564) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.4.2
   [junit4]   2> 177907 INFO  (qtp1920943-1598) [    ] o.a.s.s.IndexSchema 
[c8n_crud_1x2_shard1_replica2] Schema name=test
   [junit4]   2> 177915 INFO  (qtp20220018-1564) [    ] o.a.s.s.IndexSchema 
[c8n_crud_1x2_shard1_replica1] Schema name=test
   [junit4]   2> 178016 WARN  (qtp1920943-1598) [    ] o.a.s.s.IndexSchema 
[c8n_crud_1x2_shard1_replica2] default search field in schema is text. WARNING: 
Deprecated, please use 'df' on request instead.
   [junit4]   2> 178019 INFO  (qtp1920943-1598) [    ] o.a.s.s.IndexSchema 
Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 178026 INFO  (qtp1920943-1598) [    ] o.a.s.c.CoreContainer 
Creating SolrCore 'c8n_crud_1x2_shard1_replica2' using configuration from 
collection c8n_crud_1x2
   [junit4]   2> 178027 INFO  (qtp1920943-1598) [    ] o.a.s.c.SolrCore 
[[c8n_crud_1x2_shard1_replica2] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/cores/c8n_crud_1x2_shard1_replica2],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/cores/c8n_crud_1x2_shard1_replica2/data/]
   [junit4]   2> 178027 INFO  (qtp1920943-1598) [    ] o.a.s.c.JmxMonitoredMap 
JMX monitoring is enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@195bc
   [junit4]   2> 178029 INFO  (qtp1920943-1598) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=23, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=63.849609375, 
floorSegmentMB=0.62109375, forceMergeDeletesPctAllowed=19.653036131467424, 
segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 178034 WARN  (qtp20220018-1564) [    ] o.a.s.s.IndexSchema 
[c8n_crud_1x2_shard1_replica1] default search field in schema is text. WARNING: 
Deprecated, please use 'df' on request instead.
   [junit4]   2> 178035 WARN  (qtp1920943-1598) [    ] o.a.s.c.RequestHandlers 
INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class 
= DumpRequestHandler,attributes = {initParams=a, name=/dump, 
class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 178035 INFO  (qtp20220018-1564) [    ] o.a.s.s.IndexSchema 
Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 178045 INFO  (qtp20220018-1564) [    ] o.a.s.c.CoreContainer 
Creating SolrCore 'c8n_crud_1x2_shard1_replica1' using configuration from 
collection c8n_crud_1x2
   [junit4]   2> 178046 INFO  (qtp20220018-1564) [    ] o.a.s.c.SolrCore 
[[c8n_crud_1x2_shard1_replica1] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/cores/c8n_crud_1x2_shard1_replica1],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/cores/c8n_crud_1x2_shard1_replica1/data/]
   [junit4]   2> 178046 INFO  (qtp20220018-1564) [    ] o.a.s.c.JmxMonitoredMap 
JMX monitoring is enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@195bc
   [junit4]   2> 178047 INFO  (qtp20220018-1564) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=23, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=63.849609375, 
floorSegmentMB=0.62109375, forceMergeDeletesPctAllowed=19.653036131467424, 
segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 178048 INFO  (qtp1920943-1598) [    ] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 178048 INFO  (qtp1920943-1598) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 178052 WARN  (qtp20220018-1564) [    ] o.a.s.c.RequestHandlers 
INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class 
= DumpRequestHandler,attributes = {initParams=a, name=/dump, 
class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 178055 INFO  (qtp1920943-1598) [    ] o.a.s.u.CommitTracker 
Hard AutoCommit: disabled
   [junit4]   2> 178055 INFO  (qtp1920943-1598) [    ] o.a.s.u.CommitTracker 
Soft AutoCommit: disabled
   [junit4]   2> 178055 INFO  (qtp1920943-1598) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=33, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=54.92578125, 
floorSegmentMB=1.4228515625, forceMergeDeletesPctAllowed=4.506987706237508, 
segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 178055 INFO  (qtp1920943-1598) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@2405a6[c8n_crud_1x2_shard1_replica2] main]
   [junit4]   2> 178056 INFO  (qtp1920943-1598) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 178056 INFO  (qtp1920943-1598) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 178057 INFO  (qtp1920943-1598) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 178058 INFO  (searcherExecutor-646-thread-1) [    ] 
o.a.s.c.SolrCore [c8n_crud_1x2_shard1_replica2] Registered new searcher 
Searcher@2405a6[c8n_crud_1x2_shard1_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 178058 INFO  (qtp1920943-1598) [    ] o.a.s.u.UpdateLog Could 
not find max version in index or recent updates, using new clock 
1560858926671462400
   [junit4]   2> 178064 INFO  (qtp1920943-1598) [    ] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 178068 INFO  (qtp20220018-1564) [    ] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 178068 INFO  (qtp20220018-1564) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 178074 INFO  (qtp20220018-1564) [    ] o.a.s.u.CommitTracker 
Hard AutoCommit: disabled
   [junit4]   2> 178074 INFO  (qtp20220018-1564) [    ] o.a.s.u.CommitTracker 
Soft AutoCommit: disabled
   [junit4]   2> 178074 INFO  (qtp20220018-1564) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=33, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=54.92578125, 
floorSegmentMB=1.4228515625, forceMergeDeletesPctAllowed=4.506987706237508, 
segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 178074 INFO  (qtp20220018-1564) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@1148aa8[c8n_crud_1x2_shard1_replica1] main]
   [junit4]   2> 178075 INFO  (qtp20220018-1564) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 178075 INFO  (qtp20220018-1564) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 178075 INFO  (qtp20220018-1564) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 178076 INFO  (qtp20220018-1564) [    ] o.a.s.u.UpdateLog Could 
not find max version in index or recent updates, using new clock 
1560858926690336768
   [junit4]   2> 178077 INFO  (searcherExecutor-648-thread-1) [    ] 
o.a.s.c.SolrCore [c8n_crud_1x2_shard1_replica1] Registered new searcher 
Searcher@1148aa8[c8n_crud_1x2_shard1_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 178167 INFO  (zkCallback-338-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 178167 INFO  (zkCallback-332-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 178564 INFO  (qtp1920943-1598) [    ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 178564 INFO  (qtp1920943-1598) [    ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 178564 INFO  (qtp1920943-1598) [    ] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:40875/c8n_crud_1x2_shard1_replica2/
   [junit4]   2> 178564 INFO  (qtp1920943-1598) [    ] o.a.s.u.PeerSync 
PeerSync: core=c8n_crud_1x2_shard1_replica2 url=http://127.0.0.1:40875 START 
replicas=[http://127.0.0.1:46336/c8n_crud_1x2_shard1_replica1/] nUpdates=100
   [junit4]   2> 178565 INFO  (qtp1920943-1598) [    ] o.a.s.u.PeerSync 
PeerSync: core=c8n_crud_1x2_shard1_replica2 url=http://127.0.0.1:40875 DONE.  
We have no versions.  sync failed.
   [junit4]   2> 178565 INFO  (SocketProxy-Acceptor-46336) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=44000,localport=46336], receiveBufferSize:531000
   [junit4]   2> 178566 INFO  (SocketProxy-Acceptor-46336) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=36026,localport=56942], receiveBufferSize=530904
   [junit4]   2> 178568 INFO  (qtp20220018-1571) [    ] o.a.s.c.S.Request 
[c8n_crud_1x2_shard1_replica1]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=1
   [junit4]   2> 178568 INFO  (qtp1920943-1598) [    ] o.a.s.c.SyncStrategy 
Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 178568 INFO  (qtp1920943-1598) [    ] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 178571 INFO  (qtp1920943-1598) [    ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:40875/c8n_crud_1x2_shard1_replica2/ shard1
   [junit4]   2> 178673 INFO  (zkCallback-338-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 178673 INFO  (zkCallback-332-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 178721 INFO  (qtp1920943-1598) [    ] o.a.s.c.ZkController I 
am the leader, no recovery necessary
   [junit4]   2> 178725 INFO  (qtp1920943-1598) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=c8n_crud_1x2_shard1_replica2&action=CREATE&numShards=1&collection=c8n_crud_1x2&shard=shard1&wt=javabin&version=2}
 status=0 QTime=2438
   [junit4]   2> 178824 INFO  (zkCallback-332-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 178824 INFO  (zkCallback-338-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 179083 INFO  (qtp20220018-1564) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=c8n_crud_1x2_shard1_replica1&action=CREATE&numShards=1&collection=c8n_crud_1x2&shard=shard1&wt=javabin&version=2}
 status=0 QTime=2800
   [junit4]   2> 179086 INFO  (qtp20220018-1569) [    ] 
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
30 seconds. Check all shard replicas
   [junit4]   2> 179183 INFO  (zkCallback-338-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 179183 INFO  (zkCallback-332-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 180087 INFO  (qtp20220018-1569) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/collections 
params={replicationFactor=2&maxShardsPerNode=1&name=c8n_crud_1x2&action=CREATE&numShards=1&wt=javabin&version=2}
 status=0 QTime=3910
   [junit4]   2> 180088 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase Found 2 replicas and leader on 
127.0.0.1:40875_ for shard1 in c8n_crud_1x2
   [junit4]   2> 180088 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase Took 0.0 ms to see all replicas become 
active.
   [junit4]   2> 180100 INFO  (SocketProxy-Acceptor-33520) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=49042,localport=33520], receiveBufferSize:531000
   [junit4]   2> 180100 INFO  (SocketProxy-Acceptor-33520) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=32874,localport=52706], receiveBufferSize=530904
   [junit4]   2> 180102 INFO  (qtp1505883-1502) [    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
name=c8n_crud_1x2&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 180103 INFO  (OverseerThreadFactory-605-thread-2) [    ] 
o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : 
action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 180103 INFO  
(OverseerCollectionConfigSetProcessor-97553681458790404-127.0.0.1:33520_-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 180107 INFO  (qtp20220018-1566) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.c8n_crud_1x2.shard1.replica1
   [junit4]   2> 180107 INFO  (qtp1920943-1600) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.c8n_crud_1x2.shard1.replica2
   [junit4]   2> 180108 INFO  (qtp1920943-1600) [    ] o.a.s.c.SolrCore 
[c8n_crud_1x2_shard1_replica2]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@d026d0
   [junit4]   2> 180108 INFO  (qtp20220018-1566) [    ] o.a.s.c.SolrCore 
[c8n_crud_1x2_shard1_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@673ca3
   [junit4]   2> 180177 INFO  (qtp1920943-1600) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.c8n_crud_1x2.shard1.replica2
   [junit4]   2> 180191 WARN  (zkCallback-332-thread-2) [    ] 
o.a.s.c.LeaderElector 
   [junit4]   2> org.apache.solr.common.SolrException: SolrCore not 
found:c8n_crud_1x2_shard1_replica1 in [collection1]
   [junit4]   2>        at 
org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:292)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:268)
   [junit4]   2>        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2>        at 
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
   [junit4]   2>        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161)
   [junit4]   2>        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]   2>        at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 180193 INFO  (qtp1920943-1600) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=c8n_crud_1x2_shard1_replica2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=87
   [junit4]   2> 180197 INFO  (qtp20220018-1566) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.c8n_crud_1x2.shard1.replica1
   [junit4]   2> 180220 INFO  (qtp20220018-1566) [    ] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 180220 INFO  (qtp20220018-1566) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=c8n_crud_1x2_shard1_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=115
   [junit4]   2> 180924 INFO  (qtp1505883-1502) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/collections 
params={name=c8n_crud_1x2&action=DELETE&wt=javabin&version=2} status=0 QTime=822
   [junit4]   2> 180927 INFO  (SocketProxy-Acceptor-45697) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=49678,localport=45697], receiveBufferSize:531000
   [junit4]   2> 180927 INFO  (SocketProxy-Acceptor-45697) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=38629,localport=50694], receiveBufferSize=530904
   [junit4]   2> 180928 INFO  (qtp28947811-1537) [    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=3&maxShardsPerNode=1&name=collMinRf_1x3&action=CREATE&numShards=1&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 180930 INFO  (OverseerThreadFactory-605-thread-3) [    ] 
o.a.s.c.CreateCollectionCmd Create collection collMinRf_1x3
   [junit4]   2> 180930 INFO  (OverseerThreadFactory-605-thread-3) [    ] 
o.a.s.c.CreateCollectionCmd Only one config set found in zk - using it:conf1
   [junit4]   2> 180930 INFO  
(OverseerCollectionConfigSetProcessor-97553681458790404-127.0.0.1:33520_-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 181133 INFO  (SocketProxy-Acceptor-33520) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=49052,localport=33520], receiveBufferSize:531000
   [junit4]   2> 181134 INFO  (SocketProxy-Acceptor-33520) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=32874,localport=52716], receiveBufferSize=530904
   [junit4]   2> 181136 INFO  (qtp20220018-1564) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf1&newCollection=true&name=collMinRf_1x3_shard1_replica2&action=CREATE&numShards=1&collection=collMinRf_1x3&shard=shard1&wt=javabin&version=2
   [junit4]   2> 181136 INFO  (qtp1505883-1503) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf1&newCollection=true&name=collMinRf_1x3_shard1_replica3&action=CREATE&numShards=1&collection=collMinRf_1x3&shard=shard1&wt=javabin&version=2
   [junit4]   2> 181136 INFO  (qtp1920943-1595) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf1&newCollection=true&name=collMinRf_1x3_shard1_replica1&action=CREATE&numShards=1&collection=collMinRf_1x3&shard=shard1&wt=javabin&version=2
   [junit4]   2> 181241 INFO  (zkCallback-316-thread-6) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collMinRf_1x3/state.json] for collection [collMinRf_1x3] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 181241 INFO  (zkCallback-332-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collMinRf_1x3/state.json] for collection [collMinRf_1x3] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 181241 INFO  (zkCallback-338-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collMinRf_1x3/state.json] for collection [collMinRf_1x3] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 182147 WARN  (qtp1505883-1503) [    ] o.a.s.c.Config Beginning 
with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 182147 WARN  (qtp20220018-1564) [    ] o.a.s.c.Config 
Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> 
instead.
   [junit4]   2> 182147 WARN  (qtp1920943-1595) [    ] o.a.s.c.Config Beginn

[...truncated too long message...]

pe:NodeDataChanged path:/collections/collection1/state.json] for collection 
[collection1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 304176 INFO  (zkCallback-338-thread-9) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collMinRf_1x3/state.json] for collection [collMinRf_1x3] has 
occurred - updating... (live nodes size: [1])
   [junit4]   2> 304278 INFO  (zkCallback-338-thread-9) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collMinRf_1x3/state.json] for collection [collMinRf_1x3] has 
occurred - updating... (live nodes size: [1])
   [junit4]   2> 305648 WARN  (zkCallback-332-thread-2) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 
[KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 305649 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 305651 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.e.j.s.AbstractConnector Stopped 
ServerConnector@8793ae{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 305651 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@1e15ac4{/,null,UNAVAILABLE}
   [junit4]   2> 305652 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.ChaosMonkey monkey: stop shard! 40875
   [junit4]   2> 305652 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=9696251
   [junit4]   2> 305658 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] o.a.s.c.Overseer 
Overseer (id=97553681458790416-127.0.0.1:40875_-n_0000000004) closing
   [junit4]   2> 305659 INFO  (zkCallback-338-thread-7) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collMinRf_1x3/state.json] for collection [collMinRf_1x3] has 
occurred - updating... (live nodes size: [1])
   [junit4]   2> 305659 INFO  
(OverseerStateUpdate-97553681458790416-127.0.0.1:40875_-n_0000000004) [    ] 
o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40875_
   [junit4]   2> 305660 INFO  (zkCallback-320-thread-3) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 306556 WARN  (zkCallback-338-thread-4) [    ] 
o.a.s.c.SyncStrategy Closed, skipping sync up.
   [junit4]   2> 306556 INFO  (zkCallback-338-thread-4) [    ] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 306556 INFO  (zkCallback-338-thread-4) [    ] o.a.s.c.SolrCore 
[collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1a5b594
   [junit4]   2> 306590 INFO  (zkCallback-338-thread-4) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
   [junit4]   2> 306654 WARN  (zkCallback-338-thread-3) [    ] 
o.a.s.c.SyncStrategy Closed, skipping sync up.
   [junit4]   2> 306655 INFO  (zkCallback-338-thread-3) [    ] o.a.s.c.SolrCore 
[collMinRf_1x3_shard1_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@4556e5
   [junit4]   2> 306685 INFO  (zkCallback-338-thread-3) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.collMinRf_1x3.shard1.replica1
   [junit4]   2> 307159 WARN  (zkCallback-338-thread-7) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 
[KeeperErrorCode = Session expired for /collections/collMinRf_1x3/state.json]
   [junit4]   2> 307160 WARN  (zkCallback-338-thread-9) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 
[KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 307161 WARN  (zkCallback-338-thread-6) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 
[KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 307161 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 307162 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.e.j.s.AbstractConnector Stopped 
ServerConnector@7dc250{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 307162 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@e1ab35{/,null,UNAVAILABLE}
   [junit4]   2> 307163 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.ChaosMonkey monkey: stop shard! 33520
   [junit4]   2> 307164 INFO  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:33001 33001
   [junit4]   2> 307189 INFO  (Thread-336) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:33001 33001
   [junit4]   2> 307190 WARN  (Thread-336) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        6       /solr/clusterprops.json
   [junit4]   2>        6       /solr/aliases.json
   [junit4]   2>        5       /solr/security.json
   [junit4]   2>        5       /solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        6       /solr/clusterstate.json
   [junit4]   2>        4       /solr/collections/collection1/state.json
   [junit4]   2>        4       /solr/collections/collMinRf_1x3/state.json
   [junit4]   2>        3       /solr/collections/c8n_1x3/state.json
   [junit4]   2>        3       
/solr/collections/c8n_1x2_leader_session_loss/state.json
   [junit4]   2>        2       
/solr/overseer_elect/election/97553681458790412-127.0.0.1:46336_-n_0000000002
   [junit4]   2>        2       /solr/collections/c8n_1x2/state.json
   [junit4]   2>        2       /solr/collections/c8n_crud_1x2/state.json
   [junit4]   2>        2       
/solr/collections/collMinRf_1x3/leader_elect/shard1/election/97553681458790404-core_node1-n_0000000001
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard2/election/97553681458790409-core_node1-n_0000000000
   [junit4]   2>        2       
/solr/collections/collMinRf_1x3/leader_elect/shard1/election/97553681458790412-core_node2-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        131     /solr/overseer/collection-queue-work
   [junit4]   2>        84      /solr/overseer/queue
   [junit4]   2>        40      /solr/overseer/queue-work
   [junit4]   2>        7       /solr/live_nodes
   [junit4]   2>        6       /solr/collections
   [junit4]   2> 
   [junit4]   2> 307190 WARN  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.SocketProxy Closing 9 connections to: http://127.0.0.1:33520/, target: 
http://127.0.0.1:32874/
   [junit4]   2> 307190 WARN  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.SocketProxy Closing 5 connections to: http://127.0.0.1:45697/, target: 
http://127.0.0.1:38629/
   [junit4]   2> 307190 WARN  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.SocketProxy Closing 13 connections to: http://127.0.0.1:46336/, target: 
http://127.0.0.1:36026/
   [junit4]   2> 307190 WARN  
(TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [    ] 
o.a.s.c.SocketProxy Closing 5 connections to: http://127.0.0.1:40875/, target: 
http://127.0.0.1:36998/
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HttpPartitionTest 
-Dtests.method=test -Dtests.seed=2C617D978245810C -Dtests.multiplier=3 
-Dtests.slow=true -Dtests.locale=mer-KE -Dtests.timezone=Europe/Riga 
-Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR    151s J0 | HttpPartitionTest.test <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=2007, name=SocketProxy-Response-32874:49790, 
state=RUNNABLE, group=TGRP-HttpPartitionTest]
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([2C617D978245810C:A435424D2CB9ECF4]:0)
   [junit4]    > Caused by: java.lang.RuntimeException: 
java.net.SocketException: Socket is closed
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([2C617D978245810C]:0)
   [junit4]    >        at 
org.apache.solr.cloud.SocketProxy$Bridge$Pump.run(SocketProxy.java:347)
   [junit4]    > Caused by: java.net.SocketException: Socket is closed
   [junit4]    >        at 
java.base/java.net.Socket.setSoTimeout(Socket.java:1137)
   [junit4]    >        at 
org.apache.solr.cloud.SocketProxy$Bridge$Pump.run(SocketProxy.java:344)
   [junit4]   2> 307193 INFO  
(SUITE-HttpPartitionTest-seed#[2C617D978245810C]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Mar 03, 2017 2:26:39 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62), 
sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=mer-KE, 
timezone=Europe/Riga
   [junit4]   2> NOTE: Linux 4.4.0-53-generic i386/Oracle Corporation 9-ea 
(32-bit)/cpus=12,threads=1,free=37534768,total=288096256
   [junit4]   2> NOTE: All tests run in this JVM: [TestQuerySenderNoQuery, 
TestSolrCLIRunExample, TestQueryWrapperFilter, FastVectorHighlighterTest, 
BlockCacheTest, AnalysisErrorHandlingTest, TestNRTOpen, AlternateDirectoryTest, 
TestCustomDocTransformer, MergeStrategyTest, SolrXmlInZkTest, 
RegexBoostProcessorTest, NotRequiredUniqueKeyTest, TestSQLHandler, 
LeaderFailureAfterFreshStartTest, TestLRUStatsCache, TestReRankQParserPlugin, 
DocumentAnalysisRequestHandlerTest, TestRawResponseWriter, TestRealTimeGet, 
TestCopyFieldCollectionResource, UUIDFieldTest, HttpPartitionTest]
   [junit4] Completed [97/680 (1!)] on J0 in 152.61s, 1 test, 1 error <<< 
FAILURES!

[...truncated 53440 lines...]

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to