I fixed this for MacOS and Solaris. Steve missed to check the ANT version in 
the "Tools Environment".

Uwe

-----
Uwe Schindler
Achterdiek 19, D-28357 Bremen
http://www.thetaphi.de
eMail: u...@thetaphi.de

> -----Original Message-----
> From: Policeman Jenkins Server [mailto:jenk...@thetaphi.de]
> Sent: Friday, February 23, 2018 10:59 AM
> To: dev@lucene.apache.org
> Subject: [JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk1.8.0) - Build # 4458
> - Failure!
> 
> Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4458/
> Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC
> 
> No tests ran.
> 
> Build Log:
> [...truncated 13166 lines...]
>    [junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
>    [junit4]   2> 1696288 INFO  (SUITE-FullSolrCloudDistribCmdsTest-
> seed#[E4AEC87AD39772B3]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom
> sanity checks: test.solr.allowed.securerandom=null &
> java.security.egd=file:/dev/./urandom
>    [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-
> master-MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/init-core-data-001
>    [junit4]   2> 1696289 WARN  (SUITE-FullSolrCloudDistribCmdsTest-
> seed#[E4AEC87AD39772B3]-worker) [    ] o.a.s.SolrTestCaseJ4
> startTrackingSearchers: numOpens=10 numCloses=10
>    [junit4]   2> 1696289 INFO  (SUITE-FullSolrCloudDistribCmdsTest-
> seed#[E4AEC87AD39772B3]-worker) [    ] o.a.s.SolrTestCaseJ4 Using
> PointFields (NUMERIC_POINTS_SYSPROP=true)
> w/NUMERIC_DOCVALUES_SYSPROP=true
>    [junit4]   2> 1696296 INFO  (SUITE-FullSolrCloudDistribCmdsTest-
> seed#[E4AEC87AD39772B3]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized
> ssl (false) and clientAuth (false) via:
> @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache
> .org/jira/browse/SOLR-5776) w/ MAC_OS_X supressed clientAuth
>    [junit4]   2> 1696296 INFO  (SUITE-FullSolrCloudDistribCmdsTest-
> seed#[E4AEC87AD39772B3]-worker) [    ]
> o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
>    [junit4]   2> 1696298 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST
> SERVER
>    [junit4]   2> 1696298 INFO  (Thread-3704) [    ] o.a.s.c.ZkTestServer 
> client
> port:0.0.0.0/0.0.0.0:0
>    [junit4]   2> 1696299 INFO  (Thread-3704) [    ] o.a.s.c.ZkTestServer 
> Starting
> server
>    [junit4]   2> 1696302 ERROR (Thread-3704) [    ] o.a.z.s.ZooKeeperServer
> ZKShutdownHandler is not registered, so ZooKeeper server won't take any
> action on ERROR or SHUTDOWN server state changes
>    [junit4]   2> 1696399 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.ZkTestServer start zk server on
> port:60299
>    [junit4]   2> 1696417 INFO  (zkConnectionManagerCallback-4020-thread-1) [
> ] o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1696424 INFO  (zkConnectionManagerCallback-4022-thread-1) [
> ] o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1696438 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractZkTestCase put
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-
> files/solr/collection1/conf/solrconfig-tlog.xml to
> /configs/conf1/solrconfig.xml
>    [junit4]   2> 1696443 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractZkTestCase put
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-
> files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
>    [junit4]   2> 1696446 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractZkTestCase put
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-
> files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to
> /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>    [junit4]   2> 1696449 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractZkTestCase put
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-
> files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
>    [junit4]   2> 1696455 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractZkTestCase put
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-
> files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
>    [junit4]   2> 1696466 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractZkTestCase put
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-
> files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
>    [junit4]   2> 1696478 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractZkTestCase put
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-
> files/solr/collection1/conf/enumsConfig.xml to
> /configs/conf1/enumsConfig.xml
>    [junit4]   2> 1696488 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractZkTestCase put
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-
> files/solr/collection1/conf/open-exchange-rates.json to
> /configs/conf1/open-exchange-rates.json
>    [junit4]   2> 1696498 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractZkTestCase put
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-
> files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to
> /configs/conf1/mapping-ISOLatin1Accent.txt
>    [junit4]   2> 1696508 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractZkTestCase put
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-
> files/solr/collection1/conf/old_synonyms.txt to
> /configs/conf1/old_synonyms.txt
>    [junit4]   2> 1696516 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractZkTestCase put
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-
> files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
>    [junit4]   2> 1696524 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will
> use NRT replicas unless explicitly asked otherwise
>    [junit4]   2> 1698059 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build
> timestamp: 2017-11-21T21:27:37Z, git hash:
> 82b8fb23f757335bb3329d540ce37a2a2615f0a8
>    [junit4]   2> 1698062 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session DefaultSessionIdManager
> workerName=node0
>    [junit4]   2> 1698062 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session No SessionScavenger set,
> using defaults
>    [junit4]   2> 1698062 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session Scavenging every 660000ms
>    [junit4]   2> 1698062 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.h.ContextHandler Started
> o.e.j.s.ServletContextHandler@7b6ed5cb{/,null,AVAILABLE}
>    [junit4]   2> 1698065 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.AbstractConnector Started
> ServerConnector@5e3646b8{HTTP/1.1,[http/1.1]}{127.0.0.1:60302}
>    [junit4]   2> 1698066 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.Server Started @1701844ms
>    [junit4]   2> 1698066 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties:
> {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/tempDir-001/control/data, hostContext=/, hostPort=60302,
> coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/control-001/cores}
>    [junit4]   2> 1698066 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.u.StartupLoggingUtils Missing Java
> Option solr.log.dir. Logging may be missing or incomplete.
>    [junit4]   2> 1698066 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter  ___      _
> Welcome to Apache Solr™ version 8.0.0
>    [junit4]   2> 1698066 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _
> Starting in cloud mode on port null
>    [junit4]   2> 1698066 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|
> Install dir: null
>    [junit4]   2> 1698066 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|
> Start time: 2018-02-23T09:00:41.090Z
>    [junit4]   2> 1698068 INFO  (zkConnectionManagerCallback-4024-thread-1) [
> ] o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1698069 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml
> from SolrHome (not found in ZooKeeper)
>    [junit4]   2> 1698069 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Loading container
> configuration from /Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/control-001/solr.xml
>    [junit4]   2> 1698076 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Configuration
> parameter autoReplicaFailoverWorkLoopDelay is ignored
>    [junit4]   2> 1698076 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Configuration
> parameter autoReplicaFailoverBadNodeExpiration is ignored
>    [junit4]   2> 1698076 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig MBean server found:
> com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a, but no JMX
> reporters were configured - adding default JMX reporter.
>    [junit4]   2> 1698080 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.ZkContainer Zookeeper
> client=127.0.0.1:60299/solr
>    [junit4]   2> 1698081 INFO  (zkConnectionManagerCallback-4028-thread-1) [
> ] o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1698084 INFO  (zkConnectionManagerCallback-4030-thread-1-
> processing-n:127.0.0.1:60302_) [n:127.0.0.1:60302_    ]
> o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1698378 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60302_    ] o.a.s.c.Overseer
> Overseer (id=null) closing
>    [junit4]   2> 1698379 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60302_    ]
> o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60302_
>    [junit4]   2> 1698380 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60302_    ] o.a.s.c.Overseer
> Overseer (id=72109023952371716-127.0.0.1:60302_-n_0000000000) starting
>    [junit4]   2> 1698419 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60302_    ] o.a.s.c.ZkController
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60302_
>    [junit4]   2> 1698437 INFO  (OverseerStateUpdate-72109023952371716-
> 127.0.0.1:60302_-n_0000000000) [n:127.0.0.1:60302_    ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
>    [junit4]   2> 1698836 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60302_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry
> 'solr.node') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1698912 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60302_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm')
> enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1698914 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60302_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 
> 'solr.jetty')
> enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1698924 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60302_    ]
> o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/control-001/cores
>    [junit4]   2> 1699068 INFO  (zkConnectionManagerCallback-4036-thread-1) [
> ] o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1699071 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes
> from ZooKeeper... (0) -> (1)
>    [junit4]   2> 1699073 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider
> Cluster at 127.0.0.1:60299/solr ready
>    [junit4]   2> 1699075 INFO  (qtp182226460-18373) [n:127.0.0.1:60302_    ]
> o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params
> replicationFactor=1&collection.configName=conf1&name=control_collection
> &nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:60
> 302_&wt=javabin&version=2 and sendToOCPQueue=true
>    [junit4]   2> 1699080 INFO  (OverseerThreadFactory-7826-thread-1-
> processing-n:127.0.0.1:60302_) [n:127.0.0.1:60302_    ]
> o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
>    [junit4]   2> 1699199 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_    ]
> o.a.s.h.a.CoreAdminOperation core create command
> qt=/admin/cores&collection.configName=conf1&newCollection=true&name=
> control_collection_shard1_replica_n1&action=CREATE&numShards=1&collec
> tion=control_collection&shard=shard1&wt=javabin&version=2&replicaType=
> NRT
>    [junit4]   2> 1699200 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_    ]
> o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
> transient cores
>    [junit4]   2> 1699308 INFO  (zkCallback-4029-thread-1-processing-
> n:127.0.0.1:60302_) [n:127.0.0.1:60302_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/control_collection/state.json] for collection
> [control_collection] has occurred - updating... (live nodes size: [1])
>    [junit4]   2> 1700226 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
>    [junit4]   2> 1700240 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema
> name=test
>    [junit4]   2> 1700406 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
>    [junit4]   2> 1700433 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.CoreContainer Creating SolrCore
> 'control_collection_shard1_replica_n1' using configuration from collection
> control_collection, trusted=true
>    [junit4]   2> 1700433 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.core.control_collection.shard1.replica_n1' (registry
> 'solr.core.control_collection.shard1.replica_n1') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1700433 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
>    [junit4]   2> 1700433 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new
> SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/control-001/cores/control_collection_shard1_replica_n1],
> dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/control-001/cores/control_collection_shard1_replica_n1/data/]
>    [junit4]   2> 1700448 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
> minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
>    [junit4]   2> 1700486 WARN  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
> requestHandler,name = /dump,class = DumpRequestHandler,attributes =
> {initParams=a, name=/dump, class=DumpRequestHandler},args =
> {defaults={a=A,b=B}}}
>    [junit4]   2> 1700799 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.UpdateHandler Using UpdateLog implementation:
> org.apache.solr.update.UpdateLog
>    [junit4]   2> 1700799 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
> numRecordsToKeep=100 maxNumLogsToKeep=10
> numVersionBuckets=65536
>    [junit4]   2> 1700800 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.CommitTracker Hard AutoCommit: disabled
>    [junit4]   2> 1700800 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.CommitTracker Soft AutoCommit: disabled
>    [junit4]   2> 1700803 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=30, maxMergeAtOnceExplicit=40,
> maxMergedSegmentMB=13.4248046875, floorSegmentMB=1.13671875,
> forceMergeDeletesPctAllowed=12.314599913182427, segmentsPerTier=36.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>    [junit4]   2> 1700803 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.s.SolrIndexSearcher Opening
> [Searcher@45f8d2b7[control_collection_shard1_replica_n1] main]
>    [junit4]   2> 1700805 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with
> znodeBase: /configs/conf1
>    [junit4]   2> 1700805 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json
> using ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 1700806 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
>    [junit4]   2> 1700806 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.u.UpdateLog Could not find max version in index or recent updates,
> using new clock 1593181673965486080
>    [junit4]   2> 1700806 INFO  (searcherExecutor-7829-thread-1-processing-
> n:127.0.0.1:60302_ x:control_collection_shard1_replica_n1 s:shard1
> c:control_collection) [n:127.0.0.1:60302_ c:control_collection s:shard1
> x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore
> [control_collection_shard1_replica_n1] Registered new searcher
> Searcher@45f8d2b7[control_collection_shard1_replica_n1]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>    [junit4]   2> 1700820 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
>    [junit4]   2> 1700820 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
>    [junit4]   2> 1700821 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.SyncStrategy Sync replicas to
> http://127.0.0.1:60302/control_collection_shard1_replica_n1/
>    [junit4]   2> 1700821 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
>    [junit4]   2> 1700821 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.SyncStrategy
> http://127.0.0.1:60302/control_collection_shard1_replica_n1/ has no
> replicas
>    [junit4]   2> 1700821 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.ShardLeaderElectionContext Found all replicas participating in
> election, clear LIR
>    [junit4]   2> 1700826 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.ShardLeaderElectionContext I am the new leader:
> http://127.0.0.1:60302/control_collection_shard1_replica_n1/ shard1
>    [junit4]   2> 1700930 INFO  (zkCallback-4029-thread-2-processing-
> n:127.0.0.1:60302_) [n:127.0.0.1:60302_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/control_collection/state.json] for collection
> [control_collection] has occurred - updating... (live nodes size: [1])
>    [junit4]   2> 1700933 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.c.ZkController I am the leader, no recovery necessary
>    [junit4]   2> 1700942 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_
> c:control_collection s:shard1  x:control_collection_shard1_replica_n1]
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores
> params={qt=/admin/cores&collection.configName=conf1&newCollection=tru
> e&name=control_collection_shard1_replica_n1&action=CREATE&numShards
> =1&collection=control_collection&shard=shard1&wt=javabin&version=2&rep
> licaType=NRT} status=0 QTime=1743
>    [junit4]   2> 1700963 INFO  (qtp182226460-18373) [n:127.0.0.1:60302_    ]
> o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most
> 30 seconds. Check all shard replicas
>    [junit4]   2> 1701040 INFO  (zkCallback-4029-thread-2-processing-
> n:127.0.0.1:60302_) [n:127.0.0.1:60302_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/control_collection/state.json] for collection
> [control_collection] has occurred - updating... (live nodes size: [1])
>    [junit4]   2> 1701084 INFO  (OverseerCollectionConfigSetProcessor-
> 72109023952371716-127.0.0.1:60302_-n_0000000000) [n:127.0.0.1:60302_
> ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-
> work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from
> ZooKeeper
>    [junit4]   2> 1701963 INFO  (qtp182226460-18373) [n:127.0.0.1:60302_    ]
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
> params={replicationFactor=1&collection.configName=conf1&name=control_c
> ollection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127
> .0.0.1:60302_&wt=javabin&version=2} status=0 QTime=2888
>    [junit4]   2> 1701972 INFO  (zkConnectionManagerCallback-4040-thread-1) [
> ] o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1701974 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes
> from ZooKeeper... (0) -> (1)
>    [junit4]   2> 1701976 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider
> Cluster at 127.0.0.1:60299/solr ready
>    [junit4]   2> 1701977 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire
> sessions:false cause connection loss:false
>    [junit4]   2> 1701978 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_    ]
> o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params
> replicationFactor=1&collection.configName=conf1&name=collection1&nrtRe
> plicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=2&w
> t=javabin&version=2 and sendToOCPQueue=true
>    [junit4]   2> 1701983 INFO  (OverseerThreadFactory-7826-thread-2-
> processing-n:127.0.0.1:60302_) [n:127.0.0.1:60302_    ]
> o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
>    [junit4]   2> 1701984 WARN  (OverseerThreadFactory-7826-thread-2-
> processing-n:127.0.0.1:60302_) [n:127.0.0.1:60302_    ]
> o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection
> (collection1) without cores.
>    [junit4]   2> 1702195 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_    ]
> o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most
> 30 seconds. Check all shard replicas
>    [junit4]   2> 1702195 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_    ]
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
> params={replicationFactor=1&collection.configName=conf1&name=collectio
> n1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFor
> mat=2&wt=javabin&version=2} status=0 QTime=217
>    [junit4]   2> 1703469 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create
> jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-1-001 of type NRT
>    [junit4]   2> 1703477 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build
> timestamp: 2017-11-21T21:27:37Z, git hash:
> 82b8fb23f757335bb3329d540ce37a2a2615f0a8
>    [junit4]   2> 1703482 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session DefaultSessionIdManager
> workerName=node0
>    [junit4]   2> 1703482 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session No SessionScavenger set,
> using defaults
>    [junit4]   2> 1703482 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session Scavenging every 660000ms
>    [junit4]   2> 1703484 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.h.ContextHandler Started
> o.e.j.s.ServletContextHandler@2db67ecb{/,null,AVAILABLE}
>    [junit4]   2> 1703486 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.AbstractConnector Started
> ServerConnector@7ab2e597{HTTP/1.1,[http/1.1]}{127.0.0.1:60311}
>    [junit4]   2> 1703487 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.Server Started @1707265ms
>    [junit4]   2> 1703488 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties:
> {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/tempDir-001/jetty1, replicaType=NRT, solrconfig=solrconfig.xml,
> hostContext=/, hostPort=60311,
> coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-1-001/cores}
>    [junit4]   2> 1703489 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.u.StartupLoggingUtils Missing Java
> Option solr.log.dir. Logging may be missing or incomplete.
>    [junit4]   2> 1703490 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter  ___      _
> Welcome to Apache Solr™ version 8.0.0
>    [junit4]   2> 1703490 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _
> Starting in cloud mode on port null
>    [junit4]   2> 1703491 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|
> Install dir: null
>    [junit4]   2> 1703491 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|
> Start time: 2018-02-23T09:00:46.515Z
>    [junit4]   2> 1703497 INFO  (zkConnectionManagerCallback-4042-thread-1) [
> ] o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1703501 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml
> from SolrHome (not found in ZooKeeper)
>    [junit4]   2> 1703501 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Loading container
> configuration from /Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-1-001/solr.xml
>    [junit4]   2> 1703519 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Configuration
> parameter autoReplicaFailoverWorkLoopDelay is ignored
>    [junit4]   2> 1703520 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Configuration
> parameter autoReplicaFailoverBadNodeExpiration is ignored
>    [junit4]   2> 1703523 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig MBean server found:
> com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a, but no JMX
> reporters were configured - adding default JMX reporter.
>    [junit4]   2> 1703552 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.ZkContainer Zookeeper
> client=127.0.0.1:60299/solr
>    [junit4]   2> 1703557 INFO  (zkConnectionManagerCallback-4046-thread-1) [
> ] o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1703565 INFO  (zkConnectionManagerCallback-4048-thread-1-
> processing-n:127.0.0.1:60311_) [n:127.0.0.1:60311_    ]
> o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1703605 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60311_    ] o.a.s.c.c.ZkStateReader
> Updated live nodes from ZooKeeper... (0) -> (1)
>    [junit4]   2> 1703612 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60311_    ] o.a.s.c.Overseer
> Overseer (id=null) closing
>    [junit4]   2> 1703618 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60311_    ] o.a.s.c.ZkController
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60311_
>    [junit4]   2> 1703621 INFO  (zkCallback-4029-thread-2-processing-
> n:127.0.0.1:60302_) [n:127.0.0.1:60302_    ] o.a.s.c.c.ZkStateReader Updated
> live nodes from ZooKeeper... (1) -> (2)
>    [junit4]   2> 1703623 INFO  (zkCallback-4039-thread-1) [    ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
>    [junit4]   2> 1703625 INFO  (zkCallback-4047-thread-1-processing-
> n:127.0.0.1:60311_) [n:127.0.0.1:60311_    ] o.a.s.c.c.ZkStateReader Updated
> live nodes from ZooKeeper... (1) -> (2)
>    [junit4]   2> 1703958 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60311_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry
> 'solr.node') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1703985 INFO  (OverseerCollectionConfigSetProcessor-
> 72109023952371716-127.0.0.1:60302_-n_0000000000) [n:127.0.0.1:60302_
> ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-
> work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from
> ZooKeeper
>    [junit4]   2> 1704049 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60311_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm')
> enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1704051 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60311_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 
> 'solr.jetty')
> enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1704063 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60311_    ]
> o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-1-001/cores
>    [junit4]   2> 1704198 INFO  (qtp182226460-18375) [n:127.0.0.1:60302_    ]
> o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with
> params
> node=127.0.0.1:60311_&action=ADDREPLICA&collection=collection1&shard=
> shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
>    [junit4]   2> 1704203 INFO  (OverseerThreadFactory-7826-thread-3-
> processing-n:127.0.0.1:60302_) [n:127.0.0.1:60302_    ]
> o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:60311_ for creating new
> replica
>    [junit4]   2> 1704208 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_    ]
> o.a.s.h.a.CoreAdminOperation core create command
> qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_r
> eplica_n61&action=CREATE&collection=collection1&shard=shard2&wt=javabi
> n&version=2&replicaType=NRT
>    [junit4]   2> 1704209 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_    ]
> o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
> transient cores
>    [junit4]   2> 1704215 INFO  (zkCallback-4047-thread-1-processing-
> n:127.0.0.1:60311_) [n:127.0.0.1:60311_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [2])
>    [junit4]   2> 1705235 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.SolrConfig
> Using Lucene MatchVersion: 8.0.0
>    [junit4]   2> 1705245 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.s.IndexSchema [collection1_shard2_replica_n61] Schema name=test
>    [junit4]   2> 1705323 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
>    [junit4]   2> 1705357 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n61'
> using configuration from collection collection1, trusted=true
>    [junit4]   2> 1705357 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.core.collection1.shard2.replica_n61' (registry
> 'solr.core.collection1.shard2.replica_n61') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1705358 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.SolrCore
> solr.RecoveryStrategy.Builder
>    [junit4]   2> 1705358 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.SolrCore
> [[collection1_shard2_replica_n61] ] Opening new SolrCore at
> [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-1-001/cores/collection1_shard2_replica_n61],
> dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-1-001/cores/collection1_shard2_replica_n61/data/]
>    [junit4]   2> 1705370 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
> minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
>    [junit4]   2> 1705381 WARN  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
> requestHandler,name = /dump,class = DumpRequestHandler,attributes =
> {initParams=a, name=/dump, class=DumpRequestHandler},args =
> {defaults={a=A,b=B}}}
>    [junit4]   2> 1705496 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.u.UpdateHandler Using UpdateLog implementation:
> org.apache.solr.update.UpdateLog
>    [junit4]   2> 1705496 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.u.UpdateLog
> Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
> numRecordsToKeep=100 maxNumLogsToKeep=10
> numVersionBuckets=65536
>    [junit4]   2> 1705504 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.u.CommitTracker Hard AutoCommit: disabled
>    [junit4]   2> 1705504 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.u.CommitTracker Soft AutoCommit: disabled
>    [junit4]   2> 1705533 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=30, maxMergeAtOnceExplicit=40,
> maxMergedSegmentMB=13.4248046875, floorSegmentMB=1.13671875,
> forceMergeDeletesPctAllowed=12.314599913182427, segmentsPerTier=36.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>    [junit4]   2> 1705550 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.s.SolrIndexSearcher Opening
> [Searcher@5eb2dedf[collection1_shard2_replica_n61] main]
>    [junit4]   2> 1705556 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with
> znodeBase: /configs/conf1
>    [junit4]   2> 1705558 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json
> using ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 1705564 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
>    [junit4]   2> 1705564 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.u.UpdateLog
> Could not find max version in index or recent updates, using new clock
> 1593181678954610688
>    [junit4]   2> 1705565 INFO  (searcherExecutor-7840-thread-1-processing-
> n:127.0.0.1:60311_ x:collection1_shard2_replica_n61 s:shard2 c:collection1)
> [n:127.0.0.1:60311_ c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.c.SolrCore [collection1_shard2_replica_n61] Registered new searcher
> Searcher@5eb2dedf[collection1_shard2_replica_n61]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>    [junit4]   2> 1705578 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
>    [junit4]   2> 1705578 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
>    [junit4]   2> 1705578 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy
> Sync replicas to http://127.0.0.1:60311/collection1_shard2_replica_n61/
>    [junit4]   2> 1705578 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy
> Sync Success - now sync replicas to me
>    [junit4]   2> 1705578 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy
> http://127.0.0.1:60311/collection1_shard2_replica_n61/ has no replicas
>    [junit4]   2> 1705578 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.c.ShardLeaderElectionContext Found all replicas participating in
> election, clear LIR
>    [junit4]   2> 1705586 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61]
> o.a.s.c.ShardLeaderElectionContext I am the new leader:
> http://127.0.0.1:60311/collection1_shard2_replica_n61/ shard2
>    [junit4]   2> 1705689 INFO  (zkCallback-4047-thread-1-processing-
> n:127.0.0.1:60311_) [n:127.0.0.1:60311_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [2])
>    [junit4]   2> 1705738 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.ZkController
> I am the leader, no recovery necessary
>    [junit4]   2> 1705747 INFO  (qtp77518644-18421) [n:127.0.0.1:60311_
> c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.s.HttpSolrCall
> [admin] webapp=null path=/admin/cores
> params={qt=/admin/cores&collection.configName=conf1&name=collection1
> _shard2_replica_n61&action=CREATE&collection=collection1&shard=shard2
> &wt=javabin&version=2&replicaType=NRT} status=0 QTime=1539
>    [junit4]   2> 1705753 INFO  (qtp182226460-18375) [n:127.0.0.1:60302_    ]
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
> params={node=127.0.0.1:60311_&action=ADDREPLICA&collection=collection
> 1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1554
>    [junit4]   2> 1705843 INFO  (zkCallback-4047-thread-1-processing-
> n:127.0.0.1:60311_) [n:127.0.0.1:60311_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [2])
>    [junit4]   2> 1706204 INFO  (OverseerCollectionConfigSetProcessor-
> 72109023952371716-127.0.0.1:60302_-n_0000000000) [n:127.0.0.1:60302_
> ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-
> work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from
> ZooKeeper
>    [junit4]   2> 1706582 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create
> jetty 2 in directory /Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-2-001 of type NRT
>    [junit4]   2> 1706583 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build
> timestamp: 2017-11-21T21:27:37Z, git hash:
> 82b8fb23f757335bb3329d540ce37a2a2615f0a8
>    [junit4]   2> 1706584 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session DefaultSessionIdManager
> workerName=node0
>    [junit4]   2> 1706584 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session No SessionScavenger set,
> using defaults
>    [junit4]   2> 1706584 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session Scavenging every 660000ms
>    [junit4]   2> 1706584 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.h.ContextHandler Started
> o.e.j.s.ServletContextHandler@7f89ae8c{/,null,AVAILABLE}
>    [junit4]   2> 1706585 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.AbstractConnector Started
> ServerConnector@1091ac03{HTTP/1.1,[http/1.1]}{127.0.0.1:60316}
>    [junit4]   2> 1706585 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.Server Started @1710363ms
>    [junit4]   2> 1706585 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties:
> {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/,
> hostPort=60316, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-
> master-MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-2-001/cores}
>    [junit4]   2> 1706585 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.u.StartupLoggingUtils Missing Java
> Option solr.log.dir. Logging may be missing or incomplete.
>    [junit4]   2> 1706585 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter  ___      _
> Welcome to Apache Solr™ version 8.0.0
>    [junit4]   2> 1706585 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _
> Starting in cloud mode on port null
>    [junit4]   2> 1706585 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|
> Install dir: null
>    [junit4]   2> 1706585 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|
> Start time: 2018-02-23T09:00:49.609Z
>    [junit4]   2> 1706587 INFO  (zkConnectionManagerCallback-4052-thread-1) [
> ] o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1706588 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml
> from SolrHome (not found in ZooKeeper)
>    [junit4]   2> 1706588 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Loading container
> configuration from /Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-2-001/solr.xml
>    [junit4]   2> 1706595 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Configuration
> parameter autoReplicaFailoverWorkLoopDelay is ignored
>    [junit4]   2> 1706595 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Configuration
> parameter autoReplicaFailoverBadNodeExpiration is ignored
>    [junit4]   2> 1706596 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig MBean server found:
> com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a, but no JMX
> reporters were configured - adding default JMX reporter.
>    [junit4]   2> 1706600 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.ZkContainer Zookeeper
> client=127.0.0.1:60299/solr
>    [junit4]   2> 1706602 INFO  (zkConnectionManagerCallback-4056-thread-1) [
> ] o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1706610 INFO  (zkConnectionManagerCallback-4058-thread-1-
> processing-n:127.0.0.1:60316_) [n:127.0.0.1:60316_    ]
> o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1706639 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60316_    ] o.a.s.c.c.ZkStateReader
> Updated live nodes from ZooKeeper... (0) -> (2)
>    [junit4]   2> 1706645 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60316_    ] o.a.s.c.Overseer
> Overseer (id=null) closing
>    [junit4]   2> 1706652 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60316_    ] o.a.s.c.ZkController
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60316_
>    [junit4]   2> 1706655 INFO  (zkCallback-4029-thread-2-processing-
> n:127.0.0.1:60302_) [n:127.0.0.1:60302_    ] o.a.s.c.c.ZkStateReader Updated
> live nodes from ZooKeeper... (2) -> (3)
>    [junit4]   2> 1706655 INFO  (zkCallback-4047-thread-1-processing-
> n:127.0.0.1:60311_) [n:127.0.0.1:60311_    ] o.a.s.c.c.ZkStateReader Updated
> live nodes from ZooKeeper... (2) -> (3)
>    [junit4]   2> 1706656 INFO  (zkCallback-4039-thread-1) [    ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
>    [junit4]   2> 1706658 INFO  (zkCallback-4057-thread-1-processing-
> n:127.0.0.1:60316_) [n:127.0.0.1:60316_    ] o.a.s.c.c.ZkStateReader Updated
> live nodes from ZooKeeper... (2) -> (3)
>    [junit4]   2> 1706861 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60316_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry
> 'solr.node') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1706926 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60316_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm')
> enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1706926 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60316_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 
> 'solr.jetty')
> enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1706940 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60316_    ]
> o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-2-001/cores
>    [junit4]   2> 1707066 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_    ]
> o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with
> params
> node=127.0.0.1:60316_&action=ADDREPLICA&collection=collection1&shard=
> shard3&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
>    [junit4]   2> 1707071 INFO  (OverseerThreadFactory-7826-thread-4-
> processing-n:127.0.0.1:60302_) [n:127.0.0.1:60302_    ]
> o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:60316_ for creating new
> replica
>    [junit4]   2> 1707075 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_    ]
> o.a.s.h.a.CoreAdminOperation core create command
> qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_r
> eplica_n63&action=CREATE&collection=collection1&shard=shard3&wt=javabi
> n&version=2&replicaType=NRT
>    [junit4]   2> 1707077 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_    ]
> o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
> transient cores
>    [junit4]   2> 1707185 INFO  (zkCallback-4047-thread-1-processing-
> n:127.0.0.1:60311_) [n:127.0.0.1:60311_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [3])
>    [junit4]   2> 1707185 INFO  (zkCallback-4057-thread-1-processing-
> n:127.0.0.1:60316_) [n:127.0.0.1:60316_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [3])
>    [junit4]   2> 1708099 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.SolrConfig
> Using Lucene MatchVersion: 8.0.0
>    [junit4]   2> 1708109 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.s.IndexSchema [collection1_shard3_replica_n63] Schema name=test
>    [junit4]   2> 1708327 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
>    [junit4]   2> 1708361 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard3_replica_n63'
> using configuration from collection collection1, trusted=true
>    [junit4]   2> 1708361 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.core.collection1.shard3.replica_n63' (registry
> 'solr.core.collection1.shard3.replica_n63') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1708361 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.SolrCore
> solr.RecoveryStrategy.Builder
>    [junit4]   2> 1708361 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.SolrCore
> [[collection1_shard3_replica_n63] ] Opening new SolrCore at
> [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-2-001/cores/collection1_shard3_replica_n63],
> dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-2-001/cores/collection1_shard3_replica_n63/data/]
>    [junit4]   2> 1708375 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
> minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
>    [junit4]   2> 1708405 WARN  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
> requestHandler,name = /dump,class = DumpRequestHandler,attributes =
> {initParams=a, name=/dump, class=DumpRequestHandler},args =
> {defaults={a=A,b=B}}}
>    [junit4]   2> 1708698 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.u.UpdateHandler Using UpdateLog implementation:
> org.apache.solr.update.UpdateLog
>    [junit4]   2> 1708698 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.u.UpdateLog
> Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
> numRecordsToKeep=100 maxNumLogsToKeep=10
> numVersionBuckets=65536
>    [junit4]   2> 1708699 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.u.CommitTracker Hard AutoCommit: disabled
>    [junit4]   2> 1708699 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.u.CommitTracker Soft AutoCommit: disabled
>    [junit4]   2> 1708707 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=30, maxMergeAtOnceExplicit=40,
> maxMergedSegmentMB=13.4248046875, floorSegmentMB=1.13671875,
> forceMergeDeletesPctAllowed=12.314599913182427, segmentsPerTier=36.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>    [junit4]   2> 1708711 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.s.SolrIndexSearcher Opening
> [Searcher@58de4926[collection1_shard3_replica_n63] main]
>    [junit4]   2> 1708716 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with
> znodeBase: /configs/conf1
>    [junit4]   2> 1708718 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json
> using ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 1708724 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
>    [junit4]   2> 1708725 INFO  (searcherExecutor-7851-thread-1-processing-
> n:127.0.0.1:60316_ x:collection1_shard3_replica_n63 s:shard3 c:collection1)
> [n:127.0.0.1:60316_ c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.c.SolrCore [collection1_shard3_replica_n63] Registered new searcher
> Searcher@58de4926[collection1_shard3_replica_n63]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>    [junit4]   2> 1708726 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.u.UpdateLog
> Could not find max version in index or recent updates, using new clock
> 1593181682269159424
>    [junit4]   2> 1708742 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
>    [junit4]   2> 1708742 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
>    [junit4]   2> 1708742 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy
> Sync replicas to http://127.0.0.1:60316/collection1_shard3_replica_n63/
>    [junit4]   2> 1708742 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy
> Sync Success - now sync replicas to me
>    [junit4]   2> 1708742 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy
> http://127.0.0.1:60316/collection1_shard3_replica_n63/ has no replicas
>    [junit4]   2> 1708742 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.c.ShardLeaderElectionContext Found all replicas participating in
> election, clear LIR
>    [junit4]   2> 1708748 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63]
> o.a.s.c.ShardLeaderElectionContext I am the new leader:
> http://127.0.0.1:60316/collection1_shard3_replica_n63/ shard3
>    [junit4]   2> 1708851 INFO  (zkCallback-4047-thread-1-processing-
> n:127.0.0.1:60311_) [n:127.0.0.1:60311_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [3])
>    [junit4]   2> 1708851 INFO  (zkCallback-4057-thread-1-processing-
> n:127.0.0.1:60316_) [n:127.0.0.1:60316_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [3])
>    [junit4]   2> 1708856 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.ZkController
> I am the leader, no recovery necessary
>    [junit4]   2> 1708864 INFO  (qtp485309935-18453) [n:127.0.0.1:60316_
> c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.s.HttpSolrCall
> [admin] webapp=null path=/admin/cores
> params={qt=/admin/cores&collection.configName=conf1&name=collection1
> _shard3_replica_n63&action=CREATE&collection=collection1&shard=shard3
> &wt=javabin&version=2&replicaType=NRT} status=0 QTime=1789
>    [junit4]   2> 1708869 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_    ]
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
> params={node=127.0.0.1:60316_&action=ADDREPLICA&collection=collection
> 1&shard=shard3&type=NRT&wt=javabin&version=2} status=0 QTime=1802
>    [junit4]   2> 1708969 INFO  (zkCallback-4057-thread-1-processing-
> n:127.0.0.1:60316_) [n:127.0.0.1:60316_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [3])
>    [junit4]   2> 1708969 INFO  (zkCallback-4047-thread-1-processing-
> n:127.0.0.1:60311_) [n:127.0.0.1:60311_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [3])
>    [junit4]   2> 1709071 INFO  (OverseerCollectionConfigSetProcessor-
> 72109023952371716-127.0.0.1:60302_-n_0000000000) [n:127.0.0.1:60302_
> ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-
> work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from
> ZooKeeper
>    [junit4]   2> 1709965 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create
> jetty 3 in directory /Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-3-001 of type NRT
>    [junit4]   2> 1709980 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build
> timestamp: 2017-11-21T21:27:37Z, git hash:
> 82b8fb23f757335bb3329d540ce37a2a2615f0a8
>    [junit4]   2> 1709983 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session DefaultSessionIdManager
> workerName=node0
>    [junit4]   2> 1709984 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session No SessionScavenger set,
> using defaults
>    [junit4]   2> 1709984 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session Scavenging every 660000ms
>    [junit4]   2> 1709986 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.h.ContextHandler Started
> o.e.j.s.ServletContextHandler@4344c8d{/,null,AVAILABLE}
>    [junit4]   2> 1709986 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.AbstractConnector Started
> ServerConnector@31616f1e{HTTP/1.1,[http/1.1]}{127.0.0.1:60321}
>    [junit4]   2> 1709986 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.Server Started @1713764ms
>    [junit4]   2> 1709986 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties:
> {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/,
> hostPort=60321, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-
> master-MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-3-001/cores}
>    [junit4]   2> 1709987 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.u.StartupLoggingUtils Missing Java
> Option solr.log.dir. Logging may be missing or incomplete.
>    [junit4]   2> 1709989 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter  ___      _
> Welcome to Apache Solr™ version 8.0.0
>    [junit4]   2> 1709990 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _
> Starting in cloud mode on port null
>    [junit4]   2> 1709990 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|
> Install dir: null
>    [junit4]   2> 1709990 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|
> Start time: 2018-02-23T09:00:53.014Z
>    [junit4]   2> 1710009 INFO  (zkConnectionManagerCallback-4062-thread-1) [
> ] o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1710016 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml
> from SolrHome (not found in ZooKeeper)
>    [junit4]   2> 1710016 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Loading container
> configuration from /Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-3-001/solr.xml
>    [junit4]   2> 1710061 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Configuration
> parameter autoReplicaFailoverWorkLoopDelay is ignored
>    [junit4]   2> 1710061 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Configuration
> parameter autoReplicaFailoverBadNodeExpiration is ignored
>    [junit4]   2> 1710066 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig MBean server found:
> com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a, but no JMX
> reporters were configured - adding default JMX reporter.
>    [junit4]   2> 1710070 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.ZkContainer Zookeeper
> client=127.0.0.1:60299/solr
>    [junit4]   2> 1710072 INFO  (zkConnectionManagerCallback-4066-thread-1) [
> ] o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1710075 INFO  (zkConnectionManagerCallback-4068-thread-1-
> processing-n:127.0.0.1:60321_) [n:127.0.0.1:60321_    ]
> o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1710090 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60321_    ] o.a.s.c.c.ZkStateReader
> Updated live nodes from ZooKeeper... (0) -> (3)
>    [junit4]   2> 1710095 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60321_    ] o.a.s.c.Overseer
> Overseer (id=null) closing
>    [junit4]   2> 1710098 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60321_    ] o.a.s.c.ZkController
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60321_
>    [junit4]   2> 1710102 INFO  (zkCallback-4057-thread-1-processing-
> n:127.0.0.1:60316_) [n:127.0.0.1:60316_    ] o.a.s.c.c.ZkStateReader Updated
> live nodes from ZooKeeper... (3) -> (4)
>    [junit4]   2> 1710102 INFO  (zkCallback-4029-thread-2-processing-
> n:127.0.0.1:60302_) [n:127.0.0.1:60302_    ] o.a.s.c.c.ZkStateReader Updated
> live nodes from ZooKeeper... (3) -> (4)
>    [junit4]   2> 1710102 INFO  (zkCallback-4047-thread-1-processing-
> n:127.0.0.1:60311_) [n:127.0.0.1:60311_    ] o.a.s.c.c.ZkStateReader Updated
> live nodes from ZooKeeper... (3) -> (4)
>    [junit4]   2> 1710102 INFO  (zkCallback-4039-thread-1) [    ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
>    [junit4]   2> 1710104 INFO  (zkCallback-4067-thread-1-processing-
> n:127.0.0.1:60321_) [n:127.0.0.1:60321_    ] o.a.s.c.c.ZkStateReader Updated
> live nodes from ZooKeeper... (3) -> (4)
>    [junit4]   2> 1710320 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60321_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry
> 'solr.node') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1710330 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60321_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm')
> enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1710330 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60321_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 
> 'solr.jetty')
> enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1710331 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60321_    ]
> o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-3-001/cores
>    [junit4]   2> 1710558 INFO  (qtp182226460-18375) [n:127.0.0.1:60302_    ]
> o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with
> params
> node=127.0.0.1:60321_&action=ADDREPLICA&collection=collection1&shard=
> shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
>    [junit4]   2> 1710564 INFO  (OverseerThreadFactory-7826-thread-5-
> processing-n:127.0.0.1:60302_) [n:127.0.0.1:60302_    ]
> o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:60321_ for creating new
> replica
>    [junit4]   2> 1710569 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_    ]
> o.a.s.h.a.CoreAdminOperation core create command
> qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_r
> eplica_n65&action=CREATE&collection=collection1&shard=shard1&wt=javabi
> n&version=2&replicaType=NRT
>    [junit4]   2> 1710570 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_    ]
> o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
> transient cores
>    [junit4]   2> 1710678 INFO  (zkCallback-4047-thread-1-processing-
> n:127.0.0.1:60311_) [n:127.0.0.1:60311_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [4])
>    [junit4]   2> 1710678 INFO  (zkCallback-4057-thread-1-processing-
> n:127.0.0.1:60316_) [n:127.0.0.1:60316_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [4])
>    [junit4]   2> 1710678 INFO  (zkCallback-4067-thread-1-processing-
> n:127.0.0.1:60321_) [n:127.0.0.1:60321_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [4])
>    [junit4]   2> 1711593 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.SolrConfig
> Using Lucene MatchVersion: 8.0.0
>    [junit4]   2> 1711603 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.s.IndexSchema [collection1_shard1_replica_n65] Schema name=test
>    [junit4]   2> 1711733 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
>    [junit4]   2> 1711756 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n65'
> using configuration from collection collection1, trusted=true
>    [junit4]   2> 1711756 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.core.collection1.shard1.replica_n65' (registry
> 'solr.core.collection1.shard1.replica_n65') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1711756 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.SolrCore
> solr.RecoveryStrategy.Builder
>    [junit4]   2> 1711756 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.SolrCore
> [[collection1_shard1_replica_n65] ] Opening new SolrCore at
> [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-3-001/cores/collection1_shard1_replica_n65],
> dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-3-001/cores/collection1_shard1_replica_n65/data/]
>    [junit4]   2> 1711759 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
> minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
>    [junit4]   2> 1711848 WARN  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
> requestHandler,name = /dump,class = DumpRequestHandler,attributes =
> {initParams=a, name=/dump, class=DumpRequestHandler},args =
> {defaults={a=A,b=B}}}
>    [junit4]   2> 1711995 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.u.UpdateHandler Using UpdateLog implementation:
> org.apache.solr.update.UpdateLog
>    [junit4]   2> 1711995 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.u.UpdateLog
> Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
> numRecordsToKeep=100 maxNumLogsToKeep=10
> numVersionBuckets=65536
>    [junit4]   2> 1711996 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.u.CommitTracker Hard AutoCommit: disabled
>    [junit4]   2> 1711996 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.u.CommitTracker Soft AutoCommit: disabled
>    [junit4]   2> 1712004 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=30, maxMergeAtOnceExplicit=40,
> maxMergedSegmentMB=13.4248046875, floorSegmentMB=1.13671875,
> forceMergeDeletesPctAllowed=12.314599913182427, segmentsPerTier=36.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>    [junit4]   2> 1712016 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.s.SolrIndexSearcher Opening
> [Searcher@2bd364e8[collection1_shard1_replica_n65] main]
>    [junit4]   2> 1712020 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with
> znodeBase: /configs/conf1
>    [junit4]   2> 1712023 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json
> using ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 1712028 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
>    [junit4]   2> 1712030 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.u.UpdateLog
> Could not find max version in index or recent updates, using new clock
> 1593181685734703104
>    [junit4]   2> 1712030 INFO  (searcherExecutor-7862-thread-1-processing-
> n:127.0.0.1:60321_ x:collection1_shard1_replica_n65 s:shard1 c:collection1)
> [n:127.0.0.1:60321_ c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.c.SolrCore [collection1_shard1_replica_n65] Registered new searcher
> Searcher@2bd364e8[collection1_shard1_replica_n65]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>    [junit4]   2> 1712063 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
>    [junit4]   2> 1712063 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
>    [junit4]   2> 1712063 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.SyncStrategy
> Sync replicas to http://127.0.0.1:60321/collection1_shard1_replica_n65/
>    [junit4]   2> 1712064 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.SyncStrategy
> Sync Success - now sync replicas to me
>    [junit4]   2> 1712065 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.SyncStrategy
> http://127.0.0.1:60321/collection1_shard1_replica_n65/ has no replicas
>    [junit4]   2> 1712066 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.c.ShardLeaderElectionContext Found all replicas participating in
> election, clear LIR
>    [junit4]   2> 1712076 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65]
> o.a.s.c.ShardLeaderElectionContext I am the new leader:
> http://127.0.0.1:60321/collection1_shard1_replica_n65/ shard1
>    [junit4]   2> 1712178 INFO  (zkCallback-4047-thread-1-processing-
> n:127.0.0.1:60311_) [n:127.0.0.1:60311_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [4])
>    [junit4]   2> 1712178 INFO  (zkCallback-4057-thread-1-processing-
> n:127.0.0.1:60316_) [n:127.0.0.1:60316_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [4])
>    [junit4]   2> 1712178 INFO  (zkCallback-4067-thread-1-processing-
> n:127.0.0.1:60321_) [n:127.0.0.1:60321_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [4])
>    [junit4]   2> 1712182 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.ZkController
> I am the leader, no recovery necessary
>    [junit4]   2> 1712191 INFO  (qtp1843680587-18484) [n:127.0.0.1:60321_
> c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.s.HttpSolrCall
> [admin] webapp=null path=/admin/cores
> params={qt=/admin/cores&collection.configName=conf1&name=collection1
> _shard1_replica_n65&action=CREATE&collection=collection1&shard=shard1
> &wt=javabin&version=2&replicaType=NRT} status=0 QTime=1622
>    [junit4]   2> 1712194 INFO  (qtp182226460-18375) [n:127.0.0.1:60302_    ]
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
> params={node=127.0.0.1:60321_&action=ADDREPLICA&collection=collection
> 1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1636
>    [junit4]   2> 1712295 INFO  (zkCallback-4047-thread-1-processing-
> n:127.0.0.1:60311_) [n:127.0.0.1:60311_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [4])
>    [junit4]   2> 1712295 INFO  (zkCallback-4057-thread-1-processing-
> n:127.0.0.1:60316_) [n:127.0.0.1:60316_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [4])
>    [junit4]   2> 1712295 INFO  (zkCallback-4067-thread-1-processing-
> n:127.0.0.1:60321_) [n:127.0.0.1:60321_    ] o.a.s.c.c.ZkStateReader A cluster
> state change: [WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [4])
>    [junit4]   2> 1712569 INFO  (OverseerCollectionConfigSetProcessor-
> 72109023952371716-127.0.0.1:60302_-n_0000000000) [n:127.0.0.1:60302_
> ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-
> work/qnr-0000000008 doesn't exist.  Requestor may have disconnected from
> ZooKeeper
>    [junit4]   2> 1713086 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create
> jetty 4 in directory /Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-4-001 of type NRT
>    [junit4]   2> 1713090 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build
> timestamp: 2017-11-21T21:27:37Z, git hash:
> 82b8fb23f757335bb3329d540ce37a2a2615f0a8
>    [junit4]   2> 1713096 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session DefaultSessionIdManager
> workerName=node0
>    [junit4]   2> 1713096 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session No SessionScavenger set,
> using defaults
>    [junit4]   2> 1713097 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.session Scavenging every 600000ms
>    [junit4]   2> 1713099 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.h.ContextHandler Started
> o.e.j.s.ServletContextHandler@2909cccb{/,null,AVAILABLE}
>    [junit4]   2> 1713102 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.AbstractConnector Started
> ServerConnector@7bd26a96{HTTP/1.1,[http/1.1]}{127.0.0.1:60326}
>    [junit4]   2> 1713102 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.e.j.s.Server Started @1716880ms
>    [junit4]   2> 1713102 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties:
> {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/tempDir-001/jetty4, replicaType=NRT, solrconfig=solrconfig.xml,
> hostContext=/, hostPort=60326,
> coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-
> master-MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-4-001/cores}
>    [junit4]   2> 1713104 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.u.StartupLoggingUtils Missing Java
> Option solr.log.dir. Logging may be missing or incomplete.
>    [junit4]   2> 1713106 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter  ___      _
> Welcome to Apache Solr™ version 8.0.0
>    [junit4]   2> 1713107 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _
> Starting in cloud mode on port null
>    [junit4]   2> 1713107 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|
> Install dir: null
>    [junit4]   2> 1713107 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|
> Start time: 2018-02-23T09:00:56.131Z
>    [junit4]   2> 1713116 INFO  (zkConnectionManagerCallback-4072-thread-1) [
> ] o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1713123 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml
> from SolrHome (not found in ZooKeeper)
>    [junit4]   2> 1713123 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Loading container
> configuration from /Users/jenkins/workspace/Lucene-Solr-master-
> MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-4-001/solr.xml
>    [junit4]   2> 1713164 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Configuration
> parameter autoReplicaFailoverWorkLoopDelay is ignored
>    [junit4]   2> 1713164 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig Configuration
> parameter autoReplicaFailoverBadNodeExpiration is ignored
>    [junit4]   2> 1713171 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.SolrXmlConfig MBean server found:
> com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a, but no JMX
> reporters were configured - adding default JMX reporter.
>    [junit4]   2> 1713192 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [    ] o.a.s.c.ZkContainer Zookeeper
> client=127.0.0.1:60299/solr
>    [junit4]   2> 1713193 INFO  (zkConnectionManagerCallback-4076-thread-1) [
> ] o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1713195 INFO  (zkConnectionManagerCallback-4078-thread-1-
> processing-n:127.0.0.1:60326_) [n:127.0.0.1:60326_    ]
> o.a.s.c.c.ConnectionManager zkClient has connected
>    [junit4]   2> 1713210 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60326_    ] o.a.s.c.c.ZkStateReader
> Updated live nodes from ZooKeeper... (0) -> (4)
>    [junit4]   2> 1713214 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60326_    ] o.a.s.c.Overseer
> Overseer (id=null) closing
>    [junit4]   2> 1713218 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60326_    ] o.a.s.c.ZkController
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60326_
>    [junit4]   2> 1713222 INFO  (zkCallback-4057-thread-1-processing-
> n:127.0.0.1:60316_) [n:127.0.0.1:60316_    ] o.a.s.c.c.ZkStateReader Updated
> live nodes from ZooKeeper... (4) -> (5)
>    [junit4]   2> 1713222 INFO  (zkCallback-4047-thread-1-processing-
> n:127.0.0.1:60311_) [n:127.0.0.1:60311_    ] o.a.s.c.c.ZkStateReader Updated
> live nodes from ZooKeeper... (4) -> (5)
>    [junit4]   2> 1713223 INFO  (zkCallback-4067-thread-1-processing-
> n:127.0.0.1:60321_) [n:127.0.0.1:60321_    ] o.a.s.c.c.ZkStateReader Updated
> live nodes from ZooKeeper... (4) -> (5)
>    [junit4]   2> 1713223 INFO  (zkCallback-4029-thread-2-processing-
> n:127.0.0.1:60302_) [n:127.0.0.1:60302_    ] o.a.s.c.c.ZkStateReader Updated
> live nodes from ZooKeeper... (4) -> (5)
>    [junit4]   2> 1713223 INFO  (zkCallback-4039-thread-1) [    ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
>    [junit4]   2> 1713225 INFO  (zkCallback-4077-thread-1-processing-
> n:127.0.0.1:60326_) [n:127.0.0.1:60326_    ] o.a.s.c.c.ZkStateReader Updated
> live nodes from ZooKeeper... (4) -> (5)
>    [junit4]   2> 1713698 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60326_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry
> 'solr.node') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1713707 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60326_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm')
> enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1713707 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60326_    ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 
> 'solr.jetty')
> enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74c5d06a
>    [junit4]   2> 1713709 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-
> seed#[E4AEC87AD39772B3]) [n:127.0.0.1:60326_    ]
> o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-
> core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-
> master-MacOSX/solr/build/solr-
> core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E4AEC87AD3977
> 2B3-001/shard-4-001/cores
>    [junit4]   2> 1713769 INFO  (qtp182226460-18377) [n:127.0.0.1:60302_    ]
> o.a.s.h.a.Collec
> 
> [...truncated too long message...]
> 
> rCoreSnapshots, TestPostingsSolrHighlighter,
> ConcurrentDeleteAndCreateCollectionTest, TestMaxScoreQueryParser,
> HLLSerializationTest, TestCollectionsAPIViaSolrCloudCluster,
> TestBulkSchemaAPI, TestSubQueryTransformerDistrib,
> TestSizeLimitedDistributedMap, HdfsBasicDistributedZk2Test,
> HdfsChaosMonkeyNothingIsSafeTest, PropertiesRequestHandlerTest,
> SOLR749Test, TestLazyCores, SolrCloudExampleTest, CoreSorterTest,
> TestRemoteStreaming, TestReloadDeadlock, TestSchemaSimilarityResource,
> TestElisionMultitermQuery, TestJoin, TestInPlaceUpdatesStandalone,
> TestNonDefinedSimilarityFactory, DocValuesMissingTest,
> DistributedQueryComponentOptimizationTest,
> TestEmbeddedSolrServerSchemaAPI, TestManagedStopFilterFactory,
> FacetPivotSmallTest, TestPseudoReturnFields, TestZkChroot,
> ClassificationUpdateProcessorTest, CdcrReplicationHandlerTest,
> TestReplicationHandlerBackup, TestIBSimilarityFactory,
> TestMaxTokenLenTokenizer, DeleteNodeTest, BasicDistributedZkTest,
> ChaosMonkeySafeLeaderTest, BasicZkTest, FullSolrCloudDistribCmdsTest]
>    [junit4] Completed [371/778 (1!)] on J0 in 80.02s, 1 test, 1 failure <<<
> FAILURES!
> 
> [...truncated 4618 lines...]
>    [junit4] Suite:
> org.apache.solr.analytics.legacy.facet.LegacyQueryFacetCloudTest
>    [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-
> master-MacOSX/solr/build/contrib/solr-
> analytics/test/J1/temp/solr.analytics.legacy.facet.LegacyQueryFacetCloudTes
> t_D7BA6AAFA08DECAE-001/init-core-data-001
>    [junit4]   2> Feb 23, 2018 9:43:15 AM
> com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
>    [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked
> thread(s).
>    [junit4]   2> Feb 23, 2018 9:43:35 AM
> com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
>    [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at
> org.apache.solr.analytics.legacy.facet.LegacyQueryFacetCloudTest:
>    [junit4]   2>    1) Thread[id=1365, name=qtp780146536-1365,
> state=TIMED_WAITING, group=TGRP-LegacyQueryFacetCloudTest]
>    [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
>    [junit4]   2>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>    [junit4]   2>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awa
> it(AbstractQueuedSynchronizer.java:2163)
>    [junit4]   2>         at
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reserv
> edWait(ReservedThreadExecutor.java:308)
>    [junit4]   2>         at
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(R
> eservedThreadExecutor.java:373)
>    [junit4]   2>         at
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.j
> ava:708)
>    [junit4]   2>         at
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.ja
> va:626)
>    [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
>    [junit4]   2> Feb 23, 2018 9:43:35 AM
> com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
>    [junit4]   2> INFO: Starting to interrupt leaked threads:
>    [junit4]   2>    1) Thread[id=1365, name=qtp780146536-1365,
> state=TIMED_WAITING, group=TGRP-LegacyQueryFacetCloudTest]
>    [junit4]   2> Feb 23, 2018 9:43:38 AM
> com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
>    [junit4]   2> SEVERE: There are still zombie threads that couldn't be
> terminated:
>    [junit4]   2>    1) Thread[id=1365, name=qtp780146536-1365,
> state=TIMED_WAITING, group=TGRP-LegacyQueryFacetCloudTest]
>    [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
>    [junit4]   2>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>    [junit4]   2>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awa
> it(AbstractQueuedSynchronizer.java:2163)
>    [junit4]   2>         at
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reserv
> edWait(ReservedThreadExecutor.java:308)
>    [junit4]   2>         at
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(R
> eservedThreadExecutor.java:373)
>    [junit4]   2>         at
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.j
> ava:708)
>    [junit4]   2>         at
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.ja
> va:626)
>    [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
>    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70):
> {string_sd=PostingsFormat(name=LuceneVarGapDocFreqInterval),
> id=PostingsFormat(name=LuceneVarGapDocFreqInterval)},
> docValues:{long_ld=DocValuesFormat(name=Asserting),
> date_dtd=DocValuesFormat(name=Asserting),
> _version_=DocValuesFormat(name=Lucene70),
> string_sd=DocValuesFormat(name=Asserting),
> int_id=DocValuesFormat(name=Asserting),
> id=DocValuesFormat(name=Asserting),
> double_dd=DocValuesFormat(name=Lucene70),
> float_fd=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=248,
> maxMBSortInHeap=5.171520950324513,
> sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@18b
> ea35), locale=nl-NL, timezone=America/Nome
>    [junit4]   2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_144
> (64-bit)/cpus=3,threads=2,free=64456816,total=250085376
>    [junit4]   2> NOTE: All tests run in this JVM: [FloatFieldsTest,
> CastingDoubleValueStreamTest, AbstractAnalyticsFieldTest,
> MultFunctionTest, LegacyNoFacetCloudTest, LegacyRangeFacetTest,
> GTEFunctionTest, SubtractFunctionTest, LegacyAbstractAnalyticsCloudTest,
> ExistsFunctionTest, DivideFunctionTest, CastingIntValueStreamTest,
> CastingLongValueStreamTest, PivotFacetTest, LTFunctionTest,
> CastingBooleanValueStreamTest, OrFunctionTest, AndFunctionTest,
> LegacyFieldFacetTest, NoFacetTest, RangeFacetTest, IfFunctionTest,
> RemoveFunctionTest, RoundFunctionTest, LegacyExpressionTest,
> LegacyFunctionTest, LegacyFieldFacetExtrasCloudTest,
> LegacyQueryFacetCloudTest]
>    [junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=LegacyQueryFacetCloudTest -Dtests.seed=D7BA6AAFA08DECAE -
> Dtests.slow=true -Dtests.locale=nl-NL -Dtests.timezone=America/Nome -
> Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
>    [junit4] ERROR   0.00s J1 | LegacyQueryFacetCloudTest (suite) <<<
>    [junit4]    > Throwable #1:
> com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from
> SUITE scope at
> org.apache.solr.analytics.legacy.facet.LegacyQueryFacetCloudTest:
>    [junit4]    >    1) Thread[id=1365, name=qtp780146536-1365,
> state=TIMED_WAITING, group=TGRP-LegacyQueryFacetCloudTest]
>    [junit4]    >         at sun.misc.Unsafe.park(Native Method)
>    [junit4]    >         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>    [junit4]    >         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awa
> it(AbstractQueuedSynchronizer.java:2163)
>    [junit4]    >         at
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reserv
> edWait(ReservedThreadExecutor.java:308)
>    [junit4]    >         at
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(R
> eservedThreadExecutor.java:373)
>    [junit4]    >         at
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.j
> ava:708)
>    [junit4]    >         at
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.ja
> va:626)
>    [junit4]    >         at java.lang.Thread.run(Thread.java:748)
>    [junit4]    >      at
> __randomizedtesting.SeedInfo.seed([D7BA6AAFA08DECAE]:0)Throwable #2:
> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie
> threads that couldn't be terminated:
>    [junit4]    >    1) Thread[id=1365, name=qtp780146536-1365,
> state=TIMED_WAITING, group=TGRP-LegacyQueryFacetCloudTest]
>    [junit4]    >         at sun.misc.Unsafe.park(Native Method)
>    [junit4]    >         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>    [junit4]    >         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awa
> it(AbstractQueuedSynchronizer.java:2163)
>    [junit4]    >         at
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reserv
> edWait(ReservedThreadExecutor.java:308)
>    [junit4]    >         at
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(R
> eservedThreadExecutor.java:373)
>    [junit4]    >         at
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.j
> ava:708)
>    [junit4]    >         at
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.ja
> va:626)
>    [junit4]    >         at java.lang.Thread.run(Thread.java:748)
>    [junit4]    >      at
> __randomizedtesting.SeedInfo.seed([D7BA6AAFA08DECAE]:0)
>    [junit4] Completed [78/78 (1!)] on J1 in 57.46s, 1 test, 2 errors <<<
> FAILURES!
> 
> [...truncated 46905 lines...]
> [repro] Jenkins log URL:
> file:///var/folders/qg/h2dfw5s161s51l2bn79mrb7r0000gn/T/tmp.Jw7R2LUb
> 
> [repro] Revision: df0f141907b0701d7b1f1fc297ae33ef901844a0
> 
> [repro] Repro line:  ant test  -Dtestcase=FullSolrCloudDistribCmdsTest -
> Dtests.method=test -Dtests.seed=E4AEC87AD39772B3 -Dtests.slow=true -
> Dtests.locale=mk-MK -Dtests.timezone=Asia/Aden -Dtests.asserts=true -
> Dtests.file.encoding=UTF-8
> 
> [repro] Repro line:  ant test  -Dtestcase=LegacyQueryFacetCloudTest -
> Dtests.seed=D7BA6AAFA08DECAE -Dtests.slow=true -Dtests.locale=nl-NL -
> Dtests.timezone=America/Nome -Dtests.asserts=true -
> Dtests.file.encoding=ISO-8859-1
> 
> [repro] ant clean
> 
> [...truncated 1 lines...]
> [repro] Setting last failure code to 32512
> 
> [repro] Traceback (most recent call last):
> 
> [...truncated 3 lines...]
>     raise RuntimeError('ERROR: "ant clean" failed.  See above.')
> RuntimeError: ERROR: "ant clean" failed.  See above.
> 
> + rm -f
> /var/folders/qg/h2dfw5s161s51l2bn79mrb7r0000gn/T/tmp.Jw7R2LUb
> Build step 'Execute shell' marked build as failure
> Archiving artifacts
> [WARNINGS] Skipping publisher since build result is FAILURE
> Recording test results
> ERROR: Step ‘Publish JUnit test result report’ failed: No test report files 
> were
> found. Configuration error?
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to