Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1331/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC
2 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([EA0402C51EC9CF66]:0)
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([EA0402C51EC9CF66]:0)
Build Log:
[...truncated 13103 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] 2> Creating dataDir:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/init-core-data-001
[junit4] 2> 1173866 WARN
(SUITE-ChaosMonkeyNothingIsSafeTest-seed#[EA0402C51EC9CF66]-worker) [ ]
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
[junit4] 2> 1173866 INFO
(SUITE-ChaosMonkeyNothingIsSafeTest-seed#[EA0402C51EC9CF66]-worker) [ ]
o.a.s.SolrTestCaseJ4 Using TrieFields
[junit4] 2> 1173867 INFO
(SUITE-ChaosMonkeyNothingIsSafeTest-seed#[EA0402C51EC9CF66]-worker) [ ]
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via:
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 1173867 INFO
(SUITE-ChaosMonkeyNothingIsSafeTest-seed#[EA0402C51EC9CF66]-worker) [ ]
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /pa/jv
[junit4] 2> 1173869 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1173869 INFO (Thread-2370) [ ] o.a.s.c.ZkTestServer client
port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1173869 INFO (Thread-2370) [ ] o.a.s.c.ZkTestServer
Starting server
[junit4] 2> 1173871 ERROR (Thread-2370) [ ] o.a.z.s.ZooKeeperServer
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action
on ERROR or SHUTDOWN server state changes
[junit4] 2> 1173969 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.ZkTestServer start zk server on port:43695
[junit4] 2> 1173983 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractZkTestCase put
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
to /configs/conf1/solrconfig.xml
[junit4] 2> 1173985 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractZkTestCase put
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/schema15.xml
to /configs/conf1/schema.xml
[junit4] 2> 1173987 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractZkTestCase put
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1173989 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractZkTestCase put
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
to /configs/conf1/stopwords.txt
[junit4] 2> 1173991 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractZkTestCase put
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/protwords.txt
to /configs/conf1/protwords.txt
[junit4] 2> 1173992 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractZkTestCase put
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/currency.xml
to /configs/conf1/currency.xml
[junit4] 2> 1173994 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractZkTestCase put
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
to /configs/conf1/enumsConfig.xml
[junit4] 2> 1173995 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractZkTestCase put
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1173997 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractZkTestCase put
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1173998 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractZkTestCase put
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
to /configs/conf1/old_synonyms.txt
[junit4] 2> 1174000 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractZkTestCase put
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
to /configs/conf1/synonyms.txt
[junit4] 2> 1174002 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly
asked otherwise
[junit4] 2> 1174121 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.SolrTestCaseJ4 Writing core.properties file to
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/control-001/cores/collection1
[junit4] 2> 1174122 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1174123 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@53092815{/pa/jv,null,AVAILABLE}
[junit4] 2> 1174123 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.AbstractConnector Started
ServerConnector@1258fada{HTTP/1.1,[http/1.1]}{127.0.0.1:56083}
[junit4] 2> 1174123 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.Server Started @1176348ms
[junit4] 2> 1174125 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/tempDir-001/control/data,
hostContext=/pa/jv, hostPort=56083,
coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/control-001/cores}
[junit4] 2> 1174125 ERROR
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 1174125 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version
7.0.0
[junit4] 2> 1174125 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1174125 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1174125 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2017-05-29T04:42:20.924Z
[junit4] 2> 1174128 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1174128 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.SolrXmlConfig Loading container configuration from
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/control-001/solr.xml
[junit4] 2> 1174132 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.SolrXmlConfig MBean server found:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d, but no JMX reporters were
configured - adding default JMX reporter.
[junit4] 2> 1174134 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43695/solr
[junit4] 2> 1174169 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1174169 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.OverseerElectionContext I am going to
be the leader 127.0.0.1:56083_pa%2Fjv
[junit4] 2> 1174171 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.Overseer Overseer
(id=98044014799749124-127.0.0.1:56083_pa%2Fjv-n_0000000000) starting
[junit4] 2> 1174183 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:56083_pa%2Fjv
[junit4] 2> 1174186 INFO
(zkCallback-2369-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (1)
[junit4] 2> 1174284 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1174286 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1174286 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1174288 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/control-001/cores
[junit4] 2> 1174288 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 1174289 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
transient cores
[junit4] 2> 1174291 INFO
(OverseerStateUpdate-98044014799749124-127.0.0.1:56083_pa%2Fjv-n_0000000000)
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard1
[junit4] 2> 1175306 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
[junit4] 2> 1175317 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1175365 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1175385 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from
collection control_collection, trusted=true
[junit4] 2> 1175385 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.core.control_collection.shard1.core_node1' (registry
'solr.core.control_collection.shard1.core_node1') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1175385 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1175385 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at
[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/control-001/cores/collection1],
dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/control-001/cores/collection1/data/]
[junit4] 2> 1175387 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=21, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=14.2421875,
floorSegmentMB=1.4921875, forceMergeDeletesPctAllowed=2.7922721379360214,
segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.7478953429355902
[junit4] 2> 1175391 WARN
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,attributes =
{initParams=a, name=/dump, class=DumpRequestHandler},args =
{defaults={a=A,b=B}}}
[junit4] 2> 1175426 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.u.UpdateHandler Using UpdateLog implementation:
org.apache.solr.update.UpdateLog
[junit4] 2> 1175426 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1175427 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1175427 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1175428 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy:
minMergeSize=0, mergeFactor=10, maxMergeSize=1933105752,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.1]
[junit4] 2> 1175428 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.s.SolrIndexSearcher Opening [Searcher@4e349523[collection1] main]
[junit4] 2> 1175430 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 1175430 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1175430 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1175430 INFO
(coreLoadExecutor-5277-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv c:control_collection x:collection1]
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using
new clock 1568704238430715904
[junit4] 2> 1175431 INFO
(searcherExecutor-5278-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv
x:collection1 c:control_collection) [n:127.0.0.1:56083_pa%2Fjv
c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered
new searcher Searcher@4e349523[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1175437 INFO
(coreZkRegister-5270-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv
x:collection1 c:control_collection) [n:127.0.0.1:56083_pa%2Fjv
c:control_collection s:shard1 r:core_node1 x:collection1]
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1175437 INFO
(coreZkRegister-5270-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv
x:collection1 c:control_collection) [n:127.0.0.1:56083_pa%2Fjv
c:control_collection s:shard1 r:core_node1 x:collection1]
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1175438 INFO
(coreZkRegister-5270-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv
x:collection1 c:control_collection) [n:127.0.0.1:56083_pa%2Fjv
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy
Sync replicas to http://127.0.0.1:56083/pa/jv/collection1/
[junit4] 2> 1175438 INFO
(coreZkRegister-5270-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv
x:collection1 c:control_collection) [n:127.0.0.1:56083_pa%2Fjv
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy
Sync Success - now sync replicas to me
[junit4] 2> 1175438 INFO
(coreZkRegister-5270-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv
x:collection1 c:control_collection) [n:127.0.0.1:56083_pa%2Fjv
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy
http://127.0.0.1:56083/pa/jv/collection1/ has no replicas
[junit4] 2> 1175438 INFO
(coreZkRegister-5270-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv
x:collection1 c:control_collection) [n:127.0.0.1:56083_pa%2Fjv
c:control_collection s:shard1 r:core_node1 x:collection1]
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in
election, clear LIR
[junit4] 2> 1175442 INFO
(coreZkRegister-5270-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv
x:collection1 c:control_collection) [n:127.0.0.1:56083_pa%2Fjv
c:control_collection s:shard1 r:core_node1 x:collection1]
o.a.s.c.ShardLeaderElectionContext I am the new leader:
http://127.0.0.1:56083/pa/jv/collection1/ shard1
[junit4] 2> 1175594 INFO
(coreZkRegister-5270-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv
x:collection1 c:control_collection) [n:127.0.0.1:56083_pa%2Fjv
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController
I am the leader, no recovery necessary
[junit4] 2> 1175815 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1175816 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43695/solr ready
[junit4] 2> 1175816 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection
loss:false
[junit4] 2> 1175933 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.SolrTestCaseJ4 Writing core.properties file to
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-1-001/cores/collection1
[junit4] 2> 1175934 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-1-001
of type NRT
[junit4] 2> 1175935 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1175936 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@1358d79b{/pa/jv,null,AVAILABLE}
[junit4] 2> 1175936 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.AbstractConnector Started
ServerConnector@43f5912e{HTTP/1.1,[http/1.1]}{127.0.0.1:36762}
[junit4] 2> 1175936 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.Server Started @1178161ms
[junit4] 2> 1175936 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/tempDir-001/jetty1,
replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/pa/jv,
hostPort=36762,
coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-1-001/cores}
[junit4] 2> 1175936 ERROR
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 1175937 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version
7.0.0
[junit4] 2> 1175937 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1175937 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1175937 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2017-05-29T04:42:22.736Z
[junit4] 2> 1175940 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1175940 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.SolrXmlConfig Loading container configuration from
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-1-001/solr.xml
[junit4] 2> 1175943 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.SolrXmlConfig MBean server found:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d, but no JMX reporters were
configured - adding default JMX reporter.
[junit4] 2> 1175945 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43695/solr
[junit4] 2> 1175957 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:36762_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (1)
[junit4] 2> 1175960 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:36762_pa%2Fjv ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1175963 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:36762_pa%2Fjv ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:36762_pa%2Fjv
[junit4] 2> 1175965 INFO
(zkCallback-2369-thread-1-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (1) -> (2)
[junit4] 2> 1175965 INFO (zkCallback-2373-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1175967 INFO
(zkCallback-2378-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (1) -> (2)
[junit4] 2> 1176033 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:36762_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1176036 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:36762_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1176036 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:36762_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1176037 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:36762_pa%2Fjv ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-1-001/cores
[junit4] 2> 1176037 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:36762_pa%2Fjv ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 1176038 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
transient cores
[junit4] 2> 1176040 INFO
(OverseerStateUpdate-98044014799749124-127.0.0.1:56083_pa%2Fjv-n_0000000000)
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard2
[junit4] 2> 1177060 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.0.0
[junit4] 2> 1177071 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1] o.a.s.s.IndexSchema
[collection1] Schema name=test
[junit4] 2> 1177121 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1] o.a.s.s.IndexSchema
Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1177164 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1] o.a.s.c.CoreContainer
Creating SolrCore 'collection1' using configuration from collection
collection1, trusted=true
[junit4] 2> 1177164 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.core.collection1.shard2.core_node1' (registry
'solr.core.collection1.shard2.core_node1') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1177164 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1] o.a.s.c.SolrCore
solr.RecoveryStrategy.Builder
[junit4] 2> 1177164 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1] o.a.s.c.SolrCore
[[collection1] ] Opening new SolrCore at
[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-1-001/cores/collection1],
dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-1-001/cores/collection1/data/]
[junit4] 2> 1177167 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=21, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=14.2421875,
floorSegmentMB=1.4921875, forceMergeDeletesPctAllowed=2.7922721379360214,
segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.7478953429355902
[junit4] 2> 1177181 WARN
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,attributes =
{initParams=a, name=/dump, class=DumpRequestHandler},args =
{defaults={a=A,b=B}}}
[junit4] 2> 1177222 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1] o.a.s.u.UpdateHandler
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1177222 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1] o.a.s.u.UpdateLog
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100
maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1177223 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1] o.a.s.u.CommitTracker
Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1177223 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1] o.a.s.u.CommitTracker
Soft AutoCommit: disabled
[junit4] 2> 1177224 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy:
minMergeSize=0, mergeFactor=10, maxMergeSize=1933105752,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.1]
[junit4] 2> 1177225 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1]
o.a.s.s.SolrIndexSearcher Opening [Searcher@68e2c9ba[collection1] main]
[junit4] 2> 1177226 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 1177226 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1177226 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1177226 INFO
(coreLoadExecutor-5288-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv c:collection1 x:collection1] o.a.s.u.UpdateLog
Could not find max version in index or recent updates, using new clock
1568704240313958400
[junit4] 2> 1177227 INFO
(searcherExecutor-5289-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:36762_pa%2Fjv c:collection1
x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher
Searcher@68e2c9ba[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1177233 INFO
(coreZkRegister-5283-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:36762_pa%2Fjv c:collection1 s:shard2
r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas
found to continue.
[junit4] 2> 1177234 INFO
(coreZkRegister-5283-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:36762_pa%2Fjv c:collection1 s:shard2
r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new
leader - try and sync
[junit4] 2> 1177234 INFO
(coreZkRegister-5283-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:36762_pa%2Fjv c:collection1 s:shard2
r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to
http://127.0.0.1:36762/pa/jv/collection1/
[junit4] 2> 1177234 INFO
(coreZkRegister-5283-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:36762_pa%2Fjv c:collection1 s:shard2
r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync
replicas to me
[junit4] 2> 1177234 INFO
(coreZkRegister-5283-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:36762_pa%2Fjv c:collection1 s:shard2
r:core_node1 x:collection1] o.a.s.c.SyncStrategy
http://127.0.0.1:36762/pa/jv/collection1/ has no replicas
[junit4] 2> 1177234 INFO
(coreZkRegister-5283-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:36762_pa%2Fjv c:collection1 s:shard2
r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Found all
replicas participating in election, clear LIR
[junit4] 2> 1177238 INFO
(coreZkRegister-5283-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:36762_pa%2Fjv c:collection1 s:shard2
r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new
leader: http://127.0.0.1:36762/pa/jv/collection1/ shard2
[junit4] 2> 1177390 INFO
(coreZkRegister-5283-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:36762_pa%2Fjv c:collection1 s:shard2
r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery
necessary
[junit4] 2> 1177656 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.SolrTestCaseJ4 Writing core.properties file to
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-2-001/cores/collection1
[junit4] 2> 1177656 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-2-001
of type NRT
[junit4] 2> 1177656 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1177658 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@16d515c2{/pa/jv,null,AVAILABLE}
[junit4] 2> 1177658 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.AbstractConnector Started
ServerConnector@3c6638a3{HTTP/1.1,[http/1.1]}{127.0.0.1:43735}
[junit4] 2> 1177658 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.Server Started @1179883ms
[junit4] 2> 1177658 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/tempDir-001/jetty2,
replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/pa/jv,
hostPort=43735,
coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-2-001/cores}
[junit4] 2> 1177658 ERROR
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 1177658 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version
7.0.0
[junit4] 2> 1177658 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1177658 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1177658 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2017-05-29T04:42:24.457Z
[junit4] 2> 1177662 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1177662 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.SolrXmlConfig Loading container configuration from
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-2-001/solr.xml
[junit4] 2> 1177666 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.SolrXmlConfig MBean server found:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d, but no JMX reporters were
configured - adding default JMX reporter.
[junit4] 2> 1177668 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43695/solr
[junit4] 2> 1177685 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:43735_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (2)
[junit4] 2> 1177689 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:43735_pa%2Fjv ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1177691 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:43735_pa%2Fjv ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:43735_pa%2Fjv
[junit4] 2> 1177693 INFO
(zkCallback-2378-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (3)
[junit4] 2> 1177693 INFO
(zkCallback-2369-thread-2-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (3)
[junit4] 2> 1177693 INFO (zkCallback-2373-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1177697 INFO
(zkCallback-2384-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (3)
[junit4] 2> 1177756 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:43735_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1177759 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:43735_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1177759 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:43735_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1177760 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:43735_pa%2Fjv ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-2-001/cores
[junit4] 2> 1177760 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:43735_pa%2Fjv ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 1177761 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
transient cores
[junit4] 2> 1177762 INFO
(OverseerStateUpdate-98044014799749124-127.0.0.1:56083_pa%2Fjv-n_0000000000)
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard1
[junit4] 2> 1178778 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.0.0
[junit4] 2> 1178792 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1] o.a.s.s.IndexSchema
[collection1] Schema name=test
[junit4] 2> 1178841 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1] o.a.s.s.IndexSchema
Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1178858 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1] o.a.s.c.CoreContainer
Creating SolrCore 'collection1' using configuration from collection
collection1, trusted=true
[junit4] 2> 1178859 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.core.collection1.shard1.core_node2' (registry
'solr.core.collection1.shard1.core_node2') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1178859 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1] o.a.s.c.SolrCore
solr.RecoveryStrategy.Builder
[junit4] 2> 1178859 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1] o.a.s.c.SolrCore
[[collection1] ] Opening new SolrCore at
[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-2-001/cores/collection1],
dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-2-001/cores/collection1/data/]
[junit4] 2> 1178860 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=21, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=14.2421875,
floorSegmentMB=1.4921875, forceMergeDeletesPctAllowed=2.7922721379360214,
segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.7478953429355902
[junit4] 2> 1178864 WARN
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,attributes =
{initParams=a, name=/dump, class=DumpRequestHandler},args =
{defaults={a=A,b=B}}}
[junit4] 2> 1178896 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1] o.a.s.u.UpdateHandler
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1178896 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1] o.a.s.u.UpdateLog
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100
maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1178896 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1] o.a.s.u.CommitTracker
Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1178896 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1] o.a.s.u.CommitTracker
Soft AutoCommit: disabled
[junit4] 2> 1178897 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy:
minMergeSize=0, mergeFactor=10, maxMergeSize=1933105752,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.1]
[junit4] 2> 1178898 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1]
o.a.s.s.SolrIndexSearcher Opening [Searcher@4294984d[collection1] main]
[junit4] 2> 1178899 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 1178899 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1178900 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1178900 INFO
(coreLoadExecutor-5299-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv c:collection1 x:collection1] o.a.s.u.UpdateLog
Could not find max version in index or recent updates, using new clock
1568704242069274624
[junit4] 2> 1178900 INFO
(searcherExecutor-5300-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:43735_pa%2Fjv c:collection1
x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher
Searcher@4294984d[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1178906 INFO
(coreZkRegister-5294-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:43735_pa%2Fjv c:collection1 s:shard1
r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas
found to continue.
[junit4] 2> 1178906 INFO
(coreZkRegister-5294-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:43735_pa%2Fjv c:collection1 s:shard1
r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new
leader - try and sync
[junit4] 2> 1178906 INFO
(coreZkRegister-5294-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:43735_pa%2Fjv c:collection1 s:shard1
r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync replicas to
http://127.0.0.1:43735/pa/jv/collection1/
[junit4] 2> 1178906 INFO
(coreZkRegister-5294-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:43735_pa%2Fjv c:collection1 s:shard1
r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync
replicas to me
[junit4] 2> 1178906 INFO
(coreZkRegister-5294-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:43735_pa%2Fjv c:collection1 s:shard1
r:core_node2 x:collection1] o.a.s.c.SyncStrategy
http://127.0.0.1:43735/pa/jv/collection1/ has no replicas
[junit4] 2> 1178906 INFO
(coreZkRegister-5294-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:43735_pa%2Fjv c:collection1 s:shard1
r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext Found all
replicas participating in election, clear LIR
[junit4] 2> 1178911 INFO
(coreZkRegister-5294-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:43735_pa%2Fjv c:collection1 s:shard1
r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new
leader: http://127.0.0.1:43735/pa/jv/collection1/ shard1
[junit4] 2> 1179066 INFO
(coreZkRegister-5294-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:43735_pa%2Fjv c:collection1 s:shard1
r:core_node2 x:collection1] o.a.s.c.ZkController I am the leader, no recovery
necessary
[junit4] 2> 1179400 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.SolrTestCaseJ4 Writing core.properties file to
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-3-001/cores/collection1
[junit4] 2> 1179400 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-3-001
of type NRT
[junit4] 2> 1179401 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1179402 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@13980365{/pa/jv,null,AVAILABLE}
[junit4] 2> 1179402 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.AbstractConnector Started
ServerConnector@7b78a546{HTTP/1.1,[http/1.1]}{127.0.0.1:45565}
[junit4] 2> 1179402 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.Server Started @1181628ms
[junit4] 2> 1179402 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/tempDir-001/jetty3,
solrconfig=solrconfig.xml, hostContext=/pa/jv, hostPort=45565,
coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-3-001/cores}
[junit4] 2> 1179403 ERROR
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 1179403 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version
7.0.0
[junit4] 2> 1179403 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1179403 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1179403 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2017-05-29T04:42:26.202Z
[junit4] 2> 1179406 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1179406 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.SolrXmlConfig Loading container configuration from
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-3-001/solr.xml
[junit4] 2> 1179410 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.SolrXmlConfig MBean server found:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d, but no JMX reporters were
configured - adding default JMX reporter.
[junit4] 2> 1179414 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43695/solr
[junit4] 2> 1179428 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:45565_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (3)
[junit4] 2> 1179431 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:45565_pa%2Fjv ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1179434 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:45565_pa%2Fjv ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:45565_pa%2Fjv
[junit4] 2> 1179436 INFO
(zkCallback-2378-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (3) -> (4)
[junit4] 2> 1179436 INFO (zkCallback-2373-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1179437 INFO
(zkCallback-2369-thread-2-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (3) -> (4)
[junit4] 2> 1179437 INFO
(zkCallback-2384-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (3) -> (4)
[junit4] 2> 1179438 INFO
(zkCallback-2390-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (3) -> (4)
[junit4] 2> 1179594 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:45565_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1179599 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:45565_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1179599 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:45565_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1179602 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:45565_pa%2Fjv ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-3-001/cores
[junit4] 2> 1179602 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:45565_pa%2Fjv ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 1179602 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
transient cores
[junit4] 2> 1179604 INFO
(OverseerStateUpdate-98044014799749124-127.0.0.1:56083_pa%2Fjv-n_0000000000)
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard2
[junit4] 2> 1180622 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.0.0
[junit4] 2> 1180634 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1] o.a.s.s.IndexSchema
[collection1] Schema name=test
[junit4] 2> 1180776 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1] o.a.s.s.IndexSchema
Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1180831 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1] o.a.s.c.CoreContainer
Creating SolrCore 'collection1' using configuration from collection
collection1, trusted=true
[junit4] 2> 1180832 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.core.collection1.shard2.core_node3' (registry
'solr.core.collection1.shard2.core_node3') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1180832 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1] o.a.s.c.SolrCore
solr.RecoveryStrategy.Builder
[junit4] 2> 1180832 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1] o.a.s.c.SolrCore
[[collection1] ] Opening new SolrCore at
[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-3-001/cores/collection1],
dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-3-001/cores/collection1/data/]
[junit4] 2> 1180834 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=21, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=14.2421875,
floorSegmentMB=1.4921875, forceMergeDeletesPctAllowed=2.7922721379360214,
segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.7478953429355902
[junit4] 2> 1180837 WARN
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,attributes =
{initParams=a, name=/dump, class=DumpRequestHandler},args =
{defaults={a=A,b=B}}}
[junit4] 2> 1180887 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1] o.a.s.u.UpdateHandler
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1180887 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1] o.a.s.u.UpdateLog
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100
maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1180888 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1] o.a.s.u.CommitTracker
Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1180888 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1] o.a.s.u.CommitTracker
Soft AutoCommit: disabled
[junit4] 2> 1180889 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy:
minMergeSize=0, mergeFactor=10, maxMergeSize=1933105752,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.1]
[junit4] 2> 1180890 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1]
o.a.s.s.SolrIndexSearcher Opening [Searcher@2afde2cd[collection1] main]
[junit4] 2> 1180914 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 1180919 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1180920 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1180920 INFO
(coreLoadExecutor-5310-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv c:collection1 x:collection1] o.a.s.u.UpdateLog
Could not find max version in index or recent updates, using new clock
1568704244187398144
[junit4] 2> 1180922 INFO
(searcherExecutor-5311-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:45565_pa%2Fjv c:collection1
x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher
Searcher@2afde2cd[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1180930 INFO
(coreZkRegister-5305-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:45565_pa%2Fjv c:collection1 s:shard2
r:core_node3 x:collection1] o.a.s.c.ZkController Core needs to
recover:collection1
[junit4] 2> 1180931 INFO
(updateExecutor-2387-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DefaultSolrCoreState
Running recovery
[junit4] 2> 1180932 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy
Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 1180939 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy
###### startupVersions=[[]]
[junit4] 2> 1180940 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy
Begin buffering updates. core=[collection1]
[junit4] 2> 1180940 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.UpdateLog Starting
to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 1180940 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy
Publishing state of core [collection1] as recovering, leader is
[http://127.0.0.1:36762/pa/jv/collection1/] and I am
[http://127.0.0.1:45565/pa/jv/collection1/]
[junit4] 2> 1180951 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy
Sending prep recovery command to [http://127.0.0.1:36762/pa/jv]; [WaitForState:
action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:45565_pa%252Fjv&coreNodeName=core_node3&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 1180953 INFO (qtp1745038990-12005) [n:127.0.0.1:36762_pa%2Fjv
] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node3,
state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive:
true, maxTime: 183 s
[junit4] 2> 1180975 INFO (qtp1745038990-12005) [n:127.0.0.1:36762_pa%2Fjv
] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering):
collection=collection1, shard=shard2, thisCore=collection1,
leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true,
currentState=down, localState=active, nodeName=127.0.0.1:45565_pa%2Fjv,
coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps:
core_node3:{"core":"collection1","base_url":"http://127.0.0.1:45565/pa/jv","node_name":"127.0.0.1:45565_pa%2Fjv","state":"down","type":"NRT"}
[junit4] 2> 1181296 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.SolrTestCaseJ4 Writing core.properties file to
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-4-001/cores/collection1
[junit4] 2> 1181297 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-4-001
of type NRT
[junit4] 2> 1181297 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1181298 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@54c857a5{/pa/jv,null,AVAILABLE}
[junit4] 2> 1181299 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.AbstractConnector Started
ServerConnector@3244a38{HTTP/1.1,[http/1.1]}{127.0.0.1:64232}
[junit4] 2> 1181299 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.e.j.s.Server Started @1183525ms
[junit4] 2> 1181299 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/tempDir-001/jetty4,
replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/pa/jv,
hostPort=64232,
coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-4-001/cores}
[junit4] 2> 1181299 ERROR
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 1181299 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version
7.0.0
[junit4] 2> 1181299 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1181300 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1181300 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2017-05-29T04:42:28.099Z
[junit4] 2> 1181304 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1181304 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.SolrXmlConfig Loading container configuration from
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-4-001/solr.xml
[junit4] 2> 1181309 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.SolrXmlConfig MBean server found:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d, but no JMX reporters were
configured - adding default JMX reporter.
[junit4] 2> 1181313 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43695/solr
[junit4] 2> 1181333 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:64232_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (4)
[junit4] 2> 1181345 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:64232_pa%2Fjv ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1181349 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:64232_pa%2Fjv ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:64232_pa%2Fjv
[junit4] 2> 1181351 INFO
(zkCallback-2369-thread-2-processing-n:127.0.0.1:56083_pa%2Fjv)
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (4) -> (5)
[junit4] 2> 1181351 INFO (zkCallback-2373-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1181352 INFO
(zkCallback-2384-thread-1-processing-n:127.0.0.1:43735_pa%2Fjv)
[n:127.0.0.1:43735_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (4) -> (5)
[junit4] 2> 1181352 INFO
(zkCallback-2390-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv)
[n:127.0.0.1:45565_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (4) -> (5)
[junit4] 2> 1181352 INFO
(zkCallback-2378-thread-1-processing-n:127.0.0.1:36762_pa%2Fjv)
[n:127.0.0.1:36762_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (4) -> (5)
[junit4] 2> 1181356 INFO
(zkCallback-2397-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (4) -> (5)
[junit4] 2> 1181440 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:64232_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1181446 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:64232_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1181446 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:64232_pa%2Fjv ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1181447 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:64232_pa%2Fjv ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-4-001/cores
[junit4] 2> 1181447 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66])
[n:127.0.0.1:64232_pa%2Fjv ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 1181447 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
transient cores
[junit4] 2> 1181453 INFO
(OverseerStateUpdate-98044014799749124-127.0.0.1:56083_pa%2Fjv-n_0000000000)
[n:127.0.0.1:56083_pa%2Fjv ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard1
[junit4] 2> 1181976 INFO (qtp1745038990-12005) [n:127.0.0.1:36762_pa%2Fjv
] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering):
collection=collection1, shard=shard2, thisCore=collection1,
leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true,
currentState=recovering, localState=active, nodeName=127.0.0.1:45565_pa%2Fjv,
coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps:
core_node3:{"core":"collection1","base_url":"http://127.0.0.1:45565/pa/jv","node_name":"127.0.0.1:45565_pa%2Fjv","state":"recovering","type":"NRT"}
[junit4] 2> 1181977 INFO (qtp1745038990-12005) [n:127.0.0.1:36762_pa%2Fjv
] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node3, state:
recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 1181977 INFO (qtp1745038990-12005) [n:127.0.0.1:36762_pa%2Fjv
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores
params={nodeName=127.0.0.1:45565_pa%252Fjv&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node3&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2}
status=0 QTime=1023
[junit4] 2> 1182487 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy
Attempting to PeerSync from [http://127.0.0.1:36762/pa/jv/collection1/] -
recoveringAfterStartup=[true]
[junit4] 2> 1182488 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.PeerSync PeerSync:
core=collection1 url=http://127.0.0.1:45565/pa/jv START
replicas=[http://127.0.0.1:36762/pa/jv/collection1/] nUpdates=100
[junit4] 2> 1182491 INFO (qtp1745038990-12008) [n:127.0.0.1:36762_pa%2Fjv
c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.IndexFingerprint
IndexFingerprint millis:1.0 result:{maxVersionSpecified=9223372036854775807,
maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0,
maxDoc=0}
[junit4] 2> 1182491 INFO (qtp1745038990-12008) [n:127.0.0.1:36762_pa%2Fjv
c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.S.Request
[collection1] webapp=/pa/jv path=/get
params={distrib=false&qt=/get&getFingerprint=9223372036854775807&wt=javabin&version=2}
status=0 QTime=1
[junit4] 2> 1182492 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.IndexFingerprint
IndexFingerprint millis:0.0 result:{maxVersionSpecified=9223372036854775807,
maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0,
maxDoc=0}
[junit4] 2> 1182492 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.PeerSync We are
already in sync. No need to do a PeerSync
[junit4] 2> 1182492 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2
start
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1182492 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2
No uncommitted changes. Skipping IW.commit.
[junit4] 2> 1182493 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2
end_commit_flush
[junit4] 2> 1182493 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy
PeerSync stage of recovery was successful.
[junit4] 2> 1182493 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy
Replaying updates buffered during PeerSync.
[junit4] 2> 1182493 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy No
replay needed.
[junit4] 2> 1182493 INFO
(recoveryExecutor-2388-thread-1-processing-n:127.0.0.1:45565_pa%2Fjv
x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:45565_pa%2Fjv
c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy
Registering as Active after recovery.
[junit4] 2> 1182513 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.0.0
[junit4] 2> 1182525 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1] o.a.s.s.IndexSchema
[collection1] Schema name=test
[junit4] 2> 1182714 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1] o.a.s.s.IndexSchema
Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1182807 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1] o.a.s.c.CoreContainer
Creating SolrCore 'collection1' using configuration from collection
collection1, trusted=true
[junit4] 2> 1182807 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.core.collection1.shard1.core_node4' (registry
'solr.core.collection1.shard1.core_node4') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@7e6a7c4d
[junit4] 2> 1182807 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1] o.a.s.c.SolrCore
solr.RecoveryStrategy.Builder
[junit4] 2> 1182807 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1] o.a.s.c.SolrCore
[[collection1] ] Opening new SolrCore at
[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-4-001/cores/collection1],
dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_EA0402C51EC9CF66-001/shard-4-001/cores/collection1/data/]
[junit4] 2> 1182810 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=21, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=14.2421875,
floorSegmentMB=1.4921875, forceMergeDeletesPctAllowed=2.7922721379360214,
segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.7478953429355902
[junit4] 2> 1182841 WARN
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,attributes =
{initParams=a, name=/dump, class=DumpRequestHandler},args =
{defaults={a=A,b=B}}}
[junit4] 2> 1182915 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1] o.a.s.u.UpdateHandler
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1182915 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1] o.a.s.u.UpdateLog
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100
maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1182917 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1] o.a.s.u.CommitTracker
Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1182917 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1] o.a.s.u.CommitTracker
Soft AutoCommit: disabled
[junit4] 2> 1182918 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy:
minMergeSize=0, mergeFactor=10, maxMergeSize=1933105752,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.1]
[junit4] 2> 1182919 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1]
o.a.s.s.SolrIndexSearcher Opening [Searcher@63faeb9c[collection1] main]
[junit4] 2> 1182950 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 1182959 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1182960 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1182971 INFO
(searcherExecutor-5322-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:64232_pa%2Fjv c:collection1
x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher
Searcher@63faeb9c[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1182972 INFO
(coreLoadExecutor-5321-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv)
[n:127.0.0.1:64232_pa%2Fjv c:collection1 x:collection1] o.a.s.u.UpdateLog
Could not find max version in index or recent updates, using new clock
1568704246339076096
[junit4] 2> 1183002 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 1183003 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]) [ ]
o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection:
collection1 failOnTimeout:true timeout (sec):330
[junit4] 2> 1183003 INFO
(coreZkRegister-5316-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv
x:collection1 c:collection1) [n:127.0.0.1:64232_pa%2Fjv c:collection1 s:shard1
r:core_node4 x:collection1] o.a.s.c.ZkController Core needs to
recover:collection1
[junit4] 2> 1183004 INFO
(updateExecutor-2394-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv
x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:64232_pa%2Fjv
c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.u.DefaultSolrCoreState
Running recovery
[junit4] 2> 1183005 INFO
(recoveryExecutor-2395-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv
x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:64232_pa%2Fjv
c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy
Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 1183007 INFO
(recoveryExecutor-2395-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv
x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:64232_pa%2Fjv
c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy
###### startupVersions=[[]]
[junit4] 2> 1183007 INFO
(recoveryExecutor-2395-thread-1-processing-n:127.0.0.1:64232_pa%2Fjv
x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:64232_pa%2Fjv
[...truncated too long message...]
org.apache.http.impl.conn.PoolingHttpClientConnectionManager.requestConnection(PoolingHttpClientConnectionManager.java:251)
[junit4] 2> at
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:175)
[junit4] 2> at
org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
[junit4] 2> at
org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
[junit4] 2> at
org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
[junit4] 2> at
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
[junit4] 2> at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] 2> at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
[junit4] 2> at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:513)
[junit4] 2> at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
[junit4] 2> at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:237)
[junit4] 2> at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:160)
[junit4] 2> at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:177)
[junit4] 2> at
org.apache.solr.cloud.StoppableIndexingThread.indexDocs(StoppableIndexingThread.java:176)
[junit4] 2> at
org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:115)
[junit4] 2> May 29, 2017 6:42:45 AM
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be
terminated:
[junit4] 2> 1) Thread[id=12142, name=StoppableSearchThread,
state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at
org.apache.solr.cloud.StoppableSearchThread.run(StoppableSearchThread.java:65)
[junit4] 2> 2) Thread[id=12112,
name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[EA0402C51EC9CF66]-SendThread(127.0.0.1:43695),
state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
[junit4] 2> 3) Thread[id=12144,
name=FullThrottleStopableIndexingThread, state=RUNNABLE,
group=TGRP-ChaosMonkeyNothingIsSafeTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at
org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient.blockUntilFinished(ConcurrentUpdateSolrClient.java:588)
[junit4] 2> at
org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient.request(ConcurrentUpdateSolrClient.java:473)
[junit4] 2> at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:160)
[junit4] 2> at
org.apache.solr.client.solrj.SolrClient.deleteById(SolrClient.java:753)
[junit4] 2> at
org.apache.solr.client.solrj.SolrClient.deleteById(SolrClient.java:716)
[junit4] 2> at
org.apache.solr.client.solrj.SolrClient.deleteById(SolrClient.java:731)
[junit4] 2> at
org.apache.solr.cloud.FullThrottleStoppableIndexingThread.run(FullThrottleStoppableIndexingThread.java:77)
[junit4] 2> 4) Thread[id=12141, name=StoppableIndexingThread,
state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]
[junit4] 2> at
org.apache.solr.common.util.JavaBinCodec.writeKnownType(JavaBinCodec.java:330)
[junit4] 2> at
org.apache.solr.common.util.JavaBinCodec.writeVal(JavaBinCodec.java:230)
[junit4] 2> at
org.apache.solr.common.util.JavaBinCodec.writeMapEntry(JavaBinCodec.java:747)
[junit4] 2> at
org.apache.solr.common.util.JavaBinCodec.writeKnownType(JavaBinCodec.java:385)
[junit4] 2> at
org.apache.solr.common.util.JavaBinCodec.writeVal(JavaBinCodec.java:230)
[junit4] 2> at
org.apache.solr.common.util.JavaBinCodec.writeIterator(JavaBinCodec.java:688)
[junit4] 2> at
org.apache.solr.common.util.JavaBinCodec.writeKnownType(JavaBinCodec.java:369)
[junit4] 2> at
org.apache.solr.common.util.JavaBinCodec.writeVal(JavaBinCodec.java:230)
[junit4] 2> at
org.apache.solr.common.util.JavaBinCodec.writeNamedList(JavaBinCodec.java:225)
[junit4] 2> at
org.apache.solr.common.util.JavaBinCodec.writeKnownType(JavaBinCodec.java:332)
[junit4] 2> at
org.apache.solr.common.util.JavaBinCodec.writeVal(JavaBinCodec.java:230)
[junit4] 2> at
org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:153)
[junit4] 2> at
org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.marshal(JavaBinUpdateRequestCodec.java:91)
[junit4] 2> at
org.apache.solr.client.solrj.impl.BinaryRequestWriter.getContentStream(BinaryRequestWriter.java:67)
[junit4] 2> at
org.apache.solr.client.solrj.request.RequestWriter$LazyContentStream.getDelegate(RequestWriter.java:94)
[junit4] 2> at
org.apache.solr.client.solrj.request.RequestWriter$LazyContentStream.getName(RequestWriter.java:104)
[junit4] 2> at
org.apache.solr.client.solrj.impl.HttpSolrClient.createMethod(HttpSolrClient.java:371)
[junit4] 2> at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:246)
[junit4] 2> at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:237)
[junit4] 2> at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:160)
[junit4] 2> at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:177)
[junit4] 2> at
org.apache.solr.cloud.StoppableIndexingThread.indexDocs(StoppableIndexingThread.java:176)
[junit4] 2> at
org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:115)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70):
{rnd_b=Lucene50(blocksize=128), a_t=PostingsFormat(name=Direct),
a_i=Lucene50(blocksize=128), id=Lucene50(blocksize=128)},
docValues:{rnd_b=DocValuesFormat(name=Lucene70),
_version_=DocValuesFormat(name=Direct), a_t=DocValuesFormat(name=Memory),
a_i=DocValuesFormat(name=Lucene70), id=DocValuesFormat(name=Lucene70)},
maxPointsInLeafNode=80, maxMBSortInHeap=6.734046449327991,
sim=RandomSimilarity(queryNorm=true): {}, locale=en-IE,
timezone=Australia/Melbourne
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_131
(64-bit)/cpus=3,threads=7,free=200775200,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [DOMUtilTest,
SolrCoreCheckLockOnStartupTest, OverseerRolesTest, TestComponentsName,
UUIDFieldTest, CdcrBootstrapTest, TestCopyFieldCollectionResource,
TestBadConfig, TestRandomFlRTGCloud, TestMaxTokenLenTokenizer,
ChangedSchemaMergeTest, StatsComponentTest, TestDistributedMissingSort,
TestSha256AuthenticationProvider, TestQueryWrapperFilter,
TestFoldingMultitermQuery, DeleteShardTest, SpellCheckComponentTest,
CleanupOldIndexTest, ConfigureRecoveryStrategyTest, TestInPlaceUpdatesDistrib,
TestStressInPlaceUpdates, TestSolrIndexConfig, HighlighterConfigTest,
BigEndianAscendingWordSerializerTest, TestRebalanceLeaders,
TestExceedMaxTermLength, TestCoreAdminApis, TestDynamicFieldResource,
TestTestInjection, SortByFunctionTest, CollectionReloadTest, TestTrieFacet,
TestPayloadCheckQParserPlugin, DistributedQueryComponentOptimizationTest,
AliasIntegrationTest, AsyncCallRequestStatusResponseTest, SuggesterTSTTest,
ManagedSchemaRoundRobinCloudTest, HdfsBasicDistributedZk2Test, SliceStateTest,
TestJavabinTupleStreamParser, HdfsChaosMonkeyNothingIsSafeTest, UpdateLogTest,
SpatialHeatmapFacetsTest, TestRecovery, BasicAuthIntegrationTest,
TestCrossCoreJoin, LargeFieldTest, MultiThreadedOCPTest, BadIndexSchemaTest,
OverseerTaskQueueTest, DebugComponentTest, FileBasedSpellCheckerTest,
DocValuesMissingTest, LukeRequestHandlerTest, PreAnalyzedFieldTest,
TestJsonFacets, PKIAuthenticationIntegrationTest, TestLRUCache,
DirectUpdateHandlerOptimizeTest, OpenCloseCoreStressTest,
TestFieldTypeResource, TestIndexSearcher, DistribJoinFromCollectionTest,
RulesTest, TestSolrQueryParser, CoreAdminCreateDiscoverTest,
DistanceFunctionTest, SSLMigrationTest, NotRequiredUniqueKeyTest,
DistributedFacetPivotWhiteBoxTest, PreAnalyzedUpdateProcessorTest,
LeaderElectionIntegrationTest, TestPHPSerializedResponseWriter,
TestUseDocValuesAsStored2, TestConfigSetsAPI, TestConfigSets,
TestSSLRandomization, TestRealTimeGet, SolrCLIZkUtilsTest, JsonLoaderTest,
SharedFSAutoReplicaFailoverUtilsTest, WordBreakSolrSpellCheckerTest,
TestDistribIDF, TestPivotHelperCode, TestSolrCoreParser, TestOrdValues,
DefaultValueUpdateProcessorTest, TestExactStatsCache,
ConjunctionSolrSpellCheckerTest, TestSolrConfigHandlerCloud,
TestCloudManagedSchema, ShardSplitTest, TolerantUpdateProcessorTest,
ZkSolrClientTest, BasicDistributedZk2Test, TestQueryUtils, LoggingHandlerTest,
ExternalFileFieldSortTest, SignatureUpdateProcessorFactoryTest, TestFiltering,
QueryParsingTest, AddSchemaFieldsUpdateProcessorFactoryTest, BadComponentTest,
TestFieldCacheSortRandom, TestScoreJoinQPScore, GraphQueryTest,
ChaosMonkeyNothingIsSafeTest]
[junit4] 2> NOTE: reproduce with: ant test
-Dtestcase=ChaosMonkeyNothingIsSafeTest -Dtests.seed=EA0402C51EC9CF66
-Dtests.slow=true -Dtests.locale=en-IE -Dtests.timezone=Australia/Melbourne
-Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J1 | ChaosMonkeyNothingIsSafeTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>=
7200000 msec).
[junit4] > at
__randomizedtesting.SeedInfo.seed([EA0402C51EC9CF66]:0)
[junit4] Completed [648/716 (1!)] on J1 in 7224.90s, 1 test, 2 errors <<<
FAILURES!
[...truncated 43592 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
