Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1399/
1 tests failed.
FAILED: org.apache.solr.cloud.CdcrVersionReplicationTest.testCdcrDocVersions
Error Message:
Captured an uncaught exception in thread: Thread[id=10703,
name=OverseerHdfsCoreFailoverThread-96666288999301125-127.0.0.1:35056_qzk%2Fov-n_0000000000,
state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught
exception in thread: Thread[id=10703,
name=OverseerHdfsCoreFailoverThread-96666288999301125-127.0.0.1:35056_qzk%2Fov-n_0000000000,
state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
Build Log:
[...truncated 11480 lines...]
[junit4] Suite: org.apache.solr.cloud.CdcrVersionReplicationTest
[junit4] 2> Creating dataDir:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/init-core-data-001
[junit4] 2> 1733148 INFO
(SUITE-CdcrVersionReplicationTest-seed#[C9CAF9AA37E1B10E]-worker) [ ]
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via:
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1733149 INFO
(SUITE-CdcrVersionReplicationTest-seed#[C9CAF9AA37E1B10E]-worker) [ ]
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /qzk/ov
[junit4] 2> 1733168 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1733176 INFO (Thread-4162) [ ] o.a.s.c.ZkTestServer client
port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1733176 INFO (Thread-4162) [ ] o.a.s.c.ZkTestServer
Starting server
[junit4] 2> 1733367 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.ZkTestServer start zk server on port:51081
[junit4] 2> 1733417 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.AbstractZkTestCase put
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-cdcr.xml
to /configs/conf1/solrconfig.xml
[junit4] 2> 1733421 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.AbstractZkTestCase put
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema15.xml
to /configs/conf1/schema.xml
[junit4] 2> 1733423 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.AbstractZkTestCase put
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1733436 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.AbstractZkTestCase put
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
to /configs/conf1/stopwords.txt
[junit4] 2> 1733438 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.AbstractZkTestCase put
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt
to /configs/conf1/protwords.txt
[junit4] 2> 1733450 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.AbstractZkTestCase put
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml
to /configs/conf1/currency.xml
[junit4] 2> 1733451 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.AbstractZkTestCase put
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
to /configs/conf1/enumsConfig.xml
[junit4] 2> 1733453 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.AbstractZkTestCase put
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1733454 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.AbstractZkTestCase put
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1733460 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.AbstractZkTestCase put
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
to /configs/conf1/old_synonyms.txt
[junit4] 2> 1733464 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.AbstractZkTestCase put
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
to /configs/conf1/synonyms.txt
[junit4] 2> 1733470 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.SolrTestCaseJ4 ###Starting testCdcrDocVersions
[junit4] 2> 1733618 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.SolrTestCaseJ4 Writing core.properties file to
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-001/cores/collection1
[junit4] 2> 1733620 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 1733633 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@5a07ed8c{/qzk/ov,null,AVAILABLE}
[junit4] 2> 1733636 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.ServerConnector Started ServerConnector@18eaf6c3{SSL,[ssl,
http/1.1]}{127.0.0.1:35056}
[junit4] 2> 1733636 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.Server Started @1742399ms
[junit4] 2> 1733636 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard1,
hostContext=/qzk/ov, hostPort=35056,
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-001/cores}
[junit4] 2> 1733636 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
version 7.0.0
[junit4] 2> 1733636 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 1733636 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1733636 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2016-09-27T21:08:33.743Z
[junit4] 2> 1733668 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1733668 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.SolrXmlConfig Loading container configuration from
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-001/solr.xml
[junit4] 2> 1733812 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51081/solr
[junit4] 2> 1733854 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.OverseerElectionContext I am going to
be the leader 127.0.0.1:35056_qzk%2Fov
[junit4] 2> 1733860 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.Overseer Overseer
(id=96666288999301125-127.0.0.1:35056_qzk%2Fov-n_0000000000) starting
[junit4] 2> 1733880 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:35056_qzk%2Fov
[junit4] 2> 1733895 INFO
(OverseerStateUpdate-96666288999301125-127.0.0.1:35056_qzk%2Fov-n_0000000000)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (0) -> (1)
[junit4] 2> 1733933 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-001/cores
[junit4] 2> 1733933 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 1733956 INFO
(OverseerStateUpdate-96666288999301125-127.0.0.1:35056_qzk%2Fov-n_0000000000)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard2
[junit4] 2> 1734968 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.c.ZkController Only one config set found in zk - using it:conf1
[junit4] 2> 1735010 WARN
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection x:collection1] o.a.s.c.Config
Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory>
instead.
[junit4] 2> 1735011 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
[junit4] 2> 1735056 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1735370 WARN
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.s.IndexSchema [collection1] default search field in schema is text.
WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1735372 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1735411 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from
collection tmp_collection
[junit4] 2> 1735411 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-001/cores/collection1],
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-001/cores/collection1/data/]
[junit4] 2> 1735411 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr
mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ef48b45
[junit4] 2> 1735412 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=31, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=6.708984375,
floorSegmentMB=1.943359375, forceMergeDeletesPctAllowed=5.994970489279878,
segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.3512512226891106
[junit4] 2> 1735500 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation:
org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 1735500 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=
defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
numVersionBuckets=65536
[junit4] 2> 1735501 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1735501 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1735501 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=44, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=72.552734375,
floorSegmentMB=0.3466796875, forceMergeDeletesPctAllowed=12.972714488831622,
segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1735508 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.s.SolrIndexSearcher Opening
[Searcher@7f8b4367[collection1] main]
[junit4] 2> 1735516 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO
with znodeBase: /configs/conf1
[junit4] 2> 1735517 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1735517 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1735522 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.h.CdcrBufferStateManager Created znode
/collections/tmp_collection/cdcr/state/buffer
[junit4] 2> 1735524 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.h.CdcrProcessStateManager Created znode
/collections/tmp_collection/cdcr/state/process
[junit4] 2> 1735536 INFO
(searcherExecutor-3851-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node1)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher
Searcher@7f8b4367[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1735537 INFO
(coreLoadExecutor-3850-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent
updates, using new clock 1546660626451922944
[junit4] 2> 1735563 INFO
(coreZkRegister-3843-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node1)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to
continue.
[junit4] 2> 1735563 INFO
(coreZkRegister-3843-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node1)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try
and sync
[junit4] 2> 1735564 INFO
(coreZkRegister-3843-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node1)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.c.SyncStrategy Sync replicas to
https://127.0.0.1:35056/qzk/ov/collection1/
[junit4] 2> 1735564 INFO
(coreZkRegister-3843-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node1)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1735564 INFO
(coreZkRegister-3843-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node1)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:35056/qzk/ov/collection1/
has no replicas
[junit4] 2> 1735573 INFO
(zkCallback-1417-thread-3-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.h.CdcrLeaderStateManager Received new
leader state @ tmp_collection:shard2
[junit4] 2> 1735590 INFO
(coreZkRegister-3843-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node1)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader:
https://127.0.0.1:35056/qzk/ov/collection1/ shard2
[junit4] 2> 1735693 INFO
(coreZkRegister-3843-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node1)
[n:127.0.0.1:35056_qzk%2Fov c:tmp_collection s:shard2 r:core_node1
x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1736090 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.SolrTestCaseJ4 Writing core.properties file to
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-002/cores/collection1
[junit4] 2> 1736092 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 1736094 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@14292503{/qzk/ov,null,AVAILABLE}
[junit4] 2> 1736096 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.ServerConnector Started ServerConnector@106bb3bf{SSL,[ssl,
http/1.1]}{127.0.0.1:38445}
[junit4] 2> 1736096 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.Server Started @1744859ms
[junit4] 2> 1736096 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard2,
hostContext=/qzk/ov, hostPort=38445,
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-002/cores}
[junit4] 2> 1736096 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
version 7.0.0
[junit4] 2> 1736096 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 1736096 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1736096 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2016-09-27T21:08:36.203Z
[junit4] 2> 1736115 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1736115 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.SolrXmlConfig Loading container configuration from
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-002/solr.xml
[junit4] 2> 1736127 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51081/solr
[junit4] 2> 1736145 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:38445_qzk%2Fov ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (0) -> (1)
[junit4] 2> 1736158 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:38445_qzk%2Fov ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:38445_qzk%2Fov
[junit4] 2> 1736159 INFO
(zkCallback-1417-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (1) -> (2)
[junit4] 2> 1736196 INFO
(zkCallback-1423-thread-2-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (1) -> (2)
[junit4] 2> 1736199 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:38445_qzk%2Fov ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-002/cores
[junit4] 2> 1736199 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:38445_qzk%2Fov ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 1736232 INFO
(OverseerStateUpdate-96666288999301125-127.0.0.1:35056_qzk%2Fov-n_0000000000)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard1
[junit4] 2> 1737277 WARN
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection x:collection1] o.a.s.c.Config
Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory>
instead.
[junit4] 2> 1737278 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
[junit4] 2> 1737296 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1737493 WARN
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.s.IndexSchema [collection1] default search field in schema is text.
WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1737495 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1737520 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from
collection tmp_collection
[junit4] 2> 1737521 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-002/cores/collection1],
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-002/cores/collection1/data/]
[junit4] 2> 1737521 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr
mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ef48b45
[junit4] 2> 1737522 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=31, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=6.708984375,
floorSegmentMB=1.943359375, forceMergeDeletesPctAllowed=5.994970489279878,
segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.3512512226891106
[junit4] 2> 1737554 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation:
org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 1737554 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=
defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
numVersionBuckets=65536
[junit4] 2> 1737555 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1737555 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1737562 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=44, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=72.552734375,
floorSegmentMB=0.3466796875, forceMergeDeletesPctAllowed=12.972714488831622,
segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1737562 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.s.SolrIndexSearcher Opening
[Searcher@2461f1bb[collection1] main]
[junit4] 2> 1737564 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO
with znodeBase: /configs/conf1
[junit4] 2> 1737564 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1737564 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1737569 INFO
(coreLoadExecutor-3862-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent
updates, using new clock 1546660628582629376
[junit4] 2> 1737573 INFO
(searcherExecutor-3863-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node2)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher
Searcher@2461f1bb[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1737639 INFO
(coreZkRegister-3857-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node2)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to
continue.
[junit4] 2> 1737640 INFO
(coreZkRegister-3857-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node2)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try
and sync
[junit4] 2> 1737640 INFO
(coreZkRegister-3857-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node2)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.c.SyncStrategy Sync replicas to
https://127.0.0.1:38445/qzk/ov/collection1/
[junit4] 2> 1737640 INFO
(coreZkRegister-3857-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node2)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1737640 INFO
(coreZkRegister-3857-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node2)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:38445/qzk/ov/collection1/
has no replicas
[junit4] 2> 1737665 INFO
(zkCallback-1423-thread-2-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov ] o.a.s.h.CdcrLeaderStateManager Received new
leader state @ tmp_collection:shard1
[junit4] 2> 1737670 INFO
(coreZkRegister-3857-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node2)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader:
https://127.0.0.1:38445/qzk/ov/collection1/ shard1
[junit4] 2> 1737780 INFO
(coreZkRegister-3857-thread-1-processing-n:127.0.0.1:38445_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node2)
[n:127.0.0.1:38445_qzk%2Fov c:tmp_collection s:shard1 r:core_node2
x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1737907 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.SolrTestCaseJ4 Writing core.properties file to
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-003/cores/collection1
[junit4] 2> 1737909 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 1737923 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@526506a2{/qzk/ov,null,AVAILABLE}
[junit4] 2> 1737925 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.ServerConnector Started ServerConnector@5892cd35{SSL,[ssl,
http/1.1]}{127.0.0.1:57819}
[junit4] 2> 1737925 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.Server Started @1746689ms
[junit4] 2> 1737925 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard3,
hostContext=/qzk/ov, hostPort=57819,
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-003/cores}
[junit4] 2> 1737925 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
version 7.0.0
[junit4] 2> 1737926 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 1737926 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1737926 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2016-09-27T21:08:38.033Z
[junit4] 2> 1737930 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1737930 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.SolrXmlConfig Loading container configuration from
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-003/solr.xml
[junit4] 2> 1737945 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51081/solr
[junit4] 2> 1738091 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:57819_qzk%2Fov ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (0) -> (2)
[junit4] 2> 1738285 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:57819_qzk%2Fov ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:57819_qzk%2Fov
[junit4] 2> 1738286 INFO
(zkCallback-1423-thread-2-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (2) -> (3)
[junit4] 2> 1738299 INFO
(zkCallback-1429-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (2) -> (3)
[junit4] 2> 1738286 INFO
(zkCallback-1417-thread-3-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (2) -> (3)
[junit4] 2> 1738306 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:57819_qzk%2Fov ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-003/cores
[junit4] 2> 1738306 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:57819_qzk%2Fov ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 1738308 INFO
(OverseerStateUpdate-96666288999301125-127.0.0.1:35056_qzk%2Fov-n_0000000000)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard2
[junit4] 2> 1739373 WARN
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection x:collection1] o.a.s.c.Config
Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory>
instead.
[junit4] 2> 1739377 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
[junit4] 2> 1739429 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1739535 WARN
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.s.IndexSchema [collection1] default search field in schema is text.
WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1739539 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1739557 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from
collection tmp_collection
[junit4] 2> 1739558 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-003/cores/collection1],
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-003/cores/collection1/data/]
[junit4] 2> 1739558 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr
mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ef48b45
[junit4] 2> 1739559 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=31, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=6.708984375,
floorSegmentMB=1.943359375, forceMergeDeletesPctAllowed=5.994970489279878,
segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.3512512226891106
[junit4] 2> 1739585 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation:
org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 1739585 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=
defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
numVersionBuckets=65536
[junit4] 2> 1739586 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1739586 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1739587 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=44, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=72.552734375,
floorSegmentMB=0.3466796875, forceMergeDeletesPctAllowed=12.972714488831622,
segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1739592 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.s.SolrIndexSearcher Opening
[Searcher@7642df3a[collection1] main]
[junit4] 2> 1739593 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO
with znodeBase: /configs/conf1
[junit4] 2> 1739594 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1739594 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1739596 INFO
(coreLoadExecutor-3874-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent
updates, using new clock 1546660630708092928
[junit4] 2> 1739600 INFO
(searcherExecutor-3875-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node3)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher
Searcher@7642df3a[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1739602 INFO
(coreZkRegister-3869-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node3)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.c.ZkController Core needs to recover:collection1
[junit4] 2> 1739604 INFO
(updateExecutor-1426-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node3)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 1739604 INFO
(recoveryExecutor-1427-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node3)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process.
recoveringAfterStartup=true
[junit4] 2> 1739608 INFO
(recoveryExecutor-1427-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node3)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 1739608 INFO
(recoveryExecutor-1427-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node3)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates.
core=[collection1]
[junit4] 2> 1739608 INFO
(recoveryExecutor-1427-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node3)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.u.UpdateLog Starting to buffer updates.
FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 1739608 INFO
(recoveryExecutor-1427-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node3)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1]
as recovering, leader is [https://127.0.0.1:35056/qzk/ov/collection1/] and I am
[https://127.0.0.1:57819/qzk/ov/collection1/]
[junit4] 2> 1739611 INFO
(recoveryExecutor-1427-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov
x:collection1 s:shard2 c:tmp_collection r:core_node3)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to
[https://127.0.0.1:35056/qzk/ov]; [WaitForState:
action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:57819_qzk%252Fov&coreNodeName=core_node3&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 1739672 INFO (qtp1229379210-10685)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.h.a.PrepRecoveryOp Going to wait for
coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader:
true, onlyIfLeaderActive: true
[junit4] 2> 1739673 INFO (qtp1229379210-10685)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.h.a.PrepRecoveryOp Will wait a max of
183 seconds to see collection1 (shard2 of tmp_collection) have state: recovering
[junit4] 2> 1739673 INFO (qtp1229379210-10685)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.h.a.PrepRecoveryOp In
WaitForState(recovering): collection=tmp_collection, shard=shard2,
thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true,
live=true, checkLive=true, currentState=down, localState=active,
nodeName=127.0.0.1:57819_qzk%2Fov, coreNodeName=core_node3,
onlyIfActiveCheckResult=false, nodeProps:
core_node3:{"core":"collection1","base_url":"https://127.0.0.1:57819/qzk/ov","node_name":"127.0.0.1:57819_qzk%2Fov","state":"down"}
[junit4] 2> 1740030 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.SolrTestCaseJ4 Writing core.properties file to
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-004/cores/collection1
[junit4] 2> 1740032 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 1740037 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@30ff0955{/qzk/ov,null,AVAILABLE}
[junit4] 2> 1740038 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.ServerConnector Started ServerConnector@aef7fd8{SSL,[ssl,
http/1.1]}{127.0.0.1:60481}
[junit4] 2> 1740038 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.Server Started @1748802ms
[junit4] 2> 1740038 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard4,
hostContext=/qzk/ov, hostPort=60481,
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-004/cores}
[junit4] 2> 1740039 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
version 7.0.0
[junit4] 2> 1740039 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 1740039 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1740039 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2016-09-27T21:08:40.146Z
[junit4] 2> 1740052 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1740052 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.SolrXmlConfig Loading container configuration from
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-004/solr.xml
[junit4] 2> 1740060 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51081/solr
[junit4] 2> 1740071 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:60481_qzk%2Fov ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (0) -> (3)
[junit4] 2> 1740076 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:60481_qzk%2Fov ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:60481_qzk%2Fov
[junit4] 2> 1740080 INFO
(zkCallback-1417-thread-3-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (3) -> (4)
[junit4] 2> 1740116 INFO
(zkCallback-1429-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (3) -> (4)
[junit4] 2> 1740119 INFO
(zkCallback-1423-thread-2-processing-n:127.0.0.1:38445_qzk%2Fov)
[n:127.0.0.1:38445_qzk%2Fov ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (3) -> (4)
[junit4] 2> 1740167 INFO
(zkCallback-1436-thread-2-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (3) -> (4)
[junit4] 2> 1740179 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:60481_qzk%2Fov ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-004/cores
[junit4] 2> 1740179 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E])
[n:127.0.0.1:60481_qzk%2Fov ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 1740182 INFO
(OverseerStateUpdate-96666288999301125-127.0.0.1:35056_qzk%2Fov-n_0000000000)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard1
[junit4] 2> 1740686 INFO (qtp1229379210-10685)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.h.a.PrepRecoveryOp In
WaitForState(recovering): collection=tmp_collection, shard=shard2,
thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true,
live=true, checkLive=true, currentState=recovering, localState=active,
nodeName=127.0.0.1:57819_qzk%2Fov, coreNodeName=core_node3,
onlyIfActiveCheckResult=false, nodeProps:
core_node3:{"core":"collection1","base_url":"https://127.0.0.1:57819/qzk/ov","node_name":"127.0.0.1:57819_qzk%2Fov","state":"recovering"}
[junit4] 2> 1740686 INFO (qtp1229379210-10685)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName:
core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 1
seconds.
[junit4] 2> 1740686 INFO (qtp1229379210-10685)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.s.HttpSolrCall [admin] webapp=null
path=/admin/cores
params={nodeName=127.0.0.1:57819_qzk%252Fov&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node3&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2}
status=0 QTime=1014
[junit4] 2> 1741222 WARN
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection x:collection1] o.a.s.c.Config
Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory>
instead.
[junit4] 2> 1741223 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
[junit4] 2> 1741291 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1741374 WARN
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.s.IndexSchema [collection1] default search field in schema is text.
WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 1741375 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1741398 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection x:collection1]
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from
collection tmp_collection
[junit4] 2> 1741399 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-004/cores/collection1],
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001/jetty-004/cores/collection1/data/]
[junit4] 2> 1741399 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr
mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ef48b45
[junit4] 2> 1741400 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=31, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=6.708984375,
floorSegmentMB=1.943359375, forceMergeDeletesPctAllowed=5.994970489279878,
segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.3512512226891106
[junit4] 2> 1741422 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation:
org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 1741422 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=
defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
numVersionBuckets=65536
[junit4] 2> 1741423 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1741423 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1741423 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=44, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=72.552734375,
floorSegmentMB=0.3466796875, forceMergeDeletesPctAllowed=12.972714488831622,
segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1741423 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.s.SolrIndexSearcher Opening
[Searcher@7e7199e7[collection1] main]
[junit4] 2> 1741424 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO
with znodeBase: /configs/conf1
[junit4] 2> 1741425 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1741425 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1741432 INFO
(coreLoadExecutor-3885-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent
updates, using new clock 1546660632633278464
[junit4] 2> 1741435 INFO
(searcherExecutor-3886-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node4)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher
Searcher@7e7199e7[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1741438 INFO
(coreZkRegister-3880-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node4)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.c.ZkController Core needs to recover:collection1
[junit4] 2> 1741438 INFO
(updateExecutor-1433-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node4)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 1741438 INFO
(recoveryExecutor-1434-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node4)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process.
recoveringAfterStartup=true
[junit4] 2> 1741444 INFO
(recoveryExecutor-1434-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node4)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 1741444 INFO
(recoveryExecutor-1434-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node4)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates.
core=[collection1]
[junit4] 2> 1741444 INFO
(recoveryExecutor-1434-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node4)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.u.UpdateLog Starting to buffer updates.
FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 1741444 INFO
(recoveryExecutor-1434-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node4)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1]
as recovering, leader is [https://127.0.0.1:38445/qzk/ov/collection1/] and I am
[https://127.0.0.1:60481/qzk/ov/collection1/]
[junit4] 2> 1741453 INFO
(recoveryExecutor-1434-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov
x:collection1 s:shard1 c:tmp_collection r:core_node4)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to
[https://127.0.0.1:38445/qzk/ov]; [WaitForState:
action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:60481_qzk%252Fov&coreNodeName=core_node4&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 1741749 INFO (qtp345493241-10720) [n:127.0.0.1:38445_qzk%2Fov
] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node4,
state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 1741752 INFO (qtp345493241-10720) [n:127.0.0.1:38445_qzk%2Fov
] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1
(shard1 of tmp_collection) have state: recovering
[junit4] 2> 1741752 INFO (qtp345493241-10720) [n:127.0.0.1:38445_qzk%2Fov
] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering):
collection=tmp_collection, shard=shard1, thisCore=collection1,
leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true,
currentState=recovering, localState=active, nodeName=127.0.0.1:60481_qzk%2Fov,
coreNodeName=core_node4, onlyIfActiveCheckResult=false, nodeProps:
core_node4:{"core":"collection1","base_url":"https://127.0.0.1:60481/qzk/ov","node_name":"127.0.0.1:60481_qzk%2Fov","state":"recovering"}
[junit4] 2> 1741752 INFO (qtp345493241-10720) [n:127.0.0.1:38445_qzk%2Fov
] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node4, state:
recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
[junit4] 2> 1741752 INFO (qtp345493241-10720) [n:127.0.0.1:38445_qzk%2Fov
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores
params={nodeName=127.0.0.1:60481_qzk%252Fov&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node4&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2}
status=0 QTime=3
[junit4] 1> / (2)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /zookeeper (1)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /solr (9)
[junit4] 1> /solr/configs (1)
[junit4] 1> /solr/configs/conf1 (11)
[junit4] 1> /solr/configs/conf1/currency.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/enumsConfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/protwords.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/old_synonyms.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/solrconfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/synonyms.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/stopwords.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/schema.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1>
/solr/configs/conf1/solrconfig.snippet.randomindexconfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "disclaimer": "This data is not real, it was
synthetically created to match currency.xml. It is modeled after the data
format available from openexchangerates.org. See
https://openexchangerates.org/documentation for details
[junit4] 1>
[junit4] 1>
[junit4] 1> IMPORTANT NOTE: In order for tests to work, this
data must be kept in sync with ./currency.xml",
[junit4] 1>
[junit4] 1>
[junit4] 1> "license":
"http://www.apache.org/licenses/LICENSE-2.0";,
[junit4] 1> "timestamp": 1332070464,
[junit4] 1> "base": "USD",
[junit4] 1> "rates": {
[junit4] 1> "USD": 1,
[junit4] 1> "JPY": 81.29,
[junit4] 1> "EUR": 2.5,
[junit4] 1> "GBP": 0.5,
[junit4] 1> "MXN": 2.0
[junit4] 1> }
[junit4] 1> }
[junit4] 1>
[junit4] 1> /solr/overseer (6)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4] 1> /solr/overseer/queue-work (0)
[junit4] 1> /solr/overseer/collection-map-failure (0)
[junit4] 1> /solr/overseer/collection-map-completed (0)
[junit4] 1> /solr/overseer/queue (0)
[junit4] 1> /solr/overseer/collection-map-running (0)
[junit4] 1> /solr/aliases.json (0)
[junit4] 1> /solr/collections (3)
[junit4] 1> /solr/collections/collection1 (1)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/collection1/shards (0)
[junit4] 1> /solr/collections/tmp_collection (3)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/tmp_collection/leaders (2)
[junit4] 1> /solr/collections/tmp_collection/leaders/shard2 (1)
[junit4] 1> /solr/collections/tmp_collection/leaders/shard2/leader
(0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection1",
[junit4] 1> "core_node_name":"core_node1",
[junit4] 1> "base_url":"https://127.0.0.1:35056/qzk/ov";,
[junit4] 1> "node_name":"127.0.0.1:35056_qzk%2Fov"}
[junit4] 1> /solr/collections/tmp_collection/leaders/shard1 (1)
[junit4] 1> /solr/collections/tmp_collection/leaders/shard1/leader
(0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection1",
[junit4] 1> "core_node_name":"core_node2",
[junit4] 1> "base_url":"https://127.0.0.1:38445/qzk/ov";,
[junit4] 1> "node_name":"127.0.0.1:38445_qzk%2Fov"}
[junit4] 1> /solr/collections/tmp_collection/cdcr (1)
[junit4] 1> /solr/collections/tmp_collection/cdcr/state (2)
[junit4] 1> /solr/collections/tmp_collection/cdcr/state/process (0)
[junit4] 1> DATA:
[junit4] 1> stopped
[junit4] 1> /solr/collections/tmp_collection/cdcr/state/buffer (0)
[junit4] 1> DATA:
[junit4] 1> enabled
[junit4] 1> /solr/collections/tmp_collection/leader_elect (2)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard2 (1)
[junit4] 1>
/solr/collections/tmp_collection/leader_elect/shard2/election (2)
[junit4] 1>
/solr/collections/tmp_collection/leader_elect/shard2/election/96666288999301131-core_node3-n_0000000001
(0)
[junit4] 1>
/solr/collections/tmp_collection/leader_elect/shard2/election/96666288999301125-core_node1-n_0000000000
(0)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard1 (1)
[junit4] 1>
/solr/collections/tmp_collection/leader_elect/shard1/election (2)
[junit4] 1>
/solr/collections/tmp_collection/leader_elect/shard1/election/96666288999301128-core_node2-n_0000000000
(0)
[junit4] 1>
/solr/collections/tmp_collection/leader_elect/shard1/election/96666288999301134-core_node4-n_0000000001
(0)
[junit4] 1> /solr/collections/control_collection (1)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/control_collection/shards (0)
[junit4] 1> /solr/live_nodes (4)
[junit4] 1> /solr/live_nodes/127.0.0.1:35056_qzk%2Fov (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:38445_qzk%2Fov (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:60481_qzk%2Fov (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:57819_qzk%2Fov (0)
[junit4] 1> /solr/overseer_elect (2)
[junit4] 1> /solr/overseer_elect/leader (0)
[junit4] 1> DATA:
[junit4] 1>
{"id":"96666288999301125-127.0.0.1:35056_qzk%2Fov-n_0000000000"}
[junit4] 1> /solr/overseer_elect/election (4)
[junit4] 1>
/solr/overseer_elect/election/96666288999301131-127.0.0.1:57819_qzk%2Fov-n_0000000002
(0)
[junit4] 1>
/solr/overseer_elect/election/96666288999301134-127.0.0.1:60481_qzk%2Fov-n_0000000003
(0)
[junit4] 1>
/solr/overseer_elect/election/96666288999301128-127.0.0.1:38445_qzk%2Fov-n_0000000001
(0)
[junit4] 1>
/solr/overseer_elect/election/96666288999301125-127.0.0.1:35056_qzk%2Fov-n_0000000000
(0)
[junit4] 1> /solr/security.json (0)
[junit4] 1> DATA:
[junit4] 1> {}
[junit4] 1> /solr/clusterstate.json (0)
[junit4] 1> DATA:
[junit4] 1> {"tmp_collection":{
[junit4] 1> "replicationFactor":"1",
[junit4] 1> "router":{"name":"compositeId"},
[junit4] 1> "maxShardsPerNode":"1",
[junit4] 1> "autoAddReplicas":"false",
[junit4] 1> "autoCreated":"true",
[junit4] 1> "shards":{
[junit4] 1> "shard1":{
[junit4] 1> "range":"80000000-ffffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node2":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:38445/qzk/ov";,
[junit4] 1> "node_name":"127.0.0.1:38445_qzk%2Fov",
[junit4] 1> "state":"active",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node4":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:60481/qzk/ov";,
[junit4] 1> "node_name":"127.0.0.1:60481_qzk%2Fov",
[junit4] 1> "state":"recovering"}}},
[junit4] 1> "shard2":{
[junit4] 1> "range":"0-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node1":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:35056/qzk/ov";,
[junit4] 1> "node_name":"127.0.0.1:35056_qzk%2Fov",
[junit4] 1> "state":"active",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node3":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:57819/qzk/ov";,
[junit4] 1> "node_name":"127.0.0.1:57819_qzk%2Fov",
[junit4] 1> "state":"recovering"}}}}}}
[junit4] 1> /solr/clusterprops.json (0)
[junit4] 1> DATA:
[junit4] 1> {"urlScheme":"https"}
[junit4] 1>
[junit4] 1> / (2)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /zookeeper (1)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /solr (9)
[junit4] 1> /solr/configs (1)
[junit4] 1> /solr/configs/conf1 (11)
[junit4] 1> /solr/configs/conf1/currency.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/enumsConfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/protwords.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/old_synonyms.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/solrconfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/synonyms.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/stopwords.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/schema.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1>
/solr/configs/conf1/solrconfig.snippet.randomindexconfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "disclaimer": "This data is not real, it was
synthetically created to match currency.xml. It is modeled after the data
format available from openexchangerates.org. See
https://openexchangerates.org/documentation for details
[junit4] 1>
[junit4] 1>
[junit4] 1> IMPORTANT NOTE: In order for tests to work, this
data must be kept in sync with ./currency.xml",
[junit4] 1>
[junit4] 1>
[junit4] 1> "license":
"http://www.apache.org/licenses/LICENSE-2.0";,
[junit4] 1> "timestamp": 1332070464,
[junit4] 1> "base": "USD",
[junit4] 1> "rates": {
[junit4] 1> "USD": 1,
[junit4] 1> "JPY": 81.29,
[junit4] 1> "EUR": 2.5,
[junit4] 1> "GBP": 0.5,
[junit4] 1> "MXN": 2.0
[junit4] 1> }
[junit4] 1> }
[junit4] 1>
[junit4] 1> /solr/overseer (6)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4] 1> /solr/overseer/queue-work (0)
[junit4] 1> /solr/overseer/collection-map-failure (0)
[junit4] 1> /solr/overseer/collection-map-completed (0)
[junit4] 1> /solr/overseer/queue (0)
[junit4] 1> /solr/overseer/collection-map-running (0)
[junit4] 1> /solr/aliases.json (0)
[junit4] 1> /solr/collections (3)
[junit4] 1> /solr/collections/collection1 (1)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/collection1/shards (0)
[junit4] 1> /solr/collections/tmp_collection (3)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/tmp_collection/leaders (2)
[junit4] 1> /solr/collections/tmp_collection/leaders/shard2 (1)
[junit4] 1> /solr/collections/tmp_collection/leaders/shard2/leader
(0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection1",
[junit4] 1> "core_node_name":"core_node1",
[junit4] 1> "base_url":"https://127.0.0.1:35056/qzk/ov";,
[junit4] 1> "node_name":"127.0.0.1:35056_qzk%2Fov"}
[junit4] 1> /solr/collections/tmp_collection/leaders/shard1 (1)
[junit4] 1> /solr/collections/tmp_collection/leaders/shard1/leader
(0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection1",
[junit4] 1> "core_node_name":"core_node2",
[junit4] 1> "base_url":"https://127.0.0.1:38445/qzk/ov";,
[junit4] 1> "node_name":"127.0.0.1:38445_qzk%2Fov"}
[junit4] 1> /solr/collections/tmp_collection/cdcr (1)
[junit4] 1> /solr/collections/tmp_collection/cdcr/state (2)
[junit4] 1> /solr/collections/tmp_collection/cdcr/state/process (0)
[junit4] 1> DATA:
[junit4] 1> stopped
[junit4] 1> /solr/collections/tmp_collection/cdcr/state/buffer (0)
[junit4] 1> DATA:
[junit4] 1> enabled
[junit4] 1> /solr/collections/tmp_collection/leader_elect (2)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard2 (1)
[junit4] 1>
/solr/collections/tmp_collection/leader_elect/shard2/election (2)
[junit4] 1>
/solr/collections/tmp_collection/leader_elect/shard2/election/96666288999301131-core_node3-n_0000000001
(0)
[junit4] 1>
/solr/collections/tmp_collection/leader_elect/shard2/election/96666288999301125-core_node1-n_0000000000
(0)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard1 (1)
[junit4] 1>
/solr/collections/tmp_collection/leader_elect/shard1/election (2)
[junit4] 1>
/solr/collections/tmp_collection/leader_elect/shard1/election/96666288999301128-core_node2-n_0000000000
(0)
[junit4] 1>
/solr/collections/tmp_collection/leader_elect/shard1/election/96666288999301134-core_node4-n_0000000001
(0)
[junit4] 1> /solr/collections/control_collection (1)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/control_collection/shards (0)
[junit4] 1> /solr/live_nodes (4)
[junit4] 1> /solr/live_nodes/127.0.0.1:35056_qzk%2Fov (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:38445_qzk%2Fov (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:60481_qzk%2Fov (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:57819_qzk%2Fov (0)
[junit4] 1> /solr/overseer_elect (2)
[junit4] 1> /solr/overseer_elect/leader (0)
[junit4] 1> DATA:
[junit4] 1>
{"id":"96666288999301125-127.0.0.1:35056_qzk%2Fov-n_0000000000"}
[junit4] 1> /solr/overseer_elect/election (4)
[junit4] 1>
/solr/overseer_elect/election/96666288999301131-127.0.0.1:57819_qzk%2Fov-n_0000000002
(0)
[junit4] 1>
/solr/overseer_elect/election/96666288999301134-127.0.0.1:60481_qzk%2Fov-n_0000000003
(0)
[junit4] 1>
/solr/overseer_elect/election/96666288999301128-127.0.0.1:38445_qzk%2Fov-n_0000000001
(0)
[junit4] 1>
/solr/overseer_elect/election/96666288999301125-127.0.0.1:35056_qzk%2Fov-n_0000000000
(0)
[junit4] 1> /solr/security.json (0)
[junit4] 1> DATA:
[junit4] 1> {}
[junit4] 1> /solr/clusterstate.json (0)
[junit4] 1> DATA:
[junit4] 1> {"tmp_collection":{
[junit4] 1> "replicationFactor":"1",
[junit4] 1> "router":{"name":"compositeId"},
[junit4] 1> "maxShardsPerNode":"1",
[junit4] 1> "autoAddReplicas":"false",
[junit4] 1> "autoCreated":"true",
[junit4] 1> "shards":{
[junit4] 1> "shard1":{
[junit4] 1> "range":"80000000-ffffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node2":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:38445/qzk/ov";,
[junit4] 1> "node_name":"127.0.0.1:38445_qzk%2Fov",
[junit4] 1> "state":"active",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node4":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:60481/qzk/ov";,
[junit4] 1> "node_name":"127.0.0.1:60481_qzk%2Fov",
[junit4] 1> "state":"recovering"}}},
[junit4] 1> "shard2":{
[junit4] 1> "range":"0-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node1":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:35056/qzk/ov";,
[junit4] 1> "node_name":"127.0.0.1:35056_qzk%2Fov",
[junit4] 1> "state":"active",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node3":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:57819/qzk/ov";,
[junit4] 1> "node_name":"127.0.0.1:57819_qzk%2Fov",
[junit4] 1> "state":"recovering"}}}}}}
[junit4] 1> /solr/clusterprops.json (0)
[junit4] 1> DATA:
[junit4] 1> {"urlScheme":"https"}
[junit4] 1>
[junit4] 2> 1742070 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1742122 INFO (qtp1229379210-10686)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.h.a.CollectionsHandler Invoked
Collection Action :delete with params
name=tmp_collection&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1742159 INFO
(OverseerThreadFactory-3848-thread-1-processing-n:127.0.0.1:35056_qzk%2Fov)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.OverseerCollectionMessageHandler
Executing Collection Cmd :
action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 1742178 INFO (qtp345493241-10715) [n:127.0.0.1:38445_qzk%2Fov
] o.a.s.c.SolrCore [collection1] CLOSING SolrCore
org.apache.solr.core.SolrCore@6b965963
[junit4] 2> 1742178 INFO (qtp345493241-10715) [n:127.0.0.1:38445_qzk%2Fov
] o.a.s.h.CdcrRequestHandler Solr core is being closed - shutting down CDCR
handler @ tmp_collection:shard1
[junit4] 2> 1742203 INFO (qtp1229379210-10681)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.c.SolrCore [collection1] CLOSING
SolrCore org.apache.solr.core.SolrCore@1b24ebb
[junit4] 2> 1742203 INFO (qtp1229379210-10681)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.h.CdcrRequestHandler Solr core is being
closed - shutting down CDCR handler @ tmp_collection:shard2
[junit4] 2> 1742424 INFO
(zkCallback-1429-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.c.ShardLeaderElectionContext There may be a better leader
candidate than us - going back into recovery
[junit4] 2> 1742425 INFO
(zkCallback-1429-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.c.ShardLeaderElectionContextBase No version found for
ephemeral leader parent node, won't remove previous leader registration.
[junit4] 2> 1742426 INFO (qtp345493241-10715) [n:127.0.0.1:38445_qzk%2Fov
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores
params={deleteInstanceDir=true&core=collection1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
status=0 QTime=248
[junit4] 2> 1742441 WARN (qtp419793184-10785) [n:127.0.0.1:60481_qzk%2Fov
] o.a.s.c.RecoveryStrategy Stopping recovery for core=[collection1]
coreNodeName=[core_node4]
[junit4] 2> 1742458 INFO (qtp419793184-10785) [n:127.0.0.1:60481_qzk%2Fov
] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before
checking again.
[junit4] 2> 1742457 INFO
(zkCallback-1436-thread-1-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov ] o.a.s.h.CdcrLeaderStateManager Received new
leader state @ tmp_collection:shard1
[junit4] 2> 1742456 INFO (qtp1229379210-10681)
[n:127.0.0.1:35056_qzk%2Fov ] o.a.s.s.HttpSolrCall [admin] webapp=null
path=/admin/cores
params={deleteInstanceDir=true&core=collection1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
status=0 QTime=253
[junit4] 2> 1742452 INFO
(zkCallback-1429-thread-2-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov ] o.a.s.h.CdcrLeaderStateManager Received new
leader state @ tmp_collection:shard2
[junit4] 2> 1742441 WARN (qtp1524294140-10747)
[n:127.0.0.1:57819_qzk%2Fov ] o.a.s.c.RecoveryStrategy Stopping recovery for
core=[collection1] coreNodeName=[core_node3]
[junit4] 2> 1742460 INFO (qtp1524294140-10747)
[n:127.0.0.1:57819_qzk%2Fov ] o.a.s.c.SolrCore Core collection1 is not yet
closed, waiting 100 ms before checking again.
[junit4] 2> 1742464 INFO
(zkCallback-1436-thread-2-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.c.ShardLeaderElectionContextBase No version found for
ephemeral leader parent node, won't remove previous leader registration.
[junit4] 2> 1742464 WARN
(zkCallback-1436-thread-2-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov c:tmp_collection s:shard1 r:core_node4
x:collection1] o.a.s.c.LeaderElector
[junit4] 2> org.apache.solr.common.SolrException: SolrCore not
found:collection1 in []
[junit4] 2> at
org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:335)
[junit4] 2> at
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
[junit4] 2> at
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
[junit4] 2> at
org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
[junit4] 2> at
org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:268)
[junit4] 2> at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at
java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1742468 WARN
(zkCallback-1429-thread-1-processing-n:127.0.0.1:57819_qzk%2Fov)
[n:127.0.0.1:57819_qzk%2Fov c:tmp_collection s:shard2 r:core_node3
x:collection1] o.a.s.c.LeaderElector
[junit4] 2> org.apache.solr.common.SolrException: SolrCore not
found:collection1 in []
[junit4] 2> at
org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:295)
[junit4] 2> at
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
[junit4] 2> at
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
[junit4] 2> at
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307)
[junit4] 2> at
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:216)
[junit4] 2> at
org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:673)
[junit4] 2> at
org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:343)
[junit4] 2> at
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
[junit4] 2> at org.apache.solr.clou
[...truncated too long message...]
ed, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for
/live_nodes]
[junit4] 2> 2213865 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.ServerConnector Stopped ServerConnector@5892cd35{SSL,[ssl,
http/1.1]}{127.0.0.1:0}
[junit4] 2> 2213865 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@526506a2{/qzk/ov,null,UNAVAILABLE}
[junit4] 2> 2214400 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.ChaosMonkey monkey: stop shard! 60481
[junit4] 2> 2214400 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1562622966
[junit4] 2> 2214446 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.Overseer Overseer
(id=96666288999301140-127.0.0.1:60481_qzk%2Fov-n_0000000006) closing
[junit4] 2> 2214511 INFO
(OverseerStateUpdate-96666288999301140-127.0.0.1:60481_qzk%2Fov-n_0000000006)
[n:127.0.0.1:60481_qzk%2Fov ] o.a.s.c.Overseer Overseer Loop exiting :
127.0.0.1:60481_qzk%2Fov
[junit4] 2> 2214514 WARN
(zkCallback-1436-thread-9-processing-n:127.0.0.1:60481_qzk%2Fov)
[n:127.0.0.1:60481_qzk%2Fov ] o.a.s.c.c.ZkStateReader ZooKeeper watch
triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for
/live_nodes]
[junit4] 2> 2214590 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.ServerConnector Stopped ServerConnector@aef7fd8{SSL,[ssl,
http/1.1]}{127.0.0.1:0}
[junit4] 2> 2214590 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@30ff0955{/qzk/ov,null,UNAVAILABLE}
[junit4] 2> 2214753 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.SolrTestCaseJ4 ###Ending testCdcrDocVersions
[junit4] 2> 2214841 INFO
(TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[C9CAF9AA37E1B10E]) [
] o.a.s.c.ZkTestServer connecting to 127.0.0.1:51081 51081
[junit4] 2> 2215123 INFO (Thread-4162) [ ] o.a.s.c.ZkTestServer
connecting to 127.0.0.1:51081 51081
[junit4] 2> 2215125 WARN (Thread-4162) [ ] o.a.s.c.ZkTestServer Watch
limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/aliases.json
[junit4] 2> 8 /solr/security.json
[junit4] 2> 5 /solr/collections/tmp_collection/state.json
[junit4] 2> 4 /solr/configs/conf1
[junit4] 2> 2
/solr/collections/tmp_collection/leaders/shard2/leader
[junit4] 2> 2
/solr/collections/tmp_collection/leaders/shard1/leader
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/clusterprops.json
[junit4] 2> 11 /solr/clusterstate.json
[junit4] 2> 4
/solr/collections/tmp_collection/cdcr/state/buffer
[junit4] 2> 4
/solr/collections/tmp_collection/cdcr/state/process
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 29 /solr/overseer/collection-queue-work
[junit4] 2> 21 /solr/overseer/queue
[junit4] 2> 11 /solr/collections
[junit4] 2> 8 /solr/live_nodes
[junit4] 2> 6 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test
-Dtestcase=CdcrVersionReplicationTest -Dtests.method=testCdcrDocVersions
-Dtests.seed=C9CAF9AA37E1B10E -Dtests.multiplier=2 -Dtests.slow=true
-Dtests.locale=sv -Dtests.timezone=America/Paramaribo -Dtests.asserts=true
-Dtests.file.encoding=US-ASCII
[junit4] ERROR 482s J1 | CdcrVersionReplicationTest.testCdcrDocVersions
<<<
[junit4] > Throwable #1: java.lang.AssertionError: The collection
(tmp_collection) is still present - waited for 15 seconds
[junit4] > at
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForCollectionToDisappear(AbstractDistribZkTestBase.java:212)
[junit4] > at
org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForCollectionToDisappear(BaseCdcrDistributedZkTest.java:498)
[junit4] > at
org.apache.solr.cloud.BaseCdcrDistributedZkTest.startServers(BaseCdcrDistributedZkTest.java:598)
[junit4] > at
org.apache.solr.cloud.BaseCdcrDistributedZkTest.createSourceCollection(BaseCdcrDistributedZkTest.java:348)
[junit4] > at
org.apache.solr.cloud.BaseCdcrDistributedZkTest.baseBefore(BaseCdcrDistributedZkTest.java:167)
[junit4] > at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
[junit4] > at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught
exception in thread: Thread[id=10703,
name=OverseerHdfsCoreFailoverThread-96666288999301125-127.0.0.1:35056_qzk%2Fov-n_0000000000,
state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] > Caused by: java.lang.OutOfMemoryError: GC overhead limit
exceeded
[junit4] 2> 2215134 INFO
(SUITE-CdcrVersionReplicationTest-seed#[C9CAF9AA37E1B10E]-worker) [ ]
o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrVersionReplicationTest_C9CAF9AA37E1B10E-001
[junit4] 2> NOTE: test params are:
codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION,
chunkSize=29343, maxDocsPerChunk=10, blockSize=9),
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION,
chunkSize=29343, blockSize=9)), sim=RandomSimilarity(queryNorm=false): {},
locale=sv, timezone=America/Paramaribo
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation
1.8.0_102 (64-bit)/cpus=4,threads=1,free=102731632,total=473432064
[junit4] 2> NOTE: All tests run in this JVM: [JsonLoaderTest,
SolrCmdDistributorTest, LoggingHandlerTest, RankQueryTest,
DistributedMLTComponentTest, ZkSolrClientTest, SoftAutoCommitTest,
CreateCollectionCleanupTest, DirectSolrSpellCheckerTest,
TestFieldTypeCollectionResource, TestTrie, CSVRequestHandlerTest,
TestSolrCloudWithDelegationTokens, SpatialHeatmapFacetsTest,
TestExactSharedStatsCache, TestSolrFieldCacheMBean, TestSortByMinMaxFunction,
HdfsChaosMonkeyNothingIsSafeTest, TestSolrIndexConfig, TestStressVersions,
MoreLikeThisHandlerTest, IndexBasedSpellCheckerTest, ChaosMonkeySafeLeaderTest,
TestSurroundQueryParser, TestCopyFieldCollectionResource,
LeaderInitiatedRecoveryOnShardRestartTest, CloudMLTQParserTest,
SharedFSAutoReplicaFailoverUtilsTest, ExitableDirectoryReaderTest, DOMUtilTest,
UpdateRequestProcessorFactoryTest, TestNoOpRegenerator, TestFiltering,
TestDynamicFieldResource, CloudExitableDirectoryReaderTest,
TestEmbeddedSolrServerConstructors, BadComponentTest, TestSolrConfigHandler,
TestNumericTerms32, TestRecoveryHdfs, TestBackupRepositoryFactory,
TermsComponentTest, ZkStateWriterTest, RulesTest,
OpenExchangeRatesOrgProviderTest, TestUseDocValuesAsStored, TestReqParamsAPI,
ClusterStateUpdateTest, TestScoreJoinQPNoScore, TestSSLRandomization,
SaslZkACLProviderTest, TestConfigSetProperties, DocumentBuilderTest,
CollectionTooManyReplicasTest, TestRandomCollapseQParserPlugin,
DistribDocExpirationUpdateProcessorTest, TestTrieFacet, HdfsNNFailoverTest,
TestCloudDeleteByQuery, IndexSchemaRuntimeFieldTest, DataDrivenBlockJoinTest,
TestHashPartitioner, SOLR749Test, AnalyticsQueryTest, TimeZoneUtilsTest,
OutOfBoxZkACLAndCredentialsProvidersTest, UUIDUpdateProcessorFallbackTest,
SolrCloudExampleTest, AliasIntegrationTest, BufferStoreTest,
SortByFunctionTest, VMParamsZkACLAndCredentialsProvidersTest,
ConcurrentDeleteAndCreateCollectionTest, TestDFISimilarityFactory,
TestQueryTypes, TestHdfsUpdateLog, SolrIndexSplitterTest, TestStressRecovery,
TestConfigReload, DistributedDebugComponentTest, TestGeoJSONResponseWriter,
CollectionsAPIDistributedZkTest, OverseerTaskQueueTest,
DistributedFacetPivotLargeTest, AsyncMigrateRouteKeyTest,
TestPKIAuthenticationPlugin, SpellCheckCollatorTest, SolrInfoMBeanTest,
TestSweetSpotSimilarityFactory, BadCopyFieldTest, BasicAuthIntegrationTest,
TestSlowCompositeReaderWrapper, CdcrVersionReplicationTest]
[junit4] Completed [257/633 (1!)] on J1 in 482.07s, 1 test, 1 error <<<
FAILURES!
[...truncated 1203 lines...]
[junit4] JVM J1: stdout was not empty, see:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/temp/junit4-J1-20160927_203931_171.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] Dumping heap to
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/heapdumps/java_pid32150.hprof
...
[junit4] Heap dump file created [589938674 bytes in 8.826 secs]
[junit4] <<< JVM J1: EOF ----
[...truncated 11031 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:763: The
following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:715:
Some of the tests produced a heap dump, but did not fail. Maybe a suppressed
OutOfMemoryError? Dumps created:
* java_pid32150.hprof
Total time: 132 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
