[ 
https://issues.apache.org/jira/browse/SOLR-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153335#comment-16153335
 ] 

Amrit Sarkar commented on SOLR-11278:
-------------------------------------

More detailing,

{code}
  [beaster]   2> 76078 INFO  
(zkCallback-171-thread-1-processing-n:127.0.0.1:39903_solr) 
[n:127.0.0.1:39903_solr    ] o.a.s.h.CdcrProcessStateManager Received new CDCR 
process state from watcher: STARTED @ cdcr-source:shard1
  [beaster]   2> 76079 INFO  (qtp499216332-625) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.h.CdcrRequestHandler Boostrap is issued now. Request :: 
{action=BOOTSTRAP&qt=/cdcr&masterUrl=http://127.0.0.1:39903/solr/cdcr-source_shard1_replica_n1/&wt=javabin&version=2}
 : collection : cdcr-target
  [beaster]   2> 76079 INFO  (qtp499216332-625) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.h.CdcrRequestHandler bs runnable : 
org.apache.solr.handler.CdcrRequestHandler$$Lambda$256/1608384375@cfd51e6
  [beaster]   2> 76079 INFO  (qtp499216332-625) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.h.CdcrRequestHandler bs service : 
com.codahale.metrics.InstrumentedExecutorService@23aae09
  [beaster]   2> 76079 INFO  (qtp499216332-625) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.c.S.Request [cdcr-target_shard1_replica_n1]  webapp=/solr path=/cdcr 
params={qt=/cdcr&masterUrl=http://127.0.0.1:39903/solr/cdcr-source_shard1_replica_n1/&action=BOOTSTRAP&wt=javabin&version=2}
 status=0 QTime=0
  [beaster]   2> 76079 INFO  (qtp1089963867-718) [n:127.0.0.1:39903_solr 
c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] 
o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/cdcr 
params={qt=/cdcr&_stateVer_=cdcr-source:7&action=queues&wt=javabin&version=2} 
status=0 QTime=0
  [beaster]   1> Cdcr queue response: 
{responseHeader={status=0,QTime=0},queues={127.0.0.1:37043/solr={cdcr-target={queueSize=-1703936001,lastTimestamp=}}},tlogTotalSize=4773,tlogTotalCount=1,updateLogSynchronizer=stopped}
  [beaster]   2> 76081 INFO  (qtp499216332-629) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.u.DirectUpdateHandler2 start 
commit{_version_=1577620265858236416,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
  [beaster]   2> 76082 INFO  (qtp499216332-629) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
  [beaster]   2> 76082 INFO  
(updateExecutor-143-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler what the fuck is 
happening :: 
Thread[updateExecutor-143-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target 
r:core_node2,5,TGRP-CdcrBootstrapTest]
  [beaster]   2> 76083 INFO  
(updateExecutor-143-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler what' the lock this 
time :: true :: thread :: org.apache.solr.handler.CdcrRequestHandler@259eac66
  [beaster]   2> 76083 INFO  
(updateExecutor-143-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler we reached this 
point :: BOOTSTRAP will go on, locked :: true
  [beaster]   2> 76083 INFO  (qtp499216332-628) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.c.S.Request [cdcr-target_shard1_replica_n1]  webapp=/solr path=/cdcr 
params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin&version=2} status=0 QTime=0
  [beaster]   2> 76082 INFO  (qtp499216332-629) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
  [beaster]   2> 76083 INFO  (qtp499216332-629) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.c.S.Request [cdcr-target_shard1_replica_n1]  webapp=/solr path=/update 
params={_stateVer_=cdcr-target:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}
 status=0 QTime=2
  [beaster]   2> 76084 WARN  
(cdcr-bootstrap-status-177-thread-1-processing-n:127.0.0.1:39903_solr 
x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) 
[n:127.0.0.1:39903_solr c:cdcr-source s:shard1 r:core_node2 
x:cdcr-source_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager Bootstrap 
process was not found on target collection: cdcr-target shard: shard1, leader: 
http://127.0.0.1:42370/solr/cdcr-target_shard1_replica_n1/
  [beaster]   2> 76085 INFO  (qtp499216332-623) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.c.S.Request [cdcr-target_shard1_replica_n1]  webapp=/solr path=/select 
params={q=*:*&_stateVer_=cdcr-target:4&wt=javabin&version=2} hits=0 status=0 
QTime=0
  [beaster]   2> 76085 INFO  
(TEST-CdcrBootstrapTest.testConvertClusterToCdcrAndBootstrap-seed#[950E76D71DFD418])
 [    ] o.a.s.c.CdcrBootstrapTest numDocs found for now :: 1 :: 0
  [beaster]   2> 76085 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.u.UpdateLog Starting to buffer updates. 
FSUpdateLog{state=ACTIVE, tlog=null}
  [beaster]   2> 76092 INFO  
(cdcr-bootstrap-status-177-thread-1-processing-n:127.0.0.1:39903_solr 
x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) 
[n:127.0.0.1:39903_solr c:cdcr-source s:shard1 r:core_node2 
x:cdcr-source_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager Attempting to 
bootstrap target collection: cdcr-target shard: shard1 leader: 
http://127.0.0.1:42370/solr/cdcr-target_shard1_replica_n1/
  [beaster]   2> 76093 INFO  (qtp499216332-627) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.h.CdcrRequestHandler Boostrap is issued now. Request :: 
{action=BOOTSTRAP&qt=/cdcr&masterUrl=http://127.0.0.1:39903/solr/cdcr-source_shard1_replica_n1/&wt=javabin&version=2}
 : collection : cdcr-target
  [beaster]   2> 76093 INFO  (qtp499216332-627) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.h.CdcrRequestHandler bs runnable : 
org.apache.solr.handler.CdcrRequestHandler$$Lambda$256/1608384375@785b9b5f
  [beaster]   2> 76093 INFO  (qtp499216332-627) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.h.CdcrRequestHandler bs service : 
com.codahale.metrics.InstrumentedExecutorService@23aae09
  [beaster]   2> 76094 INFO  (qtp1089963867-721) [n:127.0.0.1:39903_solr 
c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] 
o.a.s.u.DirectUpdateHandler2 start 
commit{_version_=1577620265871867904,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
  [beaster]   2> 76094 INFO  (qtp499216332-627) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.c.S.Request [cdcr-target_shard1_replica_n1]  webapp=/solr path=/cdcr 
params={qt=/cdcr&masterUrl=http://127.0.0.1:39903/solr/cdcr-source_shard1_replica_n1/&action=BOOTSTRAP&wt=javabin&version=2}
 status=0 QTime=0
  [beaster]   2> 76100 INFO  (qtp1089963867-721) [n:127.0.0.1:39903_solr 
c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
  [beaster]   2> 76101 INFO  (qtp1089963867-721) [n:127.0.0.1:39903_solr 
c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
  [beaster]   2> 76102 INFO  (qtp1089963867-721) [n:127.0.0.1:39903_solr 
c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] 
o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update 
params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&commit_end_point=true&wt=javabin&version=2}
 status=0 QTime=8
  [beaster]   2> 76102 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler boostrap callable 
closed :: false
  [beaster]   2> 76104 INFO  
(updateExecutor-143-thread-2-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler what the fuck is 
happening :: 
Thread[updateExecutor-143-thread-2-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target 
r:core_node2,5,TGRP-CdcrBootstrapTest]
  [beaster]   2> 76104 INFO  
(updateExecutor-143-thread-2-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler what' the lock this 
time :: false :: thread :: org.apache.solr.handler.CdcrRequestHandler@259eac66
  [beaster]   2> 76104 INFO  
(updateExecutor-143-thread-2-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler we reached this 
point :: CANCEL BOOTSTRAP, locked :: false
  [beaster]   2> 76104 INFO  
(updateExecutor-143-thread-2-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler someone called me, 
yes they did
  [beaster]   2> 76104 INFO  (qtp1089963867-722) [n:127.0.0.1:39903_solr 
c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] 
o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr 
path=/replication 
params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 
QTime=0
  [beaster]   2> 76104 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Master's generation: 12
  [beaster]   2> 76104 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Master's version: 
1504535923111
  [beaster]   2> 76105 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Slave's generation: 1
  [beaster]   2> 76105 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Slave's version: 0
  [beaster]   2> 76105 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Starting replication 
process
  [beaster]   2> 76111 INFO  (qtp1089963867-722) [n:127.0.0.1:39903_solr 
c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] 
o.a.s.h.ReplicationHandler Adding tlog files to list: [{size=4773, 
name=tlog.0000000000000000009}]
  [beaster]   2> 76111 INFO  (qtp1089963867-722) [n:127.0.0.1:39903_solr 
c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] 
o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr 
path=/replication 
params={generation=12&qt=/replication&wt=javabin&version=2&command=filelist} 
status=0 QTime=5
  [beaster]   2> 76111 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Number of files in latest 
index in master: 13
  [beaster]   2> 76111 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Number of tlog files in 
master: 1
  [beaster]   2> 76112 INFO  (qtp499216332-622) [n:127.0.0.1:42370_solr 
c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] 
o.a.s.c.S.Request [cdcr-target_shard1_replica_n1]  webapp=/solr path=/cdcr 
params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin&version=2} status=0 QTime=0
  [beaster]   2> 76113 INFO  
(cdcr-bootstrap-status-177-thread-1-processing-n:127.0.0.1:39903_solr 
x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) 
[n:127.0.0.1:39903_solr c:cdcr-source s:shard1 r:core_node2 
x:cdcr-source_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager CDCR bootstrap 
running for 1 seconds, sleeping for 2000 ms
  [beaster]   2> 76119 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.u.DefaultSolrCoreState New IndexWriter 
is ready to be used.
  [beaster]   2> 76119 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Starting download 
(fullCopy=false) to MockDirectoryWrapper(RAMDirectory@1ec60471 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b16e27d)
  [beaster]   2> 76120 INFO  (qtp1089963867-723) [n:127.0.0.1:39903_solr 
c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] 
o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr 
path=/replication 
params={generation=12&qt=/replication&file=_a_Lucene50_0.pos&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
  [beaster]   2> 76122 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.u.DefaultSolrCoreState New IndexWriter 
is ready to be used.
  [beaster]   2> 76122 ERROR 
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher User aborted Replication
  [beaster]   2> 76122 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler boostrap callable 
status :: false
  [beaster]   2> 76122 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler boostrap callable 
closed :: true
  [beaster]   2> 76122 ERROR 
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler fetch failed for 
bootstrap :: org.apache.solr.handler.IndexFetcher$ReplicationHandlerException: 
User aborted replication
{code}

First time the Bootstrap is called, it checks whether the BOOTSTRAP is started 
or not.

{code}
[beaster]   2> 76084 WARN  
(cdcr-bootstrap-status-177-thread-1-processing-n:127.0.0.1:39903_solr 
x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) 
[n:127.0.0.1:39903_solr c:cdcr-source s:shard1 r:core_node2 
x:cdcr-source_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager Bootstrap 
process was not found on target collection: cdcr-target shard: shard1, leader: 
http://127.0.0.1:42370/solr/cdcr-target_shard1_replica_n1/
{code}

and then attempts to starts BOOTSTRAP again. Please MIND, the first call is 
still in play and second one is called too ::

{code}
 [beaster]   2> 76092 INFO  
(cdcr-bootstrap-status-177-thread-1-processing-n:127.0.0.1:39903_solr 
x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) 
[n:127.0.0.1:39903_solr c:cdcr-source s:shard1 r:core_node2 
x:cdcr-source_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager Attempting to 
bootstrap target collection: cdcr-target shard: shard1 leader: 
http://127.0.0.1:42370/solr/cdcr-target_shard1_replica_n1/
{code}

Replication begins successfully:

{code}
  [beaster]   2> 76105 INFO  
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Starting replication 
process
{code}

but in the end: its gets aborted saying "Uber aborted .......". THIS ABORT is 
due to CANCEL_BOOTSTRAP called by 2nd thread.

{code}
  [beaster]   2> 76122 ERROR 
(recoveryExecutor-144-thread-1-processing-n:127.0.0.1:42370_solr 
x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
[n:127.0.0.1:42370_solr c:cdcr-target s:shard1 r:core_node2 
x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler fetch failed for 
bootstrap :: org.apache.solr.handler.IndexFetcher$ReplicationHandlerException: 
User aborted replication
{code}

> CdcrBootstrapTest failing intermittently
> ----------------------------------------
>
>                 Key: SOLR-11278
>                 URL: https://issues.apache.org/jira/browse/SOLR-11278
>             Project: Solr
>          Issue Type: Bug
>      Security Level: Public(Default Security Level. Issues are Public) 
>          Components: CDCR
>    Affects Versions: 7.0, 6.6.1
>            Reporter: Amrit Sarkar
>            Assignee: Varun Thacker
>            Priority: Critical
>              Labels: test
>         Attachments: master-bs.patch, SOLR-11278-awaits-fix.patch, 
> SOLR-11278-cancel-bootstrap-on-stop.patch, SOLR-11278.patch, test_results
>
>
> {{CdcrBootstrapTest}} is failing while running beasts for significant 
> iterations.
> The bootstrapping is failing in the test, after the first batch is indexed 
> for each {{testmethod}}, which results in documents mismatch ::
> {code}
>   [beaster]   2> 39167 ERROR 
> (updateExecutor-39-thread-1-processing-n:127.0.0.1:42155_solr 
> x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) 
> [n:127.0.0.1:42155_solr c:cdcr-target s:shard1 r:core_node2 
> x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler Bootstrap 
> operation failed
>   [beaster]   2> java.util.concurrent.ExecutionException: 
> java.lang.AssertionError
>   [beaster]   2>      at 
> java.util.concurrent.FutureTask.report(FutureTask.java:122)
>   [beaster]   2>      at 
> java.util.concurrent.FutureTask.get(FutureTask.java:192)
>   [beaster]   2>      at 
> org.apache.solr.handler.CdcrRequestHandler.lambda$handleBootstrapAction$0(CdcrRequestHandler.java:654)
>   [beaster]   2>      at 
> com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
>   [beaster]   2>      at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>   [beaster]   2>      at 
> java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   [beaster]   2>      at 
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
>   [beaster]   2>      at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   [beaster]   2>      at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   [beaster]   2>      at java.lang.Thread.run(Thread.java:748)
>   [beaster]   2> Caused by: java.lang.AssertionError
>   [beaster]   2>      at 
> org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:813)
>   [beaster]   2>      at 
> org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:724)
>   [beaster]   2>      at 
> com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
>   [beaster]   2>      ... 5 more
> {code}
> {code}
>   [beaster] [01:37:16.282] FAILURE  153s | 
> CdcrBootstrapTest.testBootstrapWithSourceCluster <<<
>   [beaster]    > Throwable #1: java.lang.AssertionError: Document mismatch on 
> target after sync expected:<2000> but was:<1000>
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to