Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.11/475/

2 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.api.collections.HdfsCloudIncrementalBackupTest

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.cloud.api.collections.HdfsCloudIncrementalBackupTest:     1) 
Thread[id=21898, name=Command processor, state=WAITING, 
group=TGRP-HdfsCloudIncrementalBackupTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
org.apache.hadoop.hdfs.server.datanode.BPServiceActor$CommandProcessingThread.processQueue(BPServiceActor.java:1291)
         at 
org.apache.hadoop.hdfs.server.datanode.BPServiceActor$CommandProcessingThread.run(BPServiceActor.java:1275)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.api.collections.HdfsCloudIncrementalBackupTest: 
   1) Thread[id=21898, name=Command processor, state=WAITING, 
group=TGRP-HdfsCloudIncrementalBackupTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
org.apache.hadoop.hdfs.server.datanode.BPServiceActor$CommandProcessingThread.processQueue(BPServiceActor.java:1291)
        at 
org.apache.hadoop.hdfs.server.datanode.BPServiceActor$CommandProcessingThread.run(BPServiceActor.java:1275)
        at __randomizedtesting.SeedInfo.seed([1A2ACDBCF38C027E]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest:     
1) Thread[id=34890, name=Command processor, state=WAITING, 
group=TGRP-HdfsBackupRepositoryIntegrationTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
org.apache.hadoop.hdfs.server.datanode.BPServiceActor$CommandProcessingThread.processQueue(BPServiceActor.java:1291)
         at 
org.apache.hadoop.hdfs.server.datanode.BPServiceActor$CommandProcessingThread.run(BPServiceActor.java:1275)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at 
org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest: 
   1) Thread[id=34890, name=Command processor, state=WAITING, 
group=TGRP-HdfsBackupRepositoryIntegrationTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
org.apache.hadoop.hdfs.server.datanode.BPServiceActor$CommandProcessingThread.processQueue(BPServiceActor.java:1291)
        at 
org.apache.hadoop.hdfs.server.datanode.BPServiceActor$CommandProcessingThread.run(BPServiceActor.java:1275)
        at __randomizedtesting.SeedInfo.seed([1A2ACDBCF38C027E]:0)




Build Log:
[...truncated 15349 lines...]
   [junit4] Suite: 
org.apache.solr.cloud.api.collections.HdfsCloudIncrementalBackupTest
   [junit4]   2> 1673488 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to 
test-framework derived value of 
'/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.11/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 1673488 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1673489 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.a.s.u.ErrorLogMuter Closing ErrorLogMuter-regex-20900 after mutting 0 log 
messages
   [junit4]   2> 1673489 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.a.s.u.ErrorLogMuter Creating ErrorLogMuter-regex-20901 for ERROR logs 
matching regex: ignore_exception
   [junit4]   2> 1673490 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Created dataDir: 
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.11/solr/build/solr-core/test/J3/temp/solr.cloud.api.collections.HdfsCloudIncrementalBackupTest_1A2ACDBCF38C027E-001/data-dir-158-001
   [junit4]   2> 1673490 WARN  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=5 numCloses=5
   [junit4]   2> 1673490 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1673492 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1673492 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.a.s.c.SolrCloudTestCase Using per-replica state
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 1673578 WARN  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.a.h.s.a.s.AuthenticationFilter Unable to initialize FileSignerSecretProvider, 
falling back to use random secrets. Reason: access denied 
("java.io.FilePermission" "/home/jenkins/hadoop-http-auth-signature-secret" 
"read")
   [junit4]   2> 1673578 WARN  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1673580 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.e.j.s.Server jetty-9.4.53.v20231009; built: 2023-10-09T12:29:09.265Z; git: 
27bde00a0b95a1d5bbee0eae7984f891d2d0f8c9; jvm 1.8.0_362-b09
   [junit4]   2> 1673582 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1673582 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1673582 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1673583 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@4a3555c8{static,/static,jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-3.2.4-tests.jar!/webapps/static,AVAILABLE}
   [junit4]   2> 1673785 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.w.WebAppContext@6af22195{hdfs,/,file:///home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.11/solr/build/solr-core/test/J3/temp/jetty-localhost_localdomain-45267-hadoop-hdfs-3_2_4-tests_jar-_-any-2441846429320915049/webapp/,AVAILABLE}{jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-3.2.4-tests.jar!/webapps/hdfs}
   [junit4]   2> 1673786 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@26cf3f0f{HTTP/1.1, 
(http/1.1)}{localhost.localdomain:45267}
   [junit4]   2> 1673786 INFO  
(SUITE-HdfsCloudIncrementalBackupTest-seed#[1A2ACDBCF38C027E]-worker) [     ] 
o.e.j.s.Server Started @1673862ms
   [junit4]   2> 1674006 WARN  (Listener at localhost.localdomain/38245) [     
] o.a.h.s.a.s.AuthenticationFilter Unable to initialize 
FileSignerSecretProvider, falling back to use random secrets. Reason: access 
denied ("java.io.FilePermission" 
"/home/jenkins/hadoop-http-auth-signature-secret" "read")
   [junit4]   2> 1674006 WARN  (Listener at localhost.localdomain/38245) [     
] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1674008 INFO  (Listener at localhost.localdomain/38245) [     
] o.e.j.s.Server jetty-9.4.53.v20231009; built: 2023-10-09T12:29:09.265Z; git: 
27bde00a0b95a1d5bbee0eae7984f891d2d0f8c9; jvm 1.8.0_362-b09
   [junit4]   2> 1674033 INFO  (Listener at localhost.localdomain/38245) [     
] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1674033 INFO  (Listener at localhost.localdomain/38245) [     
] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1674033 INFO  (Listener at localhost.localdomain/38245) [     
] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1674036 INFO  (Listener at localhost.localdomain/38245) [     
] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@289bbf15{static,/static,jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-3.2.4-tests.jar!/webapps/static,AVAILABLE}
   [junit4]   2> 1674201 INFO  (Listener at localhost.localdomain/38245) [     
] o.e.j.s.h.ContextHandler Started 
o.e.j.w.WebAppContext@13d25e79{datanode,/,file:///home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.11/solr/build/solr-core/test/J3/temp/jetty-localhost-36359-hadoop-hdfs-3_2_4-tests_jar-_-any-4916426075569258204/webapp/,AVAILABLE}{jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-3.2.4-tests.jar!/webapps/datanode}
   [junit4]   2> 1674201 INFO  (Listener at localhost.localdomain/38245) [     
] o.e.j.s.AbstractConnector Started ServerConnector@3ca2c95a{HTTP/1.1, 
(http/1.1)}{localhost:36359}
   [junit4]   2> 1674202 INFO  (Listener at localhost.localdomain/38245) [     
] o.e.j.s.Server Started @1674278ms
   [junit4]   2> 1674248 WARN  (Listener at localhost.localdomain/42789) [     
] o.a.h.s.a.s.AuthenticationFilter Unable to initialize 
FileSignerSecretProvider, falling back to use random secrets. Reason: access 
denied ("java.io.FilePermission" 
"/home/jenkins/hadoop-http-auth-signature-secret" "read")
   [junit4]   2> 1674249 WARN  (Listener at localhost.localdomain/42789) [     
] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1674251 INFO  (Listener at localhost.localdomain/42789) [     
] o.e.j.s.Server jetty-9.4.53.v20231009; built: 2023-10-09T12:29:09.265Z; git: 
27bde00a0b95a1d5bbee0eae7984f891d2d0f8c9; jvm 1.8.0_362-b09
   [junit4]   2> 1674256 INFO  (Listener at localhost.localdomain/42789) [     
] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1674256 INFO  (Listener at localhost.localdomain/42789) [     
] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1674256 INFO  (Listener at localhost.localdomain/42789) [     
] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1674256 INFO  (Listener at localhost.localdomain/42789) [     
] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@4e90014e{static,/static,jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-3.2.4-tests.jar!/webapps/static,AVAILABLE}
   [junit4]   2> 1674390 INFO  (Listener at localhost.localdomain/42789) [     
] o.e.j.s.h.ContextHandler Started 
o.e.j.w.WebAppContext@6a3ad7e8{datanode,/,file:///home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.11/solr/build/solr-core/test/J3/temp/jetty-localhost-39499-hadoop-hdfs-3_2_4-tests_jar-_-any-8329941820071428295/webapp/,AVAILABLE}{jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-3.2.4-tests.jar!/webapps/datanode}
   [junit4]   2> 1674393 INFO  (Listener at localhost.localdomain/42789) [     
] o.e.j.s.AbstractConnector Started ServerConnector@6f1d5e89{HTTP/1.1, 
(http/1.1)}{localhost:39499}
   [junit4]   2> 1674393 INFO  (Listener at localhost.localdomain/42789) [     
] o.e.j.s.Server Started @1674469ms
   [junit4]   2> 1674424 INFO  (Block report processor) [     ] 
BlockStateChange BLOCK* processReport 0x59696bdfe0e87a0d: Processing first 
storage report for DS-5280e8bc-e921-4175-ad08-32e3210c47cc from datanode 
DatanodeRegistration(127.0.0.1:36965, 
datanodeUuid=6e3ea3b5-cd4b-46fa-8afd-be451985537b, infoPort=45257, 
infoSecurePort=0, ipcPort=42789, 
storageInfo=lv=-57;cid=testClusterID;nsid=22935639;c=1706281364735)
   [junit4]   2> 1674424 INFO  (Block report processor) [     ] 
BlockStateChange BLOCK* processReport 0x59696bdfe0e87a0d: from storage 
DS-5280e8bc-e921-4175-ad08-32e3210c47cc node 
DatanodeRegistration(127.0.0.1:36965, 
datanodeUuid=6e3ea3b5-cd4b-46fa-8afd-be451985537b, infoPort=45257, 
infoSecurePort=0, ipcPort=42789, 
storageInfo=lv=-57;cid=testClusterID;nsid=22935639;c=1706281364735), blocks: 0, 
hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0
   [junit4]   2> 1674425 INFO  (Block report processor) [     ] 
BlockStateChange BLOCK* processReport 0x59696bdfe0e87a0d: Processing first 
storage report for DS-8adf0761-d419-4d91-a590-6d038b63b866 from datanode 
DatanodeRegistration(127.0.0.1:36965, 
datanodeUuid=6e3ea3b5-cd4b-46fa-8afd-be451985537b, infoPort=45257, 
infoSecurePort=0, ipcPort=42789, 
storageInfo=lv=-57;cid=testClusterID;nsid=22935639;c=1706281364735)
   [junit4]   2> 1674425 INFO  (Block report processor) [     ] 
BlockStateChange BLOCK* processReport 0x59696bdfe0e87a0d: from storage 
DS-8adf0761-d419-4d91-a590-6d038b63b866 node 
DatanodeRegistration(127.0.0.1:36965, 
datanodeUuid=6e3ea3b5-cd4b-46fa-8afd-be451985537b, infoPort=45257, 
infoSecurePort=0, ipcPort=42789, 
storageInfo=lv=-57;cid=testClusterID;nsid=22935639;c=1706281364735), blocks: 0, 
hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0
   [junit4]   2> 1674546 INFO  (Block report processor) [     ] 
BlockStateChange BLOCK* processReport 0xa59ceba6a57090ef: Processing first 
storage report for DS-60a23dcc-b4eb-41f8-b195-239acda2f328 from datanode 
DatanodeRegistration(127.0.0.1:37639, 
datanodeUuid=439f3ad4-5577-41ec-8a0d-22bfddc28b19, infoPort=39249, 
infoSecurePort=0, ipcPort=33031, 
storageInfo=lv=-57;cid=testClusterID;nsid=22935639;c=1706281364735)
   [junit4]   2> 1674546 INFO  (Block report processor) [     ] 
BlockStateChange BLOCK* processReport 0xa59ceba6a57090ef: from storage 
DS-60a23dcc-b4eb-41f8-b195-239acda2f328 node 
DatanodeRegistration(127.0.0.1:37639, 
datanodeUuid=439f3ad4-5577-41ec-8a0d-22bfddc28b19, infoPort=39249, 
infoSecurePort=0, ipcPort=33031, 
storageInfo=lv=-57;cid=testClusterID;nsid=22935639;c=1706281364735), blocks: 0, 
hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0
   [junit4]   2> 1674547 INFO  (Block report processor) [     ] 
BlockStateChange BLOCK* processReport 0xa59ceba6a57090ef: Processing first 
storage report for DS-aba8bc4a-8038-4662-85ec-a3c688c2a5ef from datanode 
DatanodeRegistration(127.0.0.1:37639, 
datanodeUuid=439f3ad4-5577-41ec-8a0d-22bfddc28b19, infoPort=39249, 
infoSecurePort=0, ipcPort=33031, 
storageInfo=lv=-57;cid=testClusterID;nsid=22935639;c=1706281364735)
   [junit4]   2> 1674547 INFO  (Block report processor) [     ] 
BlockStateChange BLOCK* processReport 0xa59ceba6a57090ef: from storage 
DS-aba8bc4a-8038-4662-85ec-a3c688c2a5ef node 
DatanodeRegistration(127.0.0.1:37639, 
datanodeUuid=439f3ad4-5577-41ec-8a0d-22bfddc28b19, infoPort=39249, 
infoSecurePort=0, ipcPort=33031, 
storageInfo=lv=-57;cid=testClusterID;nsid=22935639;c=1706281364735), blocks: 0, 
hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0
   [junit4]   2> 1674644 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in 
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.11/solr/build/solr-core/test/J3/temp/solr.cloud.api.collections.HdfsCloudIncrementalBackupTest_1A2ACDBCF38C027E-001/tempDir-002
   [junit4]   2> 1674644 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1674645 INFO  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 1674645 INFO  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1674646 WARN  (ZkTestServer Run Thread) [     ] 
o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 1674745 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.ZkTestServer start zk server on port: 42221
   [junit4]   2> 1674745 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:42221
   [junit4]   2> 1674745 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:42221
   [junit4]   2> 1674745 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.ZkTestServer connecting to 127.0.0.1 42221
   [junit4]   2> 1674747 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1674749 INFO  (zkConnectionManagerCallback-13839-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1674749 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1674752 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1674754 INFO  (zkConnectionManagerCallback-13841-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1674754 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1674754 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1674755 INFO  (zkConnectionManagerCallback-13843-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1674755 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1674858 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1674858 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1674858 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1674858 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1674858 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.e.j.s.Server jetty-9.4.53.v20231009; built: 2023-10-09T12:29:09.265Z; git: 
27bde00a0b95a1d5bbee0eae7984f891d2d0f8c9; jvm 1.8.0_362-b09
   [junit4]   2> 1674858 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.e.j.s.Server jetty-9.4.53.v20231009; built: 2023-10-09T12:29:09.265Z; git: 
27bde00a0b95a1d5bbee0eae7984f891d2d0f8c9; jvm 1.8.0_362-b09
   [junit4]   2> 1674867 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1674867 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1674867 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1674867 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@16e92ead{/solr,null,AVAILABLE}
   [junit4]   2> 1674867 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1674867 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1674867 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@2d42ed40{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:46567}
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@c1b52d2{/solr,null,AVAILABLE}
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.e.j.s.Server Started @1674944ms
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
zkHost=127.0.0.1:42221/solr, hostPort=46567}
   [junit4]   2> 1674868 ERROR (jetty-launcher-13844-thread-1) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.11.3
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@1a735c85{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:33041}
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.11/solr
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.e.j.s.Server Started @1674944ms
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2024-01-26T15:02:46.090Z
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
zkHost=127.0.0.1:42221/solr, hostPort=33041}
   [junit4]   2> 1674868 ERROR (jetty-launcher-13844-thread-2) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.11.3
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.11/solr
   [junit4]   2> 1674868 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2024-01-26T15:02:46.090Z
   [junit4]   2> 1674869 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1674869 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1674870 INFO  (zkConnectionManagerCallback-13846-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1674870 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1674870 INFO  (zkConnectionManagerCallback-13848-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1674870 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1674871 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1674871 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1674901 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2573a914, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1674902 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2573a914, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 1675745 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1675746 WARN  (jetty-launcher-13844-thread-1) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@777fd7cf[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1675746 WARN  (jetty-launcher-13844-thread-1) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@777fd7cf[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1675749 WARN  (jetty-launcher-13844-thread-1) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@66b993b8[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1675749 WARN  (jetty-launcher-13844-thread-1) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@66b993b8[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1675750 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42221/solr
   [junit4]   2> 1675751 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1675752 INFO  (zkConnectionManagerCallback-13862-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1675752 INFO  (jetty-launcher-13844-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1675753 WARN  
(jetty-launcher-13844-thread-1-SendThread(127.0.0.1:42221)) [     ] 
o.a.z.ClientCnxn An exception was thrown while closing send thread for session 
0x10019495cd10005.
   [junit4]   2>           => EndOfStreamException: Unable to read additional 
data from server sessionid 0x10019495cd10005, likely server has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable 
to read additional data from server sessionid 0x10019495cd10005, likely server 
has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) 
~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
 ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) 
[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1675854 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 1675855 INFO  (zkConnectionManagerCallback-13864-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1675855 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 1675929 WARN  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.ZkController Contents of zookeeper 
/security.json are world-readable; consider setting up ACLs as described in 
https://solr.apache.org/guide/zookeeper-access-control.html
   [junit4]   2> 1675933 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:46567_solr
   [junit4]   2> 1675933 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.Overseer Overseer 
(id=72085396918435846-127.0.0.1:46567_solr-n_0000000000) starting
   [junit4]   2> 1675950 INFO  
(OverseerStateUpdate-72085396918435846-127.0.0.1:46567_solr-n_0000000000) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:46567_solr
   [junit4]   2> 1675958 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:46567_solr
   [junit4]   2> 1675960 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.ZkController non-data nodes now []
   [junit4]   2> 1675961 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 1675961 WARN  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.CoreContainer Not all security plugins 
configured!  authentication=disabled authorization=disabled.  Solr is only as 
secure as you make it. Consider configuring authentication/authorization before 
exposing Solr to users internal or external.  See 
https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1675961 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.b.r.BackupRepositoryFactory Added backup 
repository with configuration params {type = repository,name = 
trackingBackupRepository,class = 
org.apache.solr.core.TrackingBackupRepository,attributes = {default=true, 
name=trackingBackupRepository, 
class=org.apache.solr.core.TrackingBackupRepository},args = 
{delegateRepoName=hdfs}}
   [junit4]   2> 1675961 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.b.r.BackupRepositoryFactory Added backup 
repository with configuration params {type = repository,name = hdfs,class = 
org.apache.solr.core.backup.repository.HdfsBackupRepository,attributes = 
{name=hdfs, 
class=org.apache.solr.core.backup.repository.HdfsBackupRepository},args = 
{location=/backup,solr.hdfs.home=hdfs://localhost.localdomain:38245/solr,solr.hdfs.confdir=}}
   [junit4]   2> 1675961 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.b.r.BackupRepositoryFactory Default 
configuration for backup repository is with configuration params {type = 
repository,name = trackingBackupRepository,class = 
org.apache.solr.core.TrackingBackupRepository,attributes = {default=true, 
name=trackingBackupRepository, 
class=org.apache.solr.core.TrackingBackupRepository},args = 
{delegateRepoName=hdfs}}
   [junit4]   2> 1675966 INFO  (zkCallback-13863-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1676023 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 1676052 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2573a914
   [junit4]   2> 1676071 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2573a914
   [junit4]   2> 1676071 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2573a914
   [junit4]   2> 1676073 INFO  (jetty-launcher-13844-thread-1) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.11/solr/build/solr-core/test/J3/temp/solr.cloud.api.collections.HdfsCloudIncrementalBackupTest_1A2ACDBCF38C027E-001/tempDir-002/node1
   [junit4]   2> 1676378 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1676379 WARN  (jetty-launcher-13844-thread-2) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@5f62d189[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1676379 WARN  (jetty-launcher-13844-thread-2) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@5f62d189[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1676382 WARN  (jetty-launcher-13844-thread-2) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@163cb26[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1676382 WARN  (jetty-launcher-13844-thread-2) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@163cb26[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1676383 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42221/solr
   [junit4]   2> 1676384 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1676384 INFO  (zkConnectionManagerCallback-13884-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1676384 INFO  (jetty-launcher-13844-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1676498 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 1676509 INFO  (zkConnectionManagerCallback-13886-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1676509 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 1676515 WARN  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.c.ZkController Contents of zookeeper 
/security.json are world-readable; consider setting up ACLs as described in 
https://solr.apache.org/guide/zookeeper-access-control.html
   [junit4]   2> 1676516 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1676521 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.c.ZkController Publish 
node=127.0.0.1:33041_solr as DOWN
   [junit4]   2> 1676521 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient core cache for max 2147483647 cores with initial capacity of 1024
   [junit4]   2> 1676521 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:33041_solr
   [junit4]   2> 1676524 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.c.ZkController non-data nodes now []
   [junit4]   2> 1676526 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 1676526 WARN  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.c.CoreContainer Not all security plugins 
configured!  authentication=disabled authorization=disabled.  Solr is only as 
secure as you make it. Consider configuring authentication/authorization before 
exposing Solr to users internal or external.  See 
https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1676526 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.c.b.r.BackupRepositoryFactory Added backup 
repository with configuration params {type = repository,name = 
trackingBackupRepository,class = 
org.apache.solr.core.TrackingBackupRepository,attributes = {default=true, 
name=trackingBackupRepository, 
class=org.apache.solr.core.TrackingBackupRepository},args = 
{delegateRepoName=hdfs}}
   [junit4]   2> 1676526 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.c.b.r.BackupRepositoryFactory Added backup 
repository with configuration params {type = repository,name = hdfs,class = 
org.apache.solr.core.backup.repository.HdfsBackupRepository,attributes = 
{name=hdfs, 
class=org.apache.solr.core.backup.repository.HdfsBackupRepository},args = 
{location=/backup,solr.hdfs.home=hdfs://localhost.localdomain:38245/solr,solr.hdfs.confdir=}}
   [junit4]   2> 1676526 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.c.b.r.BackupRepositoryFactory Default 
configuration for backup repository is with configuration params {type = 
repository,name = trackingBackupRepository,class = 
org.apache.solr.core.TrackingBackupRepository,attributes = {default=true, 
name=trackingBackupRepository, 
class=org.apache.solr.core.TrackingBackupRepository},args = 
{delegateRepoName=hdfs}}
   [junit4]   2> 1676554 INFO  (zkCallback-13863-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1676554 INFO  (zkCallback-13885-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1676562 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 1676589 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2573a914
   [junit4]   2> 1676601 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2573a914
   [junit4]   2> 1676601 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2573a914
   [junit4]   2> 1676602 INFO  (jetty-launcher-13844-thread-2) 
[n:127.0.0.1:33041_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.11/solr/build/solr-core/test/J3/temp/solr.cloud.api.collections.HdfsCloudIncrementalBackupTest_1A2ACDBCF38C027E-001/tempDir-002/node2
   [junit4]   2> 1676644 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
   [junit4]   2> 1676645 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1676655 INFO  (zkConnectionManagerCallback-13899-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1676655 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1676659 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1676660 INFO  (Listener at localhost.localdomain/33031) [     
] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42221/solr ready
   [junit4]   2> 1676714 INFO  
(TEST-HdfsCloudIncrementalBackupTest.testSimple-seed#[1A2ACDBCF38C027E]) [     
] o.a.s.SolrTestCaseJ4 ###Starting testSimple
   [junit4]   2> 1676717 INFO  (qtp347385955-22010) [n:127.0.0.1:33041_solr     
] o.a.s.s.HttpSolrCall 
HttpSolrCall.init(http://127.0.0.1:33041/solr/admin/collections?action=CREATE&name=hdfsbackuprestore_testbackupincsimple&collection.configName=conf1&numShards=2&nrtReplicas=1&wt=javabin&version=2)
   [junit4]   2> 1676720 INFO  
(OverseerThreadFactory-13871-thread-1-processing-n:127.0.0.1:46567_solr) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection 
hdfsbackuprestore_testbackupincsimple
   [junit4]   2> 1676828 INFO  
(OverseerStateUpdate-72085396918435846-127.0.0.1:46567_solr-n_0000000000) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"hdfsbackuprestore_testbackupincsimple",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   
"core":"hdfsbackuprestore_testbackupincsimple_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "node_name":"127.0.0.1:46567_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:46567/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1676830 INFO  
(OverseerStateUpdate-72085396918435846-127.0.0.1:46567_solr-n_0000000000) 
[n:127.0.0.1:46567_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"hdfsbackuprestore_testbackupincsimple",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   
"core":"hdfsbackuprestore_testbackupincsimple_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "node_name":"127.0.0.1:33041_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:33041/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1677034 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr     
] o.a.s.s.HttpSolrCall 
HttpSolrCall.init(http://127.0.0.1:46567/solr/admin/cores?null)
   [junit4]   2> 1677034 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr    
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=hdfsbackuprestore_testbackupincsimple_shard1_replica_n1&action=CREATE&numShards=2&collection=hdfsbackuprestore_testbackupincsimple&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1677035 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr    
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient core cache for max 
2147483647 cores with initial capacity of 1024
   [junit4]   2> 1677039 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr     
] o.a.s.s.HttpSolrCall 
HttpSolrCall.init(http://127.0.0.1:33041/solr/admin/cores?null)
   [junit4]   2> 1677039 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr    
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf1&newCollection=true&name=hdfsbackuprestore_testbackupincsimple_shard2_replica_n2&action=CREATE&numShards=2&collection=hdfsbackuprestore_testbackupincsimple&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1677048 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 8.11.3
   [junit4]   2> 1677049 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 8.11.3
   [junit4]   2> 1677050 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] o.a.s.s.IndexSchema 
Schema name=minimal
   [junit4]   2> 1677051 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1677051 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.CoreContainer Creating SolrCore 
'hdfsbackuprestore_testbackupincsimple_shard1_replica_n1' using configuration 
from configset conf1, trusted=true
   [junit4]   2> 1677051 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] o.a.s.s.IndexSchema 
Schema name=minimal
   [junit4]   2> 1677051 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.hdfsbackuprestore_testbackupincsimple.shard1.replica_n1' (registry 
'solr.core.hdfsbackuprestore_testbackupincsimple.shard1.replica_n1') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@2573a914
   [junit4]   2> 1677051 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] o.a.s.c.SolrCore 
[[hdfsbackuprestore_testbackupincsimple_shard1_replica_n1] ] Opening new 
SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.11/solr/build/solr-core/test/J3/temp/solr.cloud.api.collections.HdfsCloudIncrementalBackupTest_1A2ACDBCF38C027E-001/tempDir-002/node1/hdfsbackuprestore_testbackupincsimple_shard1_replica_n1],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.11/solr/build/solr-core/test/J3/temp/solr.cloud.api.collections.HdfsCloudIncrementalBackupTest_1A2ACDBCF38C027E-001/tempDir-002/node1/hdfsbackuprestore_testbackupincsimple_shard1_replica_n1/data/]
   [junit4]   2> 1677051 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1677051 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.CoreContainer Creating SolrCore 
'hdfsbackuprestore_testbackupincsimple_shard2_replica_n2' using configuration 
from configset conf1, trusted=true
   [junit4]   2> 1677051 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.hdfsbackuprestore_testbackupincsimple.shard2.replica_n2' (registry 
'solr.core.hdfsbackuprestore_testbackupincsimple.shard2.replica_n2') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@2573a914
   [junit4]   2> 1677052 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] o.a.s.c.SolrCore 
[[hdfsbackuprestore_testbackupincsimple_shard2_replica_n2] ] Opening new 
SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.11/solr/build/solr-core/test/J3/temp/solr.cloud.api.collections.HdfsCloudIncrementalBackupTest_1A2ACDBCF38C027E-001/tempDir-002/node2/hdfsbackuprestore_testbackupincsimple_shard2_replica_n2],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.11/solr/build/solr-core/test/J3/temp/solr.cloud.api.collections.HdfsCloudIncrementalBackupTest_1A2ACDBCF38C027E-001/tempDir-002/node2/hdfsbackuprestore_testbackupincsimple_shard2_replica_n2/data/]
   [junit4]   2> 1677138 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1677138 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1677138 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1677138 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1677139 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1677139 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1677139 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1677139 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1677143 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1677144 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1677144 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1677144 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1789165692115746816
   [junit4]   2> 1677144 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1677145 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1677145 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1677145 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1789165692116795392
   [junit4]   2> 1677147 INFO  
(searcherExecutor-13901-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple s:shard1 
r:core_node3 x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.SolrCore [hdfsbackuprestore_testbackupincsimple_shard1_replica_n1]  
Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1677149 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.ZkShardTerms Successful update of terms at 
/collections/hdfsbackuprestore_testbackupincsimple/terms/shard1 to 
Terms{values={core_node3=0}, version=0}
   [junit4]   2> 1677149 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.ShardLeaderElectionContextBase make sure parent is created 
/collections/hdfsbackuprestore_testbackupincsimple/leaders/shard1
   [junit4]   2> 1677149 INFO  
(searcherExecutor-13903-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4) 
[n:127.0.0.1:33041_solr c:hdfsbackuprestore_testbackupincsimple s:shard2 
r:core_node4 x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.SolrCore [hdfsbackuprestore_testbackupincsimple_shard2_replica_n2]  
Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1677152 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1677152 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1677152 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:46567/solr/hdfsbackuprestore_testbackupincsimple_shard1_replica_n1/
   [junit4]   2> 1677152 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.ZkShardTerms Successful update of terms at 
/collections/hdfsbackuprestore_testbackupincsimple/terms/shard2 to 
Terms{values={core_node4=0}, version=0}
   [junit4]   2> 1677153 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1677153 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContextBase make sure parent is created 
/collections/hdfsbackuprestore_testbackupincsimple/leaders/shard2
   [junit4]   2> 1677153 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.SyncStrategy 
http://127.0.0.1:46567/solr/hdfsbackuprestore_testbackupincsimple_shard1_replica_n1/
 has no replicas
   [junit4]   2> 1677153 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node 
/collections/hdfsbackuprestore_testbackupincsimple/leaders/shard1/leader after 
winning as 
/collections/hdfsbackuprestore_testbackupincsimple/leader_elect/shard1/election/72085396918435846-core_node3-n_0000000000
   [junit4]   2> 1677155 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:46567/solr/hdfsbackuprestore_testbackupincsimple_shard1_replica_n1/
 shard1
   [junit4]   2> 1677157 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1677157 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1677157 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:33041/solr/hdfsbackuprestore_testbackupincsimple_shard2_replica_n2/
   [junit4]   2> 1677157 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1677158 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.SyncStrategy 
http://127.0.0.1:33041/solr/hdfsbackuprestore_testbackupincsimple_shard2_replica_n2/
 has no replicas
   [junit4]   2> 1677158 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node 
/collections/hdfsbackuprestore_testbackupincsimple/leaders/shard2/leader after 
winning as 
/collections/hdfsbackuprestore_testbackupincsimple/leader_elect/shard2/election/72085396918435848-core_node4-n_0000000000
   [junit4]   2> 1677163 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:33041/solr/hdfsbackuprestore_testbackupincsimple_shard2_replica_n2/
 shard2
   [junit4]   2> 1677265 INFO  (zkCallback-13885-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/hdfsbackuprestore_testbackupincsimple/state.json] for 
collection [hdfsbackuprestore_testbackupincsimple] has occurred - updating... 
(live nodes size: [2])
   [junit4]   2> 1677265 INFO  (zkCallback-13863-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/hdfsbackuprestore_testbackupincsimple/state.json] for 
collection [hdfsbackuprestore_testbackupincsimple] has occurred - updating... 
(live nodes size: [2])
   [junit4]   2> 1677266 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1677266 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1677270 INFO  (qtp347385955-22013) [n:127.0.0.1:33041_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf1&newCollection=true&name=hdfsbackuprestore_testbackupincsimple_shard2_replica_n2&action=CREATE&numShards=2&collection=hdfsbackuprestore_testbackupincsimple&shard=shard2&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=231
   [junit4]   2> 1677271 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=hdfsbackuprestore_testbackupincsimple_shard1_replica_n1&action=CREATE&numShards=2&collection=hdfsbackuprestore_testbackupincsimple&shard=shard1&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=236
   [junit4]   2> 1677273 INFO  (qtp347385955-22010) [n:127.0.0.1:33041_solr     
] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
45 seconds. Check all shard replicas
   [junit4]   2> 1677370 INFO  (zkCallback-13863-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/hdfsbackuprestore_testbackupincsimple/state.json] for 
collection [hdfsbackuprestore_testbackupincsimple] has occurred - updating... 
(live nodes size: [2])
   [junit4]   2> 1677370 INFO  (zkCallback-13885-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/hdfsbackuprestore_testbackupincsimple/state.json] for 
collection [hdfsbackuprestore_testbackupincsimple] has occurred - updating... 
(live nodes size: [2])
   [junit4]   2> 1677370 INFO  (zkCallback-13885-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/hdfsbackuprestore_testbackupincsimple/state.json] for 
collection [hdfsbackuprestore_testbackupincsimple] has occurred - updating... 
(live nodes size: [2])
   [junit4]   2> 1677370 INFO  (zkCallback-13863-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/hdfsbackuprestore_testbackupincsimple/state.json] for 
collection [hdfsbackuprestore_testbackupincsimple] has occurred - updating... 
(live nodes size: [2])
   [junit4]   2> 1677371 INFO  (qtp347385955-22010) [n:127.0.0.1:33041_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={collection.configName=conf1&name=hdfsbackuprestore_testbackupincsimple&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2}
 status=0 QTime=654
   [junit4]   2> 1677373 INFO  (qtp595920704-22008) [n:127.0.0.1:46567_solr     
] o.a.s.s.HttpSolrCall 
HttpSolrCall.init(http://127.0.0.1:46567/solr/hdfsbackuprestore_testbackupincsimple_shard1_replica_n1/update?wt=javabin&version=2)
   [junit4]   2> 1677373 INFO  (qtp347385955-22014) [n:127.0.0.1:33041_solr     
] o.a.s.s.HttpSolrCall 
HttpSolrCall.init(http://127.0.0.1:33041/solr/hdfsbackuprestore_testbackupincsimple_shard2_replica_n2/update?wt=javabin&version=2)
   [junit4]   2> 1677379 INFO  (qtp595920704-22008) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.ZkShardTerms Successful update of terms at 
/collections/hdfsbackuprestore_testbackupincsimple/terms/shard1 to 
Terms{values={core_node3=1}, version=1}
   [junit4]   2> 1677379 INFO  (qtp347385955-22014) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.ZkShardTerms Successful update of terms at 
/collections/hdfsbackuprestore_testbackupincsimple/terms/shard2 to 
Terms{values={core_node4=1}, version=1}
   [junit4]   2> 1677379 INFO  (qtp595920704-22008) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.u.p.LogUpdateProcessorFactory 
[hdfsbackuprestore_testbackupincsimple_shard1_replica_n1]  webapp=/solr 
path=/update 
params={wt=javabin&version=2}{add=[9623a587-c655-48fa-b559-f27f79fcec48 
(1789165692356919296), 1ca6f0e0-bd39-4ee0-bd7b-b67e58cde475 
(1789165692361113600), c7675a09-e171-4c7e-abd3-5f1450fff8a7 
(1789165692361113601), b0927277-ba8e-4dad-85a0-27392036e061 
(1789165692361113602), 5111767c-7128-46a4-888a-f42884f674c8 
(1789165692361113603), 2633d86f-ddbb-482a-844e-68b05a838539 
(1789165692361113604), a44b970b-18f2-4ec3-bca6-8ebd9c3a5ac4 
(1789165692361113605), b49c2838-73b0-4491-9809-36f2a3154ef7 
(1789165692361113606), 15df1919-5ccc-4c97-bcf2-7fddc6c522ba 
(1789165692361113607), 7cea4aa7-226b-41f0-b855-9a69dc230fd6 
(1789165692361113608), ... (35 adds)]} 0 6
   [junit4]   2> 1677379 INFO  (qtp347385955-22014) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.u.p.LogUpdateProcessorFactory 
[hdfsbackuprestore_testbackupincsimple_shard2_replica_n2]  webapp=/solr 
path=/update 
params={wt=javabin&version=2}{add=[e7c90135-6e32-4cd6-96ba-a0385d0a0eab 
(1789165692356919296), 55c26297-977a-426e-8011-c57eea877b24 
(1789165692361113600), 6f10f28a-f945-451e-9a06-282fed7a0d08 
(1789165692361113601), b7ee88af-0915-4707-97da-a97d83d10c60 
(1789165692361113602), 7cf51ca9-7bcb-4f11-99b4-37c840fe278b 
(1789165692361113603), 322355c2-89ce-4642-ae11-1a95636524ed 
(1789165692361113604), 76438c7a-75eb-4b7e-947c-988cca1fe097 
(1789165692361113605), f74670e5-b424-4294-89e9-ebba61879434 
(1789165692361113606), 060fcb80-54a7-467e-af24-a0e072824c26 
(1789165692361113607), 0cd8e6ec-b194-4929-9a78-400da2fdc22e 
(1789165692361113608), ... (38 adds)]} 0 6
   [junit4]   2> 1677380 INFO  (qtp347385955-22007) [n:127.0.0.1:33041_solr     
] o.a.s.s.HttpSolrCall 
HttpSolrCall.init(http://127.0.0.1:33041/solr/hdfsbackuprestore_testbackupincsimple/update?null)
   [junit4]   2> 1677384 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr     
] o.a.s.s.HttpSolrCall 
HttpSolrCall.init(http://127.0.0.1:46567/solr/hdfsbackuprestore_testbackupincsimple_shard1_replica_n1/update?update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A33041%2Fsolr%2Fhdfsbackuprestore_testbackupincsimple_shard2_replica_n2%2F)
   [junit4]   2> 1677586 INFO  
(searcherExecutor-13901-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple s:shard1 
r:core_node3 x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.SolrCore [hdfsbackuprestore_testbackupincsimple_shard1_replica_n1]  
Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1677587 INFO  (qtp595920704-22005) [n:127.0.0.1:46567_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard1 r:core_node3 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.u.p.LogUpdateProcessorFactory 
[hdfsbackuprestore_testbackupincsimple_shard1_replica_n1]  webapp=/solr 
path=/update 
params={update.distrib=TOLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:33041/solr/hdfsbackuprestore_testbackupincsimple_shard2_replica_n2/&commit_end_point=leaders&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 203
   [junit4]   2> 1677797 INFO  
(searcherExecutor-13903-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4) 
[n:127.0.0.1:33041_solr c:hdfsbackuprestore_testbackupincsimple s:shard2 
r:core_node4 x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.SolrCore [hdfsbackuprestore_testbackupincsimple_shard2_replica_n2]  
Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1677797 INFO  (qtp347385955-22007) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple s:shard2 r:core_node4 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.u.p.LogUpdateProcessorFactory 
[hdfsbackuprestore_testbackupincsimple_shard2_replica_n2]  webapp=/solr 
path=/update 
params={_stateVer_=hdfsbackuprestore_testbackupincsimple:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=}
 0 417
   [junit4]   2> 1677797 INFO  
(TEST-HdfsCloudIncrementalBackupTest.testSimple-seed#[1A2ACDBCF38C027E]) [     
] o.a.s.c.a.c.AbstractIncrementalBackupTest Indexed 73 docs to collection: 
hdfsbackuprestore_testbackupincsimple
   [junit4]   2> 1677800 WARN  
(TEST-HdfsCloudIncrementalBackupTest.testSimple-seed#[1A2ACDBCF38C027E]) [     
] o.a.s.c.b.r.HdfsBackupRepository HDFS support in Solr has been deprecated as 
of 8.6. See SOLR-14021 for details.
   [junit4]   2> 1677800 INFO  
(TEST-HdfsCloudIncrementalBackupTest.testSimple-seed#[1A2ACDBCF38C027E]) [     
] o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost.localdomain:38245/solr
   [junit4]   2> 1677801 INFO  
(TEST-HdfsCloudIncrementalBackupTest.testSimple-seed#[1A2ACDBCF38C027E]) [     
] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 1677810 INFO  (qtp347385955-22011) [n:127.0.0.1:33041_solr     
] o.a.s.s.HttpSolrCall 
HttpSolrCall.init(http://127.0.0.1:33041/solr/admin/collections?action=BACKUP&async=edc80566-0811-4a0a-8976-3503ef44f711&name=mytestbackuptestbackupincsimple&collection=hdfsbackuprestore_testbackupincsimple&location=%2Fbackup&repository=trackingBackupRepository&incremental=true&wt=javabin&version=2)
   [junit4]   2> 1677811 WARN  (qtp347385955-22011) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple    ] o.a.s.c.b.r.HdfsBackupRepository 
HDFS support in Solr has been deprecated as of 8.6. See SOLR-14021 for details.
   [junit4]   2> 1677811 INFO  (qtp347385955-22011) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple    ] o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost.localdomain:38245/solr
   [junit4]   2> 1677811 INFO  (qtp347385955-22011) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple    ] o.a.s.c.HdfsDirectoryFactory Solr 
Kerberos Authentication disabled
   [junit4]   2> 1677825 INFO  (qtp347385955-22011) [n:127.0.0.1:33041_solr 
c:hdfsbackuprestore_testbackupincsimple    ] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/collections 
params={async=edc80566-0811-4a0a-8976-3503ef44f711&name=mytestbackuptestbackupincsimple&action=BACKUP&location=/backup&collection=hdfsbackuprestore_testbackupincsimple&incremental=true&repository=trackingBackupRepository&wt=javabin&version=2}
 status=0 QTime=14
   [junit4]   2> 1677825 INFO  (qtp347385955-22011) [n:127.0.0.1:33041_solr     
] o.a.s.s.HttpSolrCall 
HttpSolrCall.init(http://127.0.0.1:33041/solr/admin/collections?action=REQUESTSTATUS&requestid=edc80566-0811-4a0a-8976-3503ef44f711&wt=javabin&version=2)
   [junit4]   2> 1677826 INFO  (qtp347385955-22011) [n:127.0.0.1:33041_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={requestid=edc80566-0811-4a0a-8976-3503ef44f711&action=REQUESTSTATUS&wt=javabin&version=2}
 status=0 QTime=1
   [junit4]   2> 1677827 INFO  
(OverseerCollectionConfigSetProcessor-72085396918435846-127.0.0.1:46567_solr-n_0000000000)
 [n:127.0.0.1:46567_solr     ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 1677828 WARN  
(OverseerThreadFactory-13871-thread-2-processing-n:127.0.0.1:46567_solr) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple    ] 
o.a.s.c.b.r.HdfsBackupRepository HDFS support in Solr has been deprecated as of 
8.6. See SOLR-14021 for details.
   [junit4]   2> 1677828 INFO  
(OverseerThreadFactory-13871-thread-2-processing-n:127.0.0.1:46567_solr) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple    ] 
o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost.localdomain:38245/solr
   [junit4]   2> 1677828 INFO  
(OverseerThreadFactory-13871-thread-2-processing-n:127.0.0.1:46567_solr) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple    ] 
o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 1677843 INFO  
(OverseerThreadFactory-13871-thread-2-processing-n:127.0.0.1:46567_solr) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple    ] 
o.a.s.c.a.c.BackupCmd Starting backup of 
collection=hdfsbackuprestore_testbackupincsimple with 
backupName=mytestbackuptestbackupincsimple at 
location=hdfs://localhost.localdomain:38245/backup/mytestbackuptestbackupincsimple/hdfsbackuprestore_testbackupincsimple
   [junit4]   2> 1677855 INFO  (qtp347385955-22014) [n:127.0.0.1:33041_solr     
] o.a.s.s.HttpSolrCall 
HttpSolrCall.init(http://127.0.0.1:33041/solr/admin/cores?null)
   [junit4]   2> 1677855 INFO  (qtp595920704-22009) [n:127.0.0.1:46567_solr     
] o.a.s.s.HttpSolrCall 
HttpSolrCall.init(http://127.0.0.1:46567/solr/admin/cores?null)
   [junit4]   2> 1677856 INFO  (qtp347385955-22014) [n:127.0.0.1:33041_solr    
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={core=hdfsbackuprestore_testbackupincsimple_shard2_replica_n2&async=edc80566-0811-4a0a-8976-3503ef44f711424241477582921&qt=/admin/cores&name=shard2&shardBackupId=md_shard2_0&action=BACKUPCORE&location=hdfs://localhost.localdomain:38245/backup/mytestbackuptestbackupincsimple/hdfsbackuprestore_testbackupincsimple&incremental=true&repository=trackingBackupRepository&wt=javabin&version=2}
 status=0 QTime=1
   [junit4]   2> 1677856 INFO  (qtp595920704-22009) [n:127.0.0.1:46567_solr    
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={core=hdfsbackuprestore_testbackupincsimple_shard1_replica_n1&async=edc80566-0811-4a0a-8976-3503ef44f711424241477683381&qt=/admin/cores&name=shard1&shardBackupId=md_shard1_0&action=BACKUPCORE&location=hdfs://localhost.localdomain:38245/backup/mytestbackuptestbackupincsimple/hdfsbackuprestore_testbackupincsimple&incremental=true&repository=trackingBackupRepository&wt=javabin&version=2}
 status=0 QTime=1
   [junit4]   2> 1677857 WARN  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr    
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.b.r.HdfsBackupRepository HDFS support in Solr has been deprecated as of 
8.6. See SOLR-14021 for details.
   [junit4]   2> 1677857 INFO  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr    
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost.localdomain:38245/solr
   [junit4]   2> 1677858 INFO  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr    
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 1677862 WARN  
(parallelCoreAdminExecutor-13872-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
edc80566-0811-4a0a-8976-3503ef44f711424241477683381 BACKUPCORE) 
[n:127.0.0.1:46567_solr    
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.b.r.HdfsBackupRepository HDFS support in Solr has been deprecated as of 
8.6. See SOLR-14021 for details.
   [junit4]   2> 1677862 INFO  
(parallelCoreAdminExecutor-13872-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
edc80566-0811-4a0a-8976-3503ef44f711424241477683381 BACKUPCORE) 
[n:127.0.0.1:46567_solr    
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost.localdomain:38245/solr
   [junit4]   2> 1677863 INFO  
(parallelCoreAdminExecutor-13872-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
edc80566-0811-4a0a-8976-3503ef44f711424241477683381 BACKUPCORE) 
[n:127.0.0.1:46567_solr    
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 1677868 INFO  (qtp347385955-22007) [n:127.0.0.1:33041_solr     
] o.a.s.s.HttpSolrCall 
HttpSolrCall.init(http://127.0.0.1:33041/solr/admin/cores?null)
   [junit4]   2> 1677869 INFO  (qtp347385955-22007) [n:127.0.0.1:33041_solr     
] o.a.s.h.a.CoreAdminOperation Checking request status for : 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921
   [junit4]   2> 1677869 INFO  (qtp347385955-22007) [n:127.0.0.1:33041_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&requestid=edc80566-0811-4a0a-8976-3503ef44f711424241477582921&action=REQUESTSTATUS&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1677877 INFO  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr c:hdfsbackuprestore_testbackupincsimple s:shard2 
r:core_node4 x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.h.IncrementalShardBackup Creating backup snapshot at 
hdfs://localhost.localdomain:38245/backup/mytestbackuptestbackupincsimple/hdfsbackuprestore_testbackupincsimple
 shardBackupMetadataFile:org.apache.solr.core.backup.ShardBackupId@48120aa9
   [junit4]   2> 1677881 INFO  
(parallelCoreAdminExecutor-13872-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
edc80566-0811-4a0a-8976-3503ef44f711424241477683381 BACKUPCORE) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple s:shard1 
r:core_node3 x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.h.IncrementalShardBackup Creating backup snapshot at 
hdfs://localhost.localdomain:38245/backup/mytestbackuptestbackupincsimple/hdfsbackuprestore_testbackupincsimple
 shardBackupMetadataFile:org.apache.solr.core.backup.ShardBackupId@5cd2dc75
   [junit4]   2> 1677881 WARN  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr c:hdfsbackuprestore_testbackupincsimple s:shard2 
r:core_node4 x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.s.h.HdfsDirectory HDFS support in Solr has been deprecated as of 8.6. See 
SOLR-14021 for details.
   [junit4]   2> 1677885 WARN  
(parallelCoreAdminExecutor-13872-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
edc80566-0811-4a0a-8976-3503ef44f711424241477683381 BACKUPCORE) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple s:shard1 
r:core_node3 x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.s.h.HdfsDirectory HDFS support in Solr has been deprecated as of 8.6. See 
SOLR-14021 for details.
   [junit4]   2> 1677934 INFO  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr c:hdfsbackuprestore_testbackupincsimple s:shard2 
r:core_node4 x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.s.h.HdfsDirectory Closing hdfs directory 
hdfs://localhost.localdomain:38245/backup/mytestbackuptestbackupincsimple/hdfsbackuprestore_testbackupincsimple/index
   [junit4]   2> 1677936 WARN  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr c:hdfsbackuprestore_testbackupincsimple s:shard2 
r:core_node4 x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.s.h.HdfsDirectory HDFS support in Solr has been deprecated as of 8.6. See 
SOLR-14021 for details.
   [junit4]   2> 1677937 INFO  
(parallelCoreAdminExecutor-13872-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
edc80566-0811-4a0a-8976-3503ef44f711424241477683381 BACKUPCORE) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple s:shard1 
r:core_node3 x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.s.h.HdfsDirectory Closing hdfs directory 
hdfs://localhost.localdomain:38245/backup/mytestbackuptestbackupincsimple/hdfsbackuprestore_testbackupincsimple/index
   [junit4]   2> 1677939 WARN  
(parallelCoreAdminExecutor-13872-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
edc80566-0811-4a0a-8976-3503ef44f711424241477683381 BACKUPCORE) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple s:shard1 
r:core_node3 x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.s.h.HdfsDirectory HDFS support in Solr has been deprecated as of 8.6. See 
SOLR-14021 for details.
   [junit4]   2> 1677960 INFO  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr c:hdfsbackuprestore_testbackupincsimple s:shard2 
r:core_node4 x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.s.h.HdfsDirectory Closing hdfs directory 
hdfs://localhost.localdomain:38245/backup/mytestbackuptestbackupincsimple/hdfsbackuprestore_testbackupincsimple/index
   [junit4]   2> 1677962 WARN  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr c:hdfsbackuprestore_testbackupincsimple s:shard2 
r:core_node4 x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.s.h.HdfsDirectory HDFS support in Solr has been deprecated as of 8.6. See 
SOLR-14021 for details.
   [junit4]   2> 1677974 INFO  
(parallelCoreAdminExecutor-13872-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
edc80566-0811-4a0a-8976-3503ef44f711424241477683381 BACKUPCORE) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple s:shard1 
r:core_node3 x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.s.h.HdfsDirectory Closing hdfs directory 
hdfs://localhost.localdomain:38245/backup/mytestbackuptestbackupincsimple/hdfsbackuprestore_testbackupincsimple/index
   [junit4]   2> 1677979 WARN  
(parallelCoreAdminExecutor-13872-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
edc80566-0811-4a0a-8976-3503ef44f711424241477683381 BACKUPCORE) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple s:shard1 
r:core_node3 x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.s.h.HdfsDirectory HDFS support in Solr has been deprecated as of 8.6. See 
SOLR-14021 for details.
   [junit4]   2> 1678002 INFO  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr c:hdfsbackuprestore_testbackupincsimple s:shard2 
r:core_node4 x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.s.h.HdfsDirectory Closing hdfs directory 
hdfs://localhost.localdomain:38245/backup/mytestbackuptestbackupincsimple/hdfsbackuprestore_testbackupincsimple/index
   [junit4]   2> 1678004 WARN  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr c:hdfsbackuprestore_testbackupincsimple s:shard2 
r:core_node4 x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.s.h.HdfsDirectory HDFS support in Solr has been deprecated as of 8.6. See 
SOLR-14021 for details.
   [junit4]   2> 1678010 INFO  
(parallelCoreAdminExecutor-13872-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
edc80566-0811-4a0a-8976-3503ef44f711424241477683381 BACKUPCORE) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple s:shard1 
r:core_node3 x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.s.h.HdfsDirectory Closing hdfs directory 
hdfs://localhost.localdomain:38245/backup/mytestbackuptestbackupincsimple/hdfsbackuprestore_testbackupincsimple/index
   [junit4]   2> 1678016 WARN  
(parallelCoreAdminExecutor-13872-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
edc80566-0811-4a0a-8976-3503ef44f711424241477683381 BACKUPCORE) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple s:shard1 
r:core_node3 x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.s.h.HdfsDirectory HDFS support in Solr has been deprecated as of 8.6. See 
SOLR-14021 for details.
   [junit4]   2> 1678017 INFO  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr c:hdfsbackuprestore_testbackupincsimple s:shard2 
r:core_node4 x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.s.h.HdfsDirectory Closing hdfs directory 
hdfs://localhost.localdomain:38245/backup/mytestbackuptestbackupincsimple/hdfsbackuprestore_testbackupincsimple/index
   [junit4]   2> 1678019 WARN  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr c:hdfsbackuprestore_testbackupincsimple s:shard2 
r:core_node4 x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.s.h.HdfsDirectory HDFS support in Solr has been deprecated as of 8.6. See 
SOLR-14021 for details.
   [junit4]   2> 1678031 INFO  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr c:hdfsbackuprestore_testbackupincsimple s:shard2 
r:core_node4 x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.s.h.HdfsDirectory Closing hdfs directory 
hdfs://localhost.localdomain:38245/backup/mytestbackuptestbackupincsimple/hdfsbackuprestore_testbackupincsimple/index
   [junit4]   2> 1678033 WARN  
(parallelCoreAdminExecutor-13890-thread-1-processing-n:127.0.0.1:33041_solr 
x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 
edc80566-0811-4a0a-8976-3503ef44f711424241477582921 BACKUPCORE) 
[n:127.0.0.1:33041_solr c:hdfsbackuprestore_testbackupincsimple s:shard2 
r:core_node4 x:hdfsbackuprestore_testbackupincsimple_shard2_replica_n2 ] 
o.a.s.s.h.HdfsDirectory HDFS support in Solr has been deprecated as of 8.6. See 
SOLR-14021 for details.
   [junit4]   2> 1678044 INFO  
(parallelCoreAdminExecutor-13872-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
edc80566-0811-4a0a-8976-3503ef44f711424241477683381 BACKUPCORE) 
[n:127.0.0.1:46567_solr c:hdfsbackuprestore_testbackupincsimple s:shard1 
r:core_node3 x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 ] 
o.a.s.s.h.HdfsDirectory Closing hdfs directory 
hdfs://localhost.localdomain:38245/backup/mytestbackuptestbackupincsimple/hdfsbackuprestore_testbackupincsimple/index
   [junit4]   2> 1678048 WARN  
(parallelCoreAdminExecutor-13872-thread-1-processing-n:127.0.0.1:46567_solr 
x:hdfsbackuprestore_testbackupincsimple_shard1_replica_n1 
edc80566-0811-4a0a-8976-3503ef44f711424241477683381 BACKUPCORE) [n:1

[...truncated too long message...]

ating to localhost.localdomain/127.0.0.1:45989) [     ] 
o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager 
interrupted
   [junit4]   2> 1964429 WARN  (Command processor) [     ] o.a.h.h.s.d.DataNode 
Ending command processor service for: Thread[Command 
processor,5,TGRP-HdfsBackupRepositoryIntegrationTest]
   [junit4]   2> 1964429 WARN  (BP-1554583792-127.0.0.1-1706281642640 
heartbeating to localhost.localdomain/127.0.0.1:45989) [     ] 
o.a.h.h.s.d.DataNode Ending block pool service for: Block pool 
BP-1554583792-127.0.0.1-1706281642640 (Datanode Uuid 
b689ed25-30e7-4e26-ace5-182af8436db4) service to 
localhost.localdomain/127.0.0.1:45989
   [junit4]   2> 1964437 INFO  (Listener at localhost.localdomain/45393) [     
] o.e.j.s.h.ContextHandler Stopped 
o.e.j.w.WebAppContext@33a42d17{hdfs,/,null,STOPPED}{jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-3.2.4-tests.jar!/webapps/hdfs}
   [junit4]   2> 1964437 INFO  (Listener at localhost.localdomain/45393) [     
] o.e.j.s.AbstractConnector Stopped ServerConnector@1da08498{HTTP/1.1, 
(http/1.1)}{localhost.localdomain:0}
   [junit4]   2> 1964437 INFO  (Listener at localhost.localdomain/45393) [     
] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1964437 INFO  (Listener at localhost.localdomain/45393) [     
] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@6613763c{static,/static,jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-3.2.4-tests.jar!/webapps/static,STOPPED}
   [junit4]   2> 1964455 INFO  (Listener at localhost.localdomain/45393) [     
] o.a.s.u.ErrorLogMuter Closing ErrorLogMuter-regex-457 after mutting 0 log 
messages
   [junit4]   2> 1964455 INFO  (Listener at localhost.localdomain/45393) [     
] o.a.s.u.ErrorLogMuter Creating ErrorLogMuter-regex-458 for ERROR logs 
matching regex: ignore_exception
   [junit4]   2> 1964456 INFO  (Listener at localhost.localdomain/45393) [     
] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- 
Done waiting for tracked resources to be released
   [junit4]   2> Jan 26, 2024 3:07:35 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 33 leaked 
thread(s).
   [junit4]   2> Jan 26, 2024 3:07:45 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at 
org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest: 
   [junit4]   2>    1) Thread[id=34890, name=Command processor, state=WAITING, 
group=TGRP-HdfsBackupRepositoryIntegrationTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at 
org.apache.hadoop.hdfs.server.datanode.BPServiceActor$CommandProcessingThread.processQueue(BPServiceActor.java:1291)
   [junit4]   2>         at 
org.apache.hadoop.hdfs.server.datanode.BPServiceActor$CommandProcessingThread.run(BPServiceActor.java:1275)
   [junit4]   2> Jan 26, 2024 3:07:45 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=34890, name=Command processor, state=WAITING, 
group=TGRP-HdfsBackupRepositoryIntegrationTest]
   [junit4]   2> 1974481 ERROR (Command processor) [     ] o.a.h.h.s.d.DataNode 
Command processor encountered interrupt and exit.
   [junit4]   2> 1974481 WARN  (Command processor) [     ] o.a.h.h.s.d.DataNode 
Ending command processor service for: Thread[Command 
processor,5,TGRP-HdfsBackupRepositoryIntegrationTest]
   [junit4]   2> Jan 26, 2024 3:07:45 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): {}, 
docValues:{}, maxPointsInLeafNode=1918, maxMBSortInHeap=7.13228535378868, 
sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=ar-SA, 
timezone=Pacific/Apia
   [junit4]   2> NOTE: Linux 4.15.0-213-generic amd64/Temurin 1.8.0_362 
(64-bit)/cpus=4,threads=2,free=76050032,total=510656512
   [junit4]   2> NOTE: All tests run in this JVM: [PluginInfoTest, 
HdfsRecoverLeaseTest, TestCloudInspectUtil, 
VMParamsZkACLAndCredentialsProvidersTest, ForceLeaderTest, 
TestJsonFacetsWithNestedObjects, TestFuzzyAnalyzedSuggestions, TestTextField, 
RegexBoostProcessorTest, DistribJoinFromCollectionTest, FileTypeMagicUtilTest, 
TestConfigSetsAPI, TestDownShardTolerantSearch, TestBM25SimilarityFactory, 
StressHdfsTest, TestTolerantSearch, LeaderVoteWaitTimeoutTest, 
ZkStateWriterTest, SuggesterTSTTest, AdminHandlersProxyTest, TestStressReorder, 
AnalyticsMergeStrategyTest, AddBlockUpdateTest, TestFieldCacheSort, 
TestIndexSearcher, TestBackupRepositoryFactory, TestCryptoKeys, 
TestSimpleTextCodec, TestRandomDVFaceting, SolrGraphiteReporterTest, 
DistributedQueryComponentOptimizationTest, TestPayloadScoreQParserPlugin, 
TestWordDelimiterFilterFactory, CoreAdminOperationTest, TestFiltering, 
ZkDynamicConfigTest, TestCursorMarkWithoutUniqueKey, TestFunctionQuery, 
TestBlobHandler, LukeRequestHandlerTest, ExplicitHLLTest, 
SolrRequestParserTest, TestSimExtremeIndexing, SolrCloudExampleTest, 
CloneFieldUpdateProcessorFactoryTest, TestSchemaDesignerSettingsDAO, 
DistributedTermsComponentTest, OverseerModifyCollectionTest, 
NodeLostTriggerIntegrationTest, DeleteShardTest, TestTestInjection, 
TestPullReplicaWithAuth, CategoryRoutedAliasUpdateProcessorTest, 
DeleteByIdWithRouterFieldTest, PeerSyncWithLeaderTest, TriggerEventQueueTest, 
TestDynamicFieldResource, TestTolerantUpdateProcessorRandomCloud, 
TestExactSharedStatsCache, TestRTGBase, JWTVerificationkeyResolverTest, 
ZookeeperStatusHandlerTest, SSLMigrationTest, TestDocumentBuilder, 
DistanceFunctionTest, TaggingAttributeTest, TestDocBasedVersionConstraints, 
V2ApiIntegrationTest, TestLeaderElectionWithEmptyReplica, 
TestCollapseQParserPlugin, EchoParamsTest, TestSolrIndexConfig, 
TestHttpServletCarrier, TestUpdate, ResourceLoaderTest, 
TestHdfsBackupRestoreCore, TestImplicitCoreProperties, TestFacetMethods, 
TestSQLHandlerNonCloud, BasicDistributedZk2Test, TestFieldTypeResource, 
TestSolrCloudWithKerberosAlt, TestXmlQParser, BlockDirectoryTest, 
SearchRateTriggerTest, SolrCoreMetricManagerTest, IndexSchemaTest, 
TestChildDocTransformer, HttpTriggerListenerTest, 
JavaBinAtomicUpdateMultivalueTest, CleanupOldIndexTest, DocValuesTest, 
TestApiFramework, CollectionsAPIAsyncDistributedZkTest, TestStressLiveNodes, 
TestJsonFacetErrors, TestQuerySenderListener, ResponseBuilderTest, 
BooleanFieldTest, TestSimNodeLostTrigger, TestConfigSets, NumberUtilsTest, 
TestManagedSchemaAPI, TestConfig, PeerSyncTest, 
ByteBuffersDirectoryFactoryTest, SpatialHeatmapFacetsTest, 
MoreLikeThisComponentTest, TestShortCircuitedRequests, 
CdcrVersionReplicationTest, DeleteInactiveReplicaTest, RemoteQueryErrorTest, 
BlockJoinFacetSimpleTest, ScheduledMaintenanceTriggerTest, 
AnalysisAfterCoreReloadTest, BasicFunctionalityTest, ConvertedLegacyTest, 
OutputWriterTest, SampleTest, SolrInfoBeanTest, 
PathHierarchyTokenizerFactoryTest, ProtectedTermFilterFactoryTest, 
TestCharFilters, TokenizerChainTest, TestLuceneIndexBackCompat, BasicZkTest, 
ChaosMonkeyNothingIsSafeTest, ChaosMonkeySafeLeaderTest, 
FullSolrCloudDistribCmdsTest, HttpPartitionTest, LeaderElectionContextKeyTest, 
LeaderElectionTest, MetricsHistoryIntegrationTest, 
MetricsHistoryWithAuthIntegrationTest, MigrateRouteKeyTest, NodeMutatorTest, 
OutOfBoxZkACLAndCredentialsProvidersTest, OverseerRolesTest, 
PackageManagerCLITest, ReplaceNodeTest, ShardRoutingTest, SyncSliceTest, 
TestQueryingOnDownCollection, TestRandomRequestDistribution, 
TestRequestForwarding, TestUtilizeNode, ZkControllerTest, AssignTest, 
AsyncCallRequestStatusResponseTest, CollectionsAPIDistributedZkTest, 
TestHdfsCloudBackupRestore, TestLocalFSCloudBackupRestore, 
AutoAddReplicasIntegrationTest, MetricTriggerIntegrationTest, 
ScheduledTriggerIntegrationTest, TriggerIntegrationTest, TestSolrXml, 
TestXIncludeConfig, BackupIdTest, ShardBackupIdTest, 
HdfsBackupRepositoryIntegrationTest]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=HdfsBackupRepositoryIntegrationTest -Dtests.seed=1A2ACDBCF38C027E 
-Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=ar-SA 
-Dtests.timezone=Pacific/Apia -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J2 | HdfsBackupRepositoryIntegrationTest (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at 
org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest: 
   [junit4]    >    1) Thread[id=34890, name=Command processor, state=WAITING, 
group=TGRP-HdfsBackupRepositoryIntegrationTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
org.apache.hadoop.hdfs.server.datanode.BPServiceActor$CommandProcessingThread.processQueue(BPServiceActor.java:1291)
   [junit4]    >         at 
org.apache.hadoop.hdfs.server.datanode.BPServiceActor$CommandProcessingThread.run(BPServiceActor.java:1275)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([1A2ACDBCF38C027E]:0)
   [junit4] Completed [648/959 (2!)] on J2 in 23.11s, 10 tests, 1 error <<< 
FAILURES!

[...truncated 55424 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@solr.apache.org
For additional commands, e-mail: builds-h...@solr.apache.org

Reply via email to