Build: https://ci-builds.apache.org/job/Solr/job/Solr-TestIntegration-10.x/212/
No tests ran. Build Log: [...truncated 347 lines...] # ERROR: KeeperErrorCode = NoNode for /security.json # -- # # Last output: # WARN - 2026-05-18 06:16:54.507; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-05-18 06:16:54.511; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-05-18 06:16:54.975; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-05-18 06:16:54.975; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # # ERROR: KeeperErrorCode = NoNode for /security.json not ok 9 create, config, api, and delete with basic auth # in 1295 ms # (from function `setup' in test file test/test_basic_auth.bats, line 24) # `solr start -Dsolr.packages.enabled=true' failed # Starting Solr # # Port 41823 is already being used by another process (pid: 1702748) # Please choose a different port using the -p option. # # Please find the SOLR_HOME snapshot for failed test #1 at: /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/failure-snapshots/9-1 # Last output: # WARN - 2026-05-18 06:16:56.140; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-05-18 06:16:56.143; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes ok 10 post, postlogs and export with basic auth # in 17731 ms ok 11 package with basic auth # in 12023 ms ok 12 admin UI static content is excepted from basic auth # in 10653 ms ok 13 nothing # in 9 ms ok 14 server does not compress response without Accept-Encoding header # in 145 ms ok 15 server compresses response when Accept-Encoding: gzip is requested # in 79 ms ok 16 compressed response can be decompressed and parsed # in 78 ms ok 17 setting property # in 11019 ms ok 18 short form of setting property # in 6532 ms ok 19 connecting to solr via various solr urls and zk hosts # in 9305 ms ok 20 create for non cloud mode # in 7688 ms ok 21 create for cloud mode # in 9902 ms ok 22 multiple connection options are prevented # in 830 ms ok 23 create collection # in 7770 ms ok 24 create collection using solrUrl # in 5372 ms ok 25 create collection using legacy solrUrl # in 5198 ms ok 26 create collection using Zookeeper # in 5264 ms ok 27 reject d option with invalid config dir # in 2616 ms ok 28 accept d option with builtin config # in 5132 ms ok 29 accept d option with explicit path to config # in 5200 ms ok 30 accept n option as config name # in 5161 ms ok 31 allow config reuse when n option specifies same config # in 8958 ms ok 32 create multisharded collections when s provided # in 5128 ms ok 33 create replicated collections when rf provided # in 6113 ms ok 34 can delete collections # in 10786 ms ok 35 can delete collections with solr-url # in 8548 ms ok 36 collection delete also deletes zk config # in 7524 ms ok 37 deletes accompanying zk config with nondefault name # in 7317 ms ok 38 delete-config option can opt to leave config in zk # in 7098 ms ok 39 start -e cloud works with --jvm-opts # in 21953 ms ok 40 start -e cloud works with --no-prompt # in 18483 ms ok 41 Check export command # in 18774 ms ok 42 export fails on non cloud mode # in 9326 ms Waiting for Tika Server to be ready on port 41828 WARNING: Tika Server did not become ready in time; Tika-dependent tests will be bypassed. WARNING: Docker not available; bypassing test. ok 43 using curl to extract a single pdf file # in 16822 ms WARNING: Docker not available; bypassing test. ok 44 using the bin/solr post tool to extract content from pdf # in 16568 ms WARNING: Docker not available; bypassing test. ok 45 using the bin/solr post tool to crawl web site # in 16558 ms Stopping Tika Server container ok 46 healthcheck on cloud solr # in 10087 ms ok 47 healthcheck errors on standalone solr # in 11208 ms ok 48 solr help flag prints help # in 736 ms ok 49 solr with no flags prints help # in 757 ms ok 50 start help flag prints help # in 147 ms ok 51 start h flag prints help # in 149 ms ok 52 stop help flag prints help # in 143 ms ok 53 restart help flag prints help # in 145 ms ok 54 status help flag prints help # in 825 ms ok 55 healthcheck help flag prints help # in 747 ms ok 56 create help flag prints help # in 775 ms ok 57 delete help flag prints help # in 748 ms ok 58 zk help flag prints help # in 744 ms ok 59 auth help flag prints help # in 759 ms ok 60 assert help flag prints help # in 757 ms ok 61 post help flag prints help # in 761 ms ok 62 SQL Module # in 15465 ms ok 63 icu collation in analysis-extras module # in 12179 ms ok 64 Check lifecycle of sentiment classification # in 23948 ms ok 65 lifecycle of package # in 8485 ms ok 66 deploying and undeploying a collection level package # in 13186 ms ok 67 deploying and undeploying a cluster level package # skip For developing package infra; requires a connection to github ok 68 Affinity placement plugin using sysprop # in 15379 ms ok 69 Random placement plugin using ENV # in 15941 ms ok 70 Check help command # in 2333 ms ok 71 basic post with a type specified # in 5506 ms ok 72 basic post with collection instead of url parameter # in 4014 ms ok 73 basic post with solr-url and collection # in 3987 ms ok 74 basic post WITHOUT a type specified # in 11770 ms ok 75 crawling a directory as a dry-run # in 823 ms ok 76 crawling a directory # in 4411 ms ok 77 skipcommit and optimize and delete # in 3867 ms ok 78 args mode # in 7397 ms ok 79 stdin mode # in 3621 ms ok 80 verbose echo the Solr response # in 3874 ms ok 81 post solr log into solr via cli # in 9358 ms # Test failed - capturing Docker diagnostics # === docker ps (summary) === NAMES STATUS IMAGE PORTS solr-node3 Up 11 seconds apache/solr-nightly:9.10.0-SNAPSHOT-slim 8983/tcp solr-node2 Up 11 seconds apache/solr-nightly:9.10.0-SNAPSHOT-slim 8983/tcp solr-node1 Up 17 seconds apache/solr-nightly:9.10.0-SNAPSHOT-slim 8983/tcp # === Docker logs for solr-node1 === 2026-05-18T06:26:39.982629565Z *** [WARN] *** Your open file limit is currently 1024. 2026-05-18T06:26:39.982666502Z It should be set to 65000 to avoid operational disruption. 2026-05-18T06:26:39.982669757Z If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh 2026-05-18T06:26:39.982948127Z Solr will start in SolrCloud mode by default in version 10, and you will no longer need to pass in -c or --cloud flag. 2026-05-18T06:26:39.982964632Z 2026-05-18T06:26:39.992020522Z Java 17 detected. Enabled workaround for SOLR-16463 2026-05-18T06:26:39.999912970Z [0.002s][warning][pagesize] UseLargePages disabled, no large pages configured and available on the system. 2026-05-18T06:26:40.041246096Z CompileCommand: exclude com/github/benmanes/caffeine/cache/BoundedLocalCache.put bool exclude = true 2026-05-18T06:26:40.073174139Z WARNING: A command line option has enabled the Security Manager 2026-05-18T06:26:40.073193924Z WARNING: The Security Manager is deprecated and will be removed in a future release 2026-05-18T06:26:41.226955731Z 2026-05-18 06:26:41.223 INFO (main) [c: s: r: x: t:] o.e.j.s.Server jetty-10.0.26; built: 2025-08-14T15:56:56.454Z; git: 65a55c55a68c56d5f2e8232164439bd6e76e53d1; jvm 17.0.16+8 2026-05-18T06:26:41.492892271Z 2026-05-18 06:26:41.492 WARN (main) [c: s: r: x: t:] o.e.j.u.DeprecationWarning Using @Deprecated Class org.eclipse.jetty.servlet.listener.ELContextCleaner 2026-05-18T06:26:41.517416489Z 2026-05-18 06:26:41.516 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2026-05-18T06:26:41.524642572Z 2026-05-18 06:26:41.524 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.10.0-SNAPSHOT 1edeb3ac6a97186b4ae7de511196a1769de7960e [snapshot build, details omitted] 2026-05-18T06:26:41.524735767Z 2026-05-18 06:26:41.524 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port 8983 2026-05-18T06:26:41.524833683Z 2026-05-18 06:26:41.524 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /opt/solr-9.10.0-SNAPSHOT-slim 2026-05-18T06:26:41.524966512Z 2026-05-18 06:26:41.524 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2026-05-18T06:26:41.524391144Z 2026-05-18T06:26:41.527557875Z 2026-05-18 06:26:41.527 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr started with "-XX:+CrashOnOutOfMemoryError" that will crash on any OutOfMemoryError exception. The cause of the OOME will be logged in the crash file at the following path: /var/solr/logs/jvm_crash_1.log 2026-05-18T06:26:41.549805793Z 2026-05-18 06:26:41.549 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /var/solr/data (source: system property: solr.solr.home) 2026-05-18T06:26:41.563084287Z 2026-05-18 06:26:41.562 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig solr.xml not found in SOLR_HOME, using built-in default 2026-05-18T06:26:41.563151518Z 2026-05-18 06:26:41.562 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/solr.xml 2026-05-18T06:26:41.599526146Z 2026-05-18 06:26:41.598 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrResourceLoader Added 1 libs to classloader, from paths: [/opt/solr-9.10.0-SNAPSHOT-slim/lib] 2026-05-18T06:26:42.283185356Z 2026-05-18 06:26:42.282 INFO (main) [c: s: r: x: t:] o.a.s.u.t.SimplePropagator Always-on trace id generation enabled. 2026-05-18T06:26:42.955247887Z 2026-05-18 06:26:42.919 WARN (main) [c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Jetty request logging enabled. Will retain logs for last 3 days. See chapter "Configuring Logging" in reference guide for how to configure. 2026-05-18T06:26:42.957058906Z 2026-05-18 06:26:42.949 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrZkServer Zookeeper configuration not found in /var/solr/data, using built-in default 2026-05-18T06:26:42.957155409Z 2026-05-18 06:26:42.949 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrZkServerProps Reading configuration from: /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/zoo.cfg 2026-05-18T06:26:42.961676620Z 2026-05-18 06:26:42.961 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrZkServer STARTING EMBEDDED ENSEMBLE ZOOKEEPER SERVER at port 9983, listening on host 0.0.0.0 2026-05-18T06:26:42.961773272Z 2026-05-18 06:26:42.961 WARN (main) [c: s: r: x: t:] o.a.s.c.SolrZkServer Embedded Zookeeper is not recommended in production environments. See Reference Guide for details. 2026-05-18T06:26:43.327565741Z 2026-05-18 06:26:43.327 WARN (embeddedZkServer) [c: s: r: x: t:] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0. 2026-05-18T06:26:43.467109667Z 2026-05-18 06:26:43.466 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=172.18.0.2:9983 2026-05-18T06:26:43.493643733Z 2026-05-18 06:26:43.492 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-05-18T06:26:43.699413713Z 2026-05-18 06:26:43.695 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2026-05-18T06:26:43.736549649Z 2026-05-18 06:26:43.736 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-05-18T06:26:43.736671665Z 2026-05-18 06:26:43.736 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-05-18T06:26:44.043062831Z 2026-05-18 06:26:44.041 WARN (main) [c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2026-05-18T06:26:44.074349003Z 2026-05-18 06:26:44.073 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-05-18T06:26:44.102420911Z 2026-05-18 06:26:44.101 INFO (main) [c: s: r: x: t:] o.a.s.c.OverseerElectionContext I am going to be the leader solr-node1:8983_solr 2026-05-18T06:26:44.127790914Z 2026-05-18 06:26:44.127 INFO (main) [c: s: r: x: t:] o.a.s.c.Overseer Overseer (id=72074547711901696-solr-node1:8983_solr-n_0000000000) starting 2026-05-18T06:26:44.198275961Z 2026-05-18 06:26:44.197 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper: /live_nodes/solr-node1:8983_solr 2026-05-18T06:26:44.198433510Z 2026-05-18 06:26:44.198 INFO (OverseerStateUpdate-72074547711901696-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.Overseer Starting to work on the main queue : solr-node1:8983_solr 2026-05-18T06:26:44.211721123Z 2026-05-18 06:26:44.209 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2026-05-18T06:26:44.253866743Z 2026-05-18 06:26:44.253 WARN (main) [c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2026-05-18T06:26:44.800560840Z 2026-05-18 06:26:44.800 INFO (main) [c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /var/solr/data 2026-05-18T06:26:44.983602966Z 2026-05-18 06:26:44.983 WARN (main) [c: s: r: x: t:] o.g.j.m.i.MessagingBinders A class jakarta.activation.DataSource for a default provider MessageBodyWriter<jakarta.activation.DataSource> was not found. The provider is not available. 2026-05-18T06:26:45.265003891Z 2026-05-18 06:26:45.264 INFO (main) [c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-05-18T06:26:45.428795058Z 2026-05-18 06:26:45.428 INFO (main) [c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@71f67a79{solr-jetty-context.xml,/solr,file:///opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp/,AVAILABLE}{/opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp} 2026-05-18T06:26:45.436096340Z 2026-05-18 06:26:45.435 INFO (main) [c: s: r: x: t:] o.e.j.s.RequestLogWriter Opened /var/solr/logs/2026_05_18.request.log 2026-05-18T06:26:45.635059585Z 2026-05-18 06:26:45.488 INFO (main) [c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@61884cb1{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8983} 2026-05-18T06:26:45.638479896Z 2026-05-18 06:26:45.637 INFO (main) [c: s: r: x: t:] o.e.j.s.Server Started Server@350ec41e{STARTING}[10.0.26,sto=0] @5639ms 2026-05-18T06:26:45.852115585Z 2026-05-18 06:26:45.849 INFO (qtp985324122-27-solr-node1-1) [c: s: r: x: t:solr-node1-1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=45 2026-05-18T06:26:45.928206878Z 2026-05-18 06:26:45.925 INFO (qtp985324122-96-solr-node1-2) [c: s: r: x: t:solr-node1-2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=13 2026-05-18T06:26:49.552699069Z 2026-05-18 06:26:49.552 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) 2026-05-18T06:26:49.593617767Z 2026-05-18 06:26:49.593 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2026-05-18T06:26:54.160149686Z 2026-05-18 06:26:54.159 INFO (qtp985324122-99-solr-node1-3) [c: s: r: x: t:solr-node1-3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=8 2026-05-18T06:26:54.186396759Z 2026-05-18 06:26:54.185 INFO (qtp985324122-99-solr-node1-4) [c: s: r: x: t:solr-node1-4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=9 2026-05-18T06:26:54.211380361Z 2026-05-18 06:26:54.210 INFO (qtp985324122-27-solr-node1-5) [c: s: r: x: t:solr-node1-5] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=2 2026-05-18T06:26:54.524915383Z 2026-05-18 06:26:54.524 INFO (OverseerThreadFactory-17-thread-1) [c:test-collection s: r: x: t:] o.a.s.c.a.c.CreateCollectionCmd Create collection test-collection 2026-05-18T06:26:54.546740384Z 2026-05-18 06:26:54.545 INFO (OverseerThreadFactory-17-thread-1) [c:test-collection s: r: x: t:] o.a.s.c.c.ZkStateReader /collections/test-collection/state.json is deleted, stop watching children 2026-05-18T06:26:54.553984472Z 2026-05-18 06:26:54.553 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/test-collection/state.json zxid: 173] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-18T06:26:54.591395713Z 2026-05-18 06:26:54.590 INFO (OverseerStateUpdate-72074547711901696-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2026-05-18T06:26:54.591418618Z "core":"test-collection_shard3_replica_n1", 2026-05-18T06:26:54.591421821Z "node_name":"solr-node1:8983_solr", 2026-05-18T06:26:54.591424874Z "base_url":"http://solr-node1:8983/solr";, 2026-05-18T06:26:54.591427525Z "collection":"test-collection", 2026-05-18T06:26:54.591430589Z "shard":"shard3", 2026-05-18T06:26:54.591433072Z "state":"down", 2026-05-18T06:26:54.591435554Z "type":"NRT", 2026-05-18T06:26:54.591437953Z "operation":"ADDREPLICA", 2026-05-18T06:26:54.591440673Z "waitForFinalState":"false"} 2026-05-18T06:26:54.598303052Z 2026-05-18 06:26:54.597 INFO (OverseerStateUpdate-72074547711901696-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2026-05-18T06:26:54.598321694Z "core":"test-collection_shard2_replica_n2", 2026-05-18T06:26:54.598324899Z "node_name":"solr-node3:8985_solr", 2026-05-18T06:26:54.598327638Z "base_url":"http://solr-node3:8985/solr";, 2026-05-18T06:26:54.598330247Z "collection":"test-collection", 2026-05-18T06:26:54.598332853Z "shard":"shard2", 2026-05-18T06:26:54.598335284Z "state":"down", 2026-05-18T06:26:54.598337780Z "type":"NRT", 2026-05-18T06:26:54.598340301Z "operation":"ADDREPLICA", 2026-05-18T06:26:54.598342803Z "waitForFinalState":"false"} 2026-05-18T06:26:54.604887286Z 2026-05-18 06:26:54.604 INFO (OverseerStateUpdate-72074547711901696-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2026-05-18T06:26:54.604902682Z "core":"test-collection_shard1_replica_n4", 2026-05-18T06:26:54.604906017Z "node_name":"solr-node2:8984_solr", 2026-05-18T06:26:54.604919591Z "base_url":"http://solr-node2:8984/solr";, 2026-05-18T06:26:54.604921758Z "collection":"test-collection", 2026-05-18T06:26:54.604923693Z "shard":"shard1", 2026-05-18T06:26:54.604925551Z "state":"down", 2026-05-18T06:26:54.604927480Z "type":"NRT", 2026-05-18T06:26:54.604929411Z "operation":"ADDREPLICA", 2026-05-18T06:26:54.604931382Z "waitForFinalState":"false"} 2026-05-18T06:26:54.713891751Z 2026-05-18 06:26:54.713 INFO (zkCallback-11-thread-2) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 185] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-18T06:26:54.770545679Z 2026-05-18 06:26:54.770 INFO (qtp985324122-99-solr-node1-6) [c: s: r: x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=techproducts&newCollection=true&collection=test-collection&version=2&replicaType=NRT&coreNodeName=core_node3&name=test-collection_shard3_replica_n1&action=CREATE&numShards=3&shard=shard3&wt=javabin 2026-05-18T06:26:54.816628177Z 2026-05-18 06:26:54.816 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.12.0 2026-05-18T06:26:54.918939338Z 2026-05-18 06:26:54.918 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.s.IndexSchema Schema name=default-config 2026-05-18T06:26:55.408713347Z 2026-05-18 06:26:55.406 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.s.IndexSchema Loaded schema default-config/1.7 with uniqueid field id 2026-05-18T06:26:55.408802428Z 2026-05-18 06:26:55.406 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.CoreContainer Creating SolrCore 'test-collection_shard3_replica_n1' using configuration from configset techproducts, trusted=true 2026-05-18T06:26:55.442290512Z 2026-05-18 06:26:55.441 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.SolrCore Opening new SolrCore at [/var/solr/data/test-collection_shard3_replica_n1], dataDir=[/var/solr/data/test-collection_shard3_replica_n1/data/] 2026-05-18T06:26:57.016861007Z 2026-05-18 06:26:57.015 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-05-18T06:26:57.100144349Z 2026-05-18 06:26:57.098 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2026-05-18T06:26:57.130166746Z 2026-05-18 06:26:57.128 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2026-05-18T06:26:57.132045222Z 2026-05-18 06:26:57.129 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 2026-05-18T06:26:57.134076744Z 2026-05-18 06:26:57.129 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.u.CommitTracker Soft AutoCommit: if uncommitted for 3000ms; 2026-05-18T06:26:57.202974559Z 2026-05-18 06:26:57.202 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/techproducts 2026-05-18T06:26:57.209962006Z 2026-05-18 06:26:57.209 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/techproducts 2026-05-18T06:26:57.216638259Z 2026-05-18 06:26:57.216 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/techproducts/managed-schema.xml 2026-05-18T06:26:57.221623921Z 2026-05-18 06:26:57.221 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest 2026-05-18T06:26:57.243979656Z 2026-05-18 06:26:57.243 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.s.DirectSolrSpellChecker init: {name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal, accuracy=0.5, maxQueryFrequency=0.01, maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4} 2026-05-18T06:26:57.251120493Z 2026-05-18 06:26:57.250 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2026-05-18T06:26:57.256155261Z 2026-05-18 06:26:57.255 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard3_replica_n1 solr-node1-6 core_node3 solr-node1:8983_solr test-collection shard3) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.QuerySenderListener QuerySenderListener done. 2026-05-18T06:26:57.257285773Z 2026-05-18 06:26:57.257 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard3_replica_n1 solr-node1-6 core_node3 solr-node1:8983_solr test-collection shard3) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default 2026-05-18T06:26:57.286755075Z 2026-05-18 06:26:57.286 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard3_replica_n1 solr-node1-6 core_node3 solr-node1:8983_solr test-collection shard3) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2026-05-18T06:26:57.288268128Z 2026-05-18 06:26:57.287 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test-collection/terms/shard3 to Terms{values={core_node3=0}, version=0} for registerTerm 2026-05-18T06:26:57.289636933Z 2026-05-18 06:26:57.289 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test-collection/leaders/shard3 2026-05-18T06:26:57.307311662Z 2026-05-18 06:26:57.307 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2026-05-18T06:26:57.307335800Z 2026-05-18 06:26:57.307 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2026-05-18T06:26:57.307399094Z 2026-05-18 06:26:57.307 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.SyncStrategy Sync replicas to http://solr-node1:8983/solr/test-collection_shard3_replica_n1/ 2026-05-18T06:26:57.309663223Z 2026-05-18 06:26:57.309 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2026-05-18T06:26:57.309706290Z 2026-05-18 06:26:57.309 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.SyncStrategy http://solr-node1:8983/solr/test-collection_shard3_replica_n1/ has no replicas 2026-05-18T06:26:57.311143459Z 2026-05-18 06:26:57.310 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test-collection/leaders/shard3/leader after winning as /collections/test-collection/leader_elect/shard3/election/72074547711901696-core_node3-n_0000000000 2026-05-18T06:26:57.322379684Z 2026-05-18 06:26:57.322 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://solr-node1:8983/solr/test-collection_shard3_replica_n1/ shard3 2026-05-18T06:26:57.430508255Z 2026-05-18 06:26:57.430 INFO (zkCallback-11-thread-2) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 241] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-18T06:26:57.441321277Z 2026-05-18 06:26:57.440 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-6] o.a.s.c.ZkController I am the leader, no recovery necessary 2026-05-18T06:26:57.466518927Z 2026-05-18 06:26:57.465 INFO (qtp985324122-99-solr-node1-6) [c: s: r: x: t:solr-node1-6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=techproducts&newCollection=true&name=test-collection_shard3_replica_n1&action=CREATE&numShards=3&collection=test-collection&shard=shard3&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2697 2026-05-18T06:26:57.555919548Z 2026-05-18 06:26:57.555 INFO (zkCallback-11-thread-2) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 247] for collection [test-collection] has occurred - updating... (live nodes size: [3]) # === Docker inspect for solr-node1 === { "Name": "/solr-node1", "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 1732269, "ExitCode": 0, "Error": "", "StartedAt": "2026-05-18T06:26:39.741037448Z", "FinishedAt": "0001-01-01T00:00:00Z" }, "Ports": { "8983/tcp": null } } # === Docker logs for solr-node2 === 2026-05-18T06:26:46.291227183Z *** [WARN] *** Your open file limit is currently 1024. 2026-05-18T06:26:46.291252327Z It should be set to 65000 to avoid operational disruption. 2026-05-18T06:26:46.291255547Z If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh 2026-05-18T06:26:46.291591742Z Solr will start in SolrCloud mode by default in version 10, and you will no longer need to pass in -c or --cloud flag. 2026-05-18T06:26:46.291602117Z 2026-05-18T06:26:46.301320483Z Java 17 detected. Enabled workaround for SOLR-16463 2026-05-18T06:26:46.308916958Z [0.001s][warning][pagesize] UseLargePages disabled, no large pages configured and available on the system. 2026-05-18T06:26:46.353058436Z CompileCommand: exclude com/github/benmanes/caffeine/cache/BoundedLocalCache.put bool exclude = true 2026-05-18T06:26:46.385379823Z WARNING: A command line option has enabled the Security Manager 2026-05-18T06:26:46.385404958Z WARNING: The Security Manager is deprecated and will be removed in a future release 2026-05-18T06:26:47.615832568Z 2026-05-18 06:26:47.612 INFO (main) [c: s: r: x: t:] o.e.j.s.Server jetty-10.0.26; built: 2025-08-14T15:56:56.454Z; git: 65a55c55a68c56d5f2e8232164439bd6e76e53d1; jvm 17.0.16+8 2026-05-18T06:26:47.888139175Z 2026-05-18 06:26:47.887 WARN (main) [c: s: r: x: t:] o.e.j.u.DeprecationWarning Using @Deprecated Class org.eclipse.jetty.servlet.listener.ELContextCleaner 2026-05-18T06:26:47.915222026Z 2026-05-18 06:26:47.914 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2026-05-18T06:26:47.922639826Z 2026-05-18 06:26:47.921 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.10.0-SNAPSHOT 1edeb3ac6a97186b4ae7de511196a1769de7960e [snapshot build, details omitted] 2026-05-18T06:26:47.922659401Z 2026-05-18 06:26:47.921 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port 8984 2026-05-18T06:26:47.922662177Z 2026-05-18 06:26:47.922 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /opt/solr-9.10.0-SNAPSHOT-slim 2026-05-18T06:26:47.922664785Z 2026-05-18 06:26:47.922 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2026-05-18T06:26:47.922114970Z 2026-05-18T06:26:47.925378815Z 2026-05-18 06:26:47.924 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr started with "-XX:+CrashOnOutOfMemoryError" that will crash on any OutOfMemoryError exception. The cause of the OOME will be logged in the crash file at the following path: /var/solr/logs/jvm_crash_1.log 2026-05-18T06:26:47.948619723Z 2026-05-18 06:26:47.948 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /var/solr/data (source: system property: solr.solr.home) 2026-05-18T06:26:47.972977190Z 2026-05-18 06:26:47.972 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-05-18T06:26:48.113316539Z 2026-05-18 06:26:48.112 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2026-05-18T06:26:48.133389638Z 2026-05-18 06:26:48.132 INFO (zkCallback-1-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-05-18T06:26:48.133449647Z 2026-05-18 06:26:48.133 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-05-18T06:26:48.133546234Z 2026-05-18 06:26:48.133 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-05-18T06:26:48.243823493Z 2026-05-18 06:26:48.243 INFO (main) [c: s: r: x: t:] o.a.s.c.NodeConfig Loading solr.xml from SolrHome (not found in ZooKeeper) 2026-05-18T06:26:48.244233646Z 2026-05-18 06:26:48.243 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig solr.xml not found in SOLR_HOME, using built-in default 2026-05-18T06:26:48.244316227Z 2026-05-18 06:26:48.243 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/solr.xml 2026-05-18T06:26:48.277718926Z 2026-05-18 06:26:48.277 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrResourceLoader Added 1 libs to classloader, from paths: [/opt/solr-9.10.0-SNAPSHOT-slim/lib] 2026-05-18T06:26:49.142273972Z 2026-05-18 06:26:49.141 INFO (main) [c: s: r: x: t:] o.a.s.u.t.SimplePropagator Always-on trace id generation enabled. 2026-05-18T06:26:49.373578837Z 2026-05-18 06:26:49.372 WARN (main) [c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Jetty request logging enabled. Will retain logs for last 3 days. See chapter "Configuring Logging" in reference guide for how to configure. 2026-05-18T06:26:49.375013502Z 2026-05-18 06:26:49.373 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=solr-node1:9983 2026-05-18T06:26:49.385541090Z 2026-05-18 06:26:49.385 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-05-18T06:26:49.396809706Z 2026-05-18 06:26:49.396 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2026-05-18T06:26:49.404916149Z 2026-05-18 06:26:49.404 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-05-18T06:26:49.405014834Z 2026-05-18 06:26:49.404 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-05-18T06:26:49.438576793Z 2026-05-18 06:26:49.437 WARN (main) [c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2026-05-18T06:26:49.452914683Z 2026-05-18 06:26:49.452 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2026-05-18T06:26:49.482703805Z 2026-05-18 06:26:49.482 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-05-18T06:26:49.519375017Z 2026-05-18 06:26:49.517 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Publish node=solr-node2:8984_solr as DOWN 2026-05-18T06:26:49.541112135Z 2026-05-18 06:26:49.539 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper: /live_nodes/solr-node2:8984_solr 2026-05-18T06:26:49.560970579Z 2026-05-18 06:26:49.553 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) 2026-05-18T06:26:49.594011909Z 2026-05-18 06:26:49.593 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2026-05-18T06:26:49.679063832Z 2026-05-18 06:26:49.678 WARN (main) [c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2026-05-18T06:26:50.032979723Z 2026-05-18 06:26:50.030 INFO (main) [c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /var/solr/data 2026-05-18T06:26:50.219510925Z 2026-05-18 06:26:50.219 WARN (main) [c: s: r: x: t:] o.g.j.m.i.MessagingBinders A class jakarta.activation.DataSource for a default provider MessageBodyWriter<jakarta.activation.DataSource> was not found. The provider is not available. 2026-05-18T06:26:50.509325047Z 2026-05-18 06:26:50.504 INFO (main) [c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-05-18T06:26:50.650010839Z 2026-05-18 06:26:50.649 INFO (main) [c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@71f67a79{solr-jetty-context.xml,/solr,file:///opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp/,AVAILABLE}{/opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp} 2026-05-18T06:26:50.657650646Z 2026-05-18 06:26:50.657 INFO (main) [c: s: r: x: t:] o.e.j.s.RequestLogWriter Opened /var/solr/logs/2026_05_18.request.log 2026-05-18T06:26:50.663136205Z 2026-05-18 06:26:50.662 INFO (main) [c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@61884cb1{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8984} 2026-05-18T06:26:50.665144484Z 2026-05-18 06:26:50.664 INFO (main) [c: s: r: x: t:] o.e.j.s.Server Started Server@350ec41e{STARTING}[10.0.26,sto=0] @4357ms 2026-05-18T06:26:50.829052841Z 2026-05-18 06:26:50.828 INFO (qtp985324122-27-solr-node2-1) [c: s: r: x: t:solr-node2-1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=42 2026-05-18T06:26:50.891855310Z 2026-05-18 06:26:50.891 INFO (qtp985324122-55-solr-node2-2) [c: s: r: x: t:solr-node2-2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=16 2026-05-18T06:26:54.772921442Z 2026-05-18 06:26:54.772 INFO (qtp985324122-59-solr-node1-6) [c: s: r: x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=techproducts&newCollection=true&collection=test-collection&version=2&replicaType=NRT&coreNodeName=core_node6&name=test-collection_shard1_replica_n4&action=CREATE&numShards=3&shard=shard1&wt=javabin 2026-05-18T06:26:54.832719908Z 2026-05-18 06:26:54.832 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.12.0 2026-05-18T06:26:54.888458876Z 2026-05-18 06:26:54.888 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.s.IndexSchema Schema name=default-config 2026-05-18T06:26:55.217247400Z 2026-05-18 06:26:55.216 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.s.IndexSchema Loaded schema default-config/1.7 with uniqueid field id 2026-05-18T06:26:55.217271837Z 2026-05-18 06:26:55.216 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.CoreContainer Creating SolrCore 'test-collection_shard1_replica_n4' using configuration from configset techproducts, trusted=true 2026-05-18T06:26:55.236934391Z 2026-05-18 06:26:55.236 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.SolrCore Opening new SolrCore at [/var/solr/data/test-collection_shard1_replica_n4], dataDir=[/var/solr/data/test-collection_shard1_replica_n4/data/] 2026-05-18T06:26:55.682356470Z 2026-05-18 06:26:55.681 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-05-18T06:26:55.702054909Z 2026-05-18 06:26:55.701 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2026-05-18T06:26:55.706107238Z 2026-05-18 06:26:55.705 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2026-05-18T06:26:55.706911376Z 2026-05-18 06:26:55.706 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 2026-05-18T06:26:55.706975024Z 2026-05-18 06:26:55.706 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.u.CommitTracker Soft AutoCommit: if uncommitted for 3000ms; 2026-05-18T06:26:55.753024244Z 2026-05-18 06:26:55.752 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/techproducts 2026-05-18T06:26:55.756173814Z 2026-05-18 06:26:55.755 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/techproducts 2026-05-18T06:26:55.758373274Z 2026-05-18 06:26:55.757 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/techproducts/managed-schema.xml 2026-05-18T06:26:55.760027699Z 2026-05-18 06:26:55.759 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest 2026-05-18T06:26:55.771393128Z 2026-05-18 06:26:55.770 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.s.DirectSolrSpellChecker init: {maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4, accuracy=0.5, maxQueryFrequency=0.01, name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal} 2026-05-18T06:26:55.779311371Z 2026-05-18 06:26:55.778 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2026-05-18T06:26:55.785367321Z 2026-05-18 06:26:55.784 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard1_replica_n4 solr-node1-6 core_node6 solr-node2:8984_solr test-collection shard1) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.QuerySenderListener QuerySenderListener done. 2026-05-18T06:26:55.785457012Z 2026-05-18 06:26:55.785 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard1_replica_n4 solr-node1-6 core_node6 solr-node2:8984_solr test-collection shard1) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default 2026-05-18T06:26:55.794469884Z 2026-05-18 06:26:55.793 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard1_replica_n4 solr-node1-6 core_node6 solr-node2:8984_solr test-collection shard1) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2026-05-18T06:26:55.814374603Z 2026-05-18 06:26:55.813 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test-collection/terms/shard1 to Terms{values={core_node6=0}, version=0} for registerTerm 2026-05-18T06:26:55.816162311Z 2026-05-18 06:26:55.815 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test-collection/leaders/shard1 2026-05-18T06:26:55.841502070Z 2026-05-18 06:26:55.840 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2026-05-18T06:26:55.841534690Z 2026-05-18 06:26:55.841 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2026-05-18T06:26:55.841537787Z 2026-05-18 06:26:55.841 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.SyncStrategy Sync replicas to http://solr-node2:8984/solr/test-collection_shard1_replica_n4/ 2026-05-18T06:26:55.843115259Z 2026-05-18 06:26:55.842 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2026-05-18T06:26:55.844132838Z 2026-05-18 06:26:55.843 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.SyncStrategy http://solr-node2:8984/solr/test-collection_shard1_replica_n4/ has no replicas 2026-05-18T06:26:55.845506120Z 2026-05-18 06:26:55.845 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test-collection/leaders/shard1/leader after winning as /collections/test-collection/leader_elect/shard1/election/72074547711901699-core_node6-n_0000000000 2026-05-18T06:26:55.855484022Z 2026-05-18 06:26:55.855 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://solr-node2:8984/solr/test-collection_shard1_replica_n4/ shard1 2026-05-18T06:26:55.997193352Z 2026-05-18 06:26:55.996 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 205] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-18T06:26:56.001565531Z 2026-05-18 06:26:56.001 INFO (qtp985324122-59-solr-node1-6) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-6] o.a.s.c.ZkController I am the leader, no recovery necessary 2026-05-18T06:26:56.014519301Z 2026-05-18 06:26:56.014 INFO (qtp985324122-59-solr-node1-6) [c: s: r: x: t:solr-node1-6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=techproducts&newCollection=true&name=test-collection_shard1_replica_n4&action=CREATE&numShards=3&collection=test-collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1243 2026-05-18T06:26:56.114865017Z 2026-05-18 06:26:56.114 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 208] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-18T06:26:56.657155983Z 2026-05-18 06:26:56.656 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 223] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-18T06:26:56.962207538Z 2026-05-18 06:26:56.961 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 226] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-18T06:26:57.429981660Z 2026-05-18 06:26:57.429 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 241] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-18T06:26:57.556233155Z 2026-05-18 06:26:57.555 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 247] for collection [test-collection] has occurred - updating... (live nodes size: [3]) # === Docker inspect for solr-node2 === { "Name": "/solr-node2", "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 1732666, "ExitCode": 0, "Error": "", "StartedAt": "2026-05-18T06:26:46.079487694Z", "FinishedAt": "0001-01-01T00:00:00Z" }, "Ports": { "8983/tcp": null } } # === Docker logs for solr-node3 === 2026-05-18T06:26:46.526720670Z *** [WARN] *** Your open file limit is currently 1024. 2026-05-18T06:26:46.526757434Z It should be set to 65000 to avoid operational disruption. 2026-05-18T06:26:46.526760685Z If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh 2026-05-18T06:26:46.527040266Z Solr will start in SolrCloud mode by default in version 10, and you will no longer need to pass in -c or --cloud flag. 2026-05-18T06:26:46.527049947Z 2026-05-18T06:26:46.536769875Z Java 17 detected. Enabled workaround for SOLR-16463 2026-05-18T06:26:46.544755201Z [0.002s][warning][pagesize] UseLargePages disabled, no large pages configured and available on the system. 2026-05-18T06:26:46.594240014Z CompileCommand: exclude com/github/benmanes/caffeine/cache/BoundedLocalCache.put bool exclude = true 2026-05-18T06:26:46.625515997Z WARNING: A command line option has enabled the Security Manager 2026-05-18T06:26:46.625547524Z WARNING: The Security Manager is deprecated and will be removed in a future release 2026-05-18T06:26:47.724425098Z 2026-05-18 06:26:47.721 INFO (main) [c: s: r: x: t:] o.e.j.s.Server jetty-10.0.26; built: 2025-08-14T15:56:56.454Z; git: 65a55c55a68c56d5f2e8232164439bd6e76e53d1; jvm 17.0.16+8 2026-05-18T06:26:48.001984268Z 2026-05-18 06:26:48.001 WARN (main) [c: s: r: x: t:] o.e.j.u.DeprecationWarning Using @Deprecated Class org.eclipse.jetty.servlet.listener.ELContextCleaner 2026-05-18T06:26:48.026521664Z 2026-05-18 06:26:48.026 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2026-05-18T06:26:48.033398446Z 2026-05-18 06:26:48.032 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.10.0-SNAPSHOT 1edeb3ac6a97186b4ae7de511196a1769de7960e [snapshot build, details omitted] 2026-05-18T06:26:48.033502982Z 2026-05-18 06:26:48.033 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port 8985 2026-05-18T06:26:48.033642319Z 2026-05-18 06:26:48.033 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /opt/solr-9.10.0-SNAPSHOT-slim 2026-05-18T06:26:48.033675525Z 2026-05-18 06:26:48.033 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2026-05-18T06:26:48.033158572Z 2026-05-18T06:26:48.036436664Z 2026-05-18 06:26:48.036 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr started with "-XX:+CrashOnOutOfMemoryError" that will crash on any OutOfMemoryError exception. The cause of the OOME will be logged in the crash file at the following path: /var/solr/logs/jvm_crash_1.log 2026-05-18T06:26:48.058368611Z 2026-05-18 06:26:48.057 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /var/solr/data (source: system property: solr.solr.home) 2026-05-18T06:26:48.082268095Z 2026-05-18 06:26:48.081 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-05-18T06:26:48.220605091Z 2026-05-18 06:26:48.220 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2026-05-18T06:26:48.238498764Z 2026-05-18 06:26:48.237 INFO (zkCallback-1-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-05-18T06:26:48.238572399Z 2026-05-18 06:26:48.238 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-05-18T06:26:48.238698848Z 2026-05-18 06:26:48.238 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-05-18T06:26:48.347235805Z 2026-05-18 06:26:48.346 INFO (main) [c: s: r: x: t:] o.a.s.c.NodeConfig Loading solr.xml from SolrHome (not found in ZooKeeper) 2026-05-18T06:26:48.347420419Z 2026-05-18 06:26:48.347 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig solr.xml not found in SOLR_HOME, using built-in default 2026-05-18T06:26:48.347547346Z 2026-05-18 06:26:48.347 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/solr.xml 2026-05-18T06:26:48.383169039Z 2026-05-18 06:26:48.382 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrResourceLoader Added 1 libs to classloader, from paths: [/opt/solr-9.10.0-SNAPSHOT-slim/lib] 2026-05-18T06:26:49.316895453Z 2026-05-18 06:26:49.315 INFO (main) [c: s: r: x: t:] o.a.s.u.t.SimplePropagator Always-on trace id generation enabled. 2026-05-18T06:26:49.467296109Z 2026-05-18 06:26:49.466 WARN (main) [c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Jetty request logging enabled. Will retain logs for last 3 days. See chapter "Configuring Logging" in reference guide for how to configure. 2026-05-18T06:26:49.468707964Z 2026-05-18 06:26:49.466 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=solr-node1:9983 2026-05-18T06:26:49.477399119Z 2026-05-18 06:26:49.476 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-05-18T06:26:49.482580226Z 2026-05-18 06:26:49.482 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2026-05-18T06:26:49.487222016Z 2026-05-18 06:26:49.486 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-05-18T06:26:49.487275352Z 2026-05-18 06:26:49.486 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-05-18T06:26:49.519080623Z 2026-05-18 06:26:49.518 WARN (main) [c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2026-05-18T06:26:49.534345418Z 2026-05-18 06:26:49.533 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2026-05-18T06:26:49.553044515Z 2026-05-18 06:26:49.552 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) 2026-05-18T06:26:49.558834365Z 2026-05-18 06:26:49.558 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-05-18T06:26:49.573457043Z 2026-05-18 06:26:49.573 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Publish node=solr-node3:8985_solr as DOWN 2026-05-18T06:26:49.584619047Z 2026-05-18 06:26:49.584 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper: /live_nodes/solr-node3:8985_solr 2026-05-18T06:26:49.594234765Z 2026-05-18 06:26:49.593 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2026-05-18T06:26:49.635734994Z 2026-05-18 06:26:49.635 WARN (main) [c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2026-05-18T06:26:49.907393760Z 2026-05-18 06:26:49.906 INFO (main) [c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /var/solr/data 2026-05-18T06:26:50.088270919Z 2026-05-18 06:26:50.087 WARN (main) [c: s: r: x: t:] o.g.j.m.i.MessagingBinders A class jakarta.activation.DataSource for a default provider MessageBodyWriter<jakarta.activation.DataSource> was not found. The provider is not available. 2026-05-18T06:26:50.358891398Z 2026-05-18 06:26:50.358 INFO (main) [c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-05-18T06:26:50.480063794Z 2026-05-18 06:26:50.479 INFO (main) [c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@71f67a79{solr-jetty-context.xml,/solr,file:///opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp/,AVAILABLE}{/opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp} 2026-05-18T06:26:50.485606100Z 2026-05-18 06:26:50.485 INFO (main) [c: s: r: x: t:] o.e.j.s.RequestLogWriter Opened /var/solr/logs/2026_05_18.request.log 2026-05-18T06:26:50.496813666Z 2026-05-18 06:26:50.496 INFO (main) [c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@61884cb1{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8985} 2026-05-18T06:26:50.497798800Z 2026-05-18 06:26:50.497 INFO (main) [c: s: r: x: t:] o.e.j.s.Server Started Server@350ec41e{STARTING}[10.0.26,sto=0] @3954ms 2026-05-18T06:26:52.991636429Z 2026-05-18 06:26:52.978 INFO (qtp985324122-27-solr-node3-1) [c: s: r: x: t:solr-node3-1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=160 2026-05-18T06:26:53.083987025Z 2026-05-18 06:26:53.083 INFO (qtp985324122-56-solr-node3-2) [c: s: r: x: t:solr-node3-2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=23 2026-05-18T06:26:54.491467404Z 2026-05-18 06:26:54.490 INFO (qtp985324122-59-solr-node3-3) [c: s: r: x: t:solr-node3-3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=21 2026-05-18T06:26:54.772866073Z 2026-05-18 06:26:54.771 INFO (qtp985324122-60-solr-node1-6) [c: s: r: x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=techproducts&newCollection=true&collection=test-collection&version=2&replicaType=NRT&coreNodeName=core_node5&name=test-collection_shard2_replica_n2&action=CREATE&numShards=3&shard=shard2&wt=javabin 2026-05-18T06:26:54.863325487Z 2026-05-18 06:26:54.862 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.12.0 2026-05-18T06:26:54.976896139Z 2026-05-18 06:26:54.976 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.s.IndexSchema Schema name=default-config 2026-05-18T06:26:55.376553681Z 2026-05-18 06:26:55.376 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.s.IndexSchema Loaded schema default-config/1.7 with uniqueid field id 2026-05-18T06:26:55.376578209Z 2026-05-18 06:26:55.376 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.CoreContainer Creating SolrCore 'test-collection_shard2_replica_n2' using configuration from configset techproducts, trusted=true 2026-05-18T06:26:55.399103628Z 2026-05-18 06:26:55.398 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.SolrCore Opening new SolrCore at [/var/solr/data/test-collection_shard2_replica_n2], dataDir=[/var/solr/data/test-collection_shard2_replica_n2/data/] 2026-05-18T06:26:56.204774511Z 2026-05-18 06:26:56.204 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-05-18T06:26:56.231007723Z 2026-05-18 06:26:56.230 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2026-05-18T06:26:56.239461501Z 2026-05-18 06:26:56.239 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2026-05-18T06:26:56.302797344Z 2026-05-18 06:26:56.301 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 2026-05-18T06:26:56.302824936Z 2026-05-18 06:26:56.302 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.u.CommitTracker Soft AutoCommit: if uncommitted for 3000ms; 2026-05-18T06:26:56.456088214Z 2026-05-18 06:26:56.455 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/techproducts 2026-05-18T06:26:56.473678860Z 2026-05-18 06:26:56.473 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/techproducts 2026-05-18T06:26:56.476368636Z 2026-05-18 06:26:56.476 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/techproducts/managed-schema.xml 2026-05-18T06:26:56.478096134Z 2026-05-18 06:26:56.477 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest 2026-05-18T06:26:56.490586375Z 2026-05-18 06:26:56.490 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.s.DirectSolrSpellChecker init: {accuracy=0.5, maxQueryFrequency=0.01, maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4, name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal} 2026-05-18T06:26:56.502696331Z 2026-05-18 06:26:56.502 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2026-05-18T06:26:56.508314523Z 2026-05-18 06:26:56.507 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard2_replica_n2 solr-node1-6 core_node5 solr-node3:8985_solr test-collection shard2) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.QuerySenderListener QuerySenderListener done. 2026-05-18T06:26:56.508415514Z 2026-05-18 06:26:56.508 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard2_replica_n2 solr-node1-6 core_node5 solr-node3:8985_solr test-collection shard2) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default 2026-05-18T06:26:56.516367511Z 2026-05-18 06:26:56.515 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard2_replica_n2 solr-node1-6 core_node5 solr-node3:8985_solr test-collection shard2) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2026-05-18T06:26:56.523889785Z 2026-05-18 06:26:56.523 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test-collection/terms/shard2 to Terms{values={core_node5=0}, version=0} for registerTerm 2026-05-18T06:26:56.525357906Z 2026-05-18 06:26:56.525 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test-collection/leaders/shard2 2026-05-18T06:26:56.538760871Z 2026-05-18 06:26:56.538 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2026-05-18T06:26:56.538918442Z 2026-05-18 06:26:56.538 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2026-05-18T06:26:56.538930065Z 2026-05-18 06:26:56.538 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.SyncStrategy Sync replicas to http://solr-node3:8985/solr/test-collection_shard2_replica_n2/ 2026-05-18T06:26:56.540015700Z 2026-05-18 06:26:56.539 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2026-05-18T06:26:56.540511722Z 2026-05-18 06:26:56.540 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.SyncStrategy http://solr-node3:8985/solr/test-collection_shard2_replica_n2/ has no replicas 2026-05-18T06:26:56.541511862Z 2026-05-18 06:26:56.541 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test-collection/leaders/shard2/leader after winning as /collections/test-collection/leader_elect/shard2/election/72074547711901700-core_node5-n_0000000000 2026-05-18T06:26:56.552955758Z 2026-05-18 06:26:56.552 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://solr-node3:8985/solr/test-collection_shard2_replica_n2/ shard2 2026-05-18T06:26:56.657205737Z 2026-05-18 06:26:56.656 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 223] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-18T06:26:56.660970531Z 2026-05-18 06:26:56.660 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.ZkController I am the leader, no recovery necessary 2026-05-18T06:26:56.669638100Z 2026-05-18 06:26:56.669 INFO (qtp985324122-60-solr-node1-6) [c: s: r: x: t:solr-node1-6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=techproducts&newCollection=true&name=test-collection_shard2_replica_n2&action=CREATE&numShards=3&collection=test-collection&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1899 2026-05-18T06:26:56.962253564Z 2026-05-18 06:26:56.961 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 226] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-18T06:26:57.429915835Z 2026-05-18 06:26:57.429 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 241] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-18T06:26:57.497627925Z 2026-05-18 06:26:57.497 INFO (qtp985324122-58-solr-node3-4) [c:test-collection s: r: x: t:solr-node3-4] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas 2026-05-18T06:26:57.556156688Z 2026-05-18 06:26:57.555 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 247] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-18T06:26:57.560209224Z 2026-05-18 06:26:57.559 INFO (qtp985324122-58-solr-node3-4) [c:test-collection s: r: x: t:solr-node3-4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=techproducts&name=test-collection&nrtReplicas=1&action=CREATE&numShards=3&wt=json&version=2.2} status=0 QTime=3054 # === Docker inspect for solr-node3 === { "Name": "/solr-node3", "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 1732849, "ExitCode": 0, "Error": "", "StartedAt": "2026-05-18T06:26:46.309037033Z", "FinishedAt": "0001-01-01T00:00:00Z" }, "Ports": { "8983/tcp": null } } # Docker artifacts saved to: /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/docker not ok 82 Docker SolrCloud rolling upgrade # in 30464 ms # (in test file test/test_rolling_upgrade.bats, line 118) # `wait_for 30 1 docker exec solr-node1 solr healthcheck -c test-collection' failed with status 127 # 9.10.0-SNAPSHOT-slim: Pulling from apache/solr-nightly # af6eca94c810: Pulling fs layer # cb0efb96dabd: Pulling fs layer # 3e9d91201f40: Pulling fs layer # 66b76b382631: Pulling fs layer # 601f2c23751f: Pulling fs layer # 0ed719aef393: Pulling fs layer # 69a09c96e8bf: Pulling fs layer # c937aee9a870: Pulling fs layer # 9cdfe5320de8: Pulling fs layer # 3aa9120e46f5: Pulling fs layer # 4f4fb700ef54: Pulling fs layer # 66b76b382631: Waiting # 601f2c23751f: Waiting # 0ed719aef393: Waiting # 69a09c96e8bf: Waiting # c937aee9a870: Waiting # 4f4fb700ef54: Waiting # 9cdfe5320de8: Waiting # 3aa9120e46f5: Waiting # cb0efb96dabd: Verifying Checksum # cb0efb96dabd: Download complete # 3e9d91201f40: Verifying Checksum # 3e9d91201f40: Download complete # af6eca94c810: Verifying Checksum # af6eca94c810: Download complete # 66b76b382631: Verifying Checksum # 66b76b382631: Download complete # 601f2c23751f: Verifying Checksum # 601f2c23751f: Download complete # 69a09c96e8bf: Download complete # 9cdfe5320de8: Verifying Checksum # 9cdfe5320de8: Download complete # c937aee9a870: Verifying Checksum # c937aee9a870: Download complete # 4f4fb700ef54: Verifying Checksum # 4f4fb700ef54: Download complete # 3aa9120e46f5: Download complete # 0ed719aef393: Verifying Checksum # 0ed719aef393: Download complete # af6eca94c810: Pull complete # cb0efb96dabd: Pull complete # 3e9d91201f40: Pull complete # 66b76b382631: Pull complete # 601f2c23751f: Pull complete # 0ed719aef393: Pull complete # 69a09c96e8bf: Pull complete # c937aee9a870: Pull complete # 9cdfe5320de8: Pull complete # 3aa9120e46f5: Pull complete # 4f4fb700ef54: Pull complete # Digest: sha256:15c8155ceffe1042f37c77bb537aa531804a3510702ff87f2af5fedf523f4203 # Status: Downloaded newer image for apache/solr-nightly:9.10.0-SNAPSHOT-slim # docker.io/apache/solr-nightly:9.10.0-SNAPSHOT-slim # 10.0.0-SNAPSHOT-slim: Pulling from apache/solr-nightly # 40d16f30db40: Already exists # 9d5a0b6cb36c: Already exists # 49518c28c0b3: Already exists # 41162acdcc29: Already exists # 2ed0fd558ca3: Already exists # 8b0357ffbe54: Pulling fs layer # 0df26b0d5a69: Pulling fs layer # a26fc87814fe: Pulling fs layer # 67860c4a05fe: Pulling fs layer # d1a380e5a7b1: Pulling fs layer # 4f4fb700ef54: Pulling fs layer # 67860c4a05fe: Waiting # d1a380e5a7b1: Waiting # 4f4fb700ef54: Waiting # 0df26b0d5a69: Verifying Checksum # 0df26b0d5a69: Download complete # a26fc87814fe: Download complete # 67860c4a05fe: Verifying Checksum # 67860c4a05fe: Download complete # 4f4fb700ef54: Verifying Checksum # 4f4fb700ef54: Download complete # d1a380e5a7b1: Verifying Checksum # d1a380e5a7b1: Download complete # 8b0357ffbe54: Verifying Checksum # 8b0357ffbe54: Download complete # 8b0357ffbe54: Pull complete # 0df26b0d5a69: Pull complete # a26fc87814fe: Pull complete # 67860c4a05fe: Pull complete # d1a380e5a7b1: Pull complete # 4f4fb700ef54: Pull complete # Digest: sha256:16825c9cb8e05e7a6dd9d4209615781d30bc3137a6017a5254cec93560c7c8ba # Status: Downloaded newer image for apache/solr-nightly:10.0.0-SNAPSHOT-slim # docker.io/apache/solr-nightly:10.0.0-SNAPSHOT-slim # 01dd5fbe11936c0ad0879ff9d09132e17f2c83af655311d31c3056637c2b8ffb # solr-data1 # solr-data2 # solr-data3 # Starting solr-node1 with embedded ZooKeeper # e1e5c6418c709585da07ce9863ece39e8dec02f55fe116f4fec91659b5d38b57 # Starting solr-node2 connected to first node's ZooKeeper # 613bca23bda59090f7f38e1f3e9197d6bf43a2e417576912830cd5f46d96f108 # Started solr-node3 connected to first node's ZooKeeper # c4aff0d28e964a9cf439d026ea69e520f8f31cf2bd8a2c95ed497a1b66854c58 # Creating a Collection # Neither --zk-host or --solr-url parameters provided so assuming solr url is http://localhost:8983. # Neither --zk-host or --solr-url parameters provided so assuming solr url is http://localhost:8983. # WARN - 2026-05-18 06:26:54.240; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-05-18 06:26:54.270; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARNING: URLs provided to this tool needn't include Solr's context-root (e.g. "/solr"). Such URLs are deprecated and support for them will be removed in a future release. Correcting from [http://solr-node3:8985/solr] to [http://solr-node3:8985/]. # Created collection 'test-collection' with 3 shard(s), 1 replica(s) with config-set 'techproducts' # Checking collection health # /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/test/test_rolling_upgrade.bats: line 118: wait_for: command not found # solr-node1 # solr-node2 # solr-node3 # solr-node1 # solr-node2 # solr-node3 # solr-data1 # solr-data2 # solr-data3 # solrcloud-test ok 83 allowPaths - backup # in 15805 ms ok 84 snapshot lifecycle # in 4844 ms ok 85 snapshot list # in 3329 ms ok 86 snapshot describe # in 3330 ms ok 87 start solr with ssl # in 16533 ms ok 88 use different hostname when not checking peer-name # in 24784 ms ok 89 start solr with ssl and auth # in 14683 ms ok 90 start solr with client truststore and security manager # in 16620 ms ok 91 start solr with mTLS needed # in 45727 ms ok 92 start solr with mTLS wanted # in 34310 ms ok 93 test keystore reload # in 59102 ms ok 94 SOLR-11740 check 'solr stop' connection # in 15902 ms ok 95 stop command for single port # in 18284 ms ok 96 check stop command doesn't hang # in 218 ms ok 97 SOLR-16976 solr starts with remote JMX enabled # in 8105 ms ok 98 deprecated system properties converted to modern properties # in 195021 ms ok 99 start with custom jetty options # in 8218 ms ok 100 bootstrapping a configset # in 9305 ms ok 101 status detects locally running solr # in 9521 ms ok 102 status with --solr-url from user # in 7935 ms ok 103 status with --port from user # in 8170 ms ok 104 multiple connection options are prevented # in 859 ms ok 105 status with invalid --solr-url from user # in 1246 ms ok 106 status with --short format # in 195976 ms ok 107 searching solr via locally executed streaming expression # in 1723 ms ok 108 searching solr via remotely executed streaming expression # in 1288 ms ok 109 variable interpolation # in 1705 ms ok 110 searching solr without credentials fails with error # in 1141 ms ok 111 --version returns Solr version # in 736 ms ok 112 version as direct tool call still runs # in 756 ms ok 113 short help # in 789 ms ok 114 short help is inferred # in 797 ms ok 115 long help # in 798 ms ok 116 running subcommands with zk is prevented # in 731 ms ok 117 listing out files # in 2145 ms ok 118 connecting to solr via various solr urls and zk hosts # in 7945 ms ok 119 copying files around # in 11038 ms ok 120 upconfig # in 2547 ms ok 121 SOLR-12429 test upconfig fails with symlink # in 1206 ms ok 122 downconfig # in 1207 ms ok 123 bin/solr zk cp gets 'solrhome' from '--solr-home' command line option # in 1441 ms ok 124 env var ZK_HOST is honored # in 3359 ms ok 125 Cleanup # in 1873 ms > Task :solr:packaging:integrationTests FAILED FAILURE: Build failed with an exception. * Where: Build file '/home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build.gradle' line: 339 * What went wrong: Execution failed for task ':solr:packaging:integrationTests'. > Process 'command > '/home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/.gradle/node/node_modules/bats/bin/bats'' > finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.10/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 29m 15s 128 actionable tasks: 128 executed Publishing Build Scan to Develocity... https://develocity.apache.org/s/6r34x6y7xxcuy Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure Archiving artifacts Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
