Build: https://ci-builds.apache.org/job/Solr/job/Solr-TestIntegration-10.x/243/
No tests ran. Build Log: [...truncated 347 lines...] # ERROR: KeeperErrorCode = NoNode for /security.json # -- # # Last output: # WARN - 2026-06-24 12:38:52.647; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-06-24 12:38:52.651; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-06-24 12:38:53.146; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-06-24 12:38:53.146; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # # ERROR: KeeperErrorCode = NoNode for /security.json not ok 9 create, config, api, and delete with basic auth # in 11029 ms # (from function `setup' in test file test/test_basic_auth.bats, line 24) # `solr start -Dsolr.packages.enabled=true' failed # Starting Solr # # Port 40685 is already being used by another process (pid: 2536087) # Please choose a different port using the -p option. # # Please find the SOLR_HOME snapshot for failed test #1 at: /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/failure-snapshots/9-1 # Last output: # WARN - 2026-06-24 12:38:54.390; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-06-24 12:38:54.394; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # # ERROR: KeeperErrorCode = ConnectionLoss for /security.json ok 10 post, postlogs and export with basic auth # in 18735 ms ok 11 package with basic auth # in 12859 ms ok 12 admin UI static content is excepted from basic auth # in 11299 ms ok 13 nothing # in 13 ms ok 14 server does not compress response without Accept-Encoding header # in 168 ms ok 15 server compresses response when Accept-Encoding: gzip is requested # in 82 ms ok 16 compressed response can be decompressed and parsed # in 84 ms ok 17 setting property # in 12538 ms ok 18 short form of setting property # in 6982 ms ok 19 connecting to solr via various connection types # in 11486 ms ok 20 create for non cloud mode # in 8491 ms ok 21 create for cloud mode # in 10481 ms ok 22 multiple connection options are prevented # in 946 ms ok 23 create collection # in 8434 ms ok 24 create collection using solrUrl # in 5750 ms ok 25 create collection using legacy solrUrl # in 5500 ms ok 26 create collection using Zookeeper # in 5815 ms ok 27 reject d option with invalid config dir # in 2847 ms ok 28 accept d option with builtin config # in 5704 ms ok 29 accept d option with explicit path to config # in 5568 ms ok 30 accept n option as config name # in 5429 ms ok 31 allow config reuse when n option specifies same config # in 9842 ms ok 32 create multisharded collections when s provided # in 5404 ms ok 33 create replicated collections when rf provided # in 6388 ms ok 34 can delete collections # in 12069 ms ok 35 can delete collections with solr-url # in 8881 ms ok 36 can delete collections with solr-connection # in 8562 ms ok 37 collection delete also deletes zk config # in 7936 ms ok 38 deletes accompanying zk config with nondefault name # in 8037 ms ok 39 delete-config option can opt to leave config in zk # in 7491 ms ok 40 start -e cloud works with --jvm-opts # in 23009 ms ok 41 start -e cloud works with --no-prompt # in 45672 ms ok 42 Check export command # in 20545 ms ok 43 export fails on non cloud mode # in 9858 ms Waiting for Tika Server to be ready on port 40690 WARNING: Tika Server did not become ready in time; Tika-dependent tests will be bypassed. WARNING: Docker not available; bypassing test. ok 44 using curl to extract a single pdf file # in 16648 ms WARNING: Docker not available; bypassing test. ok 45 using the bin/solr post tool to extract content from pdf # in 16668 ms WARNING: Docker not available; bypassing test. ok 46 using the bin/solr post tool to crawl web site # in 16630 ms Stopping Tika Server container ok 47 healthcheck on cloud solr # in 10883 ms ok 48 healthcheck on remote cloud solr # in 10436 ms ok 49 healthcheck errors on standalone solr # in 12183 ms ok 50 solr help flag prints help # in 764 ms ok 51 solr with no flags prints help # in 779 ms ok 52 start help flag prints help # in 155 ms ok 53 start h flag prints help # in 157 ms ok 54 stop help flag prints help # in 150 ms ok 55 restart help flag prints help # in 156 ms ok 56 status help flag prints help # in 826 ms ok 57 healthcheck help flag prints help # in 781 ms ok 58 create help flag prints help # in 796 ms ok 59 delete help flag prints help # in 836 ms ok 60 zk help flag prints help # in 817 ms ok 61 auth help flag prints help # in 785 ms ok 62 assert help flag prints help # in 810 ms ok 63 post help flag prints help # in 888 ms ok 64 SQL Module # in 16947 ms ok 65 icu collation in analysis-extras module # in 13068 ms ok 66 Check lifecycle of sentiment classification # in 24364 ms ok 67 lifecycle of package # in 8719 ms ok 68 deploying and undeploying a collection level package # in 14073 ms ok 69 deploying and undeploying a cluster level package # skip For developing package infra; requires a connection to github ok 70 Affinity placement plugin using sysprop # in 16398 ms ok 71 Random placement plugin using ENV # in 16227 ms ok 72 Check help command # in 2554 ms ok 73 basic post with a type specified # in 5908 ms ok 74 basic post with collection instead of url parameter # in 4098 ms ok 75 basic post with solr-url and collection # in 4220 ms ok 76 basic post with -s (solr-connection short form) and collection # in 4212 ms ok 77 basic post WITHOUT a type specified # in 12100 ms ok 78 crawling a directory as a dry-run # in 862 ms ok 79 crawling a directory # in 4775 ms ok 80 skipcommit and optimize and delete # in 4041 ms ok 81 args mode # in 7349 ms ok 82 stdin mode # in 3592 ms ok 83 verbose echo the Solr response # in 4130 ms ok 84 post solr log into solr via cli # in 10230 ms # Test failed - capturing Docker diagnostics # === docker ps (summary) === NAMES STATUS IMAGE PORTS solr-node3 Up 10 seconds apache/solr-nightly:9.10.0-SNAPSHOT-slim 8983/tcp solr-node2 Up 10 seconds apache/solr-nightly:9.10.0-SNAPSHOT-slim 8983/tcp solr-node1 Up 15 seconds apache/solr-nightly:9.10.0-SNAPSHOT-slim 8983/tcp # === Docker logs for solr-node1 === 2026-06-24T12:50:02.602157180Z *** [WARN] *** Your open file limit is currently 1024. 2026-06-24T12:50:02.602201591Z It should be set to 65000 to avoid operational disruption. 2026-06-24T12:50:02.602205032Z If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh 2026-06-24T12:50:02.602570572Z Solr will start in SolrCloud mode by default in version 10, and you will no longer need to pass in -c or --cloud flag. 2026-06-24T12:50:02.602582884Z 2026-06-24T12:50:02.614223433Z Java 17 detected. Enabled workaround for SOLR-16463 2026-06-24T12:50:02.622537514Z [0.002s][warning][pagesize] UseLargePages disabled, no large pages configured and available on the system. 2026-06-24T12:50:02.668637442Z CompileCommand: exclude com/github/benmanes/caffeine/cache/BoundedLocalCache.put bool exclude = true 2026-06-24T12:50:02.700003577Z WARNING: A command line option has enabled the Security Manager 2026-06-24T12:50:02.700027459Z WARNING: The Security Manager is deprecated and will be removed in a future release 2026-06-24T12:50:03.994557352Z 2026-06-24 12:50:03.991 INFO (main) [c: s: r: x: t:] o.e.j.s.Server jetty-10.0.26; built: 2025-08-14T15:56:56.454Z; git: 65a55c55a68c56d5f2e8232164439bd6e76e53d1; jvm 17.0.16+8 2026-06-24T12:50:04.258527055Z 2026-06-24 12:50:04.257 WARN (main) [c: s: r: x: t:] o.e.j.u.DeprecationWarning Using @Deprecated Class org.eclipse.jetty.servlet.listener.ELContextCleaner 2026-06-24T12:50:04.284037622Z 2026-06-24 12:50:04.283 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2026-06-24T12:50:04.292165744Z 2026-06-24 12:50:04.291 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.10.0-SNAPSHOT 1edeb3ac6a97186b4ae7de511196a1769de7960e [snapshot build, details omitted] 2026-06-24T12:50:04.292384628Z 2026-06-24 12:50:04.291 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port 8983 2026-06-24T12:50:04.292579679Z 2026-06-24 12:50:04.291 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /opt/solr-9.10.0-SNAPSHOT-slim 2026-06-24T12:50:04.292708472Z 2026-06-24 12:50:04.291 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2026-06-24T12:50:04.291718583Z 2026-06-24T12:50:04.295594185Z 2026-06-24 12:50:04.295 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr started with "-XX:+CrashOnOutOfMemoryError" that will crash on any OutOfMemoryError exception. The cause of the OOME will be logged in the crash file at the following path: /var/solr/logs/jvm_crash_1.log 2026-06-24T12:50:04.318459686Z 2026-06-24 12:50:04.317 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /var/solr/data (source: system property: solr.solr.home) 2026-06-24T12:50:04.332736225Z 2026-06-24 12:50:04.332 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig solr.xml not found in SOLR_HOME, using built-in default 2026-06-24T12:50:04.333031939Z 2026-06-24 12:50:04.332 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/solr.xml 2026-06-24T12:50:04.369761053Z 2026-06-24 12:50:04.369 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrResourceLoader Added 1 libs to classloader, from paths: [/opt/solr-9.10.0-SNAPSHOT-slim/lib] 2026-06-24T12:50:05.114067530Z 2026-06-24 12:50:05.113 INFO (main) [c: s: r: x: t:] o.a.s.u.t.SimplePropagator Always-on trace id generation enabled. 2026-06-24T12:50:05.362793281Z 2026-06-24 12:50:05.362 WARN (main) [c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Jetty request logging enabled. Will retain logs for last 3 days. See chapter "Configuring Logging" in reference guide for how to configure. 2026-06-24T12:50:05.367836382Z 2026-06-24 12:50:05.367 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrZkServer Zookeeper configuration not found in /var/solr/data, using built-in default 2026-06-24T12:50:05.367854812Z 2026-06-24 12:50:05.367 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrZkServerProps Reading configuration from: /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/zoo.cfg 2026-06-24T12:50:05.370408800Z 2026-06-24 12:50:05.369 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrZkServer STARTING EMBEDDED ENSEMBLE ZOOKEEPER SERVER at port 9983, listening on host 0.0.0.0 2026-06-24T12:50:05.370435554Z 2026-06-24 12:50:05.370 WARN (main) [c: s: r: x: t:] o.a.s.c.SolrZkServer Embedded Zookeeper is not recommended in production environments. See Reference Guide for details. 2026-06-24T12:50:05.407363009Z 2026-06-24 12:50:05.406 WARN (embeddedZkServer) [c: s: r: x: t:] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0. 2026-06-24T12:50:05.877319007Z 2026-06-24 12:50:05.876 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=172.18.0.2:9983 2026-06-24T12:50:05.892176914Z 2026-06-24 12:50:05.891 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-06-24T12:50:05.932753883Z 2026-06-24 12:50:05.932 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2026-06-24T12:50:05.965484429Z 2026-06-24 12:50:05.964 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-06-24T12:50:05.965596570Z 2026-06-24 12:50:05.964 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-06-24T12:50:06.091513908Z 2026-06-24 12:50:06.090 WARN (main) [c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2026-06-24T12:50:06.114647834Z 2026-06-24 12:50:06.114 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-06-24T12:50:06.127648600Z 2026-06-24 12:50:06.127 INFO (main) [c: s: r: x: t:] o.a.s.c.OverseerElectionContext I am going to be the leader solr-node1:8983_solr 2026-06-24T12:50:06.137838592Z 2026-06-24 12:50:06.137 INFO (main) [c: s: r: x: t:] o.a.s.c.Overseer Overseer (id=72177986523693056-solr-node1:8983_solr-n_0000000000) starting 2026-06-24T12:50:06.202985634Z 2026-06-24 12:50:06.202 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper: /live_nodes/solr-node1:8983_solr 2026-06-24T12:50:06.206367993Z 2026-06-24 12:50:06.206 INFO (OverseerStateUpdate-72177986523693056-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.Overseer Starting to work on the main queue : solr-node1:8983_solr 2026-06-24T12:50:06.215322401Z 2026-06-24 12:50:06.214 INFO (OverseerStateUpdate-72177986523693056-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2026-06-24T12:50:06.257930162Z 2026-06-24 12:50:06.257 WARN (main) [c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2026-06-24T12:50:06.645104577Z 2026-06-24 12:50:06.644 INFO (main) [c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /var/solr/data 2026-06-24T12:50:06.834663439Z 2026-06-24 12:50:06.834 WARN (main) [c: s: r: x: t:] o.g.j.m.i.MessagingBinders A class jakarta.activation.DataSource for a default provider MessageBodyWriter<jakarta.activation.DataSource> was not found. The provider is not available. 2026-06-24T12:50:07.120230700Z 2026-06-24 12:50:07.119 INFO (main) [c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-06-24T12:50:07.267293009Z 2026-06-24 12:50:07.266 INFO (main) [c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@71f67a79{solr-jetty-context.xml,/solr,file:///opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp/,AVAILABLE}{/opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp} 2026-06-24T12:50:07.274523591Z 2026-06-24 12:50:07.274 INFO (main) [c: s: r: x: t:] o.e.j.s.RequestLogWriter Opened /var/solr/logs/2026_06_24.request.log 2026-06-24T12:50:07.279416533Z 2026-06-24 12:50:07.278 INFO (main) [c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@61884cb1{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8983} 2026-06-24T12:50:07.281969560Z 2026-06-24 12:50:07.281 INFO (main) [c: s: r: x: t:] o.e.j.s.Server Started Server@350ec41e{STARTING}[10.0.26,sto=0] @4660ms 2026-06-24T12:50:07.522745531Z 2026-06-24 12:50:07.522 INFO (qtp985324122-27-solr-node1-1) [c: s: r: x: t:solr-node1-1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=48 2026-06-24T12:50:07.575298814Z 2026-06-24 12:50:07.574 INFO (qtp985324122-96-solr-node1-2) [c: s: r: x: t:solr-node1-2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=13 2026-06-24T12:50:10.965209111Z 2026-06-24 12:50:10.964 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) 2026-06-24T12:50:11.045021108Z 2026-06-24 12:50:11.044 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2026-06-24T12:50:15.063090849Z 2026-06-24 12:50:15.062 INFO (qtp985324122-99-solr-node1-3) [c: s: r: x: t:solr-node1-3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=8 2026-06-24T12:50:15.091090421Z 2026-06-24 12:50:15.090 INFO (qtp985324122-99-solr-node1-4) [c: s: r: x: t:solr-node1-4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=9 2026-06-24T12:50:15.126712825Z 2026-06-24 12:50:15.126 INFO (qtp985324122-27-solr-node1-5) [c: s: r: x: t:solr-node1-5] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=2 2026-06-24T12:50:15.526632794Z 2026-06-24 12:50:15.525 INFO (qtp985324122-99-solr-node1-6) [c: s: r: x: t:solr-node1-6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=5 2026-06-24T12:50:15.554942374Z 2026-06-24 12:50:15.554 INFO (OverseerThreadFactory-17-thread-1) [c:test-collection s: r: x: t:] o.a.s.c.a.c.CreateCollectionCmd Create collection test-collection 2026-06-24T12:50:15.570623955Z 2026-06-24 12:50:15.570 INFO (OverseerThreadFactory-17-thread-1) [c:test-collection s: r: x: t:] o.a.s.c.c.ZkStateReader /collections/test-collection/state.json is deleted, stop watching children 2026-06-24T12:50:15.579476770Z 2026-06-24 12:50:15.578 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/test-collection/state.json zxid: 173] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-24T12:50:15.626535932Z 2026-06-24 12:50:15.626 INFO (OverseerStateUpdate-72177986523693056-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2026-06-24T12:50:15.626558320Z "core":"test-collection_shard3_replica_n1", 2026-06-24T12:50:15.626562159Z "node_name":"solr-node1:8983_solr", 2026-06-24T12:50:15.626565141Z "base_url":"http://solr-node1:8983/solr";, 2026-06-24T12:50:15.626568375Z "collection":"test-collection", 2026-06-24T12:50:15.626571163Z "shard":"shard3", 2026-06-24T12:50:15.626573978Z "state":"down", 2026-06-24T12:50:15.626576600Z "type":"NRT", 2026-06-24T12:50:15.626579167Z "operation":"ADDREPLICA", 2026-06-24T12:50:15.626581899Z "waitForFinalState":"false"} 2026-06-24T12:50:15.634206804Z 2026-06-24 12:50:15.633 INFO (OverseerStateUpdate-72177986523693056-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2026-06-24T12:50:15.634226874Z "core":"test-collection_shard2_replica_n2", 2026-06-24T12:50:15.634229274Z "node_name":"solr-node3:8985_solr", 2026-06-24T12:50:15.634231766Z "base_url":"http://solr-node3:8985/solr";, 2026-06-24T12:50:15.634233900Z "collection":"test-collection", 2026-06-24T12:50:15.634236177Z "shard":"shard2", 2026-06-24T12:50:15.634238153Z "state":"down", 2026-06-24T12:50:15.634240203Z "type":"NRT", 2026-06-24T12:50:15.634242134Z "operation":"ADDREPLICA", 2026-06-24T12:50:15.634245153Z "waitForFinalState":"false"} 2026-06-24T12:50:15.642358693Z 2026-06-24 12:50:15.641 INFO (OverseerStateUpdate-72177986523693056-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2026-06-24T12:50:15.642393585Z "core":"test-collection_shard1_replica_n4", 2026-06-24T12:50:15.642396560Z "node_name":"solr-node2:8984_solr", 2026-06-24T12:50:15.642398771Z "base_url":"http://solr-node2:8984/solr";, 2026-06-24T12:50:15.642400740Z "collection":"test-collection", 2026-06-24T12:50:15.642402830Z "shard":"shard1", 2026-06-24T12:50:15.642404800Z "state":"down", 2026-06-24T12:50:15.642406707Z "type":"NRT", 2026-06-24T12:50:15.642408703Z "operation":"ADDREPLICA", 2026-06-24T12:50:15.642410686Z "waitForFinalState":"false"} 2026-06-24T12:50:15.756734129Z 2026-06-24 12:50:15.756 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 185] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-24T12:50:15.856106102Z 2026-06-24 12:50:15.855 INFO (qtp985324122-29-solr-node1-8) [c: s: r: x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=techproducts&newCollection=true&collection=test-collection&version=2&replicaType=NRT&coreNodeName=core_node3&name=test-collection_shard3_replica_n1&action=CREATE&numShards=3&shard=shard3&wt=javabin 2026-06-24T12:50:15.949661268Z 2026-06-24 12:50:15.948 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.12.0 2026-06-24T12:50:16.026551167Z 2026-06-24 12:50:16.025 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.s.IndexSchema Schema name=default-config 2026-06-24T12:50:16.476891973Z 2026-06-24 12:50:16.476 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.s.IndexSchema Loaded schema default-config/1.7 with uniqueid field id 2026-06-24T12:50:16.477005046Z 2026-06-24 12:50:16.476 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.CoreContainer Creating SolrCore 'test-collection_shard3_replica_n1' using configuration from configset techproducts, trusted=true 2026-06-24T12:50:16.510762084Z 2026-06-24 12:50:16.510 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.SolrCore Opening new SolrCore at [/var/solr/data/test-collection_shard3_replica_n1], dataDir=[/var/solr/data/test-collection_shard3_replica_n1/data/] 2026-06-24T12:50:17.664752441Z 2026-06-24 12:50:17.663 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-06-24T12:50:17.719872361Z 2026-06-24 12:50:17.718 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2026-06-24T12:50:17.731060555Z 2026-06-24 12:50:17.730 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2026-06-24T12:50:17.733720499Z 2026-06-24 12:50:17.733 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 2026-06-24T12:50:17.733794028Z 2026-06-24 12:50:17.733 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.u.CommitTracker Soft AutoCommit: if uncommitted for 3000ms; 2026-06-24T12:50:17.811174338Z 2026-06-24 12:50:17.810 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/techproducts 2026-06-24T12:50:17.813949430Z 2026-06-24 12:50:17.813 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/techproducts 2026-06-24T12:50:17.816148287Z 2026-06-24 12:50:17.815 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/techproducts/managed-schema.xml 2026-06-24T12:50:17.818256026Z 2026-06-24 12:50:17.818 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest 2026-06-24T12:50:17.841061898Z 2026-06-24 12:50:17.840 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.s.DirectSolrSpellChecker init: {accuracy=0.5, maxQueryFrequency=0.01, maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4, name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal} 2026-06-24T12:50:17.850565040Z 2026-06-24 12:50:17.850 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2026-06-24T12:50:17.859209354Z 2026-06-24 12:50:17.858 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard3_replica_n1 solr-node1-8 core_node3 solr-node1:8983_solr test-collection shard3) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.QuerySenderListener QuerySenderListener done. 2026-06-24T12:50:17.859238884Z 2026-06-24 12:50:17.858 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard3_replica_n1 solr-node1-8 core_node3 solr-node1:8983_solr test-collection shard3) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default 2026-06-24T12:50:17.870498690Z 2026-06-24 12:50:17.870 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard3_replica_n1 solr-node1-8 core_node3 solr-node1:8983_solr test-collection shard3) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2026-06-24T12:50:17.878953985Z 2026-06-24 12:50:17.878 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test-collection/terms/shard3 to Terms{values={core_node3=0}, version=0} for registerTerm 2026-06-24T12:50:17.881280875Z 2026-06-24 12:50:17.880 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test-collection/leaders/shard3 2026-06-24T12:50:17.897475725Z 2026-06-24 12:50:17.897 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2026-06-24T12:50:17.897503757Z 2026-06-24 12:50:17.897 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2026-06-24T12:50:17.897530049Z 2026-06-24 12:50:17.897 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.SyncStrategy Sync replicas to http://solr-node1:8983/solr/test-collection_shard3_replica_n1/ 2026-06-24T12:50:17.898891660Z 2026-06-24 12:50:17.898 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2026-06-24T12:50:17.899493379Z 2026-06-24 12:50:17.899 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.SyncStrategy http://solr-node1:8983/solr/test-collection_shard3_replica_n1/ has no replicas 2026-06-24T12:50:17.900592550Z 2026-06-24 12:50:17.900 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test-collection/leaders/shard3/leader after winning as /collections/test-collection/leader_elect/shard3/election/72177986523693056-core_node3-n_0000000000 2026-06-24T12:50:17.907786530Z 2026-06-24 12:50:17.907 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://solr-node1:8983/solr/test-collection_shard3_replica_n1/ shard3 2026-06-24T12:50:18.013775889Z 2026-06-24 12:50:18.013 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 241] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-24T12:50:18.017623113Z 2026-06-24 12:50:18.017 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.ZkController I am the leader, no recovery necessary 2026-06-24T12:50:18.026562571Z 2026-06-24 12:50:18.026 INFO (qtp985324122-29-solr-node1-8) [c: s: r: x: t:solr-node1-8] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=techproducts&newCollection=true&name=test-collection_shard3_replica_n1&action=CREATE&numShards=3&collection=test-collection&shard=shard3&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2171 2026-06-24T12:50:18.036848804Z 2026-06-24 12:50:18.036 INFO (qtp985324122-101-solr-node1-7) [c:test-collection s: r: x: t:solr-node1-7] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas 2026-06-24T12:50:18.125977513Z 2026-06-24 12:50:18.125 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 247] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-24T12:50:18.128972243Z 2026-06-24 12:50:18.128 INFO (qtp985324122-101-solr-node1-7) [c:test-collection s: r: x: t:solr-node1-7] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=techproducts&name=test-collection&nrtReplicas=1&action=CREATE&numShards=3&wt=json&version=2.2} status=0 QTime=2591 # === Docker inspect for solr-node1 === { "Name": "/solr-node1", "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 2567588, "ExitCode": 0, "Error": "", "StartedAt": "2026-06-24T12:50:02.365514837Z", "FinishedAt": "0001-01-01T00:00:00Z" }, "Ports": { "8983/tcp": null } } # === Docker logs for solr-node2 === 2026-06-24T12:50:07.884518158Z *** [WARN] *** Your open file limit is currently 1024. 2026-06-24T12:50:07.884544549Z It should be set to 65000 to avoid operational disruption. 2026-06-24T12:50:07.884547685Z If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh 2026-06-24T12:50:07.884833505Z Solr will start in SolrCloud mode by default in version 10, and you will no longer need to pass in -c or --cloud flag. 2026-06-24T12:50:07.884847359Z 2026-06-24T12:50:07.895751345Z Java 17 detected. Enabled workaround for SOLR-16463 2026-06-24T12:50:07.903884678Z [0.002s][warning][pagesize] UseLargePages disabled, no large pages configured and available on the system. 2026-06-24T12:50:07.944112086Z CompileCommand: exclude com/github/benmanes/caffeine/cache/BoundedLocalCache.put bool exclude = true 2026-06-24T12:50:07.983308884Z WARNING: A command line option has enabled the Security Manager 2026-06-24T12:50:07.983328404Z WARNING: The Security Manager is deprecated and will be removed in a future release 2026-06-24T12:50:09.206105833Z 2026-06-24 12:50:09.202 INFO (main) [c: s: r: x: t:] o.e.j.s.Server jetty-10.0.26; built: 2025-08-14T15:56:56.454Z; git: 65a55c55a68c56d5f2e8232164439bd6e76e53d1; jvm 17.0.16+8 2026-06-24T12:50:09.489623922Z 2026-06-24 12:50:09.488 WARN (main) [c: s: r: x: t:] o.e.j.u.DeprecationWarning Using @Deprecated Class org.eclipse.jetty.servlet.listener.ELContextCleaner 2026-06-24T12:50:09.516394901Z 2026-06-24 12:50:09.515 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2026-06-24T12:50:09.524499084Z 2026-06-24 12:50:09.523 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.10.0-SNAPSHOT 1edeb3ac6a97186b4ae7de511196a1769de7960e [snapshot build, details omitted] 2026-06-24T12:50:09.524580893Z 2026-06-24 12:50:09.524 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port 8984 2026-06-24T12:50:09.524893580Z 2026-06-24 12:50:09.524 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /opt/solr-9.10.0-SNAPSHOT-slim 2026-06-24T12:50:09.525156525Z 2026-06-24 12:50:09.524 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2026-06-24T12:50:09.524162200Z 2026-06-24T12:50:09.527662572Z 2026-06-24 12:50:09.527 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr started with "-XX:+CrashOnOutOfMemoryError" that will crash on any OutOfMemoryError exception. The cause of the OOME will be logged in the crash file at the following path: /var/solr/logs/jvm_crash_1.log 2026-06-24T12:50:09.555529979Z 2026-06-24 12:50:09.554 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /var/solr/data (source: system property: solr.solr.home) 2026-06-24T12:50:09.582758259Z 2026-06-24 12:50:09.582 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-06-24T12:50:09.742517185Z 2026-06-24 12:50:09.741 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2026-06-24T12:50:09.766261810Z 2026-06-24 12:50:09.765 INFO (zkCallback-1-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-06-24T12:50:09.766357831Z 2026-06-24 12:50:09.765 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-06-24T12:50:09.766462367Z 2026-06-24 12:50:09.765 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-06-24T12:50:09.880092497Z 2026-06-24 12:50:09.878 INFO (main) [c: s: r: x: t:] o.a.s.c.NodeConfig Loading solr.xml from SolrHome (not found in ZooKeeper) 2026-06-24T12:50:09.880122653Z 2026-06-24 12:50:09.879 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig solr.xml not found in SOLR_HOME, using built-in default 2026-06-24T12:50:09.880311668Z 2026-06-24 12:50:09.879 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/solr.xml 2026-06-24T12:50:09.922255614Z 2026-06-24 12:50:09.921 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrResourceLoader Added 1 libs to classloader, from paths: [/opt/solr-9.10.0-SNAPSHOT-slim/lib] 2026-06-24T12:50:10.746990585Z 2026-06-24 12:50:10.746 INFO (main) [c: s: r: x: t:] o.a.s.u.t.SimplePropagator Always-on trace id generation enabled. 2026-06-24T12:50:10.926574644Z 2026-06-24 12:50:10.925 WARN (main) [c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Jetty request logging enabled. Will retain logs for last 3 days. See chapter "Configuring Logging" in reference guide for how to configure. 2026-06-24T12:50:10.928271908Z 2026-06-24 12:50:10.926 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=solr-node1:9983 2026-06-24T12:50:10.936857132Z 2026-06-24 12:50:10.936 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-06-24T12:50:10.941923572Z 2026-06-24 12:50:10.941 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2026-06-24T12:50:10.945492757Z 2026-06-24 12:50:10.945 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-06-24T12:50:10.945581986Z 2026-06-24 12:50:10.945 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-06-24T12:50:10.979699116Z 2026-06-24 12:50:10.979 WARN (main) [c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2026-06-24T12:50:10.988639547Z 2026-06-24 12:50:10.988 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) 2026-06-24T12:50:11.010570532Z 2026-06-24 12:50:11.009 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-06-24T12:50:11.024181702Z 2026-06-24 12:50:11.023 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Publish node=solr-node2:8984_solr as DOWN 2026-06-24T12:50:11.036625746Z 2026-06-24 12:50:11.036 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper: /live_nodes/solr-node2:8984_solr 2026-06-24T12:50:11.045645708Z 2026-06-24 12:50:11.045 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2026-06-24T12:50:11.112231863Z 2026-06-24 12:50:11.111 WARN (main) [c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2026-06-24T12:50:11.417384430Z 2026-06-24 12:50:11.416 INFO (main) [c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /var/solr/data 2026-06-24T12:50:11.610396033Z 2026-06-24 12:50:11.609 WARN (main) [c: s: r: x: t:] o.g.j.m.i.MessagingBinders A class jakarta.activation.DataSource for a default provider MessageBodyWriter<jakarta.activation.DataSource> was not found. The provider is not available. 2026-06-24T12:50:11.899617725Z 2026-06-24 12:50:11.899 INFO (main) [c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-06-24T12:50:12.050244425Z 2026-06-24 12:50:12.049 INFO (main) [c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@71f67a79{solr-jetty-context.xml,/solr,file:///opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp/,AVAILABLE}{/opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp} 2026-06-24T12:50:12.061863363Z 2026-06-24 12:50:12.061 INFO (main) [c: s: r: x: t:] o.e.j.s.RequestLogWriter Opened /var/solr/logs/2026_06_24.request.log 2026-06-24T12:50:12.070501110Z 2026-06-24 12:50:12.068 INFO (main) [c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@61884cb1{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8984} 2026-06-24T12:50:12.071601184Z 2026-06-24 12:50:12.071 INFO (main) [c: s: r: x: t:] o.e.j.s.Server Started Server@350ec41e{STARTING}[10.0.26,sto=0] @4168ms 2026-06-24T12:50:12.263769104Z 2026-06-24 12:50:12.263 INFO (qtp985324122-27-solr-node2-1) [c: s: r: x: t:solr-node2-1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=48 2026-06-24T12:50:12.336911990Z 2026-06-24 12:50:12.336 INFO (qtp985324122-55-solr-node2-2) [c: s: r: x: t:solr-node2-2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=17 2026-06-24T12:50:15.856041635Z 2026-06-24 12:50:15.855 INFO (qtp985324122-58-solr-node1-8) [c: s: r: x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=techproducts&newCollection=true&collection=test-collection&version=2&replicaType=NRT&coreNodeName=core_node6&name=test-collection_shard1_replica_n4&action=CREATE&numShards=3&shard=shard1&wt=javabin 2026-06-24T12:50:15.919031551Z 2026-06-24 12:50:15.918 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.12.0 2026-06-24T12:50:15.978123348Z 2026-06-24 12:50:15.977 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.s.IndexSchema Schema name=default-config 2026-06-24T12:50:16.305644093Z 2026-06-24 12:50:16.305 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.s.IndexSchema Loaded schema default-config/1.7 with uniqueid field id 2026-06-24T12:50:16.305673184Z 2026-06-24 12:50:16.305 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.CoreContainer Creating SolrCore 'test-collection_shard1_replica_n4' using configuration from configset techproducts, trusted=true 2026-06-24T12:50:16.324276675Z 2026-06-24 12:50:16.323 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.SolrCore Opening new SolrCore at [/var/solr/data/test-collection_shard1_replica_n4], dataDir=[/var/solr/data/test-collection_shard1_replica_n4/data/] 2026-06-24T12:50:16.746145182Z 2026-06-24 12:50:16.745 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-06-24T12:50:16.766028981Z 2026-06-24 12:50:16.765 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2026-06-24T12:50:16.769632655Z 2026-06-24 12:50:16.769 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2026-06-24T12:50:16.770950503Z 2026-06-24 12:50:16.770 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 2026-06-24T12:50:16.771010431Z 2026-06-24 12:50:16.770 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.u.CommitTracker Soft AutoCommit: if uncommitted for 3000ms; 2026-06-24T12:50:16.815531238Z 2026-06-24 12:50:16.814 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/techproducts 2026-06-24T12:50:16.818708310Z 2026-06-24 12:50:16.818 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/techproducts 2026-06-24T12:50:16.821214867Z 2026-06-24 12:50:16.820 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/techproducts/managed-schema.xml 2026-06-24T12:50:16.823387151Z 2026-06-24 12:50:16.823 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest 2026-06-24T12:50:16.834673612Z 2026-06-24 12:50:16.834 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.s.DirectSolrSpellChecker init: {name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal, accuracy=0.5, maxQueryFrequency=0.01, maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4} 2026-06-24T12:50:16.842197339Z 2026-06-24 12:50:16.841 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2026-06-24T12:50:16.848360997Z 2026-06-24 12:50:16.847 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard1_replica_n4 solr-node1-8 core_node6 solr-node2:8984_solr test-collection shard1) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.QuerySenderListener QuerySenderListener done. 2026-06-24T12:50:16.848392109Z 2026-06-24 12:50:16.848 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard1_replica_n4 solr-node1-8 core_node6 solr-node2:8984_solr test-collection shard1) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default 2026-06-24T12:50:16.856537937Z 2026-06-24 12:50:16.856 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard1_replica_n4 solr-node1-8 core_node6 solr-node2:8984_solr test-collection shard1) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2026-06-24T12:50:16.866514832Z 2026-06-24 12:50:16.865 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test-collection/terms/shard1 to Terms{values={core_node6=0}, version=0} for registerTerm 2026-06-24T12:50:16.867858276Z 2026-06-24 12:50:16.867 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test-collection/leaders/shard1 2026-06-24T12:50:16.883418414Z 2026-06-24 12:50:16.882 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2026-06-24T12:50:16.883448291Z 2026-06-24 12:50:16.883 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2026-06-24T12:50:16.883545269Z 2026-06-24 12:50:16.883 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.SyncStrategy Sync replicas to http://solr-node2:8984/solr/test-collection_shard1_replica_n4/ 2026-06-24T12:50:16.885408802Z 2026-06-24 12:50:16.885 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2026-06-24T12:50:16.886098924Z 2026-06-24 12:50:16.885 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.SyncStrategy http://solr-node2:8984/solr/test-collection_shard1_replica_n4/ has no replicas 2026-06-24T12:50:16.887231265Z 2026-06-24 12:50:16.886 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test-collection/leaders/shard1/leader after winning as /collections/test-collection/leader_elect/shard1/election/72177986523693060-core_node6-n_0000000000 2026-06-24T12:50:16.895854250Z 2026-06-24 12:50:16.895 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://solr-node2:8984/solr/test-collection_shard1_replica_n4/ shard1 2026-06-24T12:50:17.003866540Z 2026-06-24 12:50:17.003 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 205] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-24T12:50:17.008034675Z 2026-06-24 12:50:17.007 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.ZkController I am the leader, no recovery necessary 2026-06-24T12:50:17.019668861Z 2026-06-24 12:50:17.019 INFO (qtp985324122-58-solr-node1-8) [c: s: r: x: t:solr-node1-8] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=techproducts&newCollection=true&name=test-collection_shard1_replica_n4&action=CREATE&numShards=3&collection=test-collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1165 2026-06-24T12:50:17.119782485Z 2026-06-24 12:50:17.119 INFO (zkCallback-13-thread-2) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 208] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-24T12:50:17.666532674Z 2026-06-24 12:50:17.666 INFO (zkCallback-13-thread-2) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 223] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-24T12:50:17.779768515Z 2026-06-24 12:50:17.779 INFO (zkCallback-13-thread-2) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 226] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-24T12:50:18.014365747Z 2026-06-24 12:50:18.013 INFO (zkCallback-13-thread-2) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 241] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-24T12:50:18.126318333Z 2026-06-24 12:50:18.125 INFO (zkCallback-13-thread-2) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 247] for collection [test-collection] has occurred - updating... (live nodes size: [3]) # === Docker inspect for solr-node2 === { "Name": "/solr-node2", "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 2567981, "ExitCode": 0, "Error": "", "StartedAt": "2026-06-24T12:50:07.669009526Z", "FinishedAt": "0001-01-01T00:00:00Z" }, "Ports": { "8983/tcp": null } } # === Docker logs for solr-node3 === 2026-06-24T12:50:08.129493825Z *** [WARN] *** Your open file limit is currently 1024. 2026-06-24T12:50:08.129530239Z It should be set to 65000 to avoid operational disruption. 2026-06-24T12:50:08.129533266Z If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh 2026-06-24T12:50:08.129920574Z Solr will start in SolrCloud mode by default in version 10, and you will no longer need to pass in -c or --cloud flag. 2026-06-24T12:50:08.129935422Z 2026-06-24T12:50:08.140139593Z Java 17 detected. Enabled workaround for SOLR-16463 2026-06-24T12:50:08.147663856Z [0.002s][warning][pagesize] UseLargePages disabled, no large pages configured and available on the system. 2026-06-24T12:50:08.193686494Z CompileCommand: exclude com/github/benmanes/caffeine/cache/BoundedLocalCache.put bool exclude = true 2026-06-24T12:50:08.226834353Z WARNING: A command line option has enabled the Security Manager 2026-06-24T12:50:08.226859177Z WARNING: The Security Manager is deprecated and will be removed in a future release 2026-06-24T12:50:09.348768398Z 2026-06-24 12:50:09.345 INFO (main) [c: s: r: x: t:] o.e.j.s.Server jetty-10.0.26; built: 2025-08-14T15:56:56.454Z; git: 65a55c55a68c56d5f2e8232164439bd6e76e53d1; jvm 17.0.16+8 2026-06-24T12:50:09.652713595Z 2026-06-24 12:50:09.652 WARN (main) [c: s: r: x: t:] o.e.j.u.DeprecationWarning Using @Deprecated Class org.eclipse.jetty.servlet.listener.ELContextCleaner 2026-06-24T12:50:09.683463283Z 2026-06-24 12:50:09.682 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2026-06-24T12:50:09.691785872Z 2026-06-24 12:50:09.690 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.10.0-SNAPSHOT 1edeb3ac6a97186b4ae7de511196a1769de7960e [snapshot build, details omitted] 2026-06-24T12:50:09.692117224Z 2026-06-24 12:50:09.690 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port 8985 2026-06-24T12:50:09.692534998Z 2026-06-24 12:50:09.691 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /opt/solr-9.10.0-SNAPSHOT-slim 2026-06-24T12:50:09.692620147Z 2026-06-24 12:50:09.691 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2026-06-24T12:50:09.691174886Z 2026-06-24T12:50:09.695331181Z 2026-06-24 12:50:09.694 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr started with "-XX:+CrashOnOutOfMemoryError" that will crash on any OutOfMemoryError exception. The cause of the OOME will be logged in the crash file at the following path: /var/solr/logs/jvm_crash_1.log 2026-06-24T12:50:09.720173091Z 2026-06-24 12:50:09.719 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /var/solr/data (source: system property: solr.solr.home) 2026-06-24T12:50:09.745497671Z 2026-06-24 12:50:09.744 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-06-24T12:50:09.897645336Z 2026-06-24 12:50:09.897 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2026-06-24T12:50:09.919786886Z 2026-06-24 12:50:09.918 INFO (zkCallback-1-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-06-24T12:50:09.920009513Z 2026-06-24 12:50:09.919 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-06-24T12:50:09.920267731Z 2026-06-24 12:50:09.919 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-06-24T12:50:10.031351518Z 2026-06-24 12:50:10.030 INFO (main) [c: s: r: x: t:] o.a.s.c.NodeConfig Loading solr.xml from SolrHome (not found in ZooKeeper) 2026-06-24T12:50:10.031475886Z 2026-06-24 12:50:10.031 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig solr.xml not found in SOLR_HOME, using built-in default 2026-06-24T12:50:10.031616385Z 2026-06-24 12:50:10.031 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/solr.xml 2026-06-24T12:50:10.070575462Z 2026-06-24 12:50:10.069 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrResourceLoader Added 1 libs to classloader, from paths: [/opt/solr-9.10.0-SNAPSHOT-slim/lib] 2026-06-24T12:50:10.704180541Z 2026-06-24 12:50:10.703 INFO (main) [c: s: r: x: t:] o.a.s.u.t.SimplePropagator Always-on trace id generation enabled. 2026-06-24T12:50:10.842468751Z 2026-06-24 12:50:10.841 WARN (main) [c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Jetty request logging enabled. Will retain logs for last 3 days. See chapter "Configuring Logging" in reference guide for how to configure. 2026-06-24T12:50:10.844140200Z 2026-06-24 12:50:10.841 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=solr-node1:9983 2026-06-24T12:50:10.852257493Z 2026-06-24 12:50:10.851 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-06-24T12:50:10.857071156Z 2026-06-24 12:50:10.856 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2026-06-24T12:50:10.861008003Z 2026-06-24 12:50:10.860 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-06-24T12:50:10.861025728Z 2026-06-24 12:50:10.860 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-06-24T12:50:10.896481079Z 2026-06-24 12:50:10.895 WARN (main) [c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2026-06-24T12:50:10.905600711Z 2026-06-24 12:50:10.905 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2026-06-24T12:50:10.929476394Z 2026-06-24 12:50:10.928 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-06-24T12:50:10.941191827Z 2026-06-24 12:50:10.940 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Publish node=solr-node3:8985_solr as DOWN 2026-06-24T12:50:10.955137151Z 2026-06-24 12:50:10.954 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper: /live_nodes/solr-node3:8985_solr 2026-06-24T12:50:10.965551679Z 2026-06-24 12:50:10.965 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) 2026-06-24T12:50:11.007764507Z 2026-06-24 12:50:11.007 WARN (main) [c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2026-06-24T12:50:11.045170104Z 2026-06-24 12:50:11.044 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2026-06-24T12:50:11.283626494Z 2026-06-24 12:50:11.282 INFO (main) [c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /var/solr/data 2026-06-24T12:50:11.449686022Z 2026-06-24 12:50:11.449 WARN (main) [c: s: r: x: t:] o.g.j.m.i.MessagingBinders A class jakarta.activation.DataSource for a default provider MessageBodyWriter<jakarta.activation.DataSource> was not found. The provider is not available. 2026-06-24T12:50:11.707764133Z 2026-06-24 12:50:11.707 INFO (main) [c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-06-24T12:50:11.836143653Z 2026-06-24 12:50:11.835 INFO (main) [c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@71f67a79{solr-jetty-context.xml,/solr,file:///opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp/,AVAILABLE}{/opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp} 2026-06-24T12:50:11.841603214Z 2026-06-24 12:50:11.841 INFO (main) [c: s: r: x: t:] o.e.j.s.RequestLogWriter Opened /var/solr/logs/2026_06_24.request.log 2026-06-24T12:50:11.845324051Z 2026-06-24 12:50:11.844 INFO (main) [c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@61884cb1{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8985} 2026-06-24T12:50:11.846189873Z 2026-06-24 12:50:11.845 INFO (main) [c: s: r: x: t:] o.e.j.s.Server Started Server@350ec41e{STARTING}[10.0.26,sto=0] @3699ms 2026-06-24T12:50:13.826053778Z 2026-06-24 12:50:13.824 INFO (qtp985324122-27-solr-node3-1) [c: s: r: x: t:solr-node3-1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=62 2026-06-24T12:50:13.928421768Z 2026-06-24 12:50:13.927 INFO (qtp985324122-56-solr-node3-2) [c: s: r: x: t:solr-node3-2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=55 2026-06-24T12:50:15.857850029Z 2026-06-24 12:50:15.857 INFO (qtp985324122-58-solr-node1-8) [c: s: r: x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=techproducts&newCollection=true&collection=test-collection&version=2&replicaType=NRT&coreNodeName=core_node5&name=test-collection_shard2_replica_n2&action=CREATE&numShards=3&shard=shard2&wt=javabin 2026-06-24T12:50:15.933038898Z 2026-06-24 12:50:15.932 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.12.0 2026-06-24T12:50:16.132689128Z 2026-06-24 12:50:16.132 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.s.IndexSchema Schema name=default-config 2026-06-24T12:50:16.530869779Z 2026-06-24 12:50:16.530 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.s.IndexSchema Loaded schema default-config/1.7 with uniqueid field id 2026-06-24T12:50:16.530967373Z 2026-06-24 12:50:16.530 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.CoreContainer Creating SolrCore 'test-collection_shard2_replica_n2' using configuration from configset techproducts, trusted=true 2026-06-24T12:50:16.555352367Z 2026-06-24 12:50:16.554 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.SolrCore Opening new SolrCore at [/var/solr/data/test-collection_shard2_replica_n2], dataDir=[/var/solr/data/test-collection_shard2_replica_n2/data/] 2026-06-24T12:50:17.289486480Z 2026-06-24 12:50:17.288 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-06-24T12:50:17.315404762Z 2026-06-24 12:50:17.314 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2026-06-24T12:50:17.318968434Z 2026-06-24 12:50:17.318 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2026-06-24T12:50:17.320038391Z 2026-06-24 12:50:17.319 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 2026-06-24T12:50:17.320053502Z 2026-06-24 12:50:17.319 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.u.CommitTracker Soft AutoCommit: if uncommitted for 3000ms; 2026-06-24T12:50:17.477903914Z 2026-06-24 12:50:17.477 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/techproducts 2026-06-24T12:50:17.480915587Z 2026-06-24 12:50:17.480 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/techproducts 2026-06-24T12:50:17.484227447Z 2026-06-24 12:50:17.483 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/techproducts/managed-schema.xml 2026-06-24T12:50:17.488192156Z 2026-06-24 12:50:17.487 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest 2026-06-24T12:50:17.500253582Z 2026-06-24 12:50:17.499 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.s.DirectSolrSpellChecker init: {maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4, accuracy=0.5, maxQueryFrequency=0.01, name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal} 2026-06-24T12:50:17.507566309Z 2026-06-24 12:50:17.507 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2026-06-24T12:50:17.514381472Z 2026-06-24 12:50:17.513 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard2_replica_n2 solr-node1-8 core_node5 solr-node3:8985_solr test-collection shard2) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.QuerySenderListener QuerySenderListener done. 2026-06-24T12:50:17.514440245Z 2026-06-24 12:50:17.514 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard2_replica_n2 solr-node1-8 core_node5 solr-node3:8985_solr test-collection shard2) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default 2026-06-24T12:50:17.521184375Z 2026-06-24 12:50:17.520 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard2_replica_n2 solr-node1-8 core_node5 solr-node3:8985_solr test-collection shard2) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2026-06-24T12:50:17.533419775Z 2026-06-24 12:50:17.532 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test-collection/terms/shard2 to Terms{values={core_node5=0}, version=0} for registerTerm 2026-06-24T12:50:17.534828168Z 2026-06-24 12:50:17.534 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test-collection/leaders/shard2 2026-06-24T12:50:17.548903080Z 2026-06-24 12:50:17.548 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2026-06-24T12:50:17.548970347Z 2026-06-24 12:50:17.548 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2026-06-24T12:50:17.548975379Z 2026-06-24 12:50:17.548 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.SyncStrategy Sync replicas to http://solr-node3:8985/solr/test-collection_shard2_replica_n2/ 2026-06-24T12:50:17.550264191Z 2026-06-24 12:50:17.550 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2026-06-24T12:50:17.550833014Z 2026-06-24 12:50:17.550 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.SyncStrategy http://solr-node3:8985/solr/test-collection_shard2_replica_n2/ has no replicas 2026-06-24T12:50:17.552059662Z 2026-06-24 12:50:17.551 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test-collection/leaders/shard2/leader after winning as /collections/test-collection/leader_elect/shard2/election/72177986523693059-core_node5-n_0000000000 2026-06-24T12:50:17.560002639Z 2026-06-24 12:50:17.559 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://solr-node3:8985/solr/test-collection_shard2_replica_n2/ shard2 2026-06-24T12:50:17.666697050Z 2026-06-24 12:50:17.666 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 223] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-24T12:50:17.670996055Z 2026-06-24 12:50:17.670 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.ZkController I am the leader, no recovery necessary 2026-06-24T12:50:17.679533338Z 2026-06-24 12:50:17.679 INFO (qtp985324122-58-solr-node1-8) [c: s: r: x: t:solr-node1-8] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=techproducts&newCollection=true&name=test-collection_shard2_replica_n2&action=CREATE&numShards=3&collection=test-collection&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1823 2026-06-24T12:50:17.780397097Z 2026-06-24 12:50:17.779 INFO (zkCallback-13-thread-2) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 226] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-24T12:50:18.013935281Z 2026-06-24 12:50:18.013 INFO (zkCallback-13-thread-2) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 241] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-24T12:50:18.126305518Z 2026-06-24 12:50:18.125 INFO (zkCallback-13-thread-2) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 247] for collection [test-collection] has occurred - updating... (live nodes size: [3]) # === Docker inspect for solr-node3 === { "Name": "/solr-node3", "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 2568160, "ExitCode": 0, "Error": "", "StartedAt": "2026-06-24T12:50:07.880351272Z", "FinishedAt": "0001-01-01T00:00:00Z" }, "Ports": { "8983/tcp": null } } # Docker artifacts saved to: /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/docker not ok 85 Docker SolrCloud rolling upgrade # in 30307 ms # (in test file test/test_rolling_upgrade.bats, line 118) # `wait_for 30 1 docker exec solr-node1 solr healthcheck -c test-collection' failed with status 127 # 9.10.0-SNAPSHOT-slim: Pulling from apache/solr-nightly # af6eca94c810: Pulling fs layer # cb0efb96dabd: Pulling fs layer # 3e9d91201f40: Pulling fs layer # 66b76b382631: Pulling fs layer # 601f2c23751f: Pulling fs layer # 0ed719aef393: Pulling fs layer # 69a09c96e8bf: Pulling fs layer # c937aee9a870: Pulling fs layer # 9cdfe5320de8: Pulling fs layer # 3aa9120e46f5: Pulling fs layer # 4f4fb700ef54: Pulling fs layer # 66b76b382631: Waiting # 601f2c23751f: Waiting # 0ed719aef393: Waiting # 69a09c96e8bf: Waiting # c937aee9a870: Waiting # 9cdfe5320de8: Waiting # 3aa9120e46f5: Waiting # 4f4fb700ef54: Waiting # cb0efb96dabd: Verifying Checksum # cb0efb96dabd: Download complete # 66b76b382631: Download complete # af6eca94c810: Verifying Checksum # af6eca94c810: Download complete # 601f2c23751f: Verifying Checksum # 601f2c23751f: Download complete # 3e9d91201f40: Verifying Checksum # 3e9d91201f40: Download complete # 69a09c96e8bf: Verifying Checksum # 69a09c96e8bf: Download complete # c937aee9a870: Verifying Checksum # c937aee9a870: Download complete # 9cdfe5320de8: Verifying Checksum # 9cdfe5320de8: Download complete # 3aa9120e46f5: Verifying Checksum # 3aa9120e46f5: Download complete # 4f4fb700ef54: Download complete # 0ed719aef393: Download complete # af6eca94c810: Pull complete # cb0efb96dabd: Pull complete # 3e9d91201f40: Pull complete # 66b76b382631: Pull complete # 601f2c23751f: Pull complete # 0ed719aef393: Pull complete # 69a09c96e8bf: Pull complete # c937aee9a870: Pull complete # 9cdfe5320de8: Pull complete # 3aa9120e46f5: Pull complete # 4f4fb700ef54: Pull complete # Digest: sha256:15c8155ceffe1042f37c77bb537aa531804a3510702ff87f2af5fedf523f4203 # Status: Downloaded newer image for apache/solr-nightly:9.10.0-SNAPSHOT-slim # docker.io/apache/solr-nightly:9.10.0-SNAPSHOT-slim # 10.0.0-SNAPSHOT-slim: Pulling from apache/solr-nightly # 40d16f30db40: Pulling fs layer # 9d5a0b6cb36c: Pulling fs layer # 49518c28c0b3: Pulling fs layer # 41162acdcc29: Pulling fs layer # 2ed0fd558ca3: Pulling fs layer # 2488415fda1c: Pulling fs layer # 09511c8fb203: Pulling fs layer # a0c57fb89c4f: Pulling fs layer # d0641dcc41d7: Pulling fs layer # 315722fd9570: Pulling fs layer # 4f4fb700ef54: Pulling fs layer # 41162acdcc29: Waiting # 2ed0fd558ca3: Waiting # 2488415fda1c: Waiting # 315722fd9570: Waiting # 4f4fb700ef54: Waiting # 09511c8fb203: Waiting # d0641dcc41d7: Waiting # a0c57fb89c4f: Waiting # 9d5a0b6cb36c: Verifying Checksum # 9d5a0b6cb36c: Download complete # 41162acdcc29: Verifying Checksum # 41162acdcc29: Download complete # 2ed0fd558ca3: Verifying Checksum # 2ed0fd558ca3: Download complete # 40d16f30db40: Verifying Checksum # 40d16f30db40: Download complete # 09511c8fb203: Verifying Checksum # 09511c8fb203: Download complete # 49518c28c0b3: Verifying Checksum # 49518c28c0b3: Download complete # a0c57fb89c4f: Verifying Checksum # a0c57fb89c4f: Download complete # d0641dcc41d7: Verifying Checksum # d0641dcc41d7: Download complete # 315722fd9570: Verifying Checksum # 315722fd9570: Download complete # 4f4fb700ef54: Verifying Checksum # 4f4fb700ef54: Download complete # 2488415fda1c: Verifying Checksum # 2488415fda1c: Download complete # 40d16f30db40: Pull complete # 9d5a0b6cb36c: Pull complete # 49518c28c0b3: Pull complete # 41162acdcc29: Pull complete # 2ed0fd558ca3: Pull complete # 2488415fda1c: Pull complete # 09511c8fb203: Pull complete # a0c57fb89c4f: Pull complete # d0641dcc41d7: Pull complete # 315722fd9570: Pull complete # 4f4fb700ef54: Pull complete # Digest: sha256:fb25f7a7190e3027ade20e97708a8665d41ab0e9ea9285fa242b2c83b0e5f43c # Status: Downloaded newer image for apache/solr-nightly:10.0.0-SNAPSHOT-slim # docker.io/apache/solr-nightly:10.0.0-SNAPSHOT-slim # d0cca0692e3d313d6251a5fb6992d83eee62e45a97f5f4c5b2d2d51bee849740 # solr-data1 # solr-data2 # solr-data3 # Starting solr-node1 with embedded ZooKeeper # 8b2b0c2f23482326f6352bd96a17858d2ee429f6313a8dec5fdaeaa8df9e933c # Starting solr-node2 connected to first node's ZooKeeper # 30e0ee109ba7cc8fbd3c7156b6bc80dc2e36a84a95afc0838d2dbc53526acc4c # Started solr-node3 connected to first node's ZooKeeper # a5f9fdebcff4c2ced8675cb9310de7f7f4d586ddafc2e7b73d704062e6022d9f # Creating a Collection # Neither --zk-host or --solr-url parameters provided so assuming solr url is http://localhost:8983. # Neither --zk-host or --solr-url parameters provided so assuming solr url is http://localhost:8983. # WARN - 2026-06-24 12:50:15.157; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-06-24 12:50:15.189; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARNING: URLs provided to this tool needn't include Solr's context-root (e.g. "/solr"). Such URLs are deprecated and support for them will be removed in a future release. Correcting from [http://solr-node1:8983/solr] to [http://solr-node1:8983/]. # Created collection 'test-collection' with 3 shard(s), 1 replica(s) with config-set 'techproducts' # Checking collection health # /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/test/test_rolling_upgrade.bats: line 118: wait_for: command not found # solr-node1 # solr-node2 # solr-node3 # solr-node1 # solr-node2 # solr-node3 # solr-data1 # solr-data2 # solr-data3 # solrcloud-test ok 86 allowPaths - backup # in 16420 ms ok 87 snapshot lifecycle # in 5272 ms ok 88 snapshot list # in 3513 ms ok 89 snapshot list via --solr-connection # in 3674 ms ok 90 snapshot describe # in 3573 ms ok 91 snapshot describe via --solr-connection # in 3666 ms ok 92 start solr with ssl # in 17626 ms ok 93 use different hostname when not checking peer-name # in 26492 ms ok 94 start solr with ssl and auth # in 15116 ms ok 95 start solr with client truststore and security manager # in 17882 ms ok 96 start solr with mTLS needed # in 49057 ms ok 97 start solr with mTLS wanted # in 36457 ms ok 98 test keystore reload # in 61694 ms ok 99 SOLR-11740 check 'solr stop' connection # in 16921 ms ok 100 stop command for single port # in 19227 ms ok 101 check stop command doesn't hang # in 227 ms ok 102 SOLR-16976 solr starts with remote JMX enabled # in 8887 ms not ok 103 deprecated system properties converted to modern properties # in 195478 ms # (from function `assert_file_contains' in file .gradle/node/node_modules/bats-file/src/file.bash, line 566, # in test file test/test_start_solr.bats, line 86) # `assert_file_contains "${SOLR_LOGS_DIR}/solr.log" 'You are passing in deprecated system property disable.config.edit and should upgrade to using solr.api.config.edit.enabled instead.'' failed # Waiting up to 180 seconds to see Solr running on port 40685 [|] [/] [-] [\] [|] # Started Solr server on port 40685 (pid=2585689). Happy searching! # # # -- file does not contain regex -- # path : /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/solr-home/logs/solr.log # -- # # Please find the SOLR_HOME snapshot for failed test #5 at: /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/failure-snapshots/103-5 ok 104 start with custom jetty options # in 8537 ms ok 105 -c flag prints no-op warning and still starts in cloud mode # in 10112 ms not ok 106 bootstrapping a configset # in 9868 ms # (from function `config_exists' in file test/bats_helper.bash, line 84, # in test file test/test_start_solr.bats, line 116) # `config_exists "techproducts"' failed # Waiting up to 180 seconds to see Solr running on port 40685 [|] [/] [-] [\] [|] # Started Solr server on port 40685 (pid=2588401). Happy searching! # # WARN - 2026-06-24 12:59:16.847; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-06-24 12:59:16.851; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # Please find the SOLR_HOME snapshot for failed test #8 at: /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/failure-snapshots/106-8 ok 107 status detects locally running solr # in 10381 ms ok 108 status with --solr-url from user # in 8643 ms ok 109 status with --port from user # in 8480 ms ok 110 multiple connection options are prevented # in 949 ms ok 111 status with invalid --solr-url from user # in 1376 ms ok 112 status with --short format # in 196535 ms ok 113 searching solr via locally executed streaming expression # in 1928 ms ok 114 searching solr via remotely executed streaming expression by solr-url # in 1669 ms ok 115 searching solr via remotely executed streaming expression by solr connection # in 1268 ms ok 116 variable interpolation # in 1811 ms ok 117 searching solr without credentials fails with error # in 1238 ms ok 118 --version returns Solr version # in 786 ms ok 119 version as direct tool call still runs # in 782 ms ok 120 short help # in 931 ms ok 121 short help is inferred # in 811 ms ok 122 long help # in 912 ms ok 123 running subcommands with zk is prevented # in 834 ms ok 124 listing out files # in 2215 ms ok 125 connecting to solr via various solr urls and zk hosts # in 10151 ms ok 126 copying files around # in 11822 ms ok 127 upconfig # in 2790 ms ok 128 SOLR-12429 test upconfig fails with symlink # in 1435 ms ok 129 downconfig # in 1434 ms ok 130 bin/solr zk cp gets 'solrhome' from '--solr-home' command line option # in 1569 ms ok 131 env var ZK_HOST is honored # in 3453 ms ok 132 Cleanup # in 1922 ms > Task :solr:packaging:integrationTests FAILED FAILURE: Build failed with an exception. * Where: Build file '/home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build.gradle' line: 339 * What went wrong: Execution failed for task ':solr:packaging:integrationTests'. > Process 'command > '/home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/.gradle/node/node_modules/bats/bin/bats'' > finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.10/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 31m 39s 128 actionable tasks: 128 executed Publishing Build Scan to Develocity... https://develocity.apache.org/s/n22mbsns353xy Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure Archiving artifacts Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
