Build: https://ci-builds.apache.org/job/Solr/job/Solr-TestIntegration-10.x/206/
No tests ran. Build Log: [...truncated 347 lines...] # ERROR: KeeperErrorCode = NoNode for /security.json # -- # # Last output: # WARN - 2026-05-11 12:54:35.959; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-05-11 12:54:35.962; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-05-11 12:54:36.403; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-05-11 12:54:36.403; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # # ERROR: KeeperErrorCode = NoNode for /security.json not ok 9 create, config, api, and delete with basic auth # in 17047 ms # (from function `setup' in test file test/test_basic_auth.bats, line 24) # `solr start -Dsolr.packages.enabled=true' failed # Starting Solr # # Port 34963 is already being used by another process (pid: 1348924) # Please choose a different port using the -p option. # # Please find the SOLR_HOME snapshot for failed test #1 at: /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/failure-snapshots/9-1 # Last output: # WARN - 2026-05-11 12:54:37.569; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-05-11 12:54:37.572; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # # ERROR: java.util.concurrent.TimeoutException: Timeout while waiting for Zookeeper Client to connect: 15000 ms ok 10 post, postlogs and export with basic auth # in 17181 ms ok 11 package with basic auth # in 11821 ms ok 12 admin UI static content is excepted from basic auth # in 10229 ms ok 13 nothing # in 10 ms ok 14 server does not compress response without Accept-Encoding header # in 174 ms ok 15 server compresses response when Accept-Encoding: gzip is requested # in 87 ms ok 16 compressed response can be decompressed and parsed # in 85 ms ok 17 setting property # in 10800 ms ok 18 short form of setting property # in 6793 ms ok 19 connecting to solr via various solr urls and zk hosts # in 9306 ms ok 20 create for non cloud mode # in 7684 ms ok 21 create for cloud mode # in 9632 ms ok 22 multiple connection options are prevented # in 851 ms ok 23 create collection # in 7466 ms ok 24 create collection using solrUrl # in 5065 ms ok 25 create collection using legacy solrUrl # in 5184 ms ok 26 create collection using Zookeeper # in 5231 ms ok 27 reject d option with invalid config dir # in 2634 ms ok 28 accept d option with builtin config # in 5100 ms ok 29 accept d option with explicit path to config # in 5111 ms ok 30 accept n option as config name # in 5114 ms ok 31 allow config reuse when n option specifies same config # in 8836 ms ok 32 create multisharded collections when s provided # in 5057 ms ok 33 create replicated collections when rf provided # in 5951 ms ok 34 can delete collections # in 10213 ms ok 35 can delete collections with solr-url # in 8082 ms ok 36 collection delete also deletes zk config # in 6984 ms ok 37 deletes accompanying zk config with nondefault name # in 7046 ms ok 38 delete-config option can opt to leave config in zk # in 6973 ms ok 39 start -e cloud works with --jvm-opts # in 21159 ms ok 40 start -e cloud works with --no-prompt # in 18306 ms ok 41 Check export command # in 18420 ms ok 42 export fails on non cloud mode # in 9212 ms Tika Server started on port 34968 ok 43 using curl to extract a single pdf file # in 19765 ms ok 44 using the bin/solr post tool to extract content from pdf # in 20635 ms ok 45 using the bin/solr post tool to crawl web site # in 22891 ms Stopping Tika Server container ok 46 healthcheck on cloud solr # in 10271 ms ok 47 healthcheck errors on standalone solr # in 11216 ms ok 48 solr help flag prints help # in 734 ms ok 49 solr with no flags prints help # in 746 ms ok 50 start help flag prints help # in 142 ms ok 51 start h flag prints help # in 167 ms ok 52 stop help flag prints help # in 146 ms ok 53 restart help flag prints help # in 157 ms ok 54 status help flag prints help # in 826 ms ok 55 healthcheck help flag prints help # in 764 ms ok 56 create help flag prints help # in 778 ms ok 57 delete help flag prints help # in 778 ms ok 58 zk help flag prints help # in 819 ms ok 59 auth help flag prints help # in 774 ms ok 60 assert help flag prints help # in 785 ms ok 61 post help flag prints help # in 743 ms ok 62 SQL Module # in 15594 ms ok 63 icu collation in analysis-extras module # in 12392 ms ok 64 Check lifecycle of sentiment classification # in 23286 ms ok 65 lifecycle of package # in 8461 ms ok 66 deploying and undeploying a collection level package # in 13784 ms ok 67 deploying and undeploying a cluster level package # skip For developing package infra; requires a connection to github ok 68 Affinity placement plugin using sysprop # in 15296 ms ok 69 Random placement plugin using ENV # in 15604 ms ok 70 Check help command # in 2454 ms ok 71 basic post with a type specified # in 5404 ms ok 72 basic post with collection instead of url parameter # in 4041 ms ok 73 basic post with solr-url and collection # in 4118 ms ok 74 basic post WITHOUT a type specified # in 12021 ms ok 75 crawling a directory as a dry-run # in 828 ms ok 76 crawling a directory # in 4474 ms ok 77 crawling a web site # in 34330 ms ok 78 skipcommit and optimize and delete # in 5917 ms ok 79 args mode # in 9141 ms not ok 80 stdin mode # in 7900 ms # (from function `assert_output' in file .gradle/node/node_modules/bats-assert/src/assert.bash, line 247, # in test file test/test_post.bats, line 201) # `assert_output --partial "Created collection 'test_stdin'"' failed # # -- output does not contain substring -- # substring (1 lines): # Created collection 'test_stdin' # output (13 lines): # Neither --zk-host or --solr-url parameters, nor ZK_HOST env var provided, so assuming solr url is http://localhost:34963. # Neither --zk-host or --solr-url parameters, nor ZK_HOST env var provided, so assuming solr url is http://localhost:34963. # WARNING: Using _default configset. Data driven schema functionality is enabled by default, which is # NOT RECOMMENDED for production use. # # To turn it off: # curl http://localhost:34963/solr/test_stdin/config -d '{"set-user-property": {"update.autoCreateFields":"false"}}' # Or: # bin/solr config -c test_stdin -s http://localhost:34963 --action set-user-property --property update.autoCreateFields --value false # WARN - 2026-05-11 13:04:40.146; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-05-11 13:04:40.150; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # # ERROR: Failed to create collection 'test_stdin' due to: IOException occurred when talking to server at: http://localhost:34963/solr/admin/collections # -- # # Please find the SOLR_HOME snapshot for failed test #11 at: /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/failure-snapshots/80-11 # Last output: # Neither --zk-host or --solr-url parameters, nor ZK_HOST env var provided, so assuming solr url is http://localhost:34963. # Neither --zk-host or --solr-url parameters, nor ZK_HOST env var provided, so assuming solr url is http://localhost:34963. # WARNING: Using _default configset. Data driven schema functionality is enabled by default, which is # NOT RECOMMENDED for production use. # # To turn it off: # curl http://localhost:34963/solr/test_stdin/config -d '{"set-user-property": {"update.autoCreateFields":"false"}}' # Or: # bin/solr config -c test_stdin -s http://localhost:34963 --action set-user-property --property update.autoCreateFields --value false # WARN - 2026-05-11 13:04:40.146; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-05-11 13:04:40.150; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # # ERROR: Failed to create collection 'test_stdin' due to: IOException occurred when talking to server at: http://localhost:34963/solr/admin/collections not ok 81 verbose echo the Solr response # in 1151 ms # (from function `assert_output' in file .gradle/node/node_modules/bats-assert/src/assert.bash, line 247, # in test file test/test_post.bats, line 210) # `assert_output --partial "Created collection 'monitors_verbose'"' failed # # -- output does not contain substring -- # substring (1 lines): # Created collection 'monitors_verbose' # output (3 lines): # Neither --zk-host or --solr-url parameters, nor ZK_HOST env var provided, so assuming solr url is http://localhost:34963. # # ERROR: Server refused connection at: http://localhost:34963/solr/admin/info/system # -- # # Please find the SOLR_HOME snapshot for failed test #12 at: /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/failure-snapshots/81-12 # Last output: # Neither --zk-host or --solr-url parameters, nor ZK_HOST env var provided, so assuming solr url is http://localhost:34963. # # ERROR: Server refused connection at: http://localhost:34963/solr/admin/info/system ok 82 post solr log into solr via cli # in 9556 ms # Test failed - capturing Docker diagnostics # === docker ps (summary) === NAMES STATUS IMAGE PORTS solr-node3 Up 10 seconds apache/solr-nightly:9.10.0-SNAPSHOT-slim 8983/tcp solr-node2 Up 11 seconds apache/solr-nightly:9.10.0-SNAPSHOT-slim 8983/tcp solr-node1 Up 16 seconds apache/solr-nightly:9.10.0-SNAPSHOT-slim 8983/tcp # === Docker logs for solr-node1 === 2026-05-11T13:05:12.477177726Z *** [WARN] *** Your open file limit is currently 1024. 2026-05-11T13:05:12.477210060Z It should be set to 65000 to avoid operational disruption. 2026-05-11T13:05:12.477213183Z If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh 2026-05-11T13:05:12.477705882Z Solr will start in SolrCloud mode by default in version 10, and you will no longer need to pass in -c or --cloud flag. 2026-05-11T13:05:12.477717982Z 2026-05-11T13:05:12.487860173Z Java 17 detected. Enabled workaround for SOLR-16463 2026-05-11T13:05:12.495172693Z [0.001s][warning][pagesize] UseLargePages disabled, no large pages configured and available on the system. 2026-05-11T13:05:12.545381927Z CompileCommand: exclude com/github/benmanes/caffeine/cache/BoundedLocalCache.put bool exclude = true 2026-05-11T13:05:12.584961703Z WARNING: A command line option has enabled the Security Manager 2026-05-11T13:05:12.584985068Z WARNING: The Security Manager is deprecated and will be removed in a future release 2026-05-11T13:05:13.659646358Z 2026-05-11 13:05:13.656 INFO (main) [c: s: r: x: t:] o.e.j.s.Server jetty-10.0.26; built: 2025-08-14T15:56:56.454Z; git: 65a55c55a68c56d5f2e8232164439bd6e76e53d1; jvm 17.0.16+8 2026-05-11T13:05:13.937106534Z 2026-05-11 13:05:13.936 WARN (main) [c: s: r: x: t:] o.e.j.u.DeprecationWarning Using @Deprecated Class org.eclipse.jetty.servlet.listener.ELContextCleaner 2026-05-11T13:05:13.962197227Z 2026-05-11 13:05:13.961 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2026-05-11T13:05:13.969258345Z 2026-05-11 13:05:13.968 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.10.0-SNAPSHOT 1edeb3ac6a97186b4ae7de511196a1769de7960e [snapshot build, details omitted] 2026-05-11T13:05:13.969319381Z 2026-05-11 13:05:13.968 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port 8983 2026-05-11T13:05:13.969467342Z 2026-05-11 13:05:13.968 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /opt/solr-9.10.0-SNAPSHOT-slim 2026-05-11T13:05:13.969591609Z 2026-05-11 13:05:13.968 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2026-05-11T13:05:13.968942549Z 2026-05-11T13:05:13.972152555Z 2026-05-11 13:05:13.971 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr started with "-XX:+CrashOnOutOfMemoryError" that will crash on any OutOfMemoryError exception. The cause of the OOME will be logged in the crash file at the following path: /var/solr/logs/jvm_crash_1.log 2026-05-11T13:05:13.994426844Z 2026-05-11 13:05:13.993 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /var/solr/data (source: system property: solr.solr.home) 2026-05-11T13:05:14.008718789Z 2026-05-11 13:05:14.008 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig solr.xml not found in SOLR_HOME, using built-in default 2026-05-11T13:05:14.008738926Z 2026-05-11 13:05:14.008 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/solr.xml 2026-05-11T13:05:14.045007151Z 2026-05-11 13:05:14.044 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrResourceLoader Added 1 libs to classloader, from paths: [/opt/solr-9.10.0-SNAPSHOT-slim/lib] 2026-05-11T13:05:14.759808400Z 2026-05-11 13:05:14.759 INFO (main) [c: s: r: x: t:] o.a.s.u.t.SimplePropagator Always-on trace id generation enabled. 2026-05-11T13:05:15.028135342Z 2026-05-11 13:05:15.027 WARN (main) [c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Jetty request logging enabled. Will retain logs for last 3 days. See chapter "Configuring Logging" in reference guide for how to configure. 2026-05-11T13:05:15.033621160Z 2026-05-11 13:05:15.033 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrZkServer Zookeeper configuration not found in /var/solr/data, using built-in default 2026-05-11T13:05:15.033749339Z 2026-05-11 13:05:15.033 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrZkServerProps Reading configuration from: /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/zoo.cfg 2026-05-11T13:05:15.036244304Z 2026-05-11 13:05:15.035 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrZkServer STARTING EMBEDDED ENSEMBLE ZOOKEEPER SERVER at port 9983, listening on host 0.0.0.0 2026-05-11T13:05:15.036381277Z 2026-05-11 13:05:15.035 WARN (main) [c: s: r: x: t:] o.a.s.c.SolrZkServer Embedded Zookeeper is not recommended in production environments. See Reference Guide for details. 2026-05-11T13:05:15.168121966Z 2026-05-11 13:05:15.167 WARN (embeddedZkServer) [c: s: r: x: t:] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0. 2026-05-11T13:05:15.538585606Z 2026-05-11 13:05:15.538 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=172.18.0.2:9983 2026-05-11T13:05:15.552225977Z 2026-05-11 13:05:15.551 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-05-11T13:05:15.609208321Z 2026-05-11 13:05:15.608 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2026-05-11T13:05:15.634585348Z 2026-05-11 13:05:15.634 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-05-11T13:05:15.634698289Z 2026-05-11 13:05:15.634 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-05-11T13:05:15.785402924Z 2026-05-11 13:05:15.783 WARN (main) [c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2026-05-11T13:05:15.811267096Z 2026-05-11 13:05:15.810 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-05-11T13:05:15.826425436Z 2026-05-11 13:05:15.825 INFO (main) [c: s: r: x: t:] o.a.s.c.OverseerElectionContext I am going to be the leader solr-node1:8983_solr 2026-05-11T13:05:15.833678564Z 2026-05-11 13:05:15.833 INFO (main) [c: s: r: x: t:] o.a.s.c.Overseer Overseer (id=72115856288382976-solr-node1:8983_solr-n_0000000000) starting 2026-05-11T13:05:15.914129512Z 2026-05-11 13:05:15.913 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper: /live_nodes/solr-node1:8983_solr 2026-05-11T13:05:15.914846743Z 2026-05-11 13:05:15.914 INFO (OverseerStateUpdate-72115856288382976-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.Overseer Starting to work on the main queue : solr-node1:8983_solr 2026-05-11T13:05:15.926898202Z 2026-05-11 13:05:15.926 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2026-05-11T13:05:15.981805780Z 2026-05-11 13:05:15.981 WARN (main) [c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2026-05-11T13:05:16.432457006Z 2026-05-11 13:05:16.431 INFO (main) [c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /var/solr/data 2026-05-11T13:05:16.614236358Z 2026-05-11 13:05:16.613 WARN (main) [c: s: r: x: t:] o.g.j.m.i.MessagingBinders A class jakarta.activation.DataSource for a default provider MessageBodyWriter<jakarta.activation.DataSource> was not found. The provider is not available. 2026-05-11T13:05:16.882547163Z 2026-05-11 13:05:16.882 INFO (main) [c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-05-11T13:05:17.018097095Z 2026-05-11 13:05:17.017 INFO (main) [c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@71f67a79{solr-jetty-context.xml,/solr,file:///opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp/,AVAILABLE}{/opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp} 2026-05-11T13:05:17.023871343Z 2026-05-11 13:05:17.023 INFO (main) [c: s: r: x: t:] o.e.j.s.RequestLogWriter Opened /var/solr/logs/2026_05_11.request.log 2026-05-11T13:05:17.064981461Z 2026-05-11 13:05:17.063 INFO (main) [c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@61884cb1{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8983} 2026-05-11T13:05:17.065437007Z 2026-05-11 13:05:17.065 INFO (main) [c: s: r: x: t:] o.e.j.s.Server Started Server@350ec41e{STARTING}[10.0.26,sto=0] @4571ms 2026-05-11T13:05:17.236153875Z 2026-05-11 13:05:17.235 INFO (qtp985324122-27-solr-node1-1) [c: s: r: x: t:solr-node1-1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=41 2026-05-11T13:05:17.299743974Z 2026-05-11 13:05:17.299 INFO (qtp985324122-96-solr-node1-2) [c: s: r: x: t:solr-node1-2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=17 2026-05-11T13:05:20.778040687Z 2026-05-11 13:05:20.777 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) 2026-05-11T13:05:20.867359775Z 2026-05-11 13:05:20.866 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2026-05-11T13:05:24.777148326Z 2026-05-11 13:05:24.776 INFO (qtp985324122-99-solr-node1-3) [c: s: r: x: t:solr-node1-3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=8 2026-05-11T13:05:24.808833149Z 2026-05-11 13:05:24.808 INFO (qtp985324122-99-solr-node1-4) [c: s: r: x: t:solr-node1-4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=11 2026-05-11T13:05:24.837891981Z 2026-05-11 13:05:24.837 INFO (qtp985324122-27-solr-node1-5) [c: s: r: x: t:solr-node1-5] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=2 2026-05-11T13:05:25.157841360Z 2026-05-11 13:05:25.157 INFO (OverseerThreadFactory-17-thread-1) [c:test-collection s: r: x: t:] o.a.s.c.a.c.CreateCollectionCmd Create collection test-collection 2026-05-11T13:05:25.177930001Z 2026-05-11 13:05:25.177 INFO (OverseerThreadFactory-17-thread-1) [c:test-collection s: r: x: t:] o.a.s.c.c.ZkStateReader /collections/test-collection/state.json is deleted, stop watching children 2026-05-11T13:05:25.184939755Z 2026-05-11 13:05:25.184 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/test-collection/state.json zxid: 173] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-11T13:05:25.226846055Z 2026-05-11 13:05:25.226 INFO (OverseerStateUpdate-72115856288382976-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2026-05-11T13:05:25.226867296Z "core":"test-collection_shard1_replica_n1", 2026-05-11T13:05:25.226870692Z "node_name":"solr-node2:8984_solr", 2026-05-11T13:05:25.226873410Z "base_url":"http://solr-node2:8984/solr";, 2026-05-11T13:05:25.226876026Z "collection":"test-collection", 2026-05-11T13:05:25.226878731Z "shard":"shard1", 2026-05-11T13:05:25.226881238Z "state":"down", 2026-05-11T13:05:25.226883691Z "type":"NRT", 2026-05-11T13:05:25.226886130Z "operation":"ADDREPLICA", 2026-05-11T13:05:25.226888725Z "waitForFinalState":"false"} 2026-05-11T13:05:25.234113649Z 2026-05-11 13:05:25.233 INFO (OverseerStateUpdate-72115856288382976-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2026-05-11T13:05:25.234131767Z "core":"test-collection_shard2_replica_n2", 2026-05-11T13:05:25.234134984Z "node_name":"solr-node3:8985_solr", 2026-05-11T13:05:25.234138313Z "base_url":"http://solr-node3:8985/solr";, 2026-05-11T13:05:25.234141026Z "collection":"test-collection", 2026-05-11T13:05:25.234143529Z "shard":"shard2", 2026-05-11T13:05:25.234145955Z "state":"down", 2026-05-11T13:05:25.234149888Z "type":"NRT", 2026-05-11T13:05:25.234152415Z "operation":"ADDREPLICA", 2026-05-11T13:05:25.234154924Z "waitForFinalState":"false"} 2026-05-11T13:05:25.250499054Z 2026-05-11 13:05:25.250 INFO (OverseerStateUpdate-72115856288382976-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2026-05-11T13:05:25.250523804Z "core":"test-collection_shard3_replica_n4", 2026-05-11T13:05:25.250527422Z "node_name":"solr-node1:8983_solr", 2026-05-11T13:05:25.250540272Z "base_url":"http://solr-node1:8983/solr";, 2026-05-11T13:05:25.250542479Z "collection":"test-collection", 2026-05-11T13:05:25.250544535Z "shard":"shard3", 2026-05-11T13:05:25.250546470Z "state":"down", 2026-05-11T13:05:25.250548432Z "type":"NRT", 2026-05-11T13:05:25.250550303Z "operation":"ADDREPLICA", 2026-05-11T13:05:25.250552302Z "waitForFinalState":"false"} 2026-05-11T13:05:25.361391830Z 2026-05-11 13:05:25.360 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 185] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-11T13:05:25.481367587Z 2026-05-11 13:05:25.478 INFO (qtp985324122-99-solr-node1-6) [c: s: r: x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=techproducts&newCollection=true&collection=test-collection&version=2&replicaType=NRT&coreNodeName=core_node6&name=test-collection_shard3_replica_n4&action=CREATE&numShards=3&shard=shard3&wt=javabin 2026-05-11T13:05:25.530063280Z 2026-05-11 13:05:25.529 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.12.0 2026-05-11T13:05:25.644401970Z 2026-05-11 13:05:25.643 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.s.IndexSchema Schema name=default-config 2026-05-11T13:05:26.072070075Z 2026-05-11 13:05:26.070 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.s.IndexSchema Loaded schema default-config/1.7 with uniqueid field id 2026-05-11T13:05:26.072095265Z 2026-05-11 13:05:26.071 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.CoreContainer Creating SolrCore 'test-collection_shard3_replica_n4' using configuration from configset techproducts, trusted=true 2026-05-11T13:05:26.099343234Z 2026-05-11 13:05:26.098 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.SolrCore Opening new SolrCore at [/var/solr/data/test-collection_shard3_replica_n4], dataDir=[/var/solr/data/test-collection_shard3_replica_n4/data/] 2026-05-11T13:05:27.800930011Z 2026-05-11 13:05:27.799 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-05-11T13:05:27.870805590Z 2026-05-11 13:05:27.870 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2026-05-11T13:05:27.880693058Z 2026-05-11 13:05:27.880 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2026-05-11T13:05:27.882607275Z 2026-05-11 13:05:27.881 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 2026-05-11T13:05:27.882764123Z 2026-05-11 13:05:27.882 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.u.CommitTracker Soft AutoCommit: if uncommitted for 3000ms; 2026-05-11T13:05:27.969062791Z 2026-05-11 13:05:27.968 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/techproducts 2026-05-11T13:05:27.972501892Z 2026-05-11 13:05:27.972 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/techproducts 2026-05-11T13:05:27.974319114Z 2026-05-11 13:05:27.974 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/techproducts/managed-schema.xml 2026-05-11T13:05:27.976468376Z 2026-05-11 13:05:27.976 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest 2026-05-11T13:05:27.991335047Z 2026-05-11 13:05:27.990 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.s.DirectSolrSpellChecker init: {maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4, accuracy=0.5, maxQueryFrequency=0.01, name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal} 2026-05-11T13:05:27.998943033Z 2026-05-11 13:05:27.998 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2026-05-11T13:05:28.004970760Z 2026-05-11 13:05:28.004 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard3_replica_n4 solr-node1-6 core_node6 solr-node1:8983_solr test-collection shard3) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.QuerySenderListener QuerySenderListener done. 2026-05-11T13:05:28.004986695Z 2026-05-11 13:05:28.004 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard3_replica_n4 solr-node1-6 core_node6 solr-node1:8983_solr test-collection shard3) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default 2026-05-11T13:05:28.015631856Z 2026-05-11 13:05:28.015 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard3_replica_n4 solr-node1-6 core_node6 solr-node1:8983_solr test-collection shard3) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2026-05-11T13:05:28.022016896Z 2026-05-11 13:05:28.021 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test-collection/terms/shard3 to Terms{values={core_node6=0}, version=0} for registerTerm 2026-05-11T13:05:28.023720306Z 2026-05-11 13:05:28.023 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test-collection/leaders/shard3 2026-05-11T13:05:28.044028282Z 2026-05-11 13:05:28.040 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2026-05-11T13:05:28.045933127Z 2026-05-11 13:05:28.040 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2026-05-11T13:05:28.047916986Z 2026-05-11 13:05:28.040 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.SyncStrategy Sync replicas to http://solr-node1:8983/solr/test-collection_shard3_replica_n4/ 2026-05-11T13:05:28.049929928Z 2026-05-11 13:05:28.042 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2026-05-11T13:05:28.052962565Z 2026-05-11 13:05:28.042 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.SyncStrategy http://solr-node1:8983/solr/test-collection_shard3_replica_n4/ has no replicas 2026-05-11T13:05:28.055014369Z 2026-05-11 13:05:28.044 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test-collection/leaders/shard3/leader after winning as /collections/test-collection/leader_elect/shard3/election/72115856288382976-core_node6-n_0000000000 2026-05-11T13:05:28.057925118Z 2026-05-11 13:05:28.056 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://solr-node1:8983/solr/test-collection_shard3_replica_n4/ shard3 2026-05-11T13:05:28.162239563Z 2026-05-11 13:05:28.161 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 239] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-11T13:05:28.168883589Z 2026-05-11 13:05:28.168 INFO (qtp985324122-99-solr-node1-6) [c:test-collection s:shard3 r:core_node6 x:test-collection_shard3_replica_n4 t:solr-node1-6] o.a.s.c.ZkController I am the leader, no recovery necessary 2026-05-11T13:05:28.179146527Z 2026-05-11 13:05:28.178 INFO (qtp985324122-99-solr-node1-6) [c: s: r: x: t:solr-node1-6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=techproducts&newCollection=true&name=test-collection_shard3_replica_n4&action=CREATE&numShards=3&collection=test-collection&shard=shard3&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2702 2026-05-11T13:05:28.277583313Z 2026-05-11 13:05:28.277 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 245] for collection [test-collection] has occurred - updating... (live nodes size: [3]) # === Docker inspect for solr-node1 === { "Name": "/solr-node1", "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 1381191, "ExitCode": 0, "Error": "", "StartedAt": "2026-05-11T13:05:12.234401758Z", "FinishedAt": "0001-01-01T00:00:00Z" }, "Ports": { "8983/tcp": null } } # === Docker logs for solr-node2 === 2026-05-11T13:05:17.631062074Z *** [WARN] *** Your open file limit is currently 1024. 2026-05-11T13:05:17.631087847Z It should be set to 65000 to avoid operational disruption. 2026-05-11T13:05:17.631091084Z If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh 2026-05-11T13:05:17.631399409Z Solr will start in SolrCloud mode by default in version 10, and you will no longer need to pass in -c or --cloud flag. 2026-05-11T13:05:17.631408371Z 2026-05-11T13:05:17.641200098Z Java 17 detected. Enabled workaround for SOLR-16463 2026-05-11T13:05:17.648995611Z [0.002s][warning][pagesize] UseLargePages disabled, no large pages configured and available on the system. 2026-05-11T13:05:17.694329930Z CompileCommand: exclude com/github/benmanes/caffeine/cache/BoundedLocalCache.put bool exclude = true 2026-05-11T13:05:17.728923157Z WARNING: A command line option has enabled the Security Manager 2026-05-11T13:05:17.728940741Z WARNING: The Security Manager is deprecated and will be removed in a future release 2026-05-11T13:05:18.973217036Z 2026-05-11 13:05:18.970 INFO (main) [c: s: r: x: t:] o.e.j.s.Server jetty-10.0.26; built: 2025-08-14T15:56:56.454Z; git: 65a55c55a68c56d5f2e8232164439bd6e76e53d1; jvm 17.0.16+8 2026-05-11T13:05:19.247096759Z 2026-05-11 13:05:19.246 WARN (main) [c: s: r: x: t:] o.e.j.u.DeprecationWarning Using @Deprecated Class org.eclipse.jetty.servlet.listener.ELContextCleaner 2026-05-11T13:05:19.273296745Z 2026-05-11 13:05:19.272 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2026-05-11T13:05:19.280228059Z 2026-05-11 13:05:19.279 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.10.0-SNAPSHOT 1edeb3ac6a97186b4ae7de511196a1769de7960e [snapshot build, details omitted] 2026-05-11T13:05:19.280353235Z 2026-05-11 13:05:19.279 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port 8984 2026-05-11T13:05:19.280467365Z 2026-05-11 13:05:19.280 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /opt/solr-9.10.0-SNAPSHOT-slim 2026-05-11T13:05:19.280584766Z 2026-05-11 13:05:19.280 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2026-05-11T13:05:19.280080837Z 2026-05-11T13:05:19.283194126Z 2026-05-11 13:05:19.282 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr started with "-XX:+CrashOnOutOfMemoryError" that will crash on any OutOfMemoryError exception. The cause of the OOME will be logged in the crash file at the following path: /var/solr/logs/jvm_crash_1.log 2026-05-11T13:05:19.306164493Z 2026-05-11 13:05:19.305 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /var/solr/data (source: system property: solr.solr.home) 2026-05-11T13:05:19.330363434Z 2026-05-11 13:05:19.329 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-05-11T13:05:19.489065244Z 2026-05-11 13:05:19.488 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2026-05-11T13:05:19.508863309Z 2026-05-11 13:05:19.508 INFO (zkCallback-1-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-05-11T13:05:19.509055882Z 2026-05-11 13:05:19.508 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-05-11T13:05:19.509156727Z 2026-05-11 13:05:19.508 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-05-11T13:05:19.619182071Z 2026-05-11 13:05:19.618 INFO (main) [c: s: r: x: t:] o.a.s.c.NodeConfig Loading solr.xml from SolrHome (not found in ZooKeeper) 2026-05-11T13:05:19.619359582Z 2026-05-11 13:05:19.619 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig solr.xml not found in SOLR_HOME, using built-in default 2026-05-11T13:05:19.619501360Z 2026-05-11 13:05:19.619 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/solr.xml 2026-05-11T13:05:19.666480094Z 2026-05-11 13:05:19.665 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrResourceLoader Added 1 libs to classloader, from paths: [/opt/solr-9.10.0-SNAPSHOT-slim/lib] 2026-05-11T13:05:20.525408462Z 2026-05-11 13:05:20.524 INFO (main) [c: s: r: x: t:] o.a.s.u.t.SimplePropagator Always-on trace id generation enabled. 2026-05-11T13:05:20.669501828Z 2026-05-11 13:05:20.669 WARN (main) [c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Jetty request logging enabled. Will retain logs for last 3 days. See chapter "Configuring Logging" in reference guide for how to configure. 2026-05-11T13:05:20.671047370Z 2026-05-11 13:05:20.669 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=solr-node1:9983 2026-05-11T13:05:20.722872670Z 2026-05-11 13:05:20.720 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-05-11T13:05:20.747005142Z 2026-05-11 13:05:20.746 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2026-05-11T13:05:20.756865281Z 2026-05-11 13:05:20.756 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-05-11T13:05:20.757024626Z 2026-05-11 13:05:20.756 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-05-11T13:05:20.795699477Z 2026-05-11 13:05:20.795 WARN (main) [c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2026-05-11T13:05:20.806493381Z 2026-05-11 13:05:20.805 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) 2026-05-11T13:05:20.829261734Z 2026-05-11 13:05:20.828 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-05-11T13:05:20.845027656Z 2026-05-11 13:05:20.844 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Publish node=solr-node2:8984_solr as DOWN 2026-05-11T13:05:20.858369336Z 2026-05-11 13:05:20.857 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper: /live_nodes/solr-node2:8984_solr 2026-05-11T13:05:20.868833681Z 2026-05-11 13:05:20.868 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2026-05-11T13:05:20.973161685Z 2026-05-11 13:05:20.972 WARN (main) [c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2026-05-11T13:05:21.264318344Z 2026-05-11 13:05:21.263 INFO (main) [c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /var/solr/data 2026-05-11T13:05:21.439845461Z 2026-05-11 13:05:21.439 WARN (main) [c: s: r: x: t:] o.g.j.m.i.MessagingBinders A class jakarta.activation.DataSource for a default provider MessageBodyWriter<jakarta.activation.DataSource> was not found. The provider is not available. 2026-05-11T13:05:21.711584268Z 2026-05-11 13:05:21.710 INFO (main) [c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-05-11T13:05:21.877249120Z 2026-05-11 13:05:21.876 INFO (main) [c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@71f67a79{solr-jetty-context.xml,/solr,file:///opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp/,AVAILABLE}{/opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp} 2026-05-11T13:05:21.882464018Z 2026-05-11 13:05:21.882 INFO (main) [c: s: r: x: t:] o.e.j.s.RequestLogWriter Opened /var/solr/logs/2026_05_11.request.log 2026-05-11T13:05:21.887048515Z 2026-05-11 13:05:21.886 INFO (main) [c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@61884cb1{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8984} 2026-05-11T13:05:21.888689325Z 2026-05-11 13:05:21.888 INFO (main) [c: s: r: x: t:] o.e.j.s.Server Started Server@350ec41e{STARTING}[10.0.26,sto=0] @4241ms 2026-05-11T13:05:22.055020162Z 2026-05-11 13:05:22.054 INFO (qtp985324122-27-solr-node2-1) [c: s: r: x: t:solr-node2-1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=45 2026-05-11T13:05:22.115689215Z 2026-05-11 13:05:22.114 INFO (qtp985324122-55-solr-node2-2) [c: s: r: x: t:solr-node2-2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=12 2026-05-11T13:05:25.479848470Z 2026-05-11 13:05:25.479 INFO (qtp985324122-58-solr-node1-6) [c: s: r: x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=techproducts&newCollection=true&collection=test-collection&version=2&replicaType=NRT&coreNodeName=core_node3&name=test-collection_shard1_replica_n1&action=CREATE&numShards=3&shard=shard1&wt=javabin 2026-05-11T13:05:25.529756965Z 2026-05-11 13:05:25.529 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.12.0 2026-05-11T13:05:25.586348533Z 2026-05-11 13:05:25.585 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.s.IndexSchema Schema name=default-config 2026-05-11T13:05:25.923519084Z 2026-05-11 13:05:25.923 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.s.IndexSchema Loaded schema default-config/1.7 with uniqueid field id 2026-05-11T13:05:25.923557195Z 2026-05-11 13:05:25.923 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.CoreContainer Creating SolrCore 'test-collection_shard1_replica_n1' using configuration from configset techproducts, trusted=true 2026-05-11T13:05:25.942459002Z 2026-05-11 13:05:25.942 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.SolrCore Opening new SolrCore at [/var/solr/data/test-collection_shard1_replica_n1], dataDir=[/var/solr/data/test-collection_shard1_replica_n1/data/] 2026-05-11T13:05:26.380674676Z 2026-05-11 13:05:26.380 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-05-11T13:05:26.400305356Z 2026-05-11 13:05:26.399 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2026-05-11T13:05:26.403671555Z 2026-05-11 13:05:26.403 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2026-05-11T13:05:26.404886132Z 2026-05-11 13:05:26.404 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 2026-05-11T13:05:26.404902370Z 2026-05-11 13:05:26.404 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.u.CommitTracker Soft AutoCommit: if uncommitted for 3000ms; 2026-05-11T13:05:26.445358429Z 2026-05-11 13:05:26.444 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/techproducts 2026-05-11T13:05:26.448390066Z 2026-05-11 13:05:26.448 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/techproducts 2026-05-11T13:05:26.450499359Z 2026-05-11 13:05:26.450 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/techproducts/managed-schema.xml 2026-05-11T13:05:26.452321438Z 2026-05-11 13:05:26.452 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest 2026-05-11T13:05:26.463773268Z 2026-05-11 13:05:26.463 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.s.DirectSolrSpellChecker init: {maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4, name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal, accuracy=0.5, maxQueryFrequency=0.01} 2026-05-11T13:05:26.471037255Z 2026-05-11 13:05:26.470 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2026-05-11T13:05:26.476982378Z 2026-05-11 13:05:26.476 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard1_replica_n1 solr-node1-6 core_node3 solr-node2:8984_solr test-collection shard1) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.QuerySenderListener QuerySenderListener done. 2026-05-11T13:05:26.477027456Z 2026-05-11 13:05:26.476 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard1_replica_n1 solr-node1-6 core_node3 solr-node2:8984_solr test-collection shard1) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default 2026-05-11T13:05:26.484525897Z 2026-05-11 13:05:26.484 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard1_replica_n1 solr-node1-6 core_node3 solr-node2:8984_solr test-collection shard1) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2026-05-11T13:05:26.503258792Z 2026-05-11 13:05:26.502 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test-collection/terms/shard1 to Terms{values={core_node3=0}, version=0} for registerTerm 2026-05-11T13:05:26.504659334Z 2026-05-11 13:05:26.504 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test-collection/leaders/shard1 2026-05-11T13:05:26.540515161Z 2026-05-11 13:05:26.540 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2026-05-11T13:05:26.540618512Z 2026-05-11 13:05:26.540 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2026-05-11T13:05:26.540784470Z 2026-05-11 13:05:26.540 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.SyncStrategy Sync replicas to http://solr-node2:8984/solr/test-collection_shard1_replica_n1/ 2026-05-11T13:05:26.542206949Z 2026-05-11 13:05:26.541 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2026-05-11T13:05:26.542836343Z 2026-05-11 13:05:26.542 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.SyncStrategy http://solr-node2:8984/solr/test-collection_shard1_replica_n1/ has no replicas 2026-05-11T13:05:26.543937662Z 2026-05-11 13:05:26.543 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test-collection/leaders/shard1/leader after winning as /collections/test-collection/leader_elect/shard1/election/72115856288382980-core_node3-n_0000000000 2026-05-11T13:05:26.856492787Z 2026-05-11 13:05:26.856 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://solr-node2:8984/solr/test-collection_shard1_replica_n1/ shard1 2026-05-11T13:05:26.983686886Z 2026-05-11 13:05:26.983 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 207] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-11T13:05:27.016293229Z 2026-05-11 13:05:27.015 INFO (qtp985324122-58-solr-node1-6) [c:test-collection s:shard1 r:core_node3 x:test-collection_shard1_replica_n1 t:solr-node1-6] o.a.s.c.ZkController I am the leader, no recovery necessary 2026-05-11T13:05:27.043103979Z 2026-05-11 13:05:27.042 INFO (qtp985324122-58-solr-node1-6) [c: s: r: x: t:solr-node1-6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=techproducts&newCollection=true&name=test-collection_shard1_replica_n1&action=CREATE&numShards=3&collection=test-collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1565 2026-05-11T13:05:27.191613230Z 2026-05-11 13:05:27.190 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 221] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-11T13:05:27.304535734Z 2026-05-11 13:05:27.304 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 224] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-11T13:05:28.162462516Z 2026-05-11 13:05:28.162 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 239] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-11T13:05:28.277630440Z 2026-05-11 13:05:28.277 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 245] for collection [test-collection] has occurred - updating... (live nodes size: [3]) # === Docker inspect for solr-node2 === { "Name": "/solr-node2", "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 1381585, "ExitCode": 0, "Error": "", "StartedAt": "2026-05-11T13:05:17.402270613Z", "FinishedAt": "0001-01-01T00:00:00Z" }, "Ports": { "8983/tcp": null } } # === Docker logs for solr-node3 === 2026-05-11T13:05:17.861396290Z *** [WARN] *** Your open file limit is currently 1024. 2026-05-11T13:05:17.861452095Z It should be set to 65000 to avoid operational disruption. 2026-05-11T13:05:17.861456841Z If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh 2026-05-11T13:05:17.861696718Z Solr will start in SolrCloud mode by default in version 10, and you will no longer need to pass in -c or --cloud flag. 2026-05-11T13:05:17.861708970Z 2026-05-11T13:05:17.872370371Z Java 17 detected. Enabled workaround for SOLR-16463 2026-05-11T13:05:17.880746819Z [0.002s][warning][pagesize] UseLargePages disabled, no large pages configured and available on the system. 2026-05-11T13:05:17.927325295Z CompileCommand: exclude com/github/benmanes/caffeine/cache/BoundedLocalCache.put bool exclude = true 2026-05-11T13:05:17.962738875Z WARNING: A command line option has enabled the Security Manager 2026-05-11T13:05:17.962771476Z WARNING: The Security Manager is deprecated and will be removed in a future release 2026-05-11T13:05:19.122314003Z 2026-05-11 13:05:19.118 INFO (main) [c: s: r: x: t:] o.e.j.s.Server jetty-10.0.26; built: 2025-08-14T15:56:56.454Z; git: 65a55c55a68c56d5f2e8232164439bd6e76e53d1; jvm 17.0.16+8 2026-05-11T13:05:19.388028222Z 2026-05-11 13:05:19.387 WARN (main) [c: s: r: x: t:] o.e.j.u.DeprecationWarning Using @Deprecated Class org.eclipse.jetty.servlet.listener.ELContextCleaner 2026-05-11T13:05:19.413937581Z 2026-05-11 13:05:19.413 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2026-05-11T13:05:19.420968183Z 2026-05-11 13:05:19.420 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.10.0-SNAPSHOT 1edeb3ac6a97186b4ae7de511196a1769de7960e [snapshot build, details omitted] 2026-05-11T13:05:19.421289863Z 2026-05-11 13:05:19.420 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port 8985 2026-05-11T13:05:19.421301375Z 2026-05-11 13:05:19.420 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /opt/solr-9.10.0-SNAPSHOT-slim 2026-05-11T13:05:19.421304610Z 2026-05-11 13:05:19.420 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2026-05-11T13:05:19.420684980Z 2026-05-11T13:05:19.423921816Z 2026-05-11 13:05:19.423 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr started with "-XX:+CrashOnOutOfMemoryError" that will crash on any OutOfMemoryError exception. The cause of the OOME will be logged in the crash file at the following path: /var/solr/logs/jvm_crash_1.log 2026-05-11T13:05:19.445323698Z 2026-05-11 13:05:19.444 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /var/solr/data (source: system property: solr.solr.home) 2026-05-11T13:05:19.468489151Z 2026-05-11 13:05:19.467 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-05-11T13:05:19.614258318Z 2026-05-11 13:05:19.613 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2026-05-11T13:05:19.633059986Z 2026-05-11 13:05:19.632 INFO (zkCallback-1-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-05-11T13:05:19.633148418Z 2026-05-11 13:05:19.632 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-05-11T13:05:19.633327467Z 2026-05-11 13:05:19.632 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-05-11T13:05:19.743423943Z 2026-05-11 13:05:19.742 INFO (main) [c: s: r: x: t:] o.a.s.c.NodeConfig Loading solr.xml from SolrHome (not found in ZooKeeper) 2026-05-11T13:05:19.743534545Z 2026-05-11 13:05:19.743 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig solr.xml not found in SOLR_HOME, using built-in default 2026-05-11T13:05:19.743615608Z 2026-05-11 13:05:19.743 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/solr.xml 2026-05-11T13:05:19.778850851Z 2026-05-11 13:05:19.778 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrResourceLoader Added 1 libs to classloader, from paths: [/opt/solr-9.10.0-SNAPSHOT-slim/lib] 2026-05-11T13:05:20.529021092Z 2026-05-11 13:05:20.528 INFO (main) [c: s: r: x: t:] o.a.s.u.t.SimplePropagator Always-on trace id generation enabled. 2026-05-11T13:05:20.668803813Z 2026-05-11 13:05:20.668 WARN (main) [c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Jetty request logging enabled. Will retain logs for last 3 days. See chapter "Configuring Logging" in reference guide for how to configure. 2026-05-11T13:05:20.670740956Z 2026-05-11 13:05:20.668 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=solr-node1:9983 2026-05-11T13:05:20.678497108Z 2026-05-11 13:05:20.678 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-05-11T13:05:20.683530290Z 2026-05-11 13:05:20.683 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2026-05-11T13:05:20.687247680Z 2026-05-11 13:05:20.686 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-05-11T13:05:20.687259092Z 2026-05-11 13:05:20.686 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-05-11T13:05:20.718653306Z 2026-05-11 13:05:20.718 WARN (main) [c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2026-05-11T13:05:20.727035941Z 2026-05-11 13:05:20.726 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2026-05-11T13:05:20.746637804Z 2026-05-11 13:05:20.746 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-05-11T13:05:20.757997787Z 2026-05-11 13:05:20.757 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Publish node=solr-node3:8985_solr as DOWN 2026-05-11T13:05:20.769688271Z 2026-05-11 13:05:20.769 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper: /live_nodes/solr-node3:8985_solr 2026-05-11T13:05:20.779315799Z 2026-05-11 13:05:20.778 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) 2026-05-11T13:05:20.824548319Z 2026-05-11 13:05:20.823 WARN (main) [c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2026-05-11T13:05:20.867683631Z 2026-05-11 13:05:20.867 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2026-05-11T13:05:21.096513787Z 2026-05-11 13:05:21.095 INFO (main) [c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /var/solr/data 2026-05-11T13:05:21.261952821Z 2026-05-11 13:05:21.261 WARN (main) [c: s: r: x: t:] o.g.j.m.i.MessagingBinders A class jakarta.activation.DataSource for a default provider MessageBodyWriter<jakarta.activation.DataSource> was not found. The provider is not available. 2026-05-11T13:05:21.514010653Z 2026-05-11 13:05:21.513 INFO (main) [c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-05-11T13:05:21.647903086Z 2026-05-11 13:05:21.646 INFO (main) [c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@71f67a79{solr-jetty-context.xml,/solr,file:///opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp/,AVAILABLE}{/opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp} 2026-05-11T13:05:21.656547871Z 2026-05-11 13:05:21.656 INFO (main) [c: s: r: x: t:] o.e.j.s.RequestLogWriter Opened /var/solr/logs/2026_05_11.request.log 2026-05-11T13:05:21.660035455Z 2026-05-11 13:05:21.659 INFO (main) [c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@61884cb1{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8985} 2026-05-11T13:05:21.660805274Z 2026-05-11 13:05:21.660 INFO (main) [c: s: r: x: t:] o.e.j.s.Server Started Server@350ec41e{STARTING}[10.0.26,sto=0] @3781ms 2026-05-11T13:05:23.625930933Z 2026-05-11 13:05:23.617 INFO (qtp985324122-27-solr-node3-1) [c: s: r: x: t:solr-node3-1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=69 2026-05-11T13:05:23.700956421Z 2026-05-11 13:05:23.700 INFO (qtp985324122-56-solr-node3-2) [c: s: r: x: t:solr-node3-2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=22 2026-05-11T13:05:25.103604785Z 2026-05-11 13:05:25.103 INFO (qtp985324122-58-solr-node3-3) [c: s: r: x: t:solr-node3-3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=8 2026-05-11T13:05:25.480965474Z 2026-05-11 13:05:25.480 INFO (qtp985324122-60-solr-node1-6) [c: s: r: x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=techproducts&newCollection=true&collection=test-collection&version=2&replicaType=NRT&coreNodeName=core_node5&name=test-collection_shard2_replica_n2&action=CREATE&numShards=3&shard=shard2&wt=javabin 2026-05-11T13:05:25.554039806Z 2026-05-11 13:05:25.553 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.12.0 2026-05-11T13:05:25.626436510Z 2026-05-11 13:05:25.625 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.s.IndexSchema Schema name=default-config 2026-05-11T13:05:26.075809563Z 2026-05-11 13:05:26.075 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.s.IndexSchema Loaded schema default-config/1.7 with uniqueid field id 2026-05-11T13:05:26.075922019Z 2026-05-11 13:05:26.075 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.CoreContainer Creating SolrCore 'test-collection_shard2_replica_n2' using configuration from configset techproducts, trusted=true 2026-05-11T13:05:26.095426121Z 2026-05-11 13:05:26.094 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.SolrCore Opening new SolrCore at [/var/solr/data/test-collection_shard2_replica_n2], dataDir=[/var/solr/data/test-collection_shard2_replica_n2/data/] 2026-05-11T13:05:26.533150532Z 2026-05-11 13:05:26.532 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-05-11T13:05:26.553150851Z 2026-05-11 13:05:26.552 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2026-05-11T13:05:26.823458350Z 2026-05-11 13:05:26.822 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2026-05-11T13:05:26.824711712Z 2026-05-11 13:05:26.824 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 2026-05-11T13:05:26.824725308Z 2026-05-11 13:05:26.824 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.u.CommitTracker Soft AutoCommit: if uncommitted for 3000ms; 2026-05-11T13:05:26.907269807Z 2026-05-11 13:05:26.906 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/techproducts 2026-05-11T13:05:26.912166705Z 2026-05-11 13:05:26.910 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/techproducts 2026-05-11T13:05:26.914828749Z 2026-05-11 13:05:26.914 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/techproducts/managed-schema.xml 2026-05-11T13:05:26.917067291Z 2026-05-11 13:05:26.916 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest 2026-05-11T13:05:26.931682882Z 2026-05-11 13:05:26.931 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.s.DirectSolrSpellChecker init: {maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4, accuracy=0.5, maxQueryFrequency=0.01, name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal} 2026-05-11T13:05:26.939115913Z 2026-05-11 13:05:26.938 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2026-05-11T13:05:26.945325879Z 2026-05-11 13:05:26.944 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard2_replica_n2 solr-node1-6 core_node5 solr-node3:8985_solr test-collection shard2) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.QuerySenderListener QuerySenderListener done. 2026-05-11T13:05:26.945410456Z 2026-05-11 13:05:26.945 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard2_replica_n2 solr-node1-6 core_node5 solr-node3:8985_solr test-collection shard2) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default 2026-05-11T13:05:26.957460096Z 2026-05-11 13:05:26.957 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard2_replica_n2 solr-node1-6 core_node5 solr-node3:8985_solr test-collection shard2) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2026-05-11T13:05:27.024925665Z 2026-05-11 13:05:27.024 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test-collection/terms/shard2 to Terms{values={core_node5=0}, version=0} for registerTerm 2026-05-11T13:05:27.026772670Z 2026-05-11 13:05:27.026 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test-collection/leaders/shard2 2026-05-11T13:05:27.064633811Z 2026-05-11 13:05:27.064 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2026-05-11T13:05:27.064653534Z 2026-05-11 13:05:27.064 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2026-05-11T13:05:27.064656711Z 2026-05-11 13:05:27.064 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.SyncStrategy Sync replicas to http://solr-node3:8985/solr/test-collection_shard2_replica_n2/ 2026-05-11T13:05:27.066392298Z 2026-05-11 13:05:27.066 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2026-05-11T13:05:27.067104123Z 2026-05-11 13:05:27.066 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.SyncStrategy http://solr-node3:8985/solr/test-collection_shard2_replica_n2/ has no replicas 2026-05-11T13:05:27.068507957Z 2026-05-11 13:05:27.068 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test-collection/leaders/shard2/leader after winning as /collections/test-collection/leader_elect/shard2/election/72115856288382979-core_node5-n_0000000000 2026-05-11T13:05:27.086029588Z 2026-05-11 13:05:27.085 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://solr-node3:8985/solr/test-collection_shard2_replica_n2/ shard2 2026-05-11T13:05:27.191825940Z 2026-05-11 13:05:27.191 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 221] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-11T13:05:27.195476590Z 2026-05-11 13:05:27.195 INFO (qtp985324122-60-solr-node1-6) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-6] o.a.s.c.ZkController I am the leader, no recovery necessary 2026-05-11T13:05:27.204127642Z 2026-05-11 13:05:27.203 INFO (qtp985324122-60-solr-node1-6) [c: s: r: x: t:solr-node1-6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=techproducts&newCollection=true&name=test-collection_shard2_replica_n2&action=CREATE&numShards=3&collection=test-collection&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1725 2026-05-11T13:05:27.304481801Z 2026-05-11 13:05:27.304 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 224] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-11T13:05:28.162603872Z 2026-05-11 13:05:28.162 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 239] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-11T13:05:28.235725589Z 2026-05-11 13:05:28.235 INFO (qtp985324122-59-solr-node3-4) [c:test-collection s: r: x: t:solr-node3-4] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas 2026-05-11T13:05:28.277678822Z 2026-05-11 13:05:28.277 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 245] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-05-11T13:05:28.280240760Z 2026-05-11 13:05:28.279 INFO (qtp985324122-59-solr-node3-4) [c:test-collection s: r: x: t:solr-node3-4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=techproducts&name=test-collection&nrtReplicas=1&action=CREATE&numShards=3&wt=json&version=2.2} status=0 QTime=3163 # === Docker inspect for solr-node3 === { "Name": "/solr-node3", "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 1381769, "ExitCode": 0, "Error": "", "StartedAt": "2026-05-11T13:05:17.639603563Z", "FinishedAt": "0001-01-01T00:00:00Z" }, "Ports": { "8983/tcp": null } } # Docker artifacts saved to: /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/docker not ok 83 Docker SolrCloud rolling upgrade # in 27254 ms # (in test file test/test_rolling_upgrade.bats, line 118) # `wait_for 30 1 docker exec solr-node1 solr healthcheck -c test-collection' failed with status 127 # 9.10.0-SNAPSHOT-slim: Pulling from apache/solr-nightly # af6eca94c810: Pulling fs layer # cb0efb96dabd: Pulling fs layer # 3e9d91201f40: Pulling fs layer # 66b76b382631: Pulling fs layer # 601f2c23751f: Pulling fs layer # 0ed719aef393: Pulling fs layer # 69a09c96e8bf: Pulling fs layer # c937aee9a870: Pulling fs layer # 9cdfe5320de8: Pulling fs layer # 3aa9120e46f5: Pulling fs layer # 4f4fb700ef54: Pulling fs layer # 0ed719aef393: Waiting # 69a09c96e8bf: Waiting # c937aee9a870: Waiting # 9cdfe5320de8: Waiting # 3aa9120e46f5: Waiting # 4f4fb700ef54: Waiting # 66b76b382631: Waiting # 601f2c23751f: Waiting # cb0efb96dabd: Verifying Checksum # cb0efb96dabd: Download complete # af6eca94c810: Verifying Checksum # af6eca94c810: Download complete # 66b76b382631: Download complete # 601f2c23751f: Verifying Checksum # 601f2c23751f: Download complete # 3e9d91201f40: Verifying Checksum # 3e9d91201f40: Download complete # 69a09c96e8bf: Verifying Checksum # 69a09c96e8bf: Download complete # c937aee9a870: Verifying Checksum # c937aee9a870: Download complete # 9cdfe5320de8: Download complete # 3aa9120e46f5: Verifying Checksum # 3aa9120e46f5: Download complete # 4f4fb700ef54: Verifying Checksum # 4f4fb700ef54: Download complete # 0ed719aef393: Verifying Checksum # 0ed719aef393: Download complete # af6eca94c810: Pull complete # cb0efb96dabd: Pull complete # 3e9d91201f40: Pull complete # 66b76b382631: Pull complete # 601f2c23751f: Pull complete # 0ed719aef393: Pull complete # 69a09c96e8bf: Pull complete # c937aee9a870: Pull complete # 9cdfe5320de8: Pull complete # 3aa9120e46f5: Pull complete # 4f4fb700ef54: Pull complete # Digest: sha256:15c8155ceffe1042f37c77bb537aa531804a3510702ff87f2af5fedf523f4203 # Status: Downloaded newer image for apache/solr-nightly:9.10.0-SNAPSHOT-slim # docker.io/apache/solr-nightly:9.10.0-SNAPSHOT-slim # 10.0.0-SNAPSHOT-slim: Pulling from apache/solr-nightly # f63eb04151bc: Already exists # 87f3bb8db2f4: Already exists # 7c0b62ebdf15: Already exists # 5b95479e5f9b: Already exists # c913227527c9: Already exists # 5eae1a236a54: Pulling fs layer # 197c7ec22b6b: Pulling fs layer # 8eed92533426: Pulling fs layer # d731976aba0c: Pulling fs layer # 2a380a22a70b: Pulling fs layer # 4f4fb700ef54: Pulling fs layer # d731976aba0c: Waiting # 2a380a22a70b: Waiting # 4f4fb700ef54: Waiting # 197c7ec22b6b: Verifying Checksum # 197c7ec22b6b: Download complete # 8eed92533426: Download complete # d731976aba0c: Verifying Checksum # d731976aba0c: Download complete # 4f4fb700ef54: Verifying Checksum # 4f4fb700ef54: Download complete # 2a380a22a70b: Verifying Checksum # 2a380a22a70b: Download complete # 5eae1a236a54: Verifying Checksum # 5eae1a236a54: Download complete # 5eae1a236a54: Pull complete # 197c7ec22b6b: Pull complete # 8eed92533426: Pull complete # d731976aba0c: Pull complete # 2a380a22a70b: Pull complete # 4f4fb700ef54: Pull complete # Digest: sha256:75dc25ea19e534f02fd5f47fb42a4c832d9b24f6de87c6adc1b75bf0cd330e1c # Status: Downloaded newer image for apache/solr-nightly:10.0.0-SNAPSHOT-slim # docker.io/apache/solr-nightly:10.0.0-SNAPSHOT-slim # 6e2e944814f24e912271ff5a54aa312d88806ee45e8ae6331db6920655b6b814 # solr-data1 # solr-data2 # solr-data3 # Starting solr-node1 with embedded ZooKeeper # c6f754cb55c18601f8bcad0acaba533e48d10eb8a14c01fecda2006901a3bfbf # Starting solr-node2 connected to first node's ZooKeeper # 00713af08906c077204eaa56153ebd95e9c8ea8d46d3c44229588f92294435c6 # Started solr-node3 connected to first node's ZooKeeper # 82bbe8bca7508aea4ec8c0440f08f9b2295f6dd9bfc014089415506688deb2cf # Creating a Collection # Neither --zk-host or --solr-url parameters provided so assuming solr url is http://localhost:8983. # Neither --zk-host or --solr-url parameters provided so assuming solr url is http://localhost:8983. # WARN - 2026-05-11 13:05:24.868; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-05-11 13:05:24.900; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARNING: URLs provided to this tool needn't include Solr's context-root (e.g. "/solr"). Such URLs are deprecated and support for them will be removed in a future release. Correcting from [http://solr-node3:8985/solr] to [http://solr-node3:8985/]. # Created collection 'test-collection' with 3 shard(s), 1 replica(s) with config-set 'techproducts' # Checking collection health # /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/test/test_rolling_upgrade.bats: line 118: wait_for: command not found # solr-node1 # solr-node2 # solr-node3 # solr-node1 # solr-node2 # solr-node3 # solr-data1 # solr-data2 # solr-data3 # solrcloud-test ok 84 allowPaths - backup # in 15616 ms ok 85 snapshot lifecycle # in 4831 ms ok 86 snapshot list # in 3382 ms ok 87 snapshot describe # in 3479 ms ok 88 start solr with ssl # in 16780 ms ok 89 use different hostname when not checking peer-name # in 26059 ms ok 90 start solr with ssl and auth # in 15175 ms ok 91 start solr with client truststore and security manager # in 16846 ms ok 92 start solr with mTLS needed # in 46470 ms ok 93 start solr with mTLS wanted # in 34519 ms ok 94 test keystore reload # in 59292 ms ok 95 SOLR-11740 check 'solr stop' connection # in 15963 ms ok 96 stop command for single port # in 18454 ms ok 97 check stop command doesn't hang # in 227 ms ok 98 SOLR-16976 solr starts with remote JMX enabled # in 8072 ms ok 99 deprecated system properties converted to modern properties # in 195170 ms ok 100 start with custom jetty options # in 8118 ms ok 101 bootstrapping a configset # in 9209 ms ok 102 status detects locally running solr # in 9439 ms ok 103 status with --solr-url from user # in 8011 ms ok 104 status with --port from user # in 7947 ms ok 105 multiple connection options are prevented # in 859 ms ok 106 status with invalid --solr-url from user # in 1242 ms ok 107 status with --short format # in 195905 ms ok 108 searching solr via locally executed streaming expression # in 1708 ms ok 109 searching solr via remotely executed streaming expression # in 1262 ms ok 110 variable interpolation # in 1698 ms ok 111 searching solr without credentials fails with error # in 1114 ms ok 112 --version returns Solr version # in 740 ms ok 113 version as direct tool call still runs # in 799 ms ok 114 short help # in 874 ms ok 115 short help is inferred # in 794 ms ok 116 long help # in 779 ms ok 117 running subcommands with zk is prevented # in 769 ms ok 118 listing out files # in 2146 ms ok 119 connecting to solr via various solr urls and zk hosts # in 7797 ms ok 120 copying files around # in 10981 ms ok 121 upconfig # in 2525 ms ok 122 SOLR-12429 test upconfig fails with symlink # in 1209 ms ok 123 downconfig # in 1199 ms ok 124 bin/solr zk cp gets 'solrhome' from '--solr-home' command line option # in 1433 ms ok 125 env var ZK_HOST is honored # in 3199 ms ok 126 Cleanup # in 1896 ms > Task :solr:packaging:integrationTests FAILED FAILURE: Build failed with an exception. * Where: Build file '/home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build.gradle' line: 339 * What went wrong: Execution failed for task ':solr:packaging:integrationTests'. > Process 'command > '/home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/.gradle/node/node_modules/bats/bin/bats'' > finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.10/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 29m 42s 128 actionable tasks: 128 executed Publishing Build Scan to Develocity... https://develocity.apache.org/s/qaxoiy3j4yspq Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure Archiving artifacts Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
