Build: https://ci-builds.apache.org/job/Solr/job/Solr-TestIntegration-10.x/247/
No tests ran. Build Log: [...truncated 347 lines...] # ERROR: KeeperErrorCode = NoNode for /security.json # -- # # Last output: # WARN - 2026-06-28 13:24:53.710; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-06-28 13:24:53.714; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-06-28 13:24:54.205; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-06-28 13:24:54.206; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # # ERROR: KeeperErrorCode = NoNode for /security.json not ok 9 create, config, api, and delete with basic auth # in 1448 ms # (from function `setup' in test file test/test_basic_auth.bats, line 24) # `solr start -Dsolr.packages.enabled=true' failed # Starting Solr # # Port 46267 is already being used by another process (pid: 2712210) # Please choose a different port using the -p option. # # Please find the SOLR_HOME snapshot for failed test #1 at: /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/failure-snapshots/9-1 # Last output: # WARN - 2026-06-28 13:24:55.515; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-06-28 13:24:55.519; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes ok 10 post, postlogs and export with basic auth # in 19521 ms ok 11 package with basic auth # in 13212 ms ok 12 admin UI static content is excepted from basic auth # in 11529 ms ok 13 nothing # in 11 ms ok 14 server does not compress response without Accept-Encoding header # in 168 ms ok 15 server compresses response when Accept-Encoding: gzip is requested # in 100 ms ok 16 compressed response can be decompressed and parsed # in 86 ms ok 17 setting property # in 13516 ms ok 18 short form of setting property # in 6994 ms ok 19 connecting to solr via various connection types # in 11756 ms ok 20 create for non cloud mode # in 8602 ms ok 21 create for cloud mode # in 10674 ms ok 22 multiple connection options are prevented # in 964 ms ok 23 create collection # in 8990 ms ok 24 create collection using solrUrl # in 5654 ms ok 25 create collection using legacy solrUrl # in 5611 ms ok 26 create collection using Zookeeper # in 5875 ms ok 27 reject d option with invalid config dir # in 2895 ms ok 28 accept d option with builtin config # in 5619 ms ok 29 accept d option with explicit path to config # in 5550 ms ok 30 accept n option as config name # in 5577 ms ok 31 allow config reuse when n option specifies same config # in 9770 ms ok 32 create multisharded collections when s provided # in 5747 ms ok 33 create replicated collections when rf provided # in 6522 ms ok 34 can delete collections # in 12124 ms ok 35 can delete collections with solr-url # in 8993 ms ok 36 can delete collections with solr-connection # in 8597 ms ok 37 collection delete also deletes zk config # in 7981 ms ok 38 deletes accompanying zk config with nondefault name # in 8006 ms ok 39 delete-config option can opt to leave config in zk # in 7679 ms ok 40 start -e cloud works with --jvm-opts # in 23296 ms ok 41 start -e cloud works with --no-prompt # in 44383 ms ok 42 Check export command # in 20641 ms ok 43 export fails on non cloud mode # in 9981 ms Waiting for Tika Server to be ready on port 46272 WARNING: Tika Server did not become ready in time; Tika-dependent tests will be bypassed. WARNING: Docker not available; bypassing test. ok 44 using curl to extract a single pdf file # in 16776 ms WARNING: Docker not available; bypassing test. ok 45 using the bin/solr post tool to extract content from pdf # in 16639 ms WARNING: Docker not available; bypassing test. ok 46 using the bin/solr post tool to crawl web site # in 16682 ms Stopping Tika Server container ok 47 healthcheck on cloud solr # in 11076 ms ok 48 healthcheck on remote cloud solr # in 11115 ms ok 49 healthcheck errors on standalone solr # in 12452 ms ok 50 solr help flag prints help # in 829 ms ok 51 solr with no flags prints help # in 819 ms ok 52 start help flag prints help # in 167 ms ok 53 start h flag prints help # in 163 ms ok 54 stop help flag prints help # in 158 ms ok 55 restart help flag prints help # in 161 ms ok 56 status help flag prints help # in 878 ms ok 57 healthcheck help flag prints help # in 829 ms ok 58 create help flag prints help # in 827 ms ok 59 delete help flag prints help # in 871 ms ok 60 zk help flag prints help # in 852 ms ok 61 auth help flag prints help # in 832 ms ok 62 assert help flag prints help # in 836 ms ok 63 post help flag prints help # in 834 ms ok 64 SQL Module # in 17449 ms ok 65 icu collation in analysis-extras module # in 13779 ms ok 66 Check lifecycle of sentiment classification # in 24529 ms ok 67 lifecycle of package # in 9160 ms ok 68 deploying and undeploying a collection level package # in 14443 ms ok 69 deploying and undeploying a cluster level package # skip For developing package infra; requires a connection to github ok 70 Affinity placement plugin using sysprop # in 17266 ms ok 71 Random placement plugin using ENV # in 17247 ms ok 72 Check help command # in 2676 ms ok 73 basic post with a type specified # in 6013 ms ok 74 basic post with collection instead of url parameter # in 4496 ms ok 75 basic post with solr-url and collection # in 4409 ms ok 76 basic post with -s (solr-connection short form) and collection # in 4330 ms ok 77 basic post WITHOUT a type specified # in 13048 ms ok 78 crawling a directory as a dry-run # in 853 ms ok 79 crawling a directory # in 4827 ms ok 80 skipcommit and optimize and delete # in 4214 ms ok 81 args mode # in 7612 ms ok 82 stdin mode # in 3711 ms ok 83 verbose echo the Solr response # in 4256 ms ok 84 post solr log into solr via cli # in 10745 ms # Test failed - capturing Docker diagnostics # === docker ps (summary) === NAMES STATUS IMAGE PORTS solr-node3 Up 10 seconds apache/solr-nightly:9.10.0-SNAPSHOT-slim 8983/tcp solr-node2 Up 10 seconds apache/solr-nightly:9.10.0-SNAPSHOT-slim 8983/tcp solr-node1 Up 15 seconds apache/solr-nightly:9.10.0-SNAPSHOT-slim 8983/tcp # === Docker logs for solr-node1 === 2026-06-28T13:36:07.539438184Z *** [WARN] *** Your open file limit is currently 1024. 2026-06-28T13:36:07.539478755Z It should be set to 65000 to avoid operational disruption. 2026-06-28T13:36:07.539481917Z If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh 2026-06-28T13:36:07.539781475Z Solr will start in SolrCloud mode by default in version 10, and you will no longer need to pass in -c or --cloud flag. 2026-06-28T13:36:07.539792845Z 2026-06-28T13:36:07.551073984Z Java 17 detected. Enabled workaround for SOLR-16463 2026-06-28T13:36:07.559888889Z [0.002s][warning][pagesize] UseLargePages disabled, no large pages configured and available on the system. 2026-06-28T13:36:07.605340559Z CompileCommand: exclude com/github/benmanes/caffeine/cache/BoundedLocalCache.put bool exclude = true 2026-06-28T13:36:07.639510463Z WARNING: A command line option has enabled the Security Manager 2026-06-28T13:36:07.639540653Z WARNING: The Security Manager is deprecated and will be removed in a future release 2026-06-28T13:36:08.904684420Z 2026-06-28 13:36:08.901 INFO (main) [c: s: r: x: t:] o.e.j.s.Server jetty-10.0.26; built: 2025-08-14T15:56:56.454Z; git: 65a55c55a68c56d5f2e8232164439bd6e76e53d1; jvm 17.0.16+8 2026-06-28T13:36:09.194715929Z 2026-06-28 13:36:09.194 WARN (main) [c: s: r: x: t:] o.e.j.u.DeprecationWarning Using @Deprecated Class org.eclipse.jetty.servlet.listener.ELContextCleaner 2026-06-28T13:36:09.221361743Z 2026-06-28 13:36:09.220 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2026-06-28T13:36:09.229580238Z 2026-06-28 13:36:09.228 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.10.0-SNAPSHOT 1edeb3ac6a97186b4ae7de511196a1769de7960e [snapshot build, details omitted] 2026-06-28T13:36:09.229784382Z 2026-06-28 13:36:09.228 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port 8983 2026-06-28T13:36:09.230030325Z 2026-06-28 13:36:09.228 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /opt/solr-9.10.0-SNAPSHOT-slim 2026-06-28T13:36:09.230237650Z 2026-06-28 13:36:09.228 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2026-06-28T13:36:09.228914300Z 2026-06-28T13:36:09.232757949Z 2026-06-28 13:36:09.232 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr started with "-XX:+CrashOnOutOfMemoryError" that will crash on any OutOfMemoryError exception. The cause of the OOME will be logged in the crash file at the following path: /var/solr/logs/jvm_crash_1.log 2026-06-28T13:36:09.255915768Z 2026-06-28 13:36:09.255 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /var/solr/data (source: system property: solr.solr.home) 2026-06-28T13:36:09.270574147Z 2026-06-28 13:36:09.269 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig solr.xml not found in SOLR_HOME, using built-in default 2026-06-28T13:36:09.270596286Z 2026-06-28 13:36:09.269 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/solr.xml 2026-06-28T13:36:09.308430012Z 2026-06-28 13:36:09.307 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrResourceLoader Added 1 libs to classloader, from paths: [/opt/solr-9.10.0-SNAPSHOT-slim/lib] 2026-06-28T13:36:10.084324211Z 2026-06-28 13:36:10.083 INFO (main) [c: s: r: x: t:] o.a.s.u.t.SimplePropagator Always-on trace id generation enabled. 2026-06-28T13:36:10.344278280Z 2026-06-28 13:36:10.343 WARN (main) [c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Jetty request logging enabled. Will retain logs for last 3 days. See chapter "Configuring Logging" in reference guide for how to configure. 2026-06-28T13:36:10.350028653Z 2026-06-28 13:36:10.349 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrZkServer Zookeeper configuration not found in /var/solr/data, using built-in default 2026-06-28T13:36:10.350192270Z 2026-06-28 13:36:10.349 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrZkServerProps Reading configuration from: /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/zoo.cfg 2026-06-28T13:36:10.353034217Z 2026-06-28 13:36:10.352 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrZkServer STARTING EMBEDDED ENSEMBLE ZOOKEEPER SERVER at port 9983, listening on host 0.0.0.0 2026-06-28T13:36:10.353056998Z 2026-06-28 13:36:10.352 WARN (main) [c: s: r: x: t:] o.a.s.c.SolrZkServer Embedded Zookeeper is not recommended in production environments. See Reference Guide for details. 2026-06-28T13:36:10.390732252Z 2026-06-28 13:36:10.390 WARN (embeddedZkServer) [c: s: r: x: t:] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0. 2026-06-28T13:36:10.859940802Z 2026-06-28 13:36:10.858 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=172.18.0.2:9983 2026-06-28T13:36:10.874824248Z 2026-06-28 13:36:10.874 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-06-28T13:36:10.925971862Z 2026-06-28 13:36:10.925 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2026-06-28T13:36:11.020984500Z 2026-06-28 13:36:11.019 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-06-28T13:36:11.021246302Z 2026-06-28 13:36:11.019 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-06-28T13:36:11.176089981Z 2026-06-28 13:36:11.175 WARN (main) [c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2026-06-28T13:36:11.206686098Z 2026-06-28 13:36:11.206 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-06-28T13:36:11.223157566Z 2026-06-28 13:36:11.222 INFO (main) [c: s: r: x: t:] o.a.s.c.OverseerElectionContext I am going to be the leader solr-node1:8983_solr 2026-06-28T13:36:11.230273536Z 2026-06-28 13:36:11.229 INFO (main) [c: s: r: x: t:] o.a.s.c.Overseer Overseer (id=72200816973905920-solr-node1:8983_solr-n_0000000000) starting 2026-06-28T13:36:11.308505164Z 2026-06-28 13:36:11.307 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper: /live_nodes/solr-node1:8983_solr 2026-06-28T13:36:11.309469463Z 2026-06-28 13:36:11.309 INFO (OverseerStateUpdate-72200816973905920-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.Overseer Starting to work on the main queue : solr-node1:8983_solr 2026-06-28T13:36:11.321450110Z 2026-06-28 13:36:11.320 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2026-06-28T13:36:11.370159651Z 2026-06-28 13:36:11.369 WARN (main) [c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2026-06-28T13:36:11.827056014Z 2026-06-28 13:36:11.826 INFO (main) [c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /var/solr/data 2026-06-28T13:36:12.013541339Z 2026-06-28 13:36:12.013 WARN (main) [c: s: r: x: t:] o.g.j.m.i.MessagingBinders A class jakarta.activation.DataSource for a default provider MessageBodyWriter<jakarta.activation.DataSource> was not found. The provider is not available. 2026-06-28T13:36:12.295731583Z 2026-06-28 13:36:12.295 INFO (main) [c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-06-28T13:36:12.435948701Z 2026-06-28 13:36:12.435 INFO (main) [c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@71f67a79{solr-jetty-context.xml,/solr,file:///opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp/,AVAILABLE}{/opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp} 2026-06-28T13:36:12.441957700Z 2026-06-28 13:36:12.441 INFO (main) [c: s: r: x: t:] o.e.j.s.RequestLogWriter Opened /var/solr/logs/2026_06_28.request.log 2026-06-28T13:36:12.446443937Z 2026-06-28 13:36:12.445 INFO (main) [c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@61884cb1{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8983} 2026-06-28T13:36:12.487366548Z 2026-06-28 13:36:12.486 INFO (main) [c: s: r: x: t:] o.e.j.s.Server Started Server@350ec41e{STARTING}[10.0.26,sto=0] @4927ms 2026-06-28T13:36:12.669777164Z 2026-06-28 13:36:12.669 INFO (qtp985324122-27-solr-node1-1) [c: s: r: x: t:solr-node1-1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=51 2026-06-28T13:36:12.732821299Z 2026-06-28 13:36:12.732 INFO (qtp985324122-96-solr-node1-2) [c: s: r: x: t:solr-node1-2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=16 2026-06-28T13:36:16.124848460Z 2026-06-28 13:36:16.124 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) 2026-06-28T13:36:16.440961283Z 2026-06-28 13:36:16.440 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2026-06-28T13:36:20.438515384Z 2026-06-28 13:36:20.438 INFO (qtp985324122-99-solr-node1-3) [c: s: r: x: t:solr-node1-3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=9 2026-06-28T13:36:20.466363717Z 2026-06-28 13:36:20.465 INFO (qtp985324122-99-solr-node1-4) [c: s: r: x: t:solr-node1-4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=9 2026-06-28T13:36:20.495054995Z 2026-06-28 13:36:20.494 INFO (qtp985324122-27-solr-node1-5) [c: s: r: x: t:solr-node1-5] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=2 2026-06-28T13:36:20.736817691Z 2026-06-28 13:36:20.735 INFO (qtp985324122-99-solr-node1-6) [c: s: r: x: t:solr-node1-6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=6 2026-06-28T13:36:20.765417908Z 2026-06-28 13:36:20.765 INFO (OverseerThreadFactory-17-thread-1) [c:test-collection s: r: x: t:] o.a.s.c.a.c.CreateCollectionCmd Create collection test-collection 2026-06-28T13:36:20.784593977Z 2026-06-28 13:36:20.784 INFO (OverseerThreadFactory-17-thread-1) [c:test-collection s: r: x: t:] o.a.s.c.c.ZkStateReader /collections/test-collection/state.json is deleted, stop watching children 2026-06-28T13:36:20.790491099Z 2026-06-28 13:36:20.790 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/test-collection/state.json zxid: 174] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-28T13:36:20.839319425Z 2026-06-28 13:36:20.838 INFO (OverseerStateUpdate-72200816973905920-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2026-06-28T13:36:20.839339994Z "core":"test-collection_shard3_replica_n1", 2026-06-28T13:36:20.839343213Z "node_name":"solr-node1:8983_solr", 2026-06-28T13:36:20.839345381Z "base_url":"http://solr-node1:8983/solr";, 2026-06-28T13:36:20.839347495Z "collection":"test-collection", 2026-06-28T13:36:20.839349641Z "shard":"shard3", 2026-06-28T13:36:20.839351730Z "state":"down", 2026-06-28T13:36:20.839353747Z "type":"NRT", 2026-06-28T13:36:20.839355830Z "operation":"ADDREPLICA", 2026-06-28T13:36:20.839357789Z "waitForFinalState":"false"} 2026-06-28T13:36:20.847394919Z 2026-06-28 13:36:20.846 INFO (OverseerStateUpdate-72200816973905920-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2026-06-28T13:36:20.847420288Z "core":"test-collection_shard2_replica_n2", 2026-06-28T13:36:20.847423202Z "node_name":"solr-node3:8985_solr", 2026-06-28T13:36:20.847425414Z "base_url":"http://solr-node3:8985/solr";, 2026-06-28T13:36:20.847427674Z "collection":"test-collection", 2026-06-28T13:36:20.847429731Z "shard":"shard2", 2026-06-28T13:36:20.847431841Z "state":"down", 2026-06-28T13:36:20.847433834Z "type":"NRT", 2026-06-28T13:36:20.847435811Z "operation":"ADDREPLICA", 2026-06-28T13:36:20.847437883Z "waitForFinalState":"false"} 2026-06-28T13:36:20.858456720Z 2026-06-28 13:36:20.857 INFO (OverseerStateUpdate-72200816973905920-solr-node1:8983_solr-n_0000000000) [c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2026-06-28T13:36:20.858489456Z "core":"test-collection_shard1_replica_n4", 2026-06-28T13:36:20.858492412Z "node_name":"solr-node2:8984_solr", 2026-06-28T13:36:20.858494544Z "base_url":"http://solr-node2:8984/solr";, 2026-06-28T13:36:20.858496525Z "collection":"test-collection", 2026-06-28T13:36:20.858498481Z "shard":"shard1", 2026-06-28T13:36:20.858500393Z "state":"down", 2026-06-28T13:36:20.858502278Z "type":"NRT", 2026-06-28T13:36:20.858504324Z "operation":"ADDREPLICA", 2026-06-28T13:36:20.858506292Z "waitForFinalState":"false"} 2026-06-28T13:36:20.972694362Z 2026-06-28 13:36:20.972 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 186] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-28T13:36:21.062312630Z 2026-06-28 13:36:21.061 INFO (qtp985324122-29-solr-node1-8) [c: s: r: x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=techproducts&newCollection=true&collection=test-collection&version=2&replicaType=NRT&coreNodeName=core_node3&name=test-collection_shard3_replica_n1&action=CREATE&numShards=3&shard=shard3&wt=javabin 2026-06-28T13:36:21.165112712Z 2026-06-28 13:36:21.164 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.12.0 2026-06-28T13:36:21.213747945Z 2026-06-28 13:36:21.213 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.s.IndexSchema Schema name=default-config 2026-06-28T13:36:21.544680830Z 2026-06-28 13:36:21.544 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.s.IndexSchema Loaded schema default-config/1.7 with uniqueid field id 2026-06-28T13:36:21.544703728Z 2026-06-28 13:36:21.544 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.CoreContainer Creating SolrCore 'test-collection_shard3_replica_n1' using configuration from configset techproducts, trusted=true 2026-06-28T13:36:21.579726809Z 2026-06-28 13:36:21.579 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.SolrCore Opening new SolrCore at [/var/solr/data/test-collection_shard3_replica_n1], dataDir=[/var/solr/data/test-collection_shard3_replica_n1/data/] 2026-06-28T13:36:22.369822464Z 2026-06-28 13:36:22.368 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-06-28T13:36:22.407898332Z 2026-06-28 13:36:22.406 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2026-06-28T13:36:22.415950172Z 2026-06-28 13:36:22.415 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2026-06-28T13:36:22.417363755Z 2026-06-28 13:36:22.416 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 2026-06-28T13:36:22.417461812Z 2026-06-28 13:36:22.416 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.u.CommitTracker Soft AutoCommit: if uncommitted for 3000ms; 2026-06-28T13:36:22.491952769Z 2026-06-28 13:36:22.491 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/techproducts 2026-06-28T13:36:22.496737667Z 2026-06-28 13:36:22.496 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/techproducts 2026-06-28T13:36:22.503251987Z 2026-06-28 13:36:22.502 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/techproducts/managed-schema.xml 2026-06-28T13:36:22.505995348Z 2026-06-28 13:36:22.504 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest 2026-06-28T13:36:22.526179802Z 2026-06-28 13:36:22.525 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.s.DirectSolrSpellChecker init: {accuracy=0.5, maxQueryFrequency=0.01, name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal, maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4} 2026-06-28T13:36:22.535416601Z 2026-06-28 13:36:22.535 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2026-06-28T13:36:22.544875166Z 2026-06-28 13:36:22.544 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard3_replica_n1 solr-node1-8 core_node3 solr-node1:8983_solr test-collection shard3) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.QuerySenderListener QuerySenderListener done. 2026-06-28T13:36:22.545016524Z 2026-06-28 13:36:22.544 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard3_replica_n1 solr-node1-8 core_node3 solr-node1:8983_solr test-collection shard3) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default 2026-06-28T13:36:22.554905614Z 2026-06-28 13:36:22.554 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard3_replica_n1 solr-node1-8 core_node3 solr-node1:8983_solr test-collection shard3) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2026-06-28T13:36:22.575857237Z 2026-06-28 13:36:22.575 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test-collection/terms/shard3 to Terms{values={core_node3=0}, version=0} for registerTerm 2026-06-28T13:36:22.577704034Z 2026-06-28 13:36:22.577 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test-collection/leaders/shard3 2026-06-28T13:36:22.604258309Z 2026-06-28 13:36:22.603 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2026-06-28T13:36:22.604419987Z 2026-06-28 13:36:22.603 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2026-06-28T13:36:22.604433060Z 2026-06-28 13:36:22.604 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.SyncStrategy Sync replicas to http://solr-node1:8983/solr/test-collection_shard3_replica_n1/ 2026-06-28T13:36:22.605968736Z 2026-06-28 13:36:22.605 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2026-06-28T13:36:22.606737753Z 2026-06-28 13:36:22.606 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.SyncStrategy http://solr-node1:8983/solr/test-collection_shard3_replica_n1/ has no replicas 2026-06-28T13:36:22.608096595Z 2026-06-28 13:36:22.607 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test-collection/leaders/shard3/leader after winning as /collections/test-collection/leader_elect/shard3/election/72200816973905920-core_node3-n_0000000000 2026-06-28T13:36:22.614889002Z 2026-06-28 13:36:22.614 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://solr-node1:8983/solr/test-collection_shard3_replica_n1/ shard3 2026-06-28T13:36:22.719895730Z 2026-06-28 13:36:22.719 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 237] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-28T13:36:22.726757929Z 2026-06-28 13:36:22.726 INFO (qtp985324122-29-solr-node1-8) [c:test-collection s:shard3 r:core_node3 x:test-collection_shard3_replica_n1 t:solr-node1-8] o.a.s.c.ZkController I am the leader, no recovery necessary 2026-06-28T13:36:22.742397679Z 2026-06-28 13:36:22.741 INFO (qtp985324122-29-solr-node1-8) [c: s: r: x: t:solr-node1-8] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=techproducts&newCollection=true&name=test-collection_shard3_replica_n1&action=CREATE&numShards=3&collection=test-collection&shard=shard3&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1682 2026-06-28T13:36:22.753125660Z 2026-06-28 13:36:22.752 INFO (qtp985324122-101-solr-node1-7) [c:test-collection s: r: x: t:solr-node1-7] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas 2026-06-28T13:36:22.842691929Z 2026-06-28 13:36:22.842 INFO (zkCallback-11-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 244] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-28T13:36:22.846769678Z 2026-06-28 13:36:22.846 INFO (qtp985324122-101-solr-node1-7) [c:test-collection s: r: x: t:solr-node1-7] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=techproducts&name=test-collection&nrtReplicas=1&action=CREATE&numShards=3&wt=json&version=2.2} status=0 QTime=2097 # === Docker inspect for solr-node1 === { "Name": "/solr-node1", "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 2746146, "ExitCode": 0, "Error": "", "StartedAt": "2026-06-28T13:36:07.30852805Z", "FinishedAt": "0001-01-01T00:00:00Z" }, "Ports": { "8983/tcp": null } } # === Docker logs for solr-node2 === 2026-06-28T13:36:13.049647037Z *** [WARN] *** Your open file limit is currently 1024. 2026-06-28T13:36:13.049682417Z It should be set to 65000 to avoid operational disruption. 2026-06-28T13:36:13.049685758Z If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh 2026-06-28T13:36:13.050013365Z Solr will start in SolrCloud mode by default in version 10, and you will no longer need to pass in -c or --cloud flag. 2026-06-28T13:36:13.050026301Z 2026-06-28T13:36:13.060746850Z Java 17 detected. Enabled workaround for SOLR-16463 2026-06-28T13:36:13.069336663Z [0.002s][warning][pagesize] UseLargePages disabled, no large pages configured and available on the system. 2026-06-28T13:36:13.113759727Z CompileCommand: exclude com/github/benmanes/caffeine/cache/BoundedLocalCache.put bool exclude = true 2026-06-28T13:36:13.153561217Z WARNING: A command line option has enabled the Security Manager 2026-06-28T13:36:13.153585885Z WARNING: The Security Manager is deprecated and will be removed in a future release 2026-06-28T13:36:14.319307615Z 2026-06-28 13:36:14.315 INFO (main) [c: s: r: x: t:] o.e.j.s.Server jetty-10.0.26; built: 2025-08-14T15:56:56.454Z; git: 65a55c55a68c56d5f2e8232164439bd6e76e53d1; jvm 17.0.16+8 2026-06-28T13:36:14.623581639Z 2026-06-28 13:36:14.622 WARN (main) [c: s: r: x: t:] o.e.j.u.DeprecationWarning Using @Deprecated Class org.eclipse.jetty.servlet.listener.ELContextCleaner 2026-06-28T13:36:14.651783101Z 2026-06-28 13:36:14.650 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2026-06-28T13:36:14.659046834Z 2026-06-28 13:36:14.658 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.10.0-SNAPSHOT 1edeb3ac6a97186b4ae7de511196a1769de7960e [snapshot build, details omitted] 2026-06-28T13:36:14.659956032Z 2026-06-28 13:36:14.658 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port 8984 2026-06-28T13:36:14.659975380Z 2026-06-28 13:36:14.658 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /opt/solr-9.10.0-SNAPSHOT-slim 2026-06-28T13:36:14.659978628Z 2026-06-28 13:36:14.658 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2026-06-28T13:36:14.658616029Z 2026-06-28T13:36:14.662089049Z 2026-06-28 13:36:14.661 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr started with "-XX:+CrashOnOutOfMemoryError" that will crash on any OutOfMemoryError exception. The cause of the OOME will be logged in the crash file at the following path: /var/solr/logs/jvm_crash_1.log 2026-06-28T13:36:14.685760391Z 2026-06-28 13:36:14.685 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /var/solr/data (source: system property: solr.solr.home) 2026-06-28T13:36:14.712061463Z 2026-06-28 13:36:14.711 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-06-28T13:36:14.876684153Z 2026-06-28 13:36:14.876 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2026-06-28T13:36:14.895970270Z 2026-06-28 13:36:14.895 INFO (zkCallback-1-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-06-28T13:36:14.896209175Z 2026-06-28 13:36:14.895 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-06-28T13:36:14.896359566Z 2026-06-28 13:36:14.895 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-06-28T13:36:15.007452635Z 2026-06-28 13:36:15.006 INFO (main) [c: s: r: x: t:] o.a.s.c.NodeConfig Loading solr.xml from SolrHome (not found in ZooKeeper) 2026-06-28T13:36:15.007701414Z 2026-06-28 13:36:15.007 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig solr.xml not found in SOLR_HOME, using built-in default 2026-06-28T13:36:15.007790378Z 2026-06-28 13:36:15.007 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/solr.xml 2026-06-28T13:36:15.045543164Z 2026-06-28 13:36:15.044 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrResourceLoader Added 1 libs to classloader, from paths: [/opt/solr-9.10.0-SNAPSHOT-slim/lib] 2026-06-28T13:36:15.816073900Z 2026-06-28 13:36:15.815 INFO (main) [c: s: r: x: t:] o.a.s.u.t.SimplePropagator Always-on trace id generation enabled. 2026-06-28T13:36:15.995345100Z 2026-06-28 13:36:15.992 WARN (main) [c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Jetty request logging enabled. Will retain logs for last 3 days. See chapter "Configuring Logging" in reference guide for how to configure. 2026-06-28T13:36:15.997548830Z 2026-06-28 13:36:15.993 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=solr-node1:9983 2026-06-28T13:36:16.004613988Z 2026-06-28 13:36:16.004 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-06-28T13:36:16.011567941Z 2026-06-28 13:36:16.010 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2026-06-28T13:36:16.016634524Z 2026-06-28 13:36:16.016 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-06-28T13:36:16.016792065Z 2026-06-28 13:36:16.016 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-06-28T13:36:16.052530109Z 2026-06-28 13:36:16.051 WARN (main) [c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2026-06-28T13:36:16.061997630Z 2026-06-28 13:36:16.061 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2026-06-28T13:36:16.084012619Z 2026-06-28 13:36:16.083 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-06-28T13:36:16.100307838Z 2026-06-28 13:36:16.099 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Publish node=solr-node2:8984_solr as DOWN 2026-06-28T13:36:16.113173602Z 2026-06-28 13:36:16.112 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper: /live_nodes/solr-node2:8984_solr 2026-06-28T13:36:16.126291146Z 2026-06-28 13:36:16.125 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) 2026-06-28T13:36:16.240136669Z 2026-06-28 13:36:16.238 WARN (main) [c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2026-06-28T13:36:16.441670781Z 2026-06-28 13:36:16.440 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2026-06-28T13:36:16.575626680Z 2026-06-28 13:36:16.574 INFO (main) [c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /var/solr/data 2026-06-28T13:36:16.789717228Z 2026-06-28 13:36:16.788 WARN (main) [c: s: r: x: t:] o.g.j.m.i.MessagingBinders A class jakarta.activation.DataSource for a default provider MessageBodyWriter<jakarta.activation.DataSource> was not found. The provider is not available. 2026-06-28T13:36:17.094061285Z 2026-06-28 13:36:17.092 INFO (main) [c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-06-28T13:36:17.245095966Z 2026-06-28 13:36:17.244 INFO (main) [c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@71f67a79{solr-jetty-context.xml,/solr,file:///opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp/,AVAILABLE}{/opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp} 2026-06-28T13:36:17.252371543Z 2026-06-28 13:36:17.251 INFO (main) [c: s: r: x: t:] o.e.j.s.RequestLogWriter Opened /var/solr/logs/2026_06_28.request.log 2026-06-28T13:36:17.258240199Z 2026-06-28 13:36:17.256 INFO (main) [c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@61884cb1{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8984} 2026-06-28T13:36:17.258964150Z 2026-06-28 13:36:17.258 INFO (main) [c: s: r: x: t:] o.e.j.s.Server Started Server@350ec41e{STARTING}[10.0.26,sto=0] @4190ms 2026-06-28T13:36:17.432951807Z 2026-06-28 13:36:17.432 INFO (qtp985324122-27-solr-node2-1) [c: s: r: x: t:solr-node2-1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=49 2026-06-28T13:36:17.488244788Z 2026-06-28 13:36:17.487 INFO (qtp985324122-55-solr-node2-2) [c: s: r: x: t:solr-node2-2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=14 2026-06-28T13:36:21.062496471Z 2026-06-28 13:36:21.061 INFO (qtp985324122-59-solr-node1-8) [c: s: r: x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=techproducts&newCollection=true&collection=test-collection&version=2&replicaType=NRT&coreNodeName=core_node6&name=test-collection_shard1_replica_n4&action=CREATE&numShards=3&shard=shard1&wt=javabin 2026-06-28T13:36:21.122251551Z 2026-06-28 13:36:21.121 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.12.0 2026-06-28T13:36:21.183600427Z 2026-06-28 13:36:21.182 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.s.IndexSchema Schema name=default-config 2026-06-28T13:36:21.515407702Z 2026-06-28 13:36:21.514 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.s.IndexSchema Loaded schema default-config/1.7 with uniqueid field id 2026-06-28T13:36:21.515432195Z 2026-06-28 13:36:21.515 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.CoreContainer Creating SolrCore 'test-collection_shard1_replica_n4' using configuration from configset techproducts, trusted=true 2026-06-28T13:36:21.535942007Z 2026-06-28 13:36:21.535 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.SolrCore Opening new SolrCore at [/var/solr/data/test-collection_shard1_replica_n4], dataDir=[/var/solr/data/test-collection_shard1_replica_n4/data/] 2026-06-28T13:36:22.039933891Z 2026-06-28 13:36:22.039 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-06-28T13:36:22.060443104Z 2026-06-28 13:36:22.059 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2026-06-28T13:36:22.063950078Z 2026-06-28 13:36:22.063 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2026-06-28T13:36:22.065184561Z 2026-06-28 13:36:22.064 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 2026-06-28T13:36:22.065200780Z 2026-06-28 13:36:22.064 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.u.CommitTracker Soft AutoCommit: if uncommitted for 3000ms; 2026-06-28T13:36:22.172578717Z 2026-06-28 13:36:22.172 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/techproducts 2026-06-28T13:36:22.176581683Z 2026-06-28 13:36:22.176 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/techproducts 2026-06-28T13:36:22.180140002Z 2026-06-28 13:36:22.179 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/techproducts/managed-schema.xml 2026-06-28T13:36:22.182398599Z 2026-06-28 13:36:22.182 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest 2026-06-28T13:36:22.195537180Z 2026-06-28 13:36:22.194 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.s.DirectSolrSpellChecker init: {name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal, accuracy=0.5, maxQueryFrequency=0.01, maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4} 2026-06-28T13:36:22.203650720Z 2026-06-28 13:36:22.203 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2026-06-28T13:36:22.210553023Z 2026-06-28 13:36:22.210 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard1_replica_n4 solr-node1-8 core_node6 solr-node2:8984_solr test-collection shard1) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.QuerySenderListener QuerySenderListener done. 2026-06-28T13:36:22.210573893Z 2026-06-28 13:36:22.210 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard1_replica_n4 solr-node1-8 core_node6 solr-node2:8984_solr test-collection shard1) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default 2026-06-28T13:36:22.219492823Z 2026-06-28 13:36:22.218 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard1_replica_n4 solr-node1-8 core_node6 solr-node2:8984_solr test-collection shard1) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2026-06-28T13:36:22.235836129Z 2026-06-28 13:36:22.234 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test-collection/terms/shard1 to Terms{values={core_node6=0}, version=0} for registerTerm 2026-06-28T13:36:22.237539933Z 2026-06-28 13:36:22.237 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test-collection/leaders/shard1 2026-06-28T13:36:22.256758044Z 2026-06-28 13:36:22.256 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2026-06-28T13:36:22.256780546Z 2026-06-28 13:36:22.256 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2026-06-28T13:36:22.256865833Z 2026-06-28 13:36:22.256 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.SyncStrategy Sync replicas to http://solr-node2:8984/solr/test-collection_shard1_replica_n4/ 2026-06-28T13:36:22.258582813Z 2026-06-28 13:36:22.258 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2026-06-28T13:36:22.259588512Z 2026-06-28 13:36:22.259 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.SyncStrategy http://solr-node2:8984/solr/test-collection_shard1_replica_n4/ has no replicas 2026-06-28T13:36:22.260881137Z 2026-06-28 13:36:22.260 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test-collection/leaders/shard1/leader after winning as /collections/test-collection/leader_elect/shard1/election/72200816973905923-core_node6-n_0000000000 2026-06-28T13:36:22.273667169Z 2026-06-28 13:36:22.273 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://solr-node2:8984/solr/test-collection_shard1_replica_n4/ shard1 2026-06-28T13:36:22.383088557Z 2026-06-28 13:36:22.382 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 206] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-28T13:36:22.387394557Z 2026-06-28 13:36:22.386 INFO (qtp985324122-59-solr-node1-8) [c:test-collection s:shard1 r:core_node6 x:test-collection_shard1_replica_n4 t:solr-node1-8] o.a.s.c.ZkController I am the leader, no recovery necessary 2026-06-28T13:36:22.399437428Z 2026-06-28 13:36:22.399 INFO (qtp985324122-59-solr-node1-8) [c: s: r: x: t:solr-node1-8] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=techproducts&newCollection=true&name=test-collection_shard1_replica_n4&action=CREATE&numShards=3&collection=test-collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1338 2026-06-28T13:36:22.501168498Z 2026-06-28 13:36:22.499 INFO (zkCallback-13-thread-2) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 209] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-28T13:36:22.720208791Z 2026-06-28 13:36:22.719 INFO (zkCallback-13-thread-2) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 237] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-28T13:36:22.843276129Z 2026-06-28 13:36:22.842 INFO (zkCallback-13-thread-2) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 244] for collection [test-collection] has occurred - updating... (live nodes size: [3]) # === Docker inspect for solr-node2 === { "Name": "/solr-node2", "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 2746543, "ExitCode": 0, "Error": "", "StartedAt": "2026-06-28T13:36:12.831103404Z", "FinishedAt": "0001-01-01T00:00:00Z" }, "Ports": { "8983/tcp": null } } # === Docker logs for solr-node3 === 2026-06-28T13:36:13.278493121Z *** [WARN] *** Your open file limit is currently 1024. 2026-06-28T13:36:13.278536525Z It should be set to 65000 to avoid operational disruption. 2026-06-28T13:36:13.278541510Z If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh 2026-06-28T13:36:13.278852190Z Solr will start in SolrCloud mode by default in version 10, and you will no longer need to pass in -c or --cloud flag. 2026-06-28T13:36:13.278859308Z 2026-06-28T13:36:13.289146488Z Java 17 detected. Enabled workaround for SOLR-16463 2026-06-28T13:36:13.297896227Z [0.002s][warning][pagesize] UseLargePages disabled, no large pages configured and available on the system. 2026-06-28T13:36:13.344454947Z CompileCommand: exclude com/github/benmanes/caffeine/cache/BoundedLocalCache.put bool exclude = true 2026-06-28T13:36:13.377732640Z WARNING: A command line option has enabled the Security Manager 2026-06-28T13:36:13.377757390Z WARNING: The Security Manager is deprecated and will be removed in a future release 2026-06-28T13:36:14.582170591Z 2026-06-28 13:36:14.577 INFO (main) [c: s: r: x: t:] o.e.j.s.Server jetty-10.0.26; built: 2025-08-14T15:56:56.454Z; git: 65a55c55a68c56d5f2e8232164439bd6e76e53d1; jvm 17.0.16+8 2026-06-28T13:36:14.885658502Z 2026-06-28 13:36:14.884 WARN (main) [c: s: r: x: t:] o.e.j.u.DeprecationWarning Using @Deprecated Class org.eclipse.jetty.servlet.listener.ELContextCleaner 2026-06-28T13:36:14.913490600Z 2026-06-28 13:36:14.912 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2026-06-28T13:36:14.921248552Z 2026-06-28 13:36:14.920 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.10.0-SNAPSHOT 1edeb3ac6a97186b4ae7de511196a1769de7960e [snapshot build, details omitted] 2026-06-28T13:36:14.921361806Z 2026-06-28 13:36:14.920 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port 8985 2026-06-28T13:36:14.921441414Z 2026-06-28 13:36:14.920 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /opt/solr-9.10.0-SNAPSHOT-slim 2026-06-28T13:36:14.921603661Z 2026-06-28 13:36:14.920 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2026-06-28T13:36:14.920851485Z 2026-06-28T13:36:14.924487710Z 2026-06-28 13:36:14.924 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr started with "-XX:+CrashOnOutOfMemoryError" that will crash on any OutOfMemoryError exception. The cause of the OOME will be logged in the crash file at the following path: /var/solr/logs/jvm_crash_1.log 2026-06-28T13:36:14.948021256Z 2026-06-28 13:36:14.947 INFO (main) [c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /var/solr/data (source: system property: solr.solr.home) 2026-06-28T13:36:14.974295493Z 2026-06-28 13:36:14.973 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-06-28T13:36:15.135616144Z 2026-06-28 13:36:15.134 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2026-06-28T13:36:15.154750189Z 2026-06-28 13:36:15.154 INFO (zkCallback-1-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-06-28T13:36:15.154949770Z 2026-06-28 13:36:15.154 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-06-28T13:36:15.155084276Z 2026-06-28 13:36:15.154 WARN (main) [c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2026-06-28T13:36:15.265718384Z 2026-06-28 13:36:15.265 INFO (main) [c: s: r: x: t:] o.a.s.c.NodeConfig Loading solr.xml from SolrHome (not found in ZooKeeper) 2026-06-28T13:36:15.265884701Z 2026-06-28 13:36:15.265 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig solr.xml not found in SOLR_HOME, using built-in default 2026-06-28T13:36:15.266056265Z 2026-06-28 13:36:15.265 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /opt/solr-9.10.0-SNAPSHOT-slim/server/solr/solr.xml 2026-06-28T13:36:15.301455292Z 2026-06-28 13:36:15.300 INFO (main) [c: s: r: x: t:] o.a.s.c.SolrResourceLoader Added 1 libs to classloader, from paths: [/opt/solr-9.10.0-SNAPSHOT-slim/lib] 2026-06-28T13:36:16.155873685Z 2026-06-28 13:36:16.155 INFO (main) [c: s: r: x: t:] o.a.s.u.t.SimplePropagator Always-on trace id generation enabled. 2026-06-28T13:36:16.308108190Z 2026-06-28 13:36:16.307 WARN (main) [c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Jetty request logging enabled. Will retain logs for last 3 days. See chapter "Configuring Logging" in reference guide for how to configure. 2026-06-28T13:36:16.310368337Z 2026-06-28 13:36:16.307 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=solr-node1:9983 2026-06-28T13:36:16.319399323Z 2026-06-28 13:36:16.318 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-06-28T13:36:16.325582295Z 2026-06-28 13:36:16.324 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2026-06-28T13:36:16.330516687Z 2026-06-28 13:36:16.330 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2026-06-28T13:36:16.330624949Z 2026-06-28 13:36:16.330 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2026-06-28T13:36:16.371905515Z 2026-06-28 13:36:16.371 WARN (main) [c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2026-06-28T13:36:16.381400028Z 2026-06-28 13:36:16.380 INFO (main) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) 2026-06-28T13:36:16.406361136Z 2026-06-28 13:36:16.405 INFO (main) [c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2026-06-28T13:36:16.419765851Z 2026-06-28 13:36:16.419 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Publish node=solr-node3:8985_solr as DOWN 2026-06-28T13:36:16.431515535Z 2026-06-28 13:36:16.431 INFO (main) [c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper: /live_nodes/solr-node3:8985_solr 2026-06-28T13:36:16.442230824Z 2026-06-28 13:36:16.441 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2026-06-28T13:36:16.487793712Z 2026-06-28 13:36:16.487 WARN (main) [c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2026-06-28T13:36:16.785274279Z 2026-06-28 13:36:16.784 INFO (main) [c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /var/solr/data 2026-06-28T13:36:16.970625708Z 2026-06-28 13:36:16.970 WARN (main) [c: s: r: x: t:] o.g.j.m.i.MessagingBinders A class jakarta.activation.DataSource for a default provider MessageBodyWriter<jakarta.activation.DataSource> was not found. The provider is not available. 2026-06-28T13:36:17.267510993Z 2026-06-28 13:36:17.266 INFO (main) [c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-06-28T13:36:17.402637813Z 2026-06-28 13:36:17.401 INFO (main) [c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@71f67a79{solr-jetty-context.xml,/solr,file:///opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp/,AVAILABLE}{/opt/solr-9.10.0-SNAPSHOT-slim/server/solr-webapp/webapp} 2026-06-28T13:36:17.408544174Z 2026-06-28 13:36:17.408 INFO (main) [c: s: r: x: t:] o.e.j.s.RequestLogWriter Opened /var/solr/logs/2026_06_28.request.log 2026-06-28T13:36:17.412405376Z 2026-06-28 13:36:17.411 INFO (main) [c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@61884cb1{HTTP/1.1, (http/1.1, h2c)}{0.0.0.0:8985} 2026-06-28T13:36:17.413312566Z 2026-06-28 13:36:17.412 INFO (main) [c: s: r: x: t:] o.e.j.s.Server Started Server@350ec41e{STARTING}[10.0.26,sto=0] @4116ms 2026-06-28T13:36:19.180159214Z 2026-06-28 13:36:19.173 INFO (qtp985324122-27-solr-node3-1) [c: s: r: x: t:solr-node3-1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=javabin&version=2} status=0 QTime=139 2026-06-28T13:36:19.270031145Z 2026-06-28 13:36:19.269 INFO (qtp985324122-56-solr-node3-2) [c: s: r: x: t:solr-node3-2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=27 2026-06-28T13:36:21.066457837Z 2026-06-28 13:36:21.065 INFO (qtp985324122-58-solr-node1-8) [c: s: r: x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=techproducts&newCollection=true&collection=test-collection&version=2&replicaType=NRT&coreNodeName=core_node5&name=test-collection_shard2_replica_n2&action=CREATE&numShards=3&shard=shard2&wt=javabin 2026-06-28T13:36:21.159950322Z 2026-06-28 13:36:21.159 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.12.0 2026-06-28T13:36:21.272048024Z 2026-06-28 13:36:21.271 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.s.IndexSchema Schema name=default-config 2026-06-28T13:36:21.693741037Z 2026-06-28 13:36:21.693 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.s.IndexSchema Loaded schema default-config/1.7 with uniqueid field id 2026-06-28T13:36:21.693765997Z 2026-06-28 13:36:21.693 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.CoreContainer Creating SolrCore 'test-collection_shard2_replica_n2' using configuration from configset techproducts, trusted=true 2026-06-28T13:36:21.717317421Z 2026-06-28 13:36:21.716 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.SolrCore Opening new SolrCore at [/var/solr/data/test-collection_shard2_replica_n2], dataDir=[/var/solr/data/test-collection_shard2_replica_n2/data/] 2026-06-28T13:36:22.361817214Z 2026-06-28 13:36:22.361 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2026-06-28T13:36:22.386366859Z 2026-06-28 13:36:22.385 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2026-06-28T13:36:22.394204747Z 2026-06-28 13:36:22.393 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2026-06-28T13:36:22.398251116Z 2026-06-28 13:36:22.394 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 2026-06-28T13:36:22.398270042Z 2026-06-28 13:36:22.397 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.u.CommitTracker Soft AutoCommit: if uncommitted for 3000ms; 2026-06-28T13:36:22.458654858Z 2026-06-28 13:36:22.458 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/techproducts 2026-06-28T13:36:22.463082169Z 2026-06-28 13:36:22.462 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/techproducts 2026-06-28T13:36:22.465735560Z 2026-06-28 13:36:22.465 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/techproducts/managed-schema.xml 2026-06-28T13:36:22.468891962Z 2026-06-28 13:36:22.468 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest 2026-06-28T13:36:22.482661797Z 2026-06-28 13:36:22.482 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.s.DirectSolrSpellChecker init: {name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal, maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4, accuracy=0.5, maxQueryFrequency=0.01} 2026-06-28T13:36:22.491026568Z 2026-06-28 13:36:22.490 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2026-06-28T13:36:22.498112621Z 2026-06-28 13:36:22.497 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard2_replica_n2 solr-node1-8 core_node5 solr-node3:8985_solr test-collection shard2) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.QuerySenderListener QuerySenderListener done. 2026-06-28T13:36:22.498520008Z 2026-06-28 13:36:22.497 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard2_replica_n2 solr-node1-8 core_node5 solr-node3:8985_solr test-collection shard2) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default 2026-06-28T13:36:22.508710382Z 2026-06-28 13:36:22.508 INFO (searcherExecutor-22-thread-1-processing-test-collection_shard2_replica_n2 solr-node1-8 core_node5 solr-node3:8985_solr test-collection shard2) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2026-06-28T13:36:22.523020933Z 2026-06-28 13:36:22.522 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test-collection/terms/shard2 to Terms{values={core_node5=0}, version=0} for registerTerm 2026-06-28T13:36:22.525546906Z 2026-06-28 13:36:22.525 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test-collection/leaders/shard2 2026-06-28T13:36:22.543050830Z 2026-06-28 13:36:22.542 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2026-06-28T13:36:22.543302330Z 2026-06-28 13:36:22.542 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2026-06-28T13:36:22.543320478Z 2026-06-28 13:36:22.542 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.SyncStrategy Sync replicas to http://solr-node3:8985/solr/test-collection_shard2_replica_n2/ 2026-06-28T13:36:22.544642679Z 2026-06-28 13:36:22.544 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2026-06-28T13:36:22.545644030Z 2026-06-28 13:36:22.545 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.SyncStrategy http://solr-node3:8985/solr/test-collection_shard2_replica_n2/ has no replicas 2026-06-28T13:36:22.546983199Z 2026-06-28 13:36:22.546 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test-collection/leaders/shard2/leader after winning as /collections/test-collection/leader_elect/shard2/election/72200816973905924-core_node5-n_0000000000 2026-06-28T13:36:22.569596301Z 2026-06-28 13:36:22.569 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://solr-node3:8985/solr/test-collection_shard2_replica_n2/ shard2 2026-06-28T13:36:22.720547891Z 2026-06-28 13:36:22.720 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 237] for collection [test-collection] has occurred - updating... (live nodes size: [3]) 2026-06-28T13:36:22.725691509Z 2026-06-28 13:36:22.725 INFO (qtp985324122-58-solr-node1-8) [c:test-collection s:shard2 r:core_node5 x:test-collection_shard2_replica_n2 t:solr-node1-8] o.a.s.c.ZkController I am the leader, no recovery necessary 2026-06-28T13:36:22.741816093Z 2026-06-28 13:36:22.741 INFO (qtp985324122-58-solr-node1-8) [c: s: r: x: t:solr-node1-8] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=techproducts&newCollection=true&name=test-collection_shard2_replica_n2&action=CREATE&numShards=3&collection=test-collection&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1678 2026-06-28T13:36:22.843282907Z 2026-06-28 13:36:22.842 INFO (zkCallback-13-thread-1) [c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test-collection/state.json zxid: 244] for collection [test-collection] has occurred - updating... (live nodes size: [3]) # === Docker inspect for solr-node3 === { "Name": "/solr-node3", "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 2746729, "ExitCode": 0, "Error": "", "StartedAt": "2026-06-28T13:36:13.040668007Z", "FinishedAt": "0001-01-01T00:00:00Z" }, "Ports": { "8983/tcp": null } } # Docker artifacts saved to: /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/docker not ok 85 Docker SolrCloud rolling upgrade # in 30277 ms # (in test file test/test_rolling_upgrade.bats, line 118) # `wait_for 30 1 docker exec solr-node1 solr healthcheck -c test-collection' failed with status 127 # 9.10.0-SNAPSHOT-slim: Pulling from apache/solr-nightly # af6eca94c810: Pulling fs layer # cb0efb96dabd: Pulling fs layer # 3e9d91201f40: Pulling fs layer # 66b76b382631: Pulling fs layer # 601f2c23751f: Pulling fs layer # 0ed719aef393: Pulling fs layer # 69a09c96e8bf: Pulling fs layer # c937aee9a870: Pulling fs layer # 9cdfe5320de8: Pulling fs layer # 3aa9120e46f5: Pulling fs layer # 4f4fb700ef54: Pulling fs layer # 69a09c96e8bf: Waiting # 3aa9120e46f5: Waiting # c937aee9a870: Waiting # 9cdfe5320de8: Waiting # 66b76b382631: Waiting # 4f4fb700ef54: Waiting # 601f2c23751f: Waiting # 0ed719aef393: Waiting # af6eca94c810: Verifying Checksum # af6eca94c810: Download complete # cb0efb96dabd: Verifying Checksum # cb0efb96dabd: Download complete # 66b76b382631: Download complete # 601f2c23751f: Verifying Checksum # 601f2c23751f: Download complete # 69a09c96e8bf: Verifying Checksum # 69a09c96e8bf: Download complete # 3e9d91201f40: Verifying Checksum # 3e9d91201f40: Download complete # c937aee9a870: Verifying Checksum # c937aee9a870: Download complete # 9cdfe5320de8: Download complete # 3aa9120e46f5: Download complete # 4f4fb700ef54: Verifying Checksum # 4f4fb700ef54: Download complete # 0ed719aef393: Verifying Checksum # 0ed719aef393: Download complete # af6eca94c810: Pull complete # cb0efb96dabd: Pull complete # 3e9d91201f40: Pull complete # 66b76b382631: Pull complete # 601f2c23751f: Pull complete # 0ed719aef393: Pull complete # 69a09c96e8bf: Pull complete # c937aee9a870: Pull complete # 9cdfe5320de8: Pull complete # 3aa9120e46f5: Pull complete # 4f4fb700ef54: Pull complete # Digest: sha256:15c8155ceffe1042f37c77bb537aa531804a3510702ff87f2af5fedf523f4203 # Status: Downloaded newer image for apache/solr-nightly:9.10.0-SNAPSHOT-slim # docker.io/apache/solr-nightly:9.10.0-SNAPSHOT-slim # 10.0.0-SNAPSHOT-slim: Pulling from apache/solr-nightly # 40d16f30db40: Pulling fs layer # 9d5a0b6cb36c: Pulling fs layer # 49518c28c0b3: Pulling fs layer # 41162acdcc29: Pulling fs layer # 2ed0fd558ca3: Pulling fs layer # 2488415fda1c: Pulling fs layer # 09511c8fb203: Pulling fs layer # a0c57fb89c4f: Pulling fs layer # d0641dcc41d7: Pulling fs layer # 315722fd9570: Pulling fs layer # 4f4fb700ef54: Pulling fs layer # 41162acdcc29: Waiting # 2ed0fd558ca3: Waiting # 2488415fda1c: Waiting # 09511c8fb203: Waiting # a0c57fb89c4f: Waiting # 315722fd9570: Waiting # 4f4fb700ef54: Waiting # d0641dcc41d7: Waiting # 40d16f30db40: Verifying Checksum # 40d16f30db40: Download complete # 9d5a0b6cb36c: Verifying Checksum # 9d5a0b6cb36c: Download complete # 41162acdcc29: Verifying Checksum # 41162acdcc29: Download complete # 2ed0fd558ca3: Download complete # 09511c8fb203: Verifying Checksum # 09511c8fb203: Download complete # a0c57fb89c4f: Download complete # 49518c28c0b3: Verifying Checksum # 49518c28c0b3: Download complete # d0641dcc41d7: Verifying Checksum # d0641dcc41d7: Download complete # 315722fd9570: Verifying Checksum # 315722fd9570: Download complete # 4f4fb700ef54: Verifying Checksum # 4f4fb700ef54: Download complete # 2488415fda1c: Verifying Checksum # 2488415fda1c: Download complete # 40d16f30db40: Pull complete # 9d5a0b6cb36c: Pull complete # 49518c28c0b3: Pull complete # 41162acdcc29: Pull complete # 2ed0fd558ca3: Pull complete # 2488415fda1c: Pull complete # 09511c8fb203: Pull complete # a0c57fb89c4f: Pull complete # d0641dcc41d7: Pull complete # 315722fd9570: Pull complete # 4f4fb700ef54: Pull complete # Digest: sha256:fb25f7a7190e3027ade20e97708a8665d41ab0e9ea9285fa242b2c83b0e5f43c # Status: Downloaded newer image for apache/solr-nightly:10.0.0-SNAPSHOT-slim # docker.io/apache/solr-nightly:10.0.0-SNAPSHOT-slim # 4d3c843a4df37b20def9b41ba3626be43b69ada825462be05f6bac1c335f8771 # solr-data1 # solr-data2 # solr-data3 # Starting solr-node1 with embedded ZooKeeper # 99c55f7ac6834bff851837fe6f8a80e3bc32986561adcd7bf1cc6f047e8d16df # Starting solr-node2 connected to first node's ZooKeeper # eb8f91e796d14efedcbf4b1489a667a046a5fc810414d5a02eb0bc016f37d3a9 # Started solr-node3 connected to first node's ZooKeeper # 80c1902d7f0892d94773df9cf518f00ba4baf1fccd10881571f7f3da3fd78dc2 # Creating a Collection # Neither --zk-host or --solr-url parameters provided so assuming solr url is http://localhost:8983. # Neither --zk-host or --solr-url parameters provided so assuming solr url is http://localhost:8983. # WARN - 2026-06-28 13:36:20.525; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-06-28 13:36:20.566; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARNING: URLs provided to this tool needn't include Solr's context-root (e.g. "/solr"). Such URLs are deprecated and support for them will be removed in a future release. Correcting from [http://solr-node1:8983/solr] to [http://solr-node1:8983/]. # Created collection 'test-collection' with 3 shard(s), 1 replica(s) with config-set 'techproducts' # Checking collection health # /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/test/test_rolling_upgrade.bats: line 118: wait_for: command not found # solr-node1 # solr-node2 # solr-node3 # solr-node1 # solr-node2 # solr-node3 # solr-data1 # solr-data2 # solr-data3 # solrcloud-test ok 86 allowPaths - backup # in 16748 ms ok 87 snapshot lifecycle # in 5270 ms ok 88 snapshot list # in 3675 ms ok 89 snapshot list via --solr-connection # in 3730 ms ok 90 snapshot describe # in 3705 ms ok 91 snapshot describe via --solr-connection # in 3663 ms ok 92 start solr with ssl # in 17674 ms ok 93 use different hostname when not checking peer-name # in 26935 ms ok 94 start solr with ssl and auth # in 16039 ms ok 95 start solr with client truststore and security manager # in 18137 ms ok 96 start solr with mTLS needed # in 50342 ms ok 97 start solr with mTLS wanted # in 38325 ms ok 98 test keystore reload # in 63134 ms ok 99 SOLR-11740 check 'solr stop' connection # in 16849 ms ok 100 stop command for single port # in 19359 ms ok 101 check stop command doesn't hang # in 244 ms ok 102 SOLR-16976 solr starts with remote JMX enabled # in 8698 ms not ok 103 deprecated system properties converted to modern properties # in 195672 ms # (from function `assert_file_contains' in file .gradle/node/node_modules/bats-file/src/file.bash, line 566, # in test file test/test_start_solr.bats, line 86) # `assert_file_contains "${SOLR_LOGS_DIR}/solr.log" 'You are passing in deprecated system property disable.config.edit and should upgrade to using solr.api.config.edit.enabled instead.'' failed # Waiting up to 180 seconds to see Solr running on port 46267 [|] [/] [-] [\] [|] # Started Solr server on port 46267 (pid=2764542). Happy searching! # # # -- file does not contain regex -- # path : /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/solr-home/logs/solr.log # -- # # Please find the SOLR_HOME snapshot for failed test #5 at: /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/failure-snapshots/103-5 ok 104 start with custom jetty options # in 8896 ms ok 105 -c flag prints no-op warning and still starts in cloud mode # in 10065 ms not ok 106 bootstrapping a configset # in 10075 ms # (from function `config_exists' in file test/bats_helper.bash, line 84, # in test file test/test_start_solr.bats, line 116) # `config_exists "techproducts"' failed # Waiting up to 180 seconds to see Solr running on port 46267 [|] [/] [-] [\] [|] # Started Solr server on port 46267 (pid=2767279). Happy searching! # # WARN - 2026-06-28 13:45:29.289; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # WARN - 2026-06-28 13:45:29.293; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes # Please find the SOLR_HOME snapshot for failed test #8 at: /home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build/test-output/failure-snapshots/106-8 ok 107 status detects locally running solr # in 10357 ms ok 108 status with --solr-url from user # in 8692 ms ok 109 status with --port from user # in 8711 ms ok 110 multiple connection options are prevented # in 1102 ms ok 111 status with invalid --solr-url from user # in 1426 ms ok 112 status with --short format # in 196655 ms ok 113 searching solr via locally executed streaming expression # in 1898 ms ok 114 searching solr via remotely executed streaming expression by solr-url # in 1728 ms ok 115 searching solr via remotely executed streaming expression by solr connection # in 1349 ms ok 116 variable interpolation # in 1865 ms ok 117 searching solr without credentials fails with error # in 1233 ms ok 118 --version returns Solr version # in 821 ms ok 119 version as direct tool call still runs # in 819 ms ok 120 short help # in 918 ms ok 121 short help is inferred # in 867 ms ok 122 long help # in 841 ms ok 123 running subcommands with zk is prevented # in 801 ms ok 124 listing out files # in 2255 ms ok 125 connecting to solr via various solr urls and zk hosts # in 10115 ms ok 126 copying files around # in 11809 ms ok 127 upconfig # in 2757 ms ok 128 SOLR-12429 test upconfig fails with symlink # in 1299 ms ok 129 downconfig # in 1324 ms ok 130 bin/solr zk cp gets 'solrhome' from '--solr-home' command line option # in 1561 ms ok 131 env var ZK_HOST is honored # in 3358 ms ok 132 Cleanup # in 1926 ms > Task :solr:packaging:integrationTests FAILED FAILURE: Build failed with an exception. * Where: Build file '/home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/build.gradle' line: 339 * What went wrong: Execution failed for task ':solr:packaging:integrationTests'. > Process 'command > '/home/jenkins/jenkins-agent/workspace/Solr/Solr-TestIntegration-10.x/solr/packaging/.gradle/node/node_modules/bats/bin/bats'' > finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.10/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 31m 57s 128 actionable tasks: 128 executed Publishing Build Scan to Develocity... https://develocity.apache.org/s/oeqtasufdylmu Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure Archiving artifacts Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
