I am only setting up a MiniSolrCloudCluster with 2 servers like this:
JettyConfig jettyConfig =
JettyConfig.builder().waitForLoadingCoresToFinish(null).setContext("/solr").build();
MiniSolrCloudCluster miniCluster = new MiniSolrCloudCluster(2,
Paths.get(baseDir), jettyConfig);
I can see the "zookeeper", "node1", "ndoe2" folders being created (with
content in them) in my $baseDir. I have not added any data to Solr index yet.
I don't know what "overseer" is and how to check status of it. My only concern
is if things are not cleared in zookeeper. Is there any way to check zookeeper
DB?
As I mentioned before, the cluster works fine when I access it via SolrClient
(solrj). The issue is when making http requests.
Can someone please test making an http request to a MiniSolrCloudCluster
(created outside of Solr) and let me know if it works fine.
The log messages during starting up the mini cloud include the following error
messages:
...
15:34:11,750 INFO ~ Watcher
org.apache.solr.common.cloud.ConnectionManager@6e374fbf
name:ZooKeeperConnection Watcher:127.0.0.1:15570/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
15:34:11,750 INFO ~ Client is connected to ZooKeeper
15:34:11,752 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0006 type:create cxid:0x1 zxid:0x10 txntype:-1
reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
/solr/overseer
15:34:11,774 INFO ~ makePath: /overseer/queue
15:34:11,774 INFO ~ makePath: /overseer/queue
15:34:11,776 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0006 type:create cxid:0x5 zxid:0x12 txntype:-1
reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NodeExists
for /solr/overseer/queue
15:34:11,799 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0006 type:create cxid:0x6 zxid:0x13 txntype:-1
reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
/solr/overseer
15:34:11,799 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0005 type:create cxid:0x7 zxid:0x14 txntype:-1
reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
/solr/overseer
15:34:11,823 INFO ~ makePath: /overseer/collection-queue-work
15:34:11,824 INFO ~ makePath: /overseer/collection-queue-work
15:34:11,825 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0005 type:create cxid:0xb zxid:0x16 txntype:-1
reqpath:n/a Error Path:/solr/overseer/collection-queue-work
Error:KeeperErrorCode = NodeExists for /solr/overseer/collection-queue-work
15:34:11,847 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0005 type:create cxid:0xc zxid:0x17 txntype:-1
reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
/solr/overseer
15:34:11,847 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0006 type:create cxid:0xc zxid:0x18 txntype:-1
reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
/solr/overseer
15:34:11,860 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0005 type:create cxid:0xd zxid:0x19 txntype:-1
reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
/solr/overseer
15:34:11,860 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0006 type:create cxid:0xd zxid:0x1a txntype:-1
reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
/solr/overseer
15:34:11,885 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0005 type:create cxid:0xf zxid:0x1b txntype:-1
reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
/solr/overseer
15:34:11,886 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0006 type:create cxid:0xf zxid:0x1c txntype:-1
reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
/solr/overseer
15:34:11,907 INFO ~ makePath: /overseer/collection-map-running
15:34:11,908 INFO ~ makePath: /overseer/collection-map-running
15:34:11,920 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0006 type:create cxid:0x13 zxid:0x1e txntype:-1
reqpath:n/a Error Path:/solr/overseer/collection-map-running
Error:KeeperErrorCode = NodeExists for /solr/overseer/collection-map-running
15:34:11,921 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0005 type:create cxid:0x15 zxid:0x1f txntype:-1
reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
/solr/overseer
15:34:11,932 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0006 type:create cxid:0x14 zxid:0x20 txntype:-1
reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
/solr/overseer
15:34:11,981 INFO ~ makePath: /overseer/collection-map-completed
15:34:11,981 INFO ~ makePath: /overseer/collection-map-completed
15:34:11,985 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0005 type:create cxid:0x19 zxid:0x22 txntype:-1
reqpath:n/a Error Path:/solr/overseer/collection-map-completed
Error:KeeperErrorCode = NodeExists for /solr/overseer/collection-map-completed
15:34:12,006 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0006 type:create cxid:0x1a zxid:0x23 txntype:-1
reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
/solr/overseer
15:34:12,006 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0005 type:create cxid:0x1a zxid:0x24 txntype:-1
reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
/solr/overseer
15:34:12,017 INFO ~ makePath: /overseer/collection-map-failure
15:34:12,017 INFO ~ makePath: /overseer/collection-map-failure
15:34:12,019 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0005 type:create cxid:0x1e zxid:0x26 txntype:-1
reqpath:n/a Error Path:/solr/overseer/collection-map-failure
Error:KeeperErrorCode = NodeExists for /solr/overseer/collection-map-failure
15:34:12,048 INFO ~ makePath: /live_nodes
15:34:12,048 INFO ~ makePath: /live_nodes
15:34:12,049 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0006 type:create cxid:0x23 zxid:0x28 txntype:-1
reqpath:n/a Error Path:/solr/live_nodes Error:KeeperErrorCode = NodeExists for
/solr/live_nodes
15:34:12,078 INFO ~ makePath: /collections
15:34:12,078 INFO ~ makePath: /collections
15:34:12,079 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0006 type:create cxid:0x26 zxid:0x2a txntype:-1
reqpath:n/a Error Path:/solr/collections Error:KeeperErrorCode = NodeExists for
/solr/collections
15:34:12,104 INFO ~ makePath: /aliases.json
15:34:12,104 INFO ~ makePath: /aliases.json
15:34:12,105 INFO ~ Got user-level KeeperException when processing
sessionid:0x154aa89febb0005 type:create cxid:0x2a zxid:0x2c txntype:-1
reqpath:n/a Error Path:/solr/aliases.json Error:KeeperErrorCode = NodeExists
for /solr/aliases.json
...
-----Original Message-----
From: Shawn Heisey [mailto:apa...@elyograg.org]
Sent: 13 May 2016 13:54
To: solr-user@lucene.apache.org
Subject: Re: http request to MiniSolrCloudCluster
On 5/13/2016 2:26 AM, Rohana Rajapakse wrote:
> Hmmm. I now get the following errors when trying to access my Mini cluster
> over http:
>
> 09:13:19,611 WARN ~ Exception causing close of session 0x0 due to
> java.io.IOException: Len error 1347375956
> 09:13:19,611 INFO ~ Closed socket connection for client
> /127.0.0.1:23244 (no session established for client)
The length that it is complaining about is a very large number -- 1.3 billion.
The error message excludes the detail I would need to learn whether it comes
from Zookeeper or Solr. If it's coming from zookeeper, your zookeeper database
contains a node whose size is over a thousand times larger than what zookeeper
supports by default.
The default maximum for znode size is about one megabyte. If you're running a
recent version of Solr (5.x or later), the most likely culprit for a large
znode is the overseer queue ... but to reach a overseer queue size of 1.3
billion bytes would probably require an extremely large cluster with thousands
of cores, and that cluster would likely be experiencing a lot of stability
issues. This is a situation that even a full Solr install has trouble handling
-- I would never try to do it with a test class like MiniSolrCloudCluster.
I could also be completely wrong, but without detailed logs and more
information on what you're trying to build, it's impossible for me to say.
Thanks,
Shawn
Registered Office: 24 Darklake View, Estover, Plymouth, PL6 7TL.
Company Registration No: 3553908
This email contains proprietary information, some or all of which may be
legally privileged. It is for the intended recipient only. If an addressing or
transmission error has misdirected this email, please notify the author by
replying to this email. If you are not the intended recipient you may not use,
disclose, distribute, copy, print or rely on this email.
Email transmission cannot be guaranteed to be secure or error free, as
information may be intercepted, corrupted, lost, destroyed, arrive late or
incomplete or contain viruses. This email and any files attached to it have
been checked with virus detection software before transmission. You should
nonetheless carry out your own virus check before opening any attachment. GOSS
Interactive Ltd accepts no liability for any loss or damage that may be caused
by software viruses.
