I don't know, but perhaps 8.8.1 checks it more than 8.1? - it's still
worth your dev team reviewing as I suggested as it may be linked to why
the nodes are going down. The error is occurring for a reason.
Charlie
On 07/09/2021 14:30, HariBabu kuruva wrote:
Hi Charlie,
The multiple values error is not occurring only for that field. Its also
occurring for multiple fields and multiple stores(collections).
Ex:
2021-09-07 13:05:53.646 ERROR (qtp1198197478-1200) [c:quoteStore s:shard1
r:core_node8 x:quoteStore_shard1_replica_n7] o.a.s.h.RequestH
andlerBase org.apache.solr.common.SolrException: ERROR:
[doc=1-116339633161] multiple values encountered for non multiValued field
quot
eAgeCompleted: [N, N]
Our Dev Team says that its only after the Solr upgrade from 8.1 to 8.8.1
Also, Solr is going down very frequently (after every one hour) on the
nodes only where a specific store (quotestore) is available. Other nodes
are fine.
For the nodes which are going down, I see OOM error for one node and for
the other node we see zookeeper connection timeout error as below.
--------------------------------
2021-09-07 13:06:13.907 WARN (main-SendThread(
zookeeperhost.corp.equinix.com:2185)) [ ] o.a.z.ClientCnxn Client session
timed out, ha
ve not heard from server in 23226ms for session id 0x40000139b3e00d3
2021-09-07 13:06:13.907 WARN (main-SendThread(
lxeisprdas10.corp.equinix.com:2185)) [ ] o.a.z.ClientCnxn Session
0x40000139b3e00d3 fo
r sever zookeeperhost.corp.equinix.com/10.250.12.54:2185, Closing socket
connection. Attempting reconnect except it is a SessionExpiredE
xception. => org.apache.zookeeper.ClientCnxn$SessionTimeoutException:
Client session timed out, have not heard from server in 23226ms f
or session id 0x40000139b3e00d3
at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1243)
org.apache.zookeeper.ClientCnxn$SessionTimeoutException: Client session
timed out, have not heard from server in 23226ms for session id
0x40000139b3e00d3
at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1243)
~[zookeeper-3.6.2.jar:3.6.2]
2021-09-07 13:06:14.010 WARN (zkConnectionManagerCallback-13-thread-1) [
] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.commo
n.cloud.ConnectionManager@5521aab name: ZooKeeperConnection Watcher:
zk1.corp.equinix.com:2181,zk2.corp.equinix.com:21
82,zk3.corp.equinix.com:2183,zk4.corp.equinix.com:2184,
zk5.corp.equinix.com:2185 got event WatchedEvent stat
e:Disconnected type:None path:null path: null type: None
2021-09-07 13:06:14.010 WARN (zkConnectionManagerCallback-13-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has disconnected
2021-09-07 13:06:39.494 WARN (main-SendThread(
lxeisprdas09.corp.equinix.com:2184)) [ ] o.a.z.ClientCnxn Client session
timed out, ha
ve not heard from server in 23533ms for session id 0x40000139b3e00d3
2021-09-07 13:06:39.494 WARN (main-SendThread(
lxeisprdas09.corp.equinix.com:2184)) [ ] o.a.z.ClientCnxn Session
0x40000139b3e00d3 fo
r sever zk4.corp.equinix.com/10.250.**.**:2184, Closing socket connection.
Attempting reconnect except it is a SessionExpiredE
xception. => org.apache.zookeeper.ClientCnxn$SessionTimeoutException:
Client session timed out, have not heard from server in 23533ms f
or session id 0x40000139b3e00d3
at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1243)
org.apache.zookeeper.ClientCnxn$SessionTimeoutException: Client session
timed out, have not heard from server in 23533ms for session id
0x40000139b3e00d3
-------------------------------------------------------
Could you please suggest.
On Tue, Sep 7, 2021 at 5:49 PM Charlie Hull <[email protected]>
wrote:
Sorry I should have worded that better - I suggest that you review your
schema file and indexing process, so that you can understand why
multiple values are being sent to the field 'quoteSLOCurrentStatus' when
it's probably not defined as multivalued.
C
On 07/09/2021 12:30, HariBabu kuruva wrote:
Thank you Charlie.
Please let me know if anything is required from my end.
Also, we have added below filed as a work around
<enableLazyFieldLoading>false</enableLazyFieldLoading> in solrconfig.xml
On Tue, Sep 7, 2021 at 4:03 PM Charlie Hull <
[email protected]>
wrote:
I doubt these are related, that second error looks like something
triggered by indexing - attempting to add multiple values to a field
that hasn't been defined in the schema as multivalued. I'd review your
indexing process and schema first.
Charlie
On 07/09/2021 11:00, HariBabu kuruva wrote:
Hi All,
We are getting OOM errors in the solr logs for only specific solr
stores.
And in the solr logs we see the below error. Is the OOM error could be
because of the below error.
Also i see below Lazyfield error is spanned across thousands of lines.
Please advise. This is a PROD environment.
---------------------------------
AsyncLogger error handling event seq=163,
value='Logger=org.apache.solr.handler.RequestHandlerBase Level=ERROR
Message=org.apache.solr.
common.SolrException: ERROR: [doc=1-121180294489] multiple values
encountered for non multiValued field quoteSLOCurrentStatus: [org.apa
che.lucene.document.LazyDocument$LazyField@2b119ab6,
org.apache.lucene.document.LazyDocument$LazyField@70dc55ed,
org.apache.lucene.docu
ment.LazyDocument$LazyField@7dba464d,
org.apache.lucene.document.LazyDocument$LazyField@6cfa4d94,
org.apache.lucene.document.LazyDocume
nt$LazyField@4b19be97,
org.apache.lucene.document.LazyDocument$LazyField@5978e924,
org.apache.lucene.document.LazyDocument$LazyField@76
--------------------------
Thanks and Regards,
Hari
Mobile:9790756568
--
Charlie Hull - Managing Consultant at OpenSource Connections Limited
<www.o19s.com>
Founding member of The Search Network <https://thesearchnetwork.com/>
and co-author of Searching the Enterprise
<https://opensourceconnections.com/about-us/books-resources/>
tel/fax: +44 (0)8700 118334
mobile: +44 (0)7767 825828
OpenSource Connections Europe GmbH | Pappelallee 78/79 | 10437 Berlin
Amtsgericht Charlottenburg | HRB 230712 B
Geschäftsführer: John M. Woodell | David E. Pugh
Finanzamt: Berlin Finanzamt für Körperschaften II
--
Charlie Hull - Managing Consultant at OpenSource Connections Limited
<www.o19s.com>
Founding member of The Search Network <https://thesearchnetwork.com/>
and co-author of Searching the Enterprise
<https://opensourceconnections.com/about-us/books-resources/>
tel/fax: +44 (0)8700 118334
mobile: +44 (0)7767 825828
OpenSource Connections Europe GmbH | Pappelallee 78/79 | 10437 Berlin
Amtsgericht Charlottenburg | HRB 230712 B
Geschäftsführer: John M. Woodell | David E. Pugh
Finanzamt: Berlin Finanzamt für Körperschaften II
--
Charlie Hull - Managing Consultant at OpenSource Connections Limited
<www.o19s.com>
Founding member of The Search Network <https://thesearchnetwork.com/>
and co-author of Searching the Enterprise
<https://opensourceconnections.com/about-us/books-resources/>
tel/fax: +44 (0)8700 118334
mobile: +44 (0)7767 825828
OpenSource Connections Europe GmbH | Pappelallee 78/79 | 10437 Berlin
Amtsgericht Charlottenburg | HRB 230712 B
Geschäftsführer: John M. Woodell | David E. Pugh
Finanzamt: Berlin Finanzamt für Körperschaften II
