Hi Charlie, I have checked with the DEV team regarding multivalue error. They say that : the fields which require/have multiple values were already set to multivalued=true . For non-multi valued fields also we are getting multiple values. That is the problem.
On Tue, Sep 7, 2021 at 9:05 PM Charlie Hull <[email protected]> wrote: > I don't know, but perhaps 8.8.1 checks it more than 8.1? - it's still > worth your dev team reviewing as I suggested as it may be linked to why > the nodes are going down. The error is occurring for a reason. > > Charlie > > On 07/09/2021 14:30, HariBabu kuruva wrote: > > Hi Charlie, > > > > The multiple values error is not occurring only for that field. Its also > > occurring for multiple fields and multiple stores(collections). > > Ex: > > 2021-09-07 13:05:53.646 ERROR (qtp1198197478-1200) [c:quoteStore s:shard1 > > r:core_node8 x:quoteStore_shard1_replica_n7] o.a.s.h.RequestH > > andlerBase org.apache.solr.common.SolrException: ERROR: > > [doc=1-116339633161] multiple values encountered for non multiValued > field > > quot > > eAgeCompleted: [N, N] > > > > Our Dev Team says that its only after the Solr upgrade from 8.1 to 8.8.1 > > > > Also, Solr is going down very frequently (after every one hour) on the > > nodes only where a specific store (quotestore) is available. Other nodes > > are fine. > > For the nodes which are going down, I see OOM error for one node and for > > the other node we see zookeeper connection timeout error as below. > > > > -------------------------------- > > 2021-09-07 13:06:13.907 WARN (main-SendThread( > > zookeeperhost.corp.equinix.com:2185)) [ ] o.a.z.ClientCnxn Client > session > > timed out, ha > > ve not heard from server in 23226ms for session id 0x40000139b3e00d3 > > 2021-09-07 13:06:13.907 WARN (main-SendThread( > > lxeisprdas10.corp.equinix.com:2185)) [ ] o.a.z.ClientCnxn Session > > 0x40000139b3e00d3 fo > > r sever zookeeperhost.corp.equinix.com/10.250.12.54:2185, Closing socket > > connection. Attempting reconnect except it is a SessionExpiredE > > xception. => org.apache.zookeeper.ClientCnxn$SessionTimeoutException: > > Client session timed out, have not heard from server in 23226ms f > > or session id 0x40000139b3e00d3 > > at > > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1243) > > org.apache.zookeeper.ClientCnxn$SessionTimeoutException: Client session > > timed out, have not heard from server in 23226ms for session id > > 0x40000139b3e00d3 > > at > > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1243) > > ~[zookeeper-3.6.2.jar:3.6.2] > > 2021-09-07 13:06:14.010 WARN (zkConnectionManagerCallback-13-thread-1) [ > > ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.commo > > n.cloud.ConnectionManager@5521aab name: ZooKeeperConnection Watcher: > > zk1.corp.equinix.com:2181,zk2.corp.equinix.com:21 > > 82,zk3.corp.equinix.com:2183,zk4.corp.equinix.com:2184, > > zk5.corp.equinix.com:2185 got event WatchedEvent stat > > e:Disconnected type:None path:null path: null type: None > > 2021-09-07 13:06:14.010 WARN (zkConnectionManagerCallback-13-thread-1) [ > > ] o.a.s.c.c.ConnectionManager zkClient has disconnected > > 2021-09-07 13:06:39.494 WARN (main-SendThread( > > lxeisprdas09.corp.equinix.com:2184)) [ ] o.a.z.ClientCnxn Client > session > > timed out, ha > > ve not heard from server in 23533ms for session id 0x40000139b3e00d3 > > 2021-09-07 13:06:39.494 WARN (main-SendThread( > > lxeisprdas09.corp.equinix.com:2184)) [ ] o.a.z.ClientCnxn Session > > 0x40000139b3e00d3 fo > > r sever zk4.corp.equinix.com/10.250.**.**:2184, Closing socket > connection. > > Attempting reconnect except it is a SessionExpiredE > > xception. => org.apache.zookeeper.ClientCnxn$SessionTimeoutException: > > Client session timed out, have not heard from server in 23533ms f > > or session id 0x40000139b3e00d3 > > at > > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1243) > > org.apache.zookeeper.ClientCnxn$SessionTimeoutException: Client session > > timed out, have not heard from server in 23533ms for session id > > 0x40000139b3e00d3 > > ------------------------------------------------------- > > > > Could you please suggest. > > > > > > > > > > > > > > > > On Tue, Sep 7, 2021 at 5:49 PM Charlie Hull < > [email protected]> > > wrote: > > > >> Sorry I should have worded that better - I suggest that you review your > >> schema file and indexing process, so that you can understand why > >> multiple values are being sent to the field 'quoteSLOCurrentStatus' when > >> it's probably not defined as multivalued. > >> > >> C > >> > >> On 07/09/2021 12:30, HariBabu kuruva wrote: > >>> Thank you Charlie. > >>> > >>> Please let me know if anything is required from my end. > >>> > >>> Also, we have added below filed as a work around > >>> <enableLazyFieldLoading>false</enableLazyFieldLoading> in > solrconfig.xml > >>> > >>> On Tue, Sep 7, 2021 at 4:03 PM Charlie Hull < > >> [email protected]> > >>> wrote: > >>> > >>>> I doubt these are related, that second error looks like something > >>>> triggered by indexing - attempting to add multiple values to a field > >>>> that hasn't been defined in the schema as multivalued. I'd review your > >>>> indexing process and schema first. > >>>> > >>>> Charlie > >>>> > >>>> On 07/09/2021 11:00, HariBabu kuruva wrote: > >>>>> Hi All, > >>>>> > >>>>> We are getting OOM errors in the solr logs for only specific solr > >> stores. > >>>>> And in the solr logs we see the below error. Is the OOM error could > be > >>>>> because of the below error. > >>>>> > >>>>> Also i see below Lazyfield error is spanned across thousands of > lines. > >>>>> > >>>>> Please advise. This is a PROD environment. > >>>>> > >>>>> --------------------------------- > >>>>> AsyncLogger error handling event seq=163, > >>>>> value='Logger=org.apache.solr.handler.RequestHandlerBase Level=ERROR > >>>>> Message=org.apache.solr. > >>>>> common.SolrException: ERROR: [doc=1-121180294489] multiple values > >>>>> encountered for non multiValued field quoteSLOCurrentStatus: [org.apa > >>>>> che.lucene.document.LazyDocument$LazyField@2b119ab6, > >>>>> org.apache.lucene.document.LazyDocument$LazyField@70dc55ed, > >>>>> org.apache.lucene.docu > >>>>> ment.LazyDocument$LazyField@7dba464d, > >>>>> org.apache.lucene.document.LazyDocument$LazyField@6cfa4d94, > >>>>> org.apache.lucene.document.LazyDocume > >>>>> nt$LazyField@4b19be97, > >>>>> org.apache.lucene.document.LazyDocument$LazyField@5978e924, > >>>>> org.apache.lucene.document.LazyDocument$LazyField@76 > >>>>> -------------------------- > >>>>> > >>>>> > >>>>> Thanks and Regards, > >>>>> Hari > >>>>> Mobile:9790756568 > >>>>> > >>>> -- > >>>> Charlie Hull - Managing Consultant at OpenSource Connections Limited > >>>> <www.o19s.com> > >>>> Founding member of The Search Network <https://thesearchnetwork.com/> > >>>> and co-author of Searching the Enterprise > >>>> <https://opensourceconnections.com/about-us/books-resources/> > >>>> tel/fax: +44 (0)8700 118334 > >>>> mobile: +44 (0)7767 825828 > >>>> > >>>> OpenSource Connections Europe GmbH | Pappelallee 78/79 | 10437 Berlin > >>>> Amtsgericht Charlottenburg | HRB 230712 B > >>>> Geschäftsführer: John M. Woodell | David E. Pugh > >>>> Finanzamt: Berlin Finanzamt für Körperschaften II > >>>> > >> -- > >> Charlie Hull - Managing Consultant at OpenSource Connections Limited > >> <www.o19s.com> > >> Founding member of The Search Network <https://thesearchnetwork.com/> > >> and co-author of Searching the Enterprise > >> <https://opensourceconnections.com/about-us/books-resources/> > >> tel/fax: +44 (0)8700 118334 > >> mobile: +44 (0)7767 825828 > >> > >> OpenSource Connections Europe GmbH | Pappelallee 78/79 | 10437 Berlin > >> Amtsgericht Charlottenburg | HRB 230712 B > >> Geschäftsführer: John M. Woodell | David E. Pugh > >> Finanzamt: Berlin Finanzamt für Körperschaften II > >> > > > > -- > Charlie Hull - Managing Consultant at OpenSource Connections Limited > <www.o19s.com> > Founding member of The Search Network <https://thesearchnetwork.com/> > and co-author of Searching the Enterprise > <https://opensourceconnections.com/about-us/books-resources/> > tel/fax: +44 (0)8700 118334 > mobile: +44 (0)7767 825828 > > OpenSource Connections Europe GmbH | Pappelallee 78/79 | 10437 Berlin > Amtsgericht Charlottenburg | HRB 230712 B > Geschäftsführer: John M. Woodell | David E. Pugh > Finanzamt: Berlin Finanzamt für Körperschaften II > -- Thanks and Regards, Hari Mobile:9790756568
