Re: Incorrect CollectionStatistics if IndexWriter.close is not called

2021-03-02 Thread Marc F
I'm indexing medical documents, and documents on emerging topics are updated quite often. For example, right now, "COVID" will be overrepresented in my index because deleted documents are still counted, and then a "COVID" query will have a lower score than a query on a "unfashionable" topic, becaus

Force-merge performance degrading after upgrade to Lucene 8.0

2021-03-02 Thread Xie, Eileen
Hi! After upgrading ES cluster from 6.2 to 7.9 version, we find that force merge operation will take long time, about double of previous latency. Based on our investigation, we found the follows is main cause of the force-merge performance decrease: * From Lucene 8.0, NormsProducer is adde

Force-merge performance degrading after upgrade to Lucene 8.0

2021-03-02 Thread Xie, Eileen
Hi! After upgrading ES cluster from 6.2 to 7.9 version, we find that force merge operation will take long time, about double of previous latency. Based on our investigation, we found the follows is main cause of the force-merge performance decrease: * From Lucene 8.0, NormsProducer is added as i

Force-merge performance degrading after upgrade to Lucene 8.0

2021-03-02 Thread Xie, Eileen
Hi! After upgrading ES cluster from 6.2 to 7.9 version, we find that force merge operation will take long time, about double of previous latency. Based on our investigation, we found the follows is main cause of the force-merge performance decrease: * From Lucene 8.0, NormsProducer is adde