Re: Slower fetch document after upgrade >=8.7

2021-04-08 Thread Никита Михайлов
Thanks for the reply. The problem of understanding. You can make flexible settings for advanced developers, leaving two facets by default. In tests, check these facets Never change them so that the developers themselves explicitly set the settings. IMHO, I think this will help to avoid such proble

Re: Slower fetch document after upgrade >=8.7

2021-04-08 Thread Adrien Grand
Actually, we don't plan to have flexible settings even for advanced developers. Our stance on these discussions is that we should be opinionated about the default codec and not offer any options. Rather than exposing advanced settings for advanced users, these advanced users can build their own cod

Re: Slower search after 8.5.x to >=8.6

2021-04-08 Thread Никита Михайлов
Thanks for the answer NIOFSDirectory is like an example. Degradation is also on MMapDirectory and SimpleFSDirectory We are using elasticseach and it has: simplefs (SimpleFsDirectory), niofs (NIOFSDirectory), mmapfs (MMapDirectory) and hybridfs (NIOFSDirectory + MMapDirectory). And for us, while ni

Re: Slower search after 8.5.x to >=8.6

2021-04-08 Thread Adrien Grand
FSDirectory#open is just a utility method that tries to pick the best Directory implementation based on the platform, it's most likely MMapDirectory for you, which is the directory implementation we use on all 64-bit platforms. So it's intriguing that you are seeing a slowdown with MMapDirectory bu

Slower search after 8.5.x to >=8.6

2021-04-08 Thread Никита Михайлов
Hi. I noticed that after the upgrade from Lucene8.5.x to Lucene >=8.6, search became slower(example TopScoreDocCollector became 20-30% slower, from ElasticSearch - 50%). While testing, I realized that it happened after LUCENE-9257(commit e7a61ea). Bug or feature? Can add settings for isOffHeep? T

Re: Slower search after 8.5.x to >=8.6

2021-04-08 Thread Никита Михайлов
> It's usually more a bottleneck when indexing with IndexWriter # > updateDocument, which needs to perform one ID lookup for every indexed > document. I guess that the queries that you are running match so few hits that very little time is spent reading postings, is that correct? > But then that

Re: Slower fetch document after upgrade >=8.7

2021-04-08 Thread Никита Михайлов
Thank you. Understood the policy > I have some changes to stored fields on my plate, I'll include this change as > well. Is there a ticket for this change? чт, 8 апр. 2021 г. в 15:30, Adrien Grand : > > Actually, we don't plan to have flexible settings even for advanced > developers. Our stance

Re: Slower fetch document after upgrade >=8.7

2021-04-08 Thread Adrien Grand
I just opened https://issues.apache.org/jira/browse/LUCENE-9917. On Thu, Apr 8, 2021 at 4:34 PM Никита Михайлов wrote: > Thank you. Understood the policy > > > I have some changes to stored fields on my plate, I'll include this > change as well. > > Is there a ticket for this change? > > чт, 8 а