Re: Indexing time increase moving from Lucene 8 to 9

2024-04-18 Thread Marc Davenport
Hi Adrien et al, I've been doing some investigation today and it looks like whatever the change is, it happens between 9.4.2 and 9.5.0. I made a smaller test set up for our code that mocks our documents and just runs through the indexing portion of our code sending in batches of 4k documents at a t

Re: Indexing time increase moving from Lucene 8 to 9

2024-04-18 Thread Gautam Worah
Does your application see a lot of document updates/deletes? GITHUB#11761 could have potentially affected you. Whenever I see large indexing times, my first suspicion is towards increased merge activity. Regards, Gautam Worah. On Thu, Apr 18, 2024 at 2:14 PM Marc Davenport wrote: > Hi Adrien e

Re: Indexing time increase moving from Lucene 8 to 9

2024-04-18 Thread Dawid Weiss
Hi Marc, You could try git bisect lucene repository to pinpoint the commit that caused what you're observing. It'll take some time to build but it's a logarithmic bisection and you'd know for sure where the problem is. D. On Thu, Apr 18, 2024 at 11:16 PM Marc Davenport wrote: > Hi Adrien et al