Erick I don't think solr was mentioned here. On Thu, Jan 18, 2018 at 8:03 AM, Erick Erickson <erickerick...@gmail.com> wrote: > My first question is always "are you running the Solr CPUs flat out?". > My guess in this case is that the indexing client is the same and the > problem is in Solr, but it's worth checking whether the clients are > just somehow not delivering docs as fast as they were before. > > My suspicion is that the indexing client hasn't changed, but it's > worth checking. > > Best, > Erick > > On Thu, Jan 18, 2018 at 2:23 AM, Rob Audenaerde > <rob.audenae...@gmail.com> wrote: >> Hi all, >> >> We recently upgraded from Lucene 6.6 to 7.1. We see a significant drop in >> indexing performace. >> >> We have a-typical use of Lucene, as we (also) index some database tables >> and add all the values as AssociatedFacetFields as well. This allows us to >> create pivot tables on search results really fast. >> >> These tables have some overlapping columns, but also disjoint ones. >> >> We anticipated a decrease in index size because of the sparse docvalues. We >> see this happening, with decreases to ~50%-80% of the original index size. >> But we did not expect an drop in indexing performance (client systems >> indexing time increased with +50% to +250%). >> >> (Our indexing-speed used to be mainly bound by the speed the Taxonomy could >> deliver new ordinals for new values, currently we are investigating if this >> is still the case, will report later when a profiler run has been done) >> >> Does anyone know if this increase in indexing time is to be expected as >> result of the sparse docvalues change? >> >> Kind regards, >> >> Rob Audenaerde > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org >
--------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
