Stupid phone autocorrect... If you add updated documents of the same ID over time, optimizing your collection(s) may help.
On Thu, Apr 14, 2016 at 7:50 AM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > If you delete a lot of documents over time, or if you add updated > documents of the same I'd over time, optimizing your collection(s) may help. > On Apr 14, 2016 3:52 AM, "Emir Arnautovic" <emir.arnauto...@sematext.com> > wrote: > >> Hi Edwin, >> Indexing speed depends on multiple factors: HW, Solr configurations and >> load, documents, indexing client: More complex documents, more CPU time to >> process each document before indexing structure is written down to disk. >> Bigger the index, more heap is used, more frequent GCs. Maybe you are just >> not sending enough doc to Solr to have such throughput. >> The best way to pinpoint bottleneck is to use some monitoring tool. One >> such tool is our SPM (http://sematext.com/spm) - it allows you to >> monitor both Solr and OS metrics. >> >> HTH, >> Emir >> >> -- >> Monitoring * Alerting * Anomaly Detection * Centralized Log Management >> Solr & Elasticsearch Support * http://sematext.com/ >> >> >> On 14.04.2016 05:29, Zheng Lin Edwin Yeo wrote: >> >>> Hi, >>> >>> Would like to find out, what is the optimal indexing speed in Solr? >>> >>> Previously, I managed to get more than 3GB/hour, but now the speed has >>> drop >>> to 0.7GB/hr. What could be the potential reason behind this? >>> >>> Besides the index size getting bigger, I have only added in more >>> collections into the core and added another field. Other than that >>> nothing >>> else has been changed.. >>> >>> Could the source file which I'm indexing made a difference in the >>> indexing >>> speed? >>> >>> I'm using Solr 5.4.0 for now, but will be planning to migrate to Solr >>> 6.0.0. >>> >>> Regards, >>> Edwin >>> >>> >>
