Re: Slow indexing with data import handler

2009-04-18 Thread Shalin Shekhar Mangar
On Sun, Apr 19, 2009 at 7:30 AM, Gustavo A. Lopes wrote: > I'm indexing around 1 million documents of one type that requires 4 > additional queries for each document + 0,5 M documents that only require 1 > query for all. > > I'm using the data import handler from contrib with SolrWriter modified >

Re: Slow indexing with data import handler

2009-04-18 Thread Otis Gospodnetic
Hi, It could be that you are simply seeing the effect of index segment merges that take longer as segments get bigger. Or it could be that the JVM doesn't have enough memory and is running GC too often. Do you see high CPU load or lots of disk IO or something else? Otis -- Sematext -- http