I'm having two problems with the solrindex job in Nutch 2.1 When I run it with -all, it indexes every single parsed document, not just the newly generated ones, as fetch and parse do.
Secondly, it's adding my documents in small chunks. I was fetching in 100 document cycles and when I run solrindex I get messages such as the following. Adding 87 documents Adding 5 documents Adding 2 documents Adding 3 documents Adding 14 documents Adding 34 documents Adding 233 documents Any ideas what causes this and how to fix it? Thanks.
