Hi,
Thanks for answering this question a while back. I have made some of
the suggestions you mentioned. ie not committing until I've finished
indexing. What I am seeing though, is as the index get larger (around
1Gb), indexing is taking a lot longer. In fact it slows down to a
crawl. Have you got any pointers as to what I might be doing wrong?
Also, I was looking at using MultiCore solr. Could this help in some
way?
Thank you
Brendan
On Oct 31, 2007, at 10:09 PM, Chris Hostetter wrote:
: I would think you would see better performance by allowing auto
commit
: to handle the commit size instead of reopening the connection all
the
: time.
if your goal is "fast" indexing, don't use autoCommit at all ... just
index everything, and don't commit until you are completely done.
autoCommitting will slow your indexing down (the benefit being that
more
results will be visible to searchers as you proceed)
-Hoss
