Hi,
Running out of memory because of XML document when indexing documents sounds
very weird/suspicious.
Are you running out of memory on the server side?
Are you indexing super large batches?
How big is your JVM heap?
How big is your ramBufferSizeMB?
Otis
--
Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
- Original Message
From: Phil Hagelberg p...@hagelb.org
To: solr-user@lucene.apache.org
Sent: Thu, January 14, 2010 5:57:31 PM
Subject: EmbeddedSolrServer and BinaryRequestWriter
I'm trying to reduce memory usage when indexing, and I see that using
the binary format may be a good way to do this. Unfortunately I can't
see a way to do this using the EmbeddedSolrServer since only the
CommonsHttpSolrServer has a setRequestWriter method. If I'm running out
of memory constructing XML request documents, does that mean I just have
to switch away from the EmbeddedSolrServer?
I understand I can stream requests if I'm just indexing files already on
disk, but I'm constructing them on the fly, and I run out of memory
constructing the XML document to submit to solr, not in actual indexing,
so it seems writing the document to disk would run into the same problems.
thanks,
Phil
