Re: SolrJ addField with Reader

2010-10-22 Thread Bojan Vukojevic
Is there an example of how to use ContentStreamBase.FileStream from SolrJ during indexing to reduce memory footprint? Using addField is requiring a string. The only example I could find in JUnits is below and does not show indexing... thx! *public* *void* testFileStream() *throws* IOException {

Re: SolrJ addField with Reader

2010-08-25 Thread Shalin Shekhar Mangar
On Tue, Aug 24, 2010 at 10:37 AM, Bojan Vukojevic email...@gmail.comwrote: I am using SolrJ with embedded Solr server and some documents have a lot of text. Solr will be running on a small device with very limited memory. In my tests I cannot process more than 3MB of text (in a body) with

Re: SolrJ addField with Reader

2010-08-25 Thread Lance Norskog
There are a couple of options here. Solr can fetch text from a file or from HTTP given an url. Look at the stream.file and stream.url parameters. You can use these from EmbeddedSolr. Also, there are 'ContentStream' objects in the SolrJ API which you can also use. Look at

SolrJ addField with Reader

2010-08-23 Thread Bojan Vukojevic
I am using SolrJ with embedded Solr server and some documents have a lot of text. Solr will be running on a small device with very limited memory. In my tests I cannot process more than 3MB of text (in a body) with 64MB heap. According to Java there is about 30MB free memory before I call