Re: how can i use solrj binary format for indexing?

2010-10-21 Thread Jason, Kim
-- View this message in context: http://lucene.472066.n3.nabble.com/how-can-i-use-solrj-binary-format-for-indexing-tp1722612p1750669.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: how can i use solrj binary format for indexing?

2010-10-20 Thread Gora Mohanty
On Mon, Oct 18, 2010 at 8:22 PM, Jason, Kim hialo...@gmail.com wrote: Sorry for the delay in replying. Was caught up in various things this week. Thank you for reply, Gora But I still have several questions. Did you use separate index? If so, you indexed 0.7 million Xml files per instance

Re: how can i use solrj binary format for indexing?

2010-10-18 Thread Peter Karich
Hi, you can try to parse the xml via Java yourself and then push the SolrInputDocuments it via SolrJ to solr. setting format to binaray + using the streaming update processor should improve performance, but I am not sure... and performant (+less mem!) reading xml in Java is another topic ... ;-)

Re: how can i use solrj binary format for indexing?

2010-10-18 Thread Jason, Kim
.nabble.com/how-can-i-use-solrj-binary-format-for-indexing-tp1722612p1724645.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: how can i use solrj binary format for indexing?

2010-10-18 Thread Gora Mohanty
On Mon, Oct 18, 2010 at 5:26 PM, Jason, Kim hialo...@gmail.com wrote: Hi, Gora I haven't tried yet indexing huge amount of xml files through curl or pure java(like a post.jar). Indexing through xml is really fast? How many files did you index? And How did it(using curl or pure java)? [...]

Re: how can i use solrj binary format for indexing?

2010-10-18 Thread Ryan McKinley
is quite slow. But I don't know how to use index through solrj binary format and can't find examples. Please give some help. Thanks, -- View this message in context: http://lucene.472066.n3.nabble.com/how-can-i-use-solrj-binary-format-for-indexing-tp1722612p1722612.html Sent from the Solr

Re: how can i use solrj binary format for indexing?

2010-10-18 Thread Jason, Kim
://lucene.472066.n3.nabble.com/how-can-i-use-solrj-binary-format-for-indexing-tp1722612p1725679.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: how can i use solrj binary format for indexing?

2010-10-18 Thread Sharp, Jonathan
, -- View this message in context: http://lucene.472066.n3.nabble.com/how-can-i-use-solrj-binary-format-for-indexing-tp1722612p1725679.html Sent from the Solr - User mailing list archive at Nabble.com. - SECURITY/CONFIDENTIALITY

how can i use solrj binary format for indexing?

2010-10-17 Thread Jason, Kim
. Thanks, -- View this message in context: http://lucene.472066.n3.nabble.com/how-can-i-use-solrj-binary-format-for-indexing-tp1722612p1722612.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: how can i use solrj binary format for indexing?

2010-10-17 Thread Gora Mohanty
On Mon, Oct 18, 2010 at 8:31 AM, Jason, Kim hialo...@gmail.com wrote: Hi all I have a huge amount of xml files for indexing. I want to index using solrj binary format to get performance gain. Because I heard that using xml files to index is quite slow. [...] Do not know about SolrJ's binary