Re: Archiving Index using partitions

2008-01-26 Thread Otis Gospodnetic
ucene - Solr - Nutch - Original Message From: vivek sar <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Thursday, January 24, 2008 11:21:08 PM Subject: Re: Archiving Index using partitions Thanks Otis for your response. I've few more questions, 1) Is it

Re: Archiving Index using partitions

2008-01-24 Thread vivek sar
Thanks Otis for your response. I've few more questions, 1) Is it recommended to do index partitioning for large indexes? - We index around 35 fields (storing only two of them - simple ids) - Each document is around 200 bytes - Our index grows to around 50G a week 2) The reaso

Re: Archiving Index using partitions

2008-01-21 Thread Otis Gospodnetic
Why not just design your system to roll over to a new index on a weekly a basis (new IndexWriter on a new index dir, roughly speaking)? You can't partition a single Document, if that is what you are asking. But you can create multiple smaller (e.g. weekly indices) instead one large one, and th

Re: Archiving Index using partitions

2008-01-21 Thread Otis Gospodnetic
Why not just design your system to roll over to a new index on a weekly a basis (new IndexWriter on a new index dir, roughly speaking)? You can't partition a single Document, if that is what you are asking. But you can create multiple smaller (e.g. weekly indices) instead one large one, and th