Re: Architecture and Capacity planning for large Solr index

2011-11-23 Thread Erick Erickson
Whether three shards will give you adequate throughput is not an answerable question. Here's what I suggest. Get a single box of the size you expect your servers to be and index 1/3 of your documents on it. Run stress tests. That's really the only way to be fairly sure your hardware is adequate.

Re: Architecture and Capacity planning for large Solr index

2011-11-21 Thread Rahul Warawdekar
Thanks ! My business requirements have changed a bit. We need one year rolling data in Production. The index size for the same comes to approximately 200 - 220 GB. I am planning to address this using Solr distributed search as follows. 1. Whole index to be split up between 3 shards, with 3

Re: Architecture and Capacity planning for large Solr index

2011-11-21 Thread Rahul Warawdekar
Thanks Otis ! Please ignore my earlier email which does not have all the information. My business requirements have changed a bit. We now need one year rolling data in Production, with the following details - Number of records - 1.2 million - Solr index size for these records comes to