Hi all, We use solr in our website for product search. Currently, we have 2.1 million documents in the products core and these documents each have around 350 fields. >90% of the fields are indexed. We have this master instance of solr running on 15GB RAM and 200GB drive. We have also configured 10 slaves for handling the reads from website. Slaves poll master at an interval of 20 minutes. We monitored the index size for a few days and found that it varies widely from 11GB to 43GB.
Recently, we started getting a lot of out of memory errors on the master. Everytime, solr becomes unresponsive and we need to restart jetty to bring it back up. At the same we observed the variation in index size. We are suspecting that these two problems may be linked. What could be the reason that the index size becomes almost 4x? Why does it vary so much? Any pointers will be appreciated. If you need any more details on the config, please let me know. -- Himanshu Sachdeva