Large multivalued field and overseer problem

2015-11-19 Thread Olivier
Hi, We have a Solrcloud cluster with 3 nodes (4 processors, 24 Gb RAM per node). We have 3 shards per node and the replication factor is 3. We host 3 collections, the biggest is about 40K documents only. The most important thing is a multivalued field with about 200K to 300K values per document

Re: Large multivalued field and overseer problem

2015-11-19 Thread Anshum Gupta
Hi Olivier, A few things that you should know: 1. The Overseer is at a per cluster level and not at a per-collection level. 2. Also, documents/fields/etc. should have zero impact on the Overseer itself. So, while the upgrade to a more recent Solr version comes with a lot of good stuff, the

Re: Large multivalued field and overseer problem

2015-11-19 Thread Erick Erickson
In addition to Anshum's excellent points: bq: And after a short period of time, all the cluster is unavailable (out of memory JVM error). This is where I'd focus my efforts. I suspect your memory-bound and are actually seeing OOM errors about the time this problem manifests itself. Or you're