Hi Guys, We are in a use-case where we need to create a large number of collections(1000 to 1500) in a SolrCloud. Here most of collections will have a very limited number of documents(100 to 1000), even some collections are empty. We are using single shard and 2 replicas.For each replica we using a machine with 12GB RAM , 32 GB SSD.
Now the problem is, when we create about 1400 collection(all of them are empty i.e. no document is added yet) the solr service goes down showing out of memory exception. We have few questions here- 1. When we are creating collections, each collection is taking about 8 MB to 12 MB of memory when there is no document yet. Is there any way to configure SolrCloud in a way that it takes low memory for each collection initially(like 1MB for each collection), then we would be able to create 1500 collection using about 3GB of machines RAM? 2. Is there any way to clear/flush the cache of SolrCloud, specially from those collections which we don't access for while(May be we can take those inactive collections out of memory and load them back when they are needed again)? 3. Is there any way to collect the Garbage Memory from SolrCloud(may be created by deleting documents and collections) ? Our target is without increasing the hardware resources, create maximum number of collections, and keeping the highly accessed collections & documents in memory. We'll appreciate your help. Best Regards, *Sharif Shahriar Ahmed*
