Re: Default Index config

2018-04-27 Thread mganeshs
To add it further, in 6.5.1, while indexing... even sometimes one of solr node goes down for a while and comes up automatically. During those period all our calls to index fails. Even in the Solr admin UI, we can see node not being active for a while and coming up again. All these happens in 4

Re: Default Index config

2018-04-11 Thread mganeshs
Hi Shawn, We found following link where its mentioned like in 6.2.1 it's

Re: Default Index config

2018-04-09 Thread mganeshs
Hi Shawn, Thanks for the reply. Yes we use only one solr client. Though collection name is passed in the function, we are using same client for now. Regarding merge config, after reading lot of forums and listening to presentation of revolution 2017, idea is to reduce the merge frequency, so

Re: Default Index config

2018-04-09 Thread Shawn Heisey
On 4/9/2018 4:04 AM, mganeshs wrote: Regarding CPU high, when we are troubleshooting, we found that Merge threads are keep on running and it's take most CPU time ( as per Visual JVM ). With a one second autoSoftCommit, nearly constant indexing will produce a lot of very small index segments. 

Re: Default Index config

2018-04-09 Thread mganeshs
Hi Shawn, Regarding CPU high, when we are troubleshooting, we found that Merge threads are keep on running and it's take most CPU time ( as per Visual JVM ). GC is not causing any issue as we use the default GC and also tried with G1 as you suggested over here

Re: Default Index config

2018-03-28 Thread Shawn Heisey
On 3/28/2018 9:44 PM, mganeshs wrote: Regarding auto commit, we discussed lot with our product owners and atlast we are forced to keep it to 1sec and we couldn't increase further. As this itself, sometimes our customers says that they have to refresh their pages for couple of times to get the

Re: Default Index config

2018-03-28 Thread mganeshs
Hi Shawn, Thanks again for detailed reply. Regarding auto commit, we discussed lot with our product owners and atlast we are forced to keep it to 1sec and we couldn't increase further. As this itself, sometimes our customers says that they have to refresh their pages for couple of times to get

Re: Default Index config

2018-03-27 Thread Shawn Heisey
On 3/27/2018 9:35 PM, mganeshs wrote: I am using the default configuration, as all solr experts say default one suits for most of the cases and so following the defaults. We changed only the commits part and using 15000 for hard commits and 1 sec for soft commit. All other setting like locking,

Re: Default Index config

2018-03-27 Thread mganeshs
Hi Shawn, Thanks for detail mail. Yes I am behind the IndexConfig only. Regarding 5GB size of collection, it's not one document. It has almost 3M of docs in that collection. I am using the default configuration, as all solr experts say default one suits for most of the cases and so following

Re: Default Index config

2018-03-26 Thread Shawn Heisey
On 3/26/2018 10:45 AM, mganeshs wrote: > I haven't changed the solr config wrt index config, which means it's all > commented in the solrconfig.xml. > > It's something like what I pasted before. But I would like to know whats the > default value of each of this. Default value of *what* exactly? 

Default Index config

2018-03-26 Thread mganeshs
Hi, I haven't changed the solr config wrt index config, which means it's all commented in the solrconfig.xml. It's something like what I pasted before. But I would like to know whats the default value of each of this. Coz.. after loading to 6.5.1 and our document size also crossed 5GB in each