Re: Seeing very low ingestion performance for a single non-cloud Solr core

2017-09-25 Thread saiks
Hi All, Thanks for the response. Increasing hard/soft commit intervals did not help. But by changing "text" field in the ingestion input from the same message to random messages of similar length gave 60% improved performance. Im able to ingest 40k - 45k messages per second, earlier I did 26k.

Seeing very low ingestion performance for a single non-cloud Solr core

2017-09-20 Thread saiks
Hi, Environment: - Solr is running in non-cloud mode on 6.4.2, Sun Java8, Linux 4.4.0-31-generic x86_64 - Ingesting into a single core - SoftCommit = 5 seconds, HardCommit = 10 seconds - System has 16 Cpus and 32 Gb of memory (Solr is given 20 Gb of JVM heap) - text = StandardTokenizer, id =

Changing "configSetBaseDir" leads to, Can't find resource 'solrconfig.xml' in classpath error while creating core

2017-02-14 Thread saiks
Hi All, I have a core "core1" created with custom config {solr.solr.home}/configsets/custom_config I changed configSetBaseDir to a different directory in solr.xml and copied the folders over to the new dir and deleted the old configs ${configSetBaseDir:/xxx/Desktop/changed-configset} Now, if I

Re: Commit/callbacks doesn't happen on core close

2017-02-07 Thread saiks
Thanks for the reply. The issue is, when the core is unloaded, post commit listeners on the core are not getting called. If you see here, the code that calls post commit listeners is commented out.

Re: Commit/callbacks doesn't happen on core close

2017-01-29 Thread saiks
Hi All, We are a big public company and we are evaluating Solr to store hundreds of tera bytes of data. Post commit listeners getting called on core close is a must for us. It would be great if anyone can help us fix the issue or suggest a workaround :) Thank you -- View this message in

Commit/callbacks doesn't happen on core close

2017-01-26 Thread saiks
Hi All, While I was testing out the transient feature of Solr cores, I found this issue. I had my transientCacheSize set to "1" in solr.xml and I have created two cores with these properties loadOnStartup=false transient=true I had my softCommit time set to 5 seconds and hardCommit to 10