Re: Data Import Handler - autoSoftCommit and autoCommit
You can start with one of the suggestions from this link based on your indexing and query load. https://lucidworks.com/blog/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/ Thanks, Susheel On Mon, Feb 8, 2016 at 10:15 AM, Troy Edwards wrote: > We are running the data import handler to retrieve about 10 million records > during work hours every day of the week. We are using Clean = true, Commit > = true and Optimize = true. The entire process takes about 1 hour. > > What would be a good setting for autoCommit and autoSoftCommit? > > Thanks >
Re: Data Import Handler - autoSoftCommit and autoCommit
we have this for a collection which updated every 3mins with min of 500
documents and once in a day of 10k documents in start of the day
${solr.autoCommit.maxTime:30}
1
true
true
${solr.autoSoftCommit.maxTime:6000}
As per solr documentation, If you have solr client to index documents,
its not suggested to use commit=true and optimize=true explicitly.
we have not tested data import handle with 10 million records.
we have settled with this config after many tests and after understanding
the need and requirements.
*Rajesh**.*
On Mon, Feb 8, 2016 at 10:15 AM, Troy Edwards
wrote:
> We are running the data import handler to retrieve about 10 million records
> during work hours every day of the week. We are using Clean = true, Commit
> = true and Optimize = true. The entire process takes about 1 hour.
>
> What would be a good setting for autoCommit and autoSoftCommit?
>
> Thanks
>
Data Import Handler - autoSoftCommit and autoCommit
We are running the data import handler to retrieve about 10 million records during work hours every day of the week. We are using Clean = true, Commit = true and Optimize = true. The entire process takes about 1 hour. What would be a good setting for autoCommit and autoSoftCommit? Thanks
