Hi folks, I'm looking for clarification on the index "-nocommit" option:
The description says: "do the commits once and for all the reducers in one
go (optional)", which sounds unintuitive. The relevant code in
IndexerJob.java looks like this:
// do the commits once and for all the reducers in one go
if (!noCommit) {
writers.open(job, "commit");
writers.commit();
}
Which tells me that if I specify the option the commits are NOT performed.
Is the "-nocommit" description incorrect?
For reference, the solrindex "-nocommit" option's description used to say:
"Do not send a commit after indexing the segment(s).". source:
https://wiki.apache.org/nutch/bin/nutch%20solrindex
To further the confusion: this option works with the indexer-solr plugin,
but is useless with indexer-elastic because indexer-elastic "commits" for
every bulk update (e.g. every N "write" calls).
Joe
