>From the docs
><http://docs.marklogic.com/guide/ingestion/content-pump#id_81418>:
“Time vs. Space: Configuring Batch and Transaction Size
You can tune the document insertion throughput and memory requirements of your
job by configuring the batch size and transaction size of the job.
• -batch_size controls the number of updates per request to the server.
• -transaction_size controls the number of requests to the server per
transaction.
The default batch size is 100. The default transaction size is 10. This means
that the default maximum number of
updates per transaction is 1000.”
So, yes, if the product of batch and transaction size is greater than your
number of documents you will get a single atomic insert. Making this number too
large, of course, will exhaust resources on the client and/or server
eventually, which is why mlcp implements batches in the first place.
Justin
On Sep 19, 2014, at 11:21 AM, Karl Erisman <[email protected]> wrote:
> Okay, just to make sure I understand the documentation about the
> transaction_size option, does this mean that if I set transaction_size to a
> large number (larger than the number of documents I want to load...what's the
> max value?), my loading task will run as a single transaction? The reason I'm
> doing this is that I need all my documents to appear in ML at the same time.
>
> How can I write a test to prove that this is the way it works? I was going to
> check xdmp:request-timestamp() before and after the load, but other things
> (even internal ML server events) could be running that would advance the
> counter so that approach won't work.
>
> On Thu, Sep 18, 2014 at 9:20 AM, Karl Erisman <[email protected]>
> wrote:
> I'd like to use mlcp to load a set of files in a single transaction. Can this
> be done with mlcp?
> _______________________________________________
> General mailing list
> [email protected]
> http://developer.marklogic.com/mailman/listinfo/general
_______________________________________________
General mailing list
[email protected]
http://developer.marklogic.com/mailman/listinfo/general
