My understanding is that you should really not turn off merges --
merging has improved a lot in later versions, and while it can be a
performance hit if the server starts merging during a big load,
MarkLogic does a better job now with scheduling and throttling merges
than in the past. Moreover, merging improves the performance of the
database after the fact, a lot.
I think you should probably look to other means for helping with ingest
times -- batch inserts (multiple docs per transaction) are probably the
biggest improvement you can get (but of course this is highly dependent
on your document structures)
Charles
On 10/29/2012 09:53 AM, Steiner, David J. (LNG-DAY) wrote:
Hello,
Thought that I’d seen in documentation where one could “speed up”
loading by turning off merges, so I did. Seemed to work pretty good
until I got this error:
XDMP-TOOMANYSTANDS: xdmp:eval("import module namespace infodev =
"http://marklogic.com/app...";, (fn:QName("", "document"),
fn:doc("[uri].xml"), fn:QName("", "path"), ...), <options
xmlns="xdmp:eval"><database>1385720675613291619</database></options>)
-- Too many stands
So, apparently a periodic merge is required to even proceed with
loading. Is there documentation on how to know when a merge would be
needed? For instance, I have X docs to load into Y forests so at most
I can load X/Z docs, then I’ll need to manually merge before more loading.
Thanks,
David
--
Charles Greer
Senior Engineer
MarkLogic Corporation
[email protected]
Phone: +1 707 408 3277
www.marklogic.com
This e-mail and any accompanying attachments are confidential. The information
is intended solely for the use of the individual to whom it is addressed. Any
review, disclosure, copying, distribution, or use of this e-mail communication
by others is strictly prohibited. If you are not the intended recipient, please
notify us immediately by returning this message to the sender and delete all
copies. Thank you for your cooperation.
_______________________________________________
General mailing list
[email protected]
http://developer.marklogic.com/mailman/listinfo/general
