I recommend you delve deeper into the presentation from MarkLogic World on the approach. They had multiple forrests, optimized the number of commits per transaction, massive amounts of RAM, and targeted specific storage locations on the forrests. (Among other things) There's quite a bit more to what it takes to achieve the 100k milestone.
That said, it still seems like your loop of 10k takes a long time...one application on my local machine can process 10k records (full documents with about 200 elements) in about 20 seconds. On Dec 1, 2012 10:18 AM, "Abhishek53 S" <[email protected]> wrote: > Hi All, > > I have gone through some nice blogs over > http://developer.marklogic.com/blog/100k-transactions-qconnewyork-2012 posted > by Eric David & Team > > I have tried to validate the same idea with my ML 6.x Amazon Cloud DEV > environment where I have initilly NO document present into database [One > forest]. The insert query for 1K document is taking more than 5 mnute. > > Please let me know if I am wrong somewhere > > Query---------------------------------------------------------- > > for $x in (1 to 10000) > let $xml := element root { > element id {$x}, > element name {"million doc commit test"} > } > let $uri := fn:concat("/test/",$x) > return > xdmp:document-insert($uri,$xml) > > Profile Reort 5+ minute > --------------------------------------------------------------- > Kind Regards > Abhishek Srivastav > Tata Consultancy Services > Cell:- +91-9883389968 > Mailto: [email protected] > Website: http://www.tcs.com > ____________________________________________ > Experience certainty. IT Services > Business Solutions > Outsourcing > ____________________________________________ > > =====-----=====-----===== > Notice: The information contained in this e-mail > message and/or attachments to it may contain > confidential or privileged information. If you are > not the intended recipient, any dissemination, use, > review, distribution, printing or copying of the > information contained in this e-mail message > and/or attachments to it are strictly prohibited. If > you have received this communication in error, > please notify us by reply e-mail or telephone and > immediately and permanently delete the message > and any attachments. Thank you > > > _______________________________________________ > General mailing list > [email protected] > http://developer.marklogic.com/mailman/listinfo/general > >
_______________________________________________ General mailing list [email protected] http://developer.marklogic.com/mailman/listinfo/general
