Damon, Running it the way Abishek has it takes 11.077 seconds on my machine. Running it with your suggestion took 13.083 seconds. What am I missing? Clearly the configuration of Abishek's EC2 is a major part of his problem. I am not seeing any gain, though using eval. Just curious, more than anything.
Thanks, Harry On Sat, Dec 1, 2012 at 10:58 AM, Damon Feldman <[email protected]>wrote: > Abhishek, > > First of all - thank you for the good question, with a self-contained > query we can use to reproduce it and play with the query. > > 10,000 documents in one transaction is a lot. I find about 100 documents > per commit is a good batch size, and 1,000 can be ok. This may vary based > on document size, indexes etc. so I suggest you try different commit sizes. > > So you would use > > for $i in 1 to 100 > return > xdmp:eval(' > for $x in (1 to 100) > > let $xml := element root { > element id {$x}, > element name {"million doc commit test"} > } > let $uri := fn:concat("/test/",$x) > return > xdmp:document-insert($uri,$xml) > ') > > And you should see better performance because each eval runs a separate > transaction. > > Yours, > Damon > > -- > > Damon Feldman > > Sr. Principal Consultant, MarkLogic > ------------------------------ > *From:* [email protected] [ > [email protected]] On Behalf Of Abhishek53 S [ > [email protected]] > *Sent:* Saturday, December 01, 2012 12:18 PM > *To:* MarkLogic Developer Discussion > *Subject:* [MarkLogic Dev General] Marklogic Transaction Commit - 1K > document > > Hi All, > > I have gone through some nice blogs over > http://developer.marklogic.com/blog/100k-transactions-qconnewyork-2012 posted > by Eric David & Team > > I have tried to validate the same idea with my ML 6.x Amazon Cloud DEV > environment where I have initilly NO document present into database [One > forest]. The insert query for 1K document is taking more than 5 mnute. > > Please let me know if I am wrong somewhere > > Query---------------------------------------------------------- > > for $x in (1 to 10000) > let $xml := element root { > element id {$x}, > element name {"million doc commit test"} > } > let $uri := fn:concat("/test/",$x) > return > xdmp:document-insert($uri,$xml) > > Profile Reort 5+ minute > --------------------------------------------------------------- > Kind Regards > Abhishek Srivastav > Tata Consultancy Services > Cell:- +91-9883389968 > Mailto: [email protected] > Website: http://www.tcs.com > ____________________________________________ > Experience certainty. IT Services > Business Solutions > Outsourcing > ____________________________________________ > > =====-----=====-----===== > Notice: The information contained in this e-mail > message and/or attachments to it may contain > confidential or privileged information. If you are > not the intended recipient, any dissemination, use, > review, distribution, printing or copying of the > information contained in this e-mail message > and/or attachments to it are strictly prohibited. If > you have received this communication in error, > please notify us by reply e-mail or telephone and > immediately and permanently delete the message > and any attachments. Thank you > > > _______________________________________________ > General mailing list > [email protected] > http://developer.marklogic.com/mailman/listinfo/general > >
_______________________________________________ General mailing list [email protected] http://developer.marklogic.com/mailman/listinfo/general
