Thanks all for your valuable suggestions. Sent from my iPad
On 19-Jan-2013, at 1:30 AM, "[email protected]" <[email protected]> wrote: > Send General mailing list submissions to > [email protected] > > To subscribe or unsubscribe via the World Wide Web, visit > http://developer.marklogic.com/mailman/listinfo/general > or, via email, send a message with subject or body 'help' to > [email protected] > > You can reach the person managing the list at > [email protected] > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of General digest..." > > > Today's Topics: > > 1. MarkLogic DB Size estimation (Chowdhury, Soumadri) > 2. Re: MarkLogic DB Size estimation (Geert Josten) > 3. Re: MarkLogic DB Size estimation (Michael Blakeley) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Fri, 18 Jan 2013 13:28:34 +0000 > From: "Chowdhury, Soumadri" <[email protected]> > Subject: [MarkLogic Dev General] MarkLogic DB Size estimation > To: "[email protected]" > <[email protected]> > Message-ID: > <9a63c2aad44d8a4db7d444877a5802a833d25...@svrndaexc01.noida.innodata.net> > > Content-Type: text/plain; charset="us-ascii" > > Hi, > > Can anyone help me understand how much the DB size can grow? I know that > because of indexing the DB size grows upto 3 times of the original data size. > But does the merge and re-indexing space (which can take 2x the DB size) > counted in the DB size or is it just the disk space which should be enough to > accommodate 2x the DB size. > > Regards, > Soumadri Roy > > > "This e-mail and any files transmitted with it are for the sole use of the > intended recipient(s) and may contain confidential and privileged > information. If you are not the intended recipient, please contact the sender > by reply e-mail and destroy all copies of the original message. Any > unauthorized review, use, disclosure, dissemination, forwarding, printing or > copying of this e-mail or any action taken in reliance on this e-mail is > strictly prohibited and may be unlawful." > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://developer.marklogic.com/pipermail/general/attachments/20130118/995e2d21/attachment-0001.html > > ------------------------------ > > Message: 2 > Date: Fri, 18 Jan 2013 14:48:47 +0100 > From: Geert Josten <[email protected]> > Subject: Re: [MarkLogic Dev General] MarkLogic DB Size estimation > To: MarkLogic Developer Discussion <[email protected]> > Message-ID: <[email protected]> > Content-Type: text/plain; charset="iso-8859-1" > > Hi Soumadri, > > > > Go to the host status page in the admin interface and look for the > cumulated (total) Forest Size value. That is the indication you are looking > for. > > > > Kind regards, > > Geert > > > > *Van:* [email protected] [mailto:gene > [email protected]] *Namens *Chowdhury, Soumadri > *Verzonden:* vrijdag 18 januari 2013 14:29 > *Aan:* [email protected] > *Onderwerp:* [MarkLogic Dev General] MarkLogic DB Size estimation > > > > Hi, > > > > Can anyone help me understand how much the DB size can grow? I know that > because of indexing the DB size grows upto 3 times of the original data > size. But does the merge and re-indexing space (which can take 2x the DB > size) counted in the DB size or is it just the disk space which should be > enough to accommodate 2x the DB size. > > > > Regards, > > Soumadri Roy > > > > > > "This e-mail and any files transmitted with it are for the sole use of the > intended recipient(s) and may contain confidential and privileged > information. If you are not the intended recipient, please contact the > sender by reply e-mail and destroy all copies of the original message. Any > unauthorized review, use, disclosure, dissemination, forwarding, printing > or copying of this e-mail or any action taken in reliance on this e-mail is > strictly prohibited and may be unlawful." > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://developer.marklogic.com/pipermail/general/attachments/20130118/5d26d731/attachment-0001.html > > ------------------------------ > > Message: 3 > Date: Fri, 18 Jan 2013 09:59:23 -0800 > From: Michael Blakeley <[email protected]> > Subject: Re: [MarkLogic Dev General] MarkLogic DB Size estimation > To: MarkLogic Developer Discussion <[email protected]> > Message-ID: <[email protected]> > Content-Type: text/plain; charset=us-ascii > > That "3x" number is just an approximation. Depending on your settings and > content it could be anywhere from 0.5x (yes, smaller than the original) to... > maybe 8x? Given that you can create as many fields as you like, there may be > no upper limit. > > The database size is the total size on disk. I'm not sure about active > merges, but merge space in general isn't included, and really ought to be up > to 3x the size of the fully-merged database. That's because you may sometimes > need to reindex the whole database, and during that process you are likely to > reach a point where you have N deleted fragments, N fragments, and need a > full merge to clean out the deleted fragments. > > The best way to find out how large your database will actually be is to > prototype. Load a significant fraction of your content in a single forest, > maybe 1-5% of what you expect to have per host, and develop your core > queries. Make any adjustments to the index configuration, then merge the > forest to one stand. Use that on-disk size to project the final size. > > -- Mike > > On 18 Jan 2013, at 05:28 , "Chowdhury, Soumadri" > <[email protected]> wrote: > >> Hi, >> >> Can anyone help me understand how much the DB size can grow? I know that >> because of indexing the DB size grows upto 3 times of the original data >> size. But does the merge and re-indexing space (which can take 2x the DB >> size) counted in the DB size or is it just the disk space which should be >> enough to accommodate 2x the DB size. >> >> Regards, >> Soumadri Roy >> >> >> "This e-mail and any files transmitted with it are for the sole use of the >> intended recipient(s) and may contain confidential and privileged >> information. If you are not the intended recipient, please contact the >> sender by reply e-mail and destroy all copies of the original message. Any >> unauthorized review, use, disclosure, dissemination, forwarding, printing or >> copying of this e-mail or any action taken in reliance on this e-mail is >> strictly prohibited and may be unlawful." >> _______________________________________________ >> General mailing list >> [email protected] >> http://developer.marklogic.com/mailman/listinfo/general > > > > ------------------------------ > > _______________________________________________ > General mailing list > [email protected] > http://developer.marklogic.com/mailman/listinfo/general > > > End of General Digest, Vol 103, Issue 23 > **************************************** "This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this e-mail or any action taken in reliance on this e-mail is strictly prohibited and may be unlawful." _______________________________________________ General mailing list [email protected] http://developer.marklogic.com/mailman/listinfo/general
