Thnx for sharing! Would be a nice addition to the Admin interface.. Cheers
> -----Oorspronkelijk bericht----- > Van: [email protected] [mailto:general- > [email protected]] Namens Gary Vidal > Verzonden: dinsdag 28 januari 2014 19:34 > Aan: [email protected] > Onderwerp: Re: [MarkLogic Dev General] Size of an index > > Ravinder, > > Here is a partial implementation of how to calculate on-disk size of each > index. There are some issues I have not figured out to resolve all index > types(geospatial) but should give you a good sense of the size of each index > (it assumes all data is in a single host), but will look into each forest > directory and sum the size. If interested I will post to github for further > updates. > > What it returns is something like this: > > > <range-index-statistics> > <all-indexes-size> > 789680 > </all-indexes-size> > <element-indexes-size> > 747608 > </element-indexes-size> > <attribute-indexes-size> > 0 > </attribute-indexes-size> > <field-indexes-size> > 0 > </field-indexes-size> > <path-indexes-size> > 42072 > </path-indexes-size> > <range-indexes> > <element-range-index> > <key> > 6ac11acd756cd4da-string > </key> > <namespace-uri> > http://marklogic.com/content-analyzer > </namespace-uri> > <localname> > attribute-localname > </localname> > <collation> > http://marklogic.com/collation/codepoint > </collation> > <type> > string > </type> > <size> > 2048 > </size> > <file-count> > 4 > </file-count> > </element-range-index> > <element-range-index> > <key> > b6ae2f8eb8298059-string > </key> > <namespace-uri> > http://marklogic.com/content-analyzer > </namespace-uri> > <localname> > attribute-namespace > </localname> > <collation> > http://marklogic.com/collation/codepoint > </collation> > <type> > string > </type> > <size> > 2048 > </size> > <file-count> > 4 > </file-count> > </element-range-index> > <element-range-index> > <key> > a2e0f65bb0efec5a-string > </key> > <namespace-uri> > http://marklogic.com/content-analyzer > </namespace-uri> > <localname> > child-localname > </localname> > <collation> > http://marklogic.com/collation/codepoint > </collation> > <type> > string > </type> > <size> > 13064 > </size> > <file-count> > 4 > </file-count> > </element-range-index> > <element-range-index> > <key> > eece0b1cf3ac97d9-string > </key> > <namespace-uri> > http://marklogic.com/content-analyzer > </namespace-uri> > <localname> > child-namespace > </localname> > <collation> > http://marklogic.com/collation/codepoint > </collation> > <type> > string > </type> > <size> > 13064 > </size> > <file-count> > 4 > </file-count> > </element-range-index> > <element-range-index> > <key> > 96bf2bc6589a5bb2-dateTime > </key> > > > > Regards, > > > Gary Vidal > Media Consultant > MarkLogic Corporation > [email protected] > Phone: +1 917 576-5794 > Skype: ml-garyvidal > www.marklogic.com > > -----Original Message----- > From: [email protected] [mailto:general- > [email protected]] On Behalf Of general- > [email protected] > Sent: Tuesday, January 28, 2014 3:00 PM > To: [email protected] > Subject: General Digest, Vol 115, Issue 32 > > Send General mailing list submissions to > [email protected] > > To subscribe or unsubscribe via the World Wide Web, visit > http://developer.marklogic.com/mailman/listinfo/general > or, via email, send a message with subject or body 'help' to > [email protected] > > You can reach the person managing the list at > [email protected] > > When replying, please edit your Subject line so it is more specific than "Re: > Contents of General digest..." > > > Today's Topics: > > 1. Re: Size of an index (RAVINDER MAAN) (Paul M) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Mon, 27 Jan 2014 10:28:43 -0800 (PST) > From: Paul M <[email protected]> > Subject: Re: [MarkLogic Dev General] Size of an index (RAVINDER MAAN) > To: "[email protected]" > <[email protected]> > Message-ID: > <[email protected] > > > Content-Type: text/plain; charset="iso-8859-1" > > What tasks are you trying to accomplish that requires knowing the size of an > index on disk? There may be? solutions other than definitive size of index. > > -Paul > > > > ________________________________ > From: "[email protected]" <general- > [email protected]> > To: [email protected] > Sent: Saturday, January 25, 2014 3:00 PM > Subject: General Digest, Vol 115, Issue 31 > > > Send General mailing list submissions to > ??? [email protected] > > To subscribe or unsubscribe via the World Wide Web, visit > ??? http://developer.marklogic.com/mailman/listinfo/general > or, via email, send a message with subject or body 'help' to > ??? [email protected] > > You can reach the person managing the list at > ??? [email protected] > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of General digest..." > > > Today's Topics: > > ? 1. Size of an index (RAVINDER MAAN) > ? 2. Re: Size of an index (Danny Sokolsky) > ? 3. Re: Size of an index (Geert J.) > ? 4. Re: Size of an index (Michael Blakeley) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Fri, 24 Jan 2014 19:41:27 +0000 > From: RAVINDER MAAN <[email protected]> > Subject: [MarkLogic Dev General] Size of an index > To: [email protected] > Message-ID: > ??? <CAFuTbAJ=m7g+YHYS- > [email protected]> > Content-Type: text/plain; charset="iso-8859-1" > > Hi all > Is threre any way to find the size of an index on disk? > > Thanks > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://developer.marklogic.com/pipermail/general/attachments/20140124/9 > 8c5aaaa/attachment-0001.html > > ------------------------------ > > Message: 2 > Date: Fri, 24 Jan 2014 21:12:33 +0000 > From: Danny Sokolsky <[email protected]> > Subject: Re: [MarkLogic Dev General] Size of an index > To: MarkLogic Developer Discussion <[email protected]> > Message-ID: > ??? <D4F697174C071D46B891B38BFC6EAFA61492F0@EXCHG10- > BE01.marklogic.com> > Content-Type: text/plain; charset="us-ascii" > > You can look at the size of the database, either in the database status page > or using xdmp:forest-status and/or xdmp:forest-counts for each forest in the > database.? If you add an index or change index settings for a database, you > can compare the sizes before and after (although merges will make the size > somewhat variable). > > -Danny > > From: [email protected] [mailto:general- > [email protected]] On Behalf Of RAVINDER MAAN > Sent: Friday, January 24, 2014 11:41 AM > To: [email protected] > Subject: [MarkLogic Dev General] Size of an index > > > Hi all > Is threre any way to find the size of an index on disk? > > Thanks > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://developer.marklogic.com/pipermail/general/attachments/20140124/1 > 9e06872/attachment-0001.html > > ------------------------------ > > Message: 3 > Date: Fri, 24 Jan 2014 23:13:59 +0100 > From: "Geert J." <[email protected]> > Subject: Re: [MarkLogic Dev General] Size of an index > To: MarkLogic Developer Discussion <[email protected]> > Message-ID: <[email protected]> > Content-Type: text/plain; charset="iso-8859-1" > > Hi Ravinder, > > > > The forest files in the MarkLogic data directory have a direct relation to > the indexes, so you could also simply look there. Most notably the ones > with a hash at the beginning of their name. You can read the type directly > from the filenames. Guessing which file belongs to which index is harder. > There is a kind of logic, but that goes beyond my comprehension. Maybe > someone from inside MarkLogic would be willing to reveal some details > about > this? > > > > Cheers, > > Geert > > > > *Van:* [email protected] [mailto:general- > [email protected]] *Namens *Danny Sokolsky > *Verzonden:* vrijdag 24 januari 2014 22:13 > *Aan:* MarkLogic Developer Discussion > *Onderwerp:* Re: [MarkLogic Dev General] Size of an index > > > > You can look at the size of the database, either in the database status > page or using xdmp:forest-status and/or xdmp:forest-counts for each forest > in the database.? If you add an index or change index settings for a > database, you can compare the sizes before and after (although merges will > make the size somewhat variable). > > > > -Danny > > > > *From:* [email protected] [ > mailto:[email protected]<general- > [email protected]>] > *On Behalf Of *RAVINDER MAAN > *Sent:* Friday, January 24, 2014 11:41 AM > *To:* [email protected] > *Subject:* [MarkLogic Dev General] Size of an index > > > > Hi all > Is threre any way to find the size of an index on disk? > > Thanks > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://developer.marklogic.com/pipermail/general/attachments/20140124/6 > f77fbc4/attachment-0001.html > > ------------------------------ > > Message: 4 > Date: Fri, 24 Jan 2014 14:28:04 -0800 > From: Michael Blakeley <[email protected]> > Subject: Re: [MarkLogic Dev General] Size of an index > To: MarkLogic Developer Discussion <[email protected]> > Message-ID: <[email protected]> > Content-Type: text/plain; charset=iso-8859-1 > > Those individual files are scalar indexes: element-value, geospatial, etc. All > the default indexing goes into the hash-based universal index, which is even > more opaque. > > -- Mike > > On 24 Jan 2014, at 14:13 , Geert J. <[email protected]> wrote: > > > Hi Ravinder, > >? > > The forest files in the MarkLogic data directory have a direct relation to the > indexes, so you could also simply look there. Most notably the ones with a > hash at the beginning of their name. You can read the type directly from the > filenames. Guessing which file belongs to which index is harder. There is a > kind of logic, but that goes beyond my comprehension. Maybe someone > from inside MarkLogic would be willing to reveal some details about this? > >? > > Cheers, > > Geert > >? > > Van: [email protected] [mailto:general- > [email protected]] NamensDanny Sokolsky > > Verzonden: vrijdag 24 januari 2014 22:13 > > Aan: MarkLogic Developer Discussion > > Onderwerp: Re: [MarkLogic Dev General] Size of an index > >? > > You can look at the size of the database, either in the database status > page or using xdmp:forest-status and/or xdmp:forest-counts for each forest > in the database.? If you add an index or change index settings for a > database, you can compare the sizes before and after (although merges will > make the size somewhat variable). > >? > > -Danny > >? > > From: [email protected] [mailto:general- > [email protected]] On Behalf Of RAVINDER MAAN > > Sent: Friday, January 24, 2014 11:41 AM > > To: [email protected] > > Subject: [MarkLogic Dev General] Size of an index > >? > > Hi all > > Is threre any way to find the size of an index on disk? > > > > Thanks > > > > _______________________________________________ > > General mailing list > > [email protected] > > http://developer.marklogic.com/mailman/listinfo/general > > > > ------------------------------ > > _______________________________________________ > General mailing list > [email protected] > http://developer.marklogic.com/mailman/listinfo/general > > > End of General Digest, Vol 115, Issue 31 > **************************************** > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://developer.marklogic.com/pipermail/general/attachments/20140127/b > f908b2d/attachment-0001.html > > ------------------------------ > > _______________________________________________ > General mailing list > [email protected] > http://developer.marklogic.com/mailman/listinfo/general > > > End of General Digest, Vol 115, Issue 32 > **************************************** _______________________________________________ General mailing list [email protected] http://developer.marklogic.com/mailman/listinfo/general
