On Fri, Dec 18, 2015 at 7:26 AM, Enrico Olivelli - Diennea < [email protected]> wrote:
> Thank you very much > > > > We got a work-around for our problem. Our bookies could not run Compaction > due to errors on listing /ledgers. > > > > It was not possible to scan list of ledgers in any way because of > zookeeper limits (see https://issues.apache.org/jira/browse/BOOKKEEPER-39 > and similar issues) > > > > Our work-around is to scan ledgers list doing a “blind” ledgerId scan from > 1 to 1.700.000 in order to find existing ledgerIDs and then dropping ledger > which were no more in use. > > We found that a procedure was “leaking” ledgers, it was never dropping > ledgers, so our system got overhelmed. > > > > Once the clean up operation completed the Compation run instantly and we > released several GBs of space on bookies > > > > Now the list of ledgers is really more affordable by FlatLedgersManager > and so we have some more time > > > > We would like to migrate to HierarchicalLederManager anyway in order not > to have such problems in the future, provided that our systems are growing > and bookkeeper is one of the fundamental pieces or our infrastructure > Good to hear that. That's a very impression action from your description. Let me work with you to complete the migration from FlatLedgerManager to HierarchicalLedgerManager. > > > -- Enrico > > > > *Da:* Sijie Guo [mailto:[email protected]] > *Inviato:* giovedì 17 dicembre 2015 19:41 > *A:* [email protected] > *Oggetto:* Re: BOOKKEEPER-878 > > > > Hello Enrico: > > Sorry for the delays. Trying to get to it today. > > - Sijie > > > > On Thu, Dec 17, 2015 at 3:54 AM, Enrico Olivelli - Diennea < > [email protected]> wrote: > > Hi, > > Any news on the switch from FlagLedgerManager to HierarchicalLedgerManager > ? > > https://issues.apache.org/jira/browse/BOOKKEEPER-878 > > > > we deployed today in production systems Bookkeeper 4.3.2 and it is working > very fine > > > > we hope that a switch is possible because our production systems Bookies > are continuing to eat disk space, because /ledgers is huge and > GarbageCollector cannot perform its work > > > > Thank you very much > > > > > > *Enrico Olivelli* > Software Development Manager @Diennea > Tel.: (+39) 0546 066100 - Int. 925 > Viale G.Marconi 30/14 - 48018 Faenza (RA) > > MagNews - E-mail Marketing Solutions > http://www.magnews.it > Diennea - Digital Marketing Solutions > http://www.diennea.com > > > > > ------------------------------ > > Iscriviti alla nostra newsletter per rimanere aggiornato su digital ed > email marketing! http://www.magnews.it/newsletter/ > > The information in this email is confidential and may be legally > privileged. If you are not the intended recipient please notify the sender > immediately and destroy this email. Any unauthorized, direct or indirect, > disclosure, copying, storage, distribution or other use is strictly > forbidden. > > > > ------------------------------ > Iscriviti alla nostra newsletter per rimanere aggiornato su digital ed > email marketing! http://www.magnews.it/newsletter/ > > The information in this email is confidential and may be legally > privileged. If you are not the intended recipient please notify the sender > immediately and destroy this email. Any unauthorized, direct or indirect, > disclosure, copying, storage, distribution or other use is strictly > forbidden. >
