On Mon, May 23, 2011 at 6:40 AM, Wayne <[email protected]> wrote: > In order to reduce the total number of regions we have up'd the max region > size to 5g. This has kept us below 100 regions per node but the side affect > is pauses occurring every 1-2 min under heavy writes to a single region. We > see the "too many store files delaying flush up to 90sec" warning every > couple of minutes. We have upped the size of the memstore flush size (256m) > as well as upped the blockingstorefiles (15) but these pauses > are occurring more than writes are occurring. In the end our write > through-put has degraded considerably. >
How many column families? Pastebin a regionserver log. You could up the number of store files before we put up the blocking writes gate but then you might have runaway files to compact. St.Ack
