Hi Lex,
We had a similar issue with our S3 bucket growing in size and we wrote our
own cleaner. The cleaner first looks at the HFiles required by the current
snapshots. We then figure out which snapshots we no longer want (for
example snapshots older than a week or whatever rules you want). Then
downside have you observed for #1 ?
>
> Cheers
>
> On Fri, Jan 13, 2017 at 2:07 PM, Timothy Brown <t...@siftscience.com>
> wrote:
>
> > I tried it out on our staging cluster and saw that the total number of
> > requests per region server a bit more balanced with our
Hi,
I have a couple of questions about the StochasticLoadBalancer.
1) In CostFromRegionLoadFunction.getRegionLoadCost the cost is weights
later samples of the RegionLoad more than previous ones. For example, with
a queue size of 4 it would be (.5 * load1 + .25*load2 + .125*load3 +
.125*load4).
at 8:43 PM, Stack <st...@duboce.net> wrote:
> On Thu, Dec 1, 2016 at 3:48 PM, Timothy Brown <t...@siftscience.com> wrote:
> >
> > >
> > >
> > If you turn on RPC-level TRACE logging for a minute or so, anything about
> > > the client addres
Thanks for the help. I've added some more responses inline.
On Tue, Nov 29, 2016 at 9:51 PM, Stack <st...@duboce.net> wrote:
> On Mon, Nov 28, 2016 at 10:25 AM, Timothy Brown <t...@siftscience.com>
> wrote:
>
> > Responses inlined.
> >
> > ...
>
>
Responses inlined.
On Mon, Nov 28, 2016 at 12:45 PM, Stack <st...@duboce.net> wrote:
> On Sun, Nov 27, 2016 at 6:53 PM, Timothy Brown <t...@siftscience.com>
> wrote:
>
> > Hi Everyone,
> >
> > I apologize for starting an additional thread about this b
ther servers ?
> Did you find anything interesting in the server log (where hbase:meta is
> hosted) ?
> Have you tried major compacting the hbase:meta table ?
> In 1.2, DEFAULT_HBASE_META_VERSIONS is still 10. See HBASE-16832
>
>
> On Sunday, November 27, 2016 6:53 PM, Timot
Hi Everyone,
I apologize for starting an additional thread about this but I wasn't
subscribed to the users mailing list when I sent the original and can't
figure out how to respond to the original :(
Original Message:
We are seeing about 80% CPU utilization on the Region Server that solely
Hi,
We are seeing about 80% CPU utilization on the Region Server that solely
serves the meta table while other region servers typically have under 50%
CPU utilization. Is this expected?
Here's some more info about our cluster:
HBase version 1.2
Number of regions: 72
Number of tables: 97
Approx.
