-Hour Periodic Network/CPU/Disk/Latency Spikes
Ah, sorry about the attachment (didn't realize they weren't allowed).
Here's the picture I was trying to attach:
http://www.plainlystated.com/hbase_major_compactions.png
It sounds like you're right, Vladimir, about the compaction storm, though I
Have you taken a look at the logs on the RegionServers during the period?
One possibility is compactions happening organically. If you were
sustaining a certain level of writes most of the time, I could maybe see
that every 3 hours enough store files build up to require compactions.
There's
Very interesting, I think we may be on to something. I grabbed all the
timestamps for major compactions completing and put them on a graph (see
attached). Each horizontal line is an individual server, and the dots are
when compactions complete. Each server clearly has a cluster of compactions
Patrick:
Attachment didn't go through.
Cheers
On Dec 13, 2013, at 3:18 PM, Patrick Schless patrick.schl...@gmail.com wrote:
Very interesting, I think we may be on to something. I grabbed all the
timestamps for major compactions completing and put them on a graph (see
attached). Each
,
Vladimir Rodionov
Principal Platform Engineer
Carrier IQ, www.carrieriq.com
e-mail: vrodio...@carrieriq.com
From: Ted Yu [yuzhih...@gmail.com]
Sent: Friday, December 13, 2013 3:33 PM
To: user@hbase.apache.org
Cc: user
Subject: Re: 3-Hour Periodic Network/CPU
[yuzhih...@gmail.com]
Sent: Friday, December 13, 2013 3:33 PM
To: user@hbase.apache.org
Cc: user
Subject: Re: 3-Hour Periodic Network/CPU/Disk/Latency Spikes
Patrick:
Attachment didn't go through.
Cheers
On Dec 13, 2013, at 3:18 PM, Patrick Schless patrick.schl...@gmail.com
wrote:
Very
Engineer
Carrier IQ, www.carrieriq.com
e-mail: vrodio...@carrieriq.com
From: Patrick Schless [patrick.schl...@gmail.com]
Sent: Friday, December 13, 2013 4:36 PM
To: user
Subject: Re: 3-Hour Periodic Network/CPU/Disk/Latency Spikes
Ah, sorry about
