Hi Lars,
We have 10 Region Servers and 2 1TB on each. The table is not salted, but
we pre split regions when we bulk load so that we force equal distribution
of our data. the data is relatively distributed across our region servers,
with no one Region Server being the "long tail."
I don't have any metrics from Ganglia. We are running CDH on EC2, for what
it is work. The CPUs spike to 100% and IO jumps pretty equallyon the
Region Servers. Attached is the RS log from one of them when all I am
doing on the entire cluster is a COUNT in phoenix.
Thanks again for your help,
Abe
On Tue, Oct 14, 2014 at 3:10 AM, lars hofhansl <[email protected]> wrote:
> Back on the envelope math - assuming disks that can sustain 120mb/s -
> suggests you'd need about 17 disks 100% busy in total to pull 120gb off the
> disks in 60s. (i.e. at least 6 servers completely utilizing all of their
> disk). How many server do you have? HBase/HDFS will likely not quite max
> out all disks so your 10 machines are cutting that close.
>
> Not concerned about the 250 regions - at least not for this.
>
> Are all machines/disks/CPUs equally busy? Is the table salted?
> Note that HBase's block cache stores data uncompressed, and hence your
> dataset likely does not fit into the aggregate block cache. Your query
> might run sightly better with the /*+ NO_CACHE */ hint.
>
> Now from your 187541ms number, things look worse, though.
> Do you have OTSDB or Ganglia to record metrics of that cluster? If so can
> you share some graphs of IO/CPU during the query time.
> Any chance to attach a profiler to one of the busy region server, or at
> least get us stack trace?
>
> Thanks.
>
> -- Lars
>
> ------------------------------
> *From:* Abe Weinograd <[email protected]>
> *To:* user <[email protected]>; lars hofhansl <[email protected]>
> *Sent:* Monday, October 13, 2014 9:30 AM
>
> *Subject:* Re: count on large table
>
> Hi Lars,
>
> Thanks for following up.
>
> Table Size - 120G doing a du on HDFS. We are using Snappy compression on
> the table.
> Column Family - We have 1 column family for all columns and are using the
> Phoenix default one.
> Regions - right now we have a ton of regions (250) because we pre split to
> help out bulk loads. I haven't collapsed them yet, but in a DEV
> environment that is configured the same way, we have ~50 regions and
> experience the same performance issues. I am planning on squaring this
> away and trying again.
> Resource Utilization - Really high CPU usage on the region servers and
> noticing a spike in IO too.
>
> Based on your questions and what I know, the # of regions needs to be
> compacted first, though I am not sure this is going to solve my issue. the
> data nodes in HDFS have 3 1TB disks so I am not convinced that my IO is the
> bottleneck here.
>
> Thanks,
> Abe
>
>
>
> On Thu, Oct 9, 2014 at 8:36 PM, lars hofhansl <[email protected]> wrote:
>
> Hi Abe,
>
> this is interesting.
>
> How big are your rows (i.e. how much data is in the table, you tell with
> du in HDFS)? And how many columns do you have? Any column families?
> How many regions are in this table? (you can tell that through the HBase
> HMaster UI page)
> When you execute the query, are all HBase region servers busy? Do you see
> IO, or just high CPU?
>
> Client batching won't help with an aggregate (such as count) where not
> much data is transferred back to the client.
>
> Thanks.
>
> -- Lars
>
> ------------------------------
> *From:* Abe Weinograd <[email protected]>
> *To:* user <[email protected]>
> *Sent:* Wednesday, October 8, 2014 9:15 AM
> *Subject:* Re: count on large table
>
> Good point. I have to figure out how to do that in a SQL Tool like
> Squirrel or workbench.
>
> Is there any obvious thing i can do to help tune this? I know that's a
> loaded question. My client scanner batches are 1000 (also tried 10000 with
> no luck).
>
> Thanks,
> Abe
>
>
>
> On Tue, Oct 7, 2014 at 9:09 PM, [email protected] <
> [email protected]> wrote:
>
> Hi, Abe
> Maybe setting the following property would help...
> <property>
> <name>phoenix.query.timeoutMs</name>
> <value>3600000</value>
> </property>
>
> Thanks,
> Sun
>
> ------------------------------
> ------------------------------
>
> *From:* Abe Weinograd <[email protected]>
> *Date:* 2014-10-08 04:34
> *To:* user <[email protected]>
> *Subject:* count on large table
> I have a table with 1B rows. I know this can is very specific to my
> environment, but just doing a SELECT COUNT(1) on the table It never
> finished.
>
> We have a 10 node cluster with the RS's Heap size at 26GiB and skewed
> towards the block cache. In the RS logs, i see a lot of these:
>
> 2014-10-07 16:27:04,942 WARN org.apache.hadoop.ipc.RpcServer:
> (responseTooSlow):
> {"processingtimems":22770,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"
> 10.10.0.10:44791
> ","starttimems":1412713602172,"queuetimems":0,"class":"HRegionServer","responsesize":8,"method":"Scan"}
>
> They stop eventually, but i the query times out and the query tool
> reports: org.apache.phoenix.exception.PhoenixIOException: 187541ms passed
> since the last invocation, timeout is currently set to 60000
>
> Any ideas of where I can start in order to figure this out?
>
> using Phoenix 4.1 on CDH 5.1 (Hbase 0.98.1)
>
> Thanks,
> Abe
>
>
>
>
>
>
>
>
2014-10-21 08:42:56,709 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE2\\xBF+\\xEF\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE2\\xBF+\\xEF\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:42:56,711 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE2\\xBF+\\xEF\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC8","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE2\\xBF+\\xEF\\xD9\\x99\\x99\\x99\\x99\\x99\\x99\\x94","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:42:56,711 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x01\\x8B\\xC0L\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x01\\x8B\\xC0Y\\x99\\x99\\x99\\x99\\x99\\x99\\x8C","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:42:56,712 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE2\\xBF+\\xEF\\xA6ffffffd","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE2\\xBF+\\xEF\\xB33333330","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:42:56,715 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x01\\x8B\\xC0\\xA6ffffffd","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x01\\x8B\\xC0\\xB33333330","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:42:56,719 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x01\\x8B\\xC0\\xB33333330","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x01\\x8B\\xC0\\xBF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:42:56,722 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3=\\xF1O\\x0C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC4","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3=\\xF1O\\x19\\x99\\x99\\x99\\x99\\x99\\x99\\x90","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:42:56,730 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3=\\xF1O3333333(","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3=\\xF1O?\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:42:56,730 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3=\\xF1O\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3=\\xF1O\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:42:56,735 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3i\\x9A\\x80\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3i\\x9A\\x80\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:13,702 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3i\\x9A\\x80\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF8","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x9D\\xD6S\\x0C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:14,865 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 701550 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3i\\x9A\\x80\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3i\\x9A\\x80\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:14,877 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":18146,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895376731,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:43:17,194 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x9D\\xD6SfffffffX","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x9D\\xD6Ss333333$","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:24,892 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:25,475 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 657943 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE2\\xBF+\\xEF\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC8","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE2\\xBF+\\xEF\\xD9\\x99\\x99\\x99\\x99\\x99\\x99\\x94","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:25,476 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":28766,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895376710,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:43:26,929 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\x99\\x99\\x99\\x99\\x99\\x99\\x99\\x98","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:28,191 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\xB33333330","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\xBF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:29,517 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 658140 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE2\\xBF+\\xEF\\xA6ffffffd","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE2\\xBF+\\xEF\\xB33333330","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:29,530 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":32818,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895376712,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:43:30,462 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 658112 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE2\\xBF+\\xEF\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE2\\xBF+\\xEF\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:30,463 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":33754,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895376709,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:43:30,895 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\xD9\\x99\\x99\\x99\\x99\\x99\\x99\\x94","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\xE6ffffff`","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:33,761 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE8\\xEE\\xA9\\xF33333333(","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE8\\xEE\\xA9\\xF3?\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:36,270 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE8\\xEE\\xA9\\xF3\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE8\\xEE\\xA9\\xF3\\x99\\x99\\x99\\x99\\x99\\x99\\x99\\x98","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:36,408 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 812994 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x01\\x8B\\xC0L\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x01\\x8B\\xC0Y\\x99\\x99\\x99\\x99\\x99\\x99\\x8C","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:36,409 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":39698,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895376711,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:43:40,284 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 849347 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3=\\xF1O\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3=\\xF1O\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:40,286 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":43557,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895376729,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:43:40,774 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 814866 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x01\\x8B\\xC0\\xA6ffffffd","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x01\\x8B\\xC0\\xB33333330","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:40,780 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":44065,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895376715,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:43:40,978 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 852450 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3=\\xF1O3333333(","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3=\\xF1O?\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:40,985 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":44255,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895376729,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:43:40,988 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE8\\xEE\\xA9\\xF3\\xBF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFC","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE8\\xEE\\xA9\\xF3\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC8","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:41,088 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 814729 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x01\\x8B\\xC0\\xB33333330","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x01\\x8B\\xC0\\xBF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:41,088 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":44369,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895376719,"queuetimems":1,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:43:43,004 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 851685 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3=\\xF1O\\x0C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC4","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3=\\xF1O\\x19\\x99\\x99\\x99\\x99\\x99\\x99\\x90","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:43,005 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":46284,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895376721,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:43:44,982 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x0A`\\x12\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF8","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9#\\x8F\\xFB\\x0C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:47,804 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9#\\x8F\\xFB\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9#\\x8F\\xFB\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:43:50,642 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9#\\x8F\\xFB\\xE6ffffff`","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9#\\x8F\\xFB\\xF3333333,","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:22,002 WARN org.apache.hadoop.hbase.util.Sleeper: We slept
34963ms instead of 10000ms, this is likely due to a long garbage collecting
pause and it's usually bad, see
http://hbase.apache.org/book.html#trouble.rs.runtime.zkexpired
2014-10-21 08:44:22,002 WARN org.apache.hadoop.hbase.util.Sleeper: We slept
34963ms instead of 10000ms, this is likely due to a long garbage collecting
pause and it's usually bad, see
http://hbase.apache.org/book.html#trouble.rs.runtime.zkexpired
2014-10-21 08:44:22,005 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_fffffffX","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_s333333$","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:22,005 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_Y\\x99\\x99\\x99\\x99\\x99\\x99\\x8C","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_fffffffX","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:22,005 WARN org.apache.hadoop.hbase.util.JvmPauseMonitor:
Detected pause in JVM or host machine (eg GC): pause of approximately 30363ms
GC pool 'ParNew' had collection(s): count=3 time=260ms
GC pool 'ConcurrentMarkSweep' had collection(s): count=2 time=30364ms
2014-10-21 08:44:22,005 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_L\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_Y\\x99\\x99\\x99\\x99\\x99\\x99\\x8C","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:22,004 INFO org.apache.zookeeper.ClientCnxn: Client session
timed out, have not heard from server in 50156ms for sessionid
0x248c7bdecf38118, closing socket connection and attempting reconnect
2014-10-21 08:44:22,004 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_?\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF4","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_L\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC0","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:22,004 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\x19\\x99\\x99\\x99\\x99\\x99\\x99\\x90","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_&ffffff\\x5C","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:22,004 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9d\\xE96\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF8","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\x0C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:22,004 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9D\\x08S\\xE6ffffff`","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9D\\x08S\\xF3333333,","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:22,002 WARN org.apache.hadoop.hbase.util.Sleeper: We slept
31343ms instead of 3000ms, this is likely due to a long garbage collecting
pause and it's usually bad, see
http://hbase.apache.org/book.html#trouble.rs.runtime.zkexpired
2014-10-21 08:44:22,629 INFO org.apache.zookeeper.ClientCnxn: Opening socket
connection to server <MYSERVER>/<MYSERVER>:2181. Will not attempt to
authenticate using SASL (unknown error)
2014-10-21 08:44:22,630 INFO org.apache.zookeeper.ClientCnxn: Socket connection
established to <MYSERVER>/<MYSERVER>:2181, initiating session
2014-10-21 08:44:22,631 INFO org.apache.zookeeper.ClientCnxn: Session
establishment complete on server <MYSERVER>/<MYSERVER>:2181, sessionid =
0x248c7bdecf38118, negotiated timeout = 60000
2014-10-21 08:44:23,085 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_s333333$","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:25,033 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\x99\\x99\\x99\\x99\\x99\\x99\\x99\\x98","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\xA6ffffffd","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:27,975 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\xA6ffffffd","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\xB33333330","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:30,213 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\xB33333330","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\xBF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:31,565 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9AY\\x99\\x99\\x99\\x99\\x99\\x99\\x8C","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9AfffffffX","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:31,832 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 685580 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3i\\x9A\\x80\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF8","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x9D\\xD6S\\x0C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:31,851 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":78150,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895393701,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:44:32,737 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9A\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9A\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:34,902 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9A\\xA6ffffffd","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9A\\xB33333330","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:36,421 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9A\\xF3333333,","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9A\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF8","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:38,677 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9A\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF8","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xB4zT\\x0C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:42,753 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 685077 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x9D\\xD6SfffffffX","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\x9D\\xD6Ss333333$","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:42,762 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":85569,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895397193,"queuetimems":2,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:44:42,766 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xB4zT\\x19\\x99\\x99\\x99\\x99\\x99\\x99\\x90","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xB4zT&ffffff\\x5C","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:44,877 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 659646 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:44,932 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":80040,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895404891,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:44:44,935 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xB4zT3333333(","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xB4zT?\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:45,208 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 659519 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\xB33333330","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\xBF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:45,209 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":77018,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895408190,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:44:45,878 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 660572 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\x99\\x99\\x99\\x99\\x99\\x99\\x99\\x98","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:45,883 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":78954,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895406929,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:44:45,887 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xB4zTL\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xB4zTY\\x99\\x99\\x99\\x99\\x99\\x99\\x8C","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:46,599 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xB4zT\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xB4zT\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:48,456 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xB4zT\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xB4zT\\x99\\x99\\x99\\x99\\x99\\x99\\x99\\x98","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:50,142 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xB4zT\\xE6ffffff`","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xB4zT\\xF3333333,","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:51,467 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xCA\\xA7\\xDF3333333(","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xCA\\xA7\\xDF?\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:53,557 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 660037 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\xD9\\x99\\x99\\x99\\x99\\x99\\x99\\x94","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE3\\xFB\\x17\\xB9\\xE6ffffff`","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:53,558 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":82664,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895410894,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:44:53,634 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xCA\\xA7\\xDFL\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xCA\\xA7\\xDFY\\x99\\x99\\x99\\x99\\x99\\x99\\x8C","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:54,579 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 636804 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE8\\xEE\\xA9\\xF33333333(","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE8\\xEE\\xA9\\xF3?\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:54,583 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":80823,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895413760,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:44:54,584 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xCA\\xA7\\xDFfffffffX","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xCA\\xA7\\xDFs333333$","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:59,805 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 635500 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE8\\xEE\\xA9\\xF3\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE8\\xEE\\xA9\\xF3\\x99\\x99\\x99\\x99\\x99\\x99\\x99\\x98","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:44:59,827 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":83558,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895416269,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:44:59,828 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xCA\\xA7\\xDF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF8","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80d\\x0C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:06,360 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 635346 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE8\\xEE\\xA9\\xF3\\xBF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFC","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE8\\xEE\\xA9\\xF3\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC8","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:06,362 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":85375,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895420987,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:06,363 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80d3333333(","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80d?\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:29,136 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 716423 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_?\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF4","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_L\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC0","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:29,138 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":67134,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895462004,"queuetimems":1,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:29,139 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80dL\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80dY\\x99\\x99\\x99\\x99\\x99\\x99\\x8C","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:30,198 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 708797 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9D\\x08S\\xE6ffffff`","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9D\\x08S\\xF3333333,","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:30,199 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":68196,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895462003,"queuetimems":1,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:30,200 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80dfffffffX","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80ds333333$","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:31,840 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 716010 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_fffffffX","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_s333333$","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:31,841 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":69836,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895462005,"queuetimems":2,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:31,842 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80ds333333$","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80d\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:32,280 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 714173 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9d\\xE96\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF8","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\x0C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:32,307 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":70304,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895462003,"queuetimems":1,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:32,308 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80d\\x99\\x99\\x99\\x99\\x99\\x99\\x99\\x98","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80d\\xA6ffffffd","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:32,932 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 716046 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_s333333$","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:32,937 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":69852,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895463085,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:32,938 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80d\\xD9\\x99\\x99\\x99\\x99\\x99\\x99\\x94","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80d\\xE6ffffff`","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:33,686 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 716973 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_L\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_Y\\x99\\x99\\x99\\x99\\x99\\x99\\x8C","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:33,697 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":71692,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895462004,"queuetimems":1,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:33,697 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80d\\xE6ffffff`","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80d\\xF3333333,","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:33,717 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 715763 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\x19\\x99\\x99\\x99\\x99\\x99\\x99\\x90","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_&ffffff\\x5C","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:33,800 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":71796,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895462004,"queuetimems":1,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:33,801 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\xE6\\x80d\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF8","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x84\\x0C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:34,944 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 715623 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_Y\\x99\\x99\\x99\\x99\\x99\\x99\\x8C","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_fffffffX","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:34,978 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":72972,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895462005,"queuetimems":2,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:34,979 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x84\\x0C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC4","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x84\\x19\\x99\\x99\\x99\\x99\\x99\\x99\\x90","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:35,760 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 807717 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x0A`\\x12\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF8","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9#\\x8F\\xFB\\x0C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC4","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:35,786 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":110805,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895424981,"queuetimems":1,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:35,787 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x84&ffffff\\x5C","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x843333333(","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:38,057 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 716407 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\x99\\x99\\x99\\x99\\x99\\x99\\x99\\x98","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\xA6ffffffd","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:38,061 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":73029,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895465032,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:38,062 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x84?\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF4","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x84L\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC0","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:39,474 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 661029 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9AY\\x99\\x99\\x99\\x99\\x99\\x99\\x8C","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9AfffffffX","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:39,478 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":67914,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895471564,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:39,489 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x84L\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xC0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x84Y\\x99\\x99\\x99\\x99\\x99\\x99\\x8C","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:41,667 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 661126 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9A\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9A\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:41,671 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":68934,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895472737,"queuetimems":1,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:41,671 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x84s333333$","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x84\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:42,757 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 807049 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9#\\x8F\\xFB\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9#\\x8F\\xFB\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:42,762 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":114955,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895427803,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:42,763 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x84\\x7F\\xFF\\xFF\\xFF\\xFF\\xFF\\xFF\\xF0","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x84\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:43,198 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 716124 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\xA6ffffffd","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x80\\x92_\\xB33333330","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:43,215 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":75241,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895467974,"queuetimems":0,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:43,216 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Starting
ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x84\\x8C\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC\\xCC","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xEA\\x04.\\x84\\x99\\x99\\x99\\x99\\x99\\x99\\x99\\x98","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:44,283 INFO
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver: Finished
scanning 660528 rows for ungrouped coprocessor scan
{"timeRange":[0,1413895376662],"batch":-1,"startRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9A\\xA6ffffffd","stopRow":"\\x02\\xFA\\xF0\\x80\\x00\\x00\\x01H\\xE9\\x9E\\x94\\x9A\\xB33333330","loadColumnFamiliesOnDemand":true,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter":"FirstKeyOnlyFilter","caching":-1}
2014-10-21 08:45:44,285 WARN org.apache.hadoop.ipc.RpcServer:
(responseTooSlow):
{"processingtimems":69384,"call":"Scan(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest)","client":"<MYCLIENT>:51062","starttimems":1413895474901,"queuetimems":18,"class":"HRegionServer","responsesize":10,"method":"Scan"}
2014-10-21 08:45:44,350 INF
