2014-11-25 13:31:35,048 DEBUG [RpcServer.handler=39,port=60020] regionserver.HRegion: Flush requested on usertable2,user8289,1416889268210.7e8fd83bb34b155bd0385aa63124a875.
2014-11-25 13:31:35,048 WARN  [MemStoreFlusher.13] regionserver.MemStoreFlusher: Region usertable2,user8289,1416889268210.7e8fd83bb34b155bd0385aa63124a875. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,048 DEBUG [MemStoreFlusher.13] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.13; compaction_queue=(0:5019), split_queue=0, merge_queue=0
2014-11-25 13:31:35,048 DEBUG [RpcServer.handler=112,port=60020] regionserver.HRegion: Flush requested on usertable2,user4239,1416889268210.e521da13cf88c7e5aa481035feae21e5.
2014-11-25 13:31:35,049 WARN  [MemStoreFlusher.17] regionserver.MemStoreFlusher: Region usertable2,user4239,1416889268210.e521da13cf88c7e5aa481035feae21e5. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,049 DEBUG [MemStoreFlusher.17] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.17; compaction_queue=(0:5020), split_queue=0, merge_queue=0
2014-11-25 13:31:35,391 DEBUG [RpcServer.handler=39,port=60020] regionserver.HRegion: Flush requested on usertable2,user8739,1416889268210.10fbbcf2b6f1389e433a4a5211bf2642.
2014-11-25 13:31:35,391 WARN  [MemStoreFlusher.21] regionserver.MemStoreFlusher: Region usertable2,user8739,1416889268210.10fbbcf2b6f1389e433a4a5211bf2642. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,391 DEBUG [MemStoreFlusher.21] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.21; compaction_queue=(0:5021), split_queue=0, merge_queue=0
2014-11-25 13:31:35,417 DEBUG [RpcServer.handler=91,port=60020] regionserver.HRegion: Flush requested on usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da.
2014-11-25 13:31:35,417 WARN  [MemStoreFlusher.25] regionserver.MemStoreFlusher: Region usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,417 DEBUG [MemStoreFlusher.25] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.25; compaction_queue=(0:5022), split_queue=0, merge_queue=0
2014-11-25 13:31:35,421 DEBUG [RpcServer.handler=112,port=60020] regionserver.HRegion: Flush requested on usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159.
2014-11-25 13:31:35,421 WARN  [MemStoreFlusher.38] regionserver.MemStoreFlusher: Region usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,421 DEBUG [MemStoreFlusher.38] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.38; compaction_queue=(0:5023), split_queue=0, merge_queue=0
2014-11-25 13:31:35,502 DEBUG [RpcServer.handler=77,port=60020] regionserver.HRegion: Flush requested on usertable2,user1179,1416889268210.96f75ffeebd3920fdcae7936024334d9.
2014-11-25 13:31:35,502 WARN  [MemStoreFlusher.28] regionserver.MemStoreFlusher: Region usertable2,user1179,1416889268210.96f75ffeebd3920fdcae7936024334d9. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,503 DEBUG [MemStoreFlusher.28] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.28; compaction_queue=(0:5024), split_queue=0, merge_queue=0
2014-11-25 13:31:35,528 DEBUG [RpcServer.handler=135,port=60020] regionserver.HRegion: Flush requested on usertable2,user3789,1416889268210.4cbd9216f88e34160a388d0cd31c622c.
2014-11-25 13:31:35,528 WARN  [MemStoreFlusher.22] regionserver.MemStoreFlusher: Region usertable2,user3789,1416889268210.4cbd9216f88e34160a388d0cd31c622c. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,529 DEBUG [MemStoreFlusher.22] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.22; compaction_queue=(0:5025), split_queue=0, merge_queue=0
2014-11-25 13:31:35,581 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:35,770 DEBUG [RpcServer.handler=118,port=60020] regionserver.HRegion: Flush requested on usertable2,user1989,1416889268210.5f25bd0630c80f4e811af5f6488c5a89.
2014-11-25 13:31:35,770 WARN  [MemStoreFlusher.30] regionserver.MemStoreFlusher: Region usertable2,user1989,1416889268210.5f25bd0630c80f4e811af5f6488c5a89. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,770 DEBUG [MemStoreFlusher.30] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.30; compaction_queue=(0:5026), split_queue=0, merge_queue=0
2014-11-25 13:31:35,810 DEBUG [RpcServer.handler=44,port=60020] regionserver.HRegion: Flush requested on usertable2,user1539,1416889268210.cc10fb31d8cc1e28a698092d6c1a5416.
2014-11-25 13:31:35,810 WARN  [MemStoreFlusher.2] regionserver.MemStoreFlusher: Region usertable2,user1539,1416889268210.cc10fb31d8cc1e28a698092d6c1a5416. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,810 DEBUG [MemStoreFlusher.2] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.2; compaction_queue=(0:5027), split_queue=0, merge_queue=0
2014-11-25 13:31:35,817 DEBUG [RpcServer.handler=61,port=60020] regionserver.HRegion: Flush requested on usertable2,user1629,1416889268210.7573f845d035393053c158d59b42c9e2.
2014-11-25 13:31:35,817 WARN  [MemStoreFlusher.27] regionserver.MemStoreFlusher: Region usertable2,user1629,1416889268210.7573f845d035393053c158d59b42c9e2. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,817 DEBUG [MemStoreFlusher.27] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.27; compaction_queue=(0:5028), split_queue=0, merge_queue=0
2014-11-25 13:31:35,859 DEBUG [RpcServer.handler=58,port=60020] regionserver.HRegion: Flush requested on usertable2,user4149,1416889268210.c068f0d848be8a8d9b2a90f612ef94a1.
2014-11-25 13:31:35,859 WARN  [MemStoreFlusher.4] regionserver.MemStoreFlusher: Region usertable2,user4149,1416889268210.c068f0d848be8a8d9b2a90f612ef94a1. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,859 DEBUG [MemStoreFlusher.4] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.4; compaction_queue=(0:5029), split_queue=0, merge_queue=0
2014-11-25 13:31:35,861 DEBUG [RpcServer.handler=61,port=60020] regionserver.HRegion: Flush requested on usertable2,user2169,1416889268210.a6d76b3d9a5a10e578fccc6098a8444b.
2014-11-25 13:31:35,861 WARN  [MemStoreFlusher.14] regionserver.MemStoreFlusher: Region usertable2,user2169,1416889268210.a6d76b3d9a5a10e578fccc6098a8444b. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,862 DEBUG [MemStoreFlusher.14] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.14; compaction_queue=(0:5030), split_queue=0, merge_queue=0
2014-11-25 13:31:35,870 DEBUG [RpcServer.handler=58,port=60020] regionserver.HRegion: Flush requested on usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4.
2014-11-25 13:31:35,870 WARN  [MemStoreFlusher.39] regionserver.MemStoreFlusher: Region usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,870 DEBUG [MemStoreFlusher.39] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.39; compaction_queue=(0:5031), split_queue=0, merge_queue=0
2014-11-25 13:31:35,874 DEBUG [RpcServer.handler=137,port=60020] regionserver.HRegion: Flush requested on usertable2,user9099,1416889268210.66f19c7f25bc31928ead99dff847aa7f.
2014-11-25 13:31:35,874 WARN  [MemStoreFlusher.36] regionserver.MemStoreFlusher: Region usertable2,user9099,1416889268210.66f19c7f25bc31928ead99dff847aa7f. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,875 DEBUG [MemStoreFlusher.36] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.36; compaction_queue=(0:5032), split_queue=0, merge_queue=0
2014-11-25 13:31:35,879 DEBUG [RpcServer.handler=77,port=60020] regionserver.HRegion: Flush requested on usertable2,user5139,1416889268210.a8d0d190cb61bd1bf54306b4bc472da1.
2014-11-25 13:31:35,879 WARN  [MemStoreFlusher.25] regionserver.MemStoreFlusher: Region usertable2,user5139,1416889268210.a8d0d190cb61bd1bf54306b4bc472da1. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,879 DEBUG [MemStoreFlusher.25] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.25; compaction_queue=(0:5033), split_queue=0, merge_queue=0
2014-11-25 13:31:35,891 DEBUG [RpcServer.handler=146,port=60020] regionserver.HRegion: Flush requested on usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b.
2014-11-25 13:31:35,891 WARN  [MemStoreFlusher.28] regionserver.MemStoreFlusher: Region usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,891 DEBUG [MemStoreFlusher.28] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.28; compaction_queue=(0:5034), split_queue=0, merge_queue=0
2014-11-25 13:31:35,896 DEBUG [RpcServer.handler=40,port=60020] regionserver.HRegion: Flush requested on usertable2,user2529,1416889268210.b451134c60b1dc7cf526e81f6db2c433.
2014-11-25 13:31:35,896 WARN  [MemStoreFlusher.19] regionserver.MemStoreFlusher: Region usertable2,user2529,1416889268210.b451134c60b1dc7cf526e81f6db2c433. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,897 DEBUG [MemStoreFlusher.19] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.19; compaction_queue=(0:5035), split_queue=0, merge_queue=0
2014-11-25 13:31:35,897 DEBUG [RpcServer.handler=65,port=60020] regionserver.HRegion: Flush requested on usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0.
2014-11-25 13:31:35,897 WARN  [MemStoreFlusher.20] regionserver.MemStoreFlusher: Region usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,898 DEBUG [MemStoreFlusher.20] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.20; compaction_queue=(0:5036), split_queue=0, merge_queue=0
2014-11-25 13:31:35,939 DEBUG [RpcServer.handler=61,port=60020] regionserver.HRegion: Flush requested on usertable2,user3069,1416889268210.42e403f1a3a1e328a3b74e3f61f62542.
2014-11-25 13:31:35,939 WARN  [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region usertable2,user3069,1416889268210.42e403f1a3a1e328a3b74e3f61f62542. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,939 DEBUG [MemStoreFlusher.1] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.1; compaction_queue=(0:5037), split_queue=0, merge_queue=0
2014-11-25 13:31:35,942 DEBUG [RpcServer.handler=118,port=60020] regionserver.HRegion: Flush requested on usertable2,user4419,1416889268210.4fa6c789550f08f213befa07da277397.
2014-11-25 13:31:35,942 WARN  [MemStoreFlusher.23] regionserver.MemStoreFlusher: Region usertable2,user4419,1416889268210.4fa6c789550f08f213befa07da277397. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,942 DEBUG [MemStoreFlusher.23] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.23; compaction_queue=(0:5038), split_queue=0, merge_queue=0
2014-11-25 13:31:35,952 DEBUG [RpcServer.handler=118,port=60020] regionserver.HRegion: Flush requested on usertable2,user4599,1416889268210.eead33f80ffa1e642cc147c38794f39c.
2014-11-25 13:31:35,952 WARN  [MemStoreFlusher.16] regionserver.MemStoreFlusher: Region usertable2,user4599,1416889268210.eead33f80ffa1e642cc147c38794f39c. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:35,953 DEBUG [MemStoreFlusher.16] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.16; compaction_queue=(0:5039), split_queue=0, merge_queue=0
2014-11-25 13:31:35,956 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4664410 synced till here 4664404
2014-11-25 13:31:36,046 DEBUG [RpcServer.handler=61,port=60020] regionserver.HRegion: Flush requested on usertable2,user3339,1416889268210.36dd667db34cc2a7fc0dd12698785418.
2014-11-25 13:31:36,046 WARN  [MemStoreFlusher.13] regionserver.MemStoreFlusher: Region usertable2,user3339,1416889268210.36dd667db34cc2a7fc0dd12698785418. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,047 DEBUG [MemStoreFlusher.13] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.13; compaction_queue=(0:5040), split_queue=0, merge_queue=0
2014-11-25 13:31:36,062 DEBUG [RpcServer.handler=77,port=60020] regionserver.HRegion: Flush requested on usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9.
2014-11-25 13:31:36,062 WARN  [MemStoreFlusher.2] regionserver.MemStoreFlusher: Region usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,062 DEBUG [MemStoreFlusher.2] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.2; compaction_queue=(0:5041), split_queue=0, merge_queue=0
2014-11-25 13:31:36,078 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893494080 with entries=2183, filesize=156.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893495582
2014-11-25 13:31:36,078 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=121, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:36,078 DEBUG [RpcServer.handler=70,port=60020] regionserver.HRegion: Flush requested on usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297.
2014-11-25 13:31:36,078 WARN  [MemStoreFlusher.31] regionserver.MemStoreFlusher: Region usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,079 DEBUG [MemStoreFlusher.31] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.31; compaction_queue=(0:5042), split_queue=0, merge_queue=0
2014-11-25 13:31:36,092 DEBUG [RpcServer.handler=77,port=60020] regionserver.HRegion: Flush requested on usertable2,user7209,1416889268210.fa362bc0b2fed482214114394bfa26f3.
2014-11-25 13:31:36,092 WARN  [MemStoreFlusher.34] regionserver.MemStoreFlusher: Region usertable2,user7209,1416889268210.fa362bc0b2fed482214114394bfa26f3. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,092 DEBUG [MemStoreFlusher.34] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.34; compaction_queue=(0:5043), split_queue=0, merge_queue=0
2014-11-25 13:31:36,118 DEBUG [RpcServer.handler=40,port=60020] regionserver.HRegion: Flush requested on usertable2,user4509,1416889268210.f0600c6f184e26e751ccebaff48fbe93.
2014-11-25 13:31:36,118 WARN  [MemStoreFlusher.11] regionserver.MemStoreFlusher: Region usertable2,user4509,1416889268210.f0600c6f184e26e751ccebaff48fbe93. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,118 DEBUG [MemStoreFlusher.11] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.11; compaction_queue=(0:5044), split_queue=0, merge_queue=0
2014-11-25 13:31:36,185 DEBUG [RpcServer.handler=146,port=60020] regionserver.HRegion: Flush requested on usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952.
2014-11-25 13:31:36,185 WARN  [MemStoreFlusher.4] regionserver.MemStoreFlusher: Region usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,186 DEBUG [MemStoreFlusher.4] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.4; compaction_queue=(0:5045), split_queue=0, merge_queue=0
2014-11-25 13:31:36,202 DEBUG [RpcServer.handler=131,port=60020] regionserver.HRegion: Flush requested on usertable2,user2889,1416889268210.44276931450f87557d509a6420f58f5c.
2014-11-25 13:31:36,202 WARN  [MemStoreFlusher.39] regionserver.MemStoreFlusher: Region usertable2,user2889,1416889268210.44276931450f87557d509a6420f58f5c. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,202 DEBUG [MemStoreFlusher.39] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.39; compaction_queue=(0:5046), split_queue=0, merge_queue=0
2014-11-25 13:31:36,221 DEBUG [RpcServer.handler=2,port=60020] regionserver.HRegion: Flush requested on usertable2,user3879,1416889268210.d32041fd1bd5e7014e265b483c173ddc.
2014-11-25 13:31:36,221 WARN  [MemStoreFlusher.25] regionserver.MemStoreFlusher: Region usertable2,user3879,1416889268210.d32041fd1bd5e7014e265b483c173ddc. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,221 DEBUG [MemStoreFlusher.25] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.25; compaction_queue=(0:5047), split_queue=0, merge_queue=0
2014-11-25 13:31:36,237 DEBUG [RpcServer.handler=131,port=60020] regionserver.HRegion: Flush requested on usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568.
2014-11-25 13:31:36,237 WARN  [MemStoreFlusher.9] regionserver.MemStoreFlusher: Region usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,237 DEBUG [MemStoreFlusher.9] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.9; compaction_queue=(0:5048), split_queue=0, merge_queue=0
2014-11-25 13:31:36,238 DEBUG [RpcServer.handler=40,port=60020] regionserver.HRegion: Flush requested on usertable2,user6399,1416889268210.69e080ff87f23f27833ae28e5f74fc61.
2014-11-25 13:31:36,238 WARN  [MemStoreFlusher.3] regionserver.MemStoreFlusher: Region usertable2,user6399,1416889268210.69e080ff87f23f27833ae28e5f74fc61. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,238 DEBUG [MemStoreFlusher.3] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.3; compaction_queue=(0:5049), split_queue=0, merge_queue=0
2014-11-25 13:31:36,245 DEBUG [RpcServer.handler=79,port=60020] regionserver.HRegion: Flush requested on usertable2,user5589,1416889268210.cfb348ee570fa731ba8caa85099a1bd5.
2014-11-25 13:31:36,245 WARN  [MemStoreFlusher.21] regionserver.MemStoreFlusher: Region usertable2,user5589,1416889268210.cfb348ee570fa731ba8caa85099a1bd5. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,245 DEBUG [MemStoreFlusher.21] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.21; compaction_queue=(0:5050), split_queue=0, merge_queue=0
2014-11-25 13:31:36,247 DEBUG [RpcServer.handler=146,port=60020] regionserver.HRegion: Flush requested on usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb.
2014-11-25 13:31:36,247 WARN  [MemStoreFlusher.33] regionserver.MemStoreFlusher: Region usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,247 DEBUG [MemStoreFlusher.33] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.33; compaction_queue=(0:5051), split_queue=0, merge_queue=0
2014-11-25 13:31:36,248 DEBUG [RpcServer.handler=79,port=60020] regionserver.HRegion: Flush requested on usertable2,user5679,1416889268210.4b90977be131e83310321e679b719b06.
2014-11-25 13:31:36,248 WARN  [MemStoreFlusher.19] regionserver.MemStoreFlusher: Region usertable2,user5679,1416889268210.4b90977be131e83310321e679b719b06. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,248 DEBUG [MemStoreFlusher.19] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.19; compaction_queue=(0:5052), split_queue=0, merge_queue=0
2014-11-25 13:31:36,257 DEBUG [RpcServer.handler=109,port=60020] regionserver.HRegion: Flush requested on usertable2,user4869,1416889268210.7303d1491dbde5950f088e98f0eebbb0.
2014-11-25 13:31:36,257 WARN  [MemStoreFlusher.7] regionserver.MemStoreFlusher: Region usertable2,user4869,1416889268210.7303d1491dbde5950f088e98f0eebbb0. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,257 DEBUG [RpcServer.handler=45,port=60020] regionserver.HRegion: Flush requested on usertable2,user1449,1416889268210.952a6132a4e977be00a90f6ac7e69235.
2014-11-25 13:31:36,257 WARN  [MemStoreFlusher.6] regionserver.MemStoreFlusher: Region usertable2,user1449,1416889268210.952a6132a4e977be00a90f6ac7e69235. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,257 DEBUG [MemStoreFlusher.7] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.7; compaction_queue=(0:5053), split_queue=0, merge_queue=0
2014-11-25 13:31:36,257 DEBUG [MemStoreFlusher.6] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.6; compaction_queue=(0:5054), split_queue=0, merge_queue=0
2014-11-25 13:31:36,258 DEBUG [RpcServer.handler=40,port=60020] regionserver.HRegion: Flush requested on usertable2,user6849,1416889268210.0cd39e0518695cae7f35da4afc8c7d16.
2014-11-25 13:31:36,258 WARN  [MemStoreFlusher.15] regionserver.MemStoreFlusher: Region usertable2,user6849,1416889268210.0cd39e0518695cae7f35da4afc8c7d16. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,259 DEBUG [MemStoreFlusher.15] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.15; compaction_queue=(0:5055), split_queue=0, merge_queue=0
2014-11-25 13:31:36,273 DEBUG [RpcServer.handler=26,port=60020] regionserver.HRegion: Flush requested on usertable2,user3159,1416889268210.09a9193727ffcc63b8838a6c82b049a5.
2014-11-25 13:31:36,273 WARN  [MemStoreFlusher.12] regionserver.MemStoreFlusher: Region usertable2,user3159,1416889268210.09a9193727ffcc63b8838a6c82b049a5. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,273 DEBUG [MemStoreFlusher.12] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.12; compaction_queue=(0:5056), split_queue=0, merge_queue=0
2014-11-25 13:31:36,304 DEBUG [RpcServer.handler=45,port=60020] regionserver.HRegion: Flush requested on usertable2,user2349,1416889268210.69fd185ded056a5c9f0e9bc4611ff44a.
2014-11-25 13:31:36,304 WARN  [MemStoreFlusher.5] regionserver.MemStoreFlusher: Region usertable2,user2349,1416889268210.69fd185ded056a5c9f0e9bc4611ff44a. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,304 DEBUG [MemStoreFlusher.5] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.5; compaction_queue=(0:5057), split_queue=0, merge_queue=0
2014-11-25 13:31:36,309 DEBUG [RpcServer.handler=22,port=60020] regionserver.HRegion: Flush requested on usertable2,user5769,1416889268210.a6f20417c02c380a5937a58b862dfbb8.
2014-11-25 13:31:36,309 WARN  [MemStoreFlusher.16] regionserver.MemStoreFlusher: Region usertable2,user5769,1416889268210.a6f20417c02c380a5937a58b862dfbb8. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,309 DEBUG [MemStoreFlusher.16] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.16; compaction_queue=(0:5058), split_queue=0, merge_queue=0
2014-11-25 13:31:36,321 DEBUG [RpcServer.handler=45,port=60020] regionserver.HRegion: Flush requested on usertable2,user2709,1416889268210.fd0aae1076bc05c8db51754294c21e38.
2014-11-25 13:31:36,321 WARN  [MemStoreFlusher.13] regionserver.MemStoreFlusher: Region usertable2,user2709,1416889268210.fd0aae1076bc05c8db51754294c21e38. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,321 DEBUG [MemStoreFlusher.13] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.13; compaction_queue=(0:5059), split_queue=0, merge_queue=0
2014-11-25 13:31:36,340 DEBUG [RpcServer.handler=55,port=60020] regionserver.HRegion: Flush requested on usertable2,user4059,1416889268210.a1bdaf5ad20e2ea54e0e5a2e45d102e5.
2014-11-25 13:31:36,340 WARN  [MemStoreFlusher.34] regionserver.MemStoreFlusher: Region usertable2,user4059,1416889268210.a1bdaf5ad20e2ea54e0e5a2e45d102e5. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,340 DEBUG [MemStoreFlusher.34] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.34; compaction_queue=(0:5060), split_queue=0, merge_queue=0
2014-11-25 13:31:36,504 DEBUG [RpcServer.handler=45,port=60020] regionserver.HRegion: Flush requested on usertable2,user7569,1416889268210.39f78d1fc672af1126040ce0be17bd1e.
2014-11-25 13:31:36,504 WARN  [MemStoreFlusher.19] regionserver.MemStoreFlusher: Region usertable2,user7569,1416889268210.39f78d1fc672af1126040ce0be17bd1e. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,504 DEBUG [MemStoreFlusher.19] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.19; compaction_queue=(0:5061), split_queue=0, merge_queue=0
2014-11-25 13:31:36,541 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e75fdc0fd4cf03697d993c7cf910e273/.tmp/94b525a7fdc54a05807de51beb5cad1c as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e75fdc0fd4cf03697d993c7cf910e273/family/94b525a7fdc54a05807de51beb5cad1c
2014-11-25 13:31:36,597 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:36,819 DEBUG [RpcServer.handler=31,port=60020] regionserver.HRegion: Flush requested on usertable2,user8109,1416889268210.4b47471f1507edfc343dfd2b4599e5cd.
2014-11-25 13:31:36,820 WARN  [MemStoreFlusher.13] regionserver.MemStoreFlusher: Region usertable2,user8109,1416889268210.4b47471f1507edfc343dfd2b4599e5cd. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:36,820 DEBUG [MemStoreFlusher.13] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.13; compaction_queue=(0:5062), split_queue=0, merge_queue=0
2014-11-25 13:31:36,930 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:31:37,060 DEBUG [RpcServer.handler=104,port=60020] regionserver.HRegion: Flush requested on usertable2,,1416889268210.a3d8de2e3c77996d502684577800bf7f.
2014-11-25 13:31:37,060 WARN  [MemStoreFlusher.7] regionserver.MemStoreFlusher: Region usertable2,,1416889268210.a3d8de2e3c77996d502684577800bf7f. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:37,060 DEBUG [MemStoreFlusher.7] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.7; compaction_queue=(0:5063), split_queue=0, merge_queue=0
2014-11-25 13:31:37,219 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893495582 with entries=2680, filesize=188.6 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893496597
2014-11-25 13:31:37,220 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=122, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:37,625 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e75fdc0fd4cf03697d993c7cf910e273/family/47ff60e55ad6419fb00e7572e97472cf, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e75fdc0fd4cf03697d993c7cf910e273/family/47ff60e55ad6419fb00e7572e97472cf
2014-11-25 13:31:37,628 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e75fdc0fd4cf03697d993c7cf910e273/family/ee3683ef4e3042bea924f3e3b8bc4c7a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e75fdc0fd4cf03697d993c7cf910e273/family/ee3683ef4e3042bea924f3e3b8bc4c7a
2014-11-25 13:31:37,675 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e75fdc0fd4cf03697d993c7cf910e273/family/e0fbdab7605341e2852319d8b0485b76, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e75fdc0fd4cf03697d993c7cf910e273/family/e0fbdab7605341e2852319d8b0485b76
2014-11-25 13:31:37,799 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e75fdc0fd4cf03697d993c7cf910e273/family/67287b03b83d4cc5adb0c3d4bc139de1, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e75fdc0fd4cf03697d993c7cf910e273/family/67287b03b83d4cc5adb0c3d4bc139de1
2014-11-25 13:31:37,799 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user6669,1416889268210.e75fdc0fd4cf03697d993c7cf910e273. into 94b525a7fdc54a05807de51beb5cad1c(size=218.6 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 6sec to execute.
2014-11-25 13:31:37,800 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user6669,1416889268210.e75fdc0fd4cf03697d993c7cf910e273., storeName=family, fileCount=4, fileSize=220.0 M, priority=-4, time=5780115095968943; duration=6sec
2014-11-25 13:31:37,800 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5064), split_queue=0, merge_queue=0
2014-11-25 13:31:37,800 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5064), split_queue=0, merge_queue=0
2014-11-25 13:31:37,800 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:31:37,800 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 231211445 starting at candidate #15 after considering 228 permutations with 207 in ratio
2014-11-25 13:31:37,800 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: e452c53f69cba13d15de325c057fb970 - family: Initiating minor compaction
2014-11-25 13:31:37,800 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user6219,1416889268210.e452c53f69cba13d15de325c057fb970.
2014-11-25 13:31:37,800 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user6219,1416889268210.e452c53f69cba13d15de325c057fb970. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/.tmp, totalSize=220.5 M
2014-11-25 13:31:37,801 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/dea9d662654544c3bbc3ebce4ba24832, keycount=36249, bloomtype=ROW, size=54.0 M, encoding=NONE, seqNum=26529
2014-11-25 13:31:37,801 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/586c7645c9e249b79b8711859ff95779, keycount=37942, bloomtype=ROW, size=56.6 M, encoding=NONE, seqNum=27276
2014-11-25 13:31:37,801 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/9461202795314337b9c1309e30033d2b, keycount=38312, bloomtype=ROW, size=57.1 M, encoding=NONE, seqNum=28027
2014-11-25 13:31:37,801 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/c5f5c6598a3c487ca22bbc64e5b3294b, keycount=35395, bloomtype=ROW, size=52.8 M, encoding=NONE, seqNum=28728
2014-11-25 13:31:38,206 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:38,604 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4669526 synced till here 4669523
2014-11-25 13:31:38,723 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893496597 with entries=2436, filesize=175.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893498207
2014-11-25 13:31:38,723 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=123, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:39,396 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:40,038 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4671553 synced till here 4671550
2014-11-25 13:31:40,222 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893498207 with entries=2027, filesize=144.3 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893499397
2014-11-25 13:31:40,222 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=124, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:40,850 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:41,279 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4674316 synced till here 4674314
2014-11-25 13:31:41,400 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893499397 with entries=2763, filesize=197.6 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893500850
2014-11-25 13:31:41,400 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=125, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:42,451 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:42,790 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4676487 synced till here 4676481
2014-11-25 13:31:42,798 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893500850 with entries=2171, filesize=154.9 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893502451
2014-11-25 13:31:42,798 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=126, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:43,035 INFO  [MemStoreFlusher.3] regionserver.MemStoreFlusher: Waited 90442ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779.
2014-11-25 13:31:43,035 DEBUG [MemStoreFlusher.3] regionserver.HRegion: Started memstore flush for usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779., current region memstore size 273.5 M
2014-11-25 13:31:43,489 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:44,271 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4678860 synced till here 4678859
2014-11-25 13:31:44,275 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/.tmp/3d3c30ee4e2b4d7e84f72ec4099a40d0 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/3d3c30ee4e2b4d7e84f72ec4099a40d0
2014-11-25 13:31:44,286 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893502451 with entries=2373, filesize=168.5 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893503489
2014-11-25 13:31:44,288 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=127, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:44,295 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:31:44,570 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/dea9d662654544c3bbc3ebce4ba24832, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/dea9d662654544c3bbc3ebce4ba24832
2014-11-25 13:31:44,734 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/586c7645c9e249b79b8711859ff95779, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/586c7645c9e249b79b8711859ff95779
2014-11-25 13:31:45,021 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/9461202795314337b9c1309e30033d2b, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/9461202795314337b9c1309e30033d2b
2014-11-25 13:31:45,035 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:45,184 INFO  [MemStoreFlusher.3] regionserver.DefaultStoreFlusher: Flushed, sequenceid=46834, memsize=273.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/.tmp/5e1b4ae387fd4c1ab56d451fd4dd521c
2014-11-25 13:31:45,351 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/c5f5c6598a3c487ca22bbc64e5b3294b, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/c5f5c6598a3c487ca22bbc64e5b3294b
2014-11-25 13:31:45,351 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user6219,1416889268210.e452c53f69cba13d15de325c057fb970. into 3d3c30ee4e2b4d7e84f72ec4099a40d0(size=219.0 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 7sec to execute.
2014-11-25 13:31:45,351 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user6219,1416889268210.e452c53f69cba13d15de325c057fb970., storeName=family, fileCount=4, fileSize=220.5 M, priority=-4, time=5780122023010729; duration=7sec
2014-11-25 13:31:45,351 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5064), split_queue=0, merge_queue=0
2014-11-25 13:31:45,351 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5064), split_queue=0, merge_queue=0
2014-11-25 13:31:45,351 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:31:45,351 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 230802591 starting at candidate #15 after considering 228 permutations with 207 in ratio
2014-11-25 13:31:45,352 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: c6657d5e07dcb6e9f983742c5fe2079e - family: Initiating minor compaction
2014-11-25 13:31:45,352 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e.
2014-11-25 13:31:45,352 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/.tmp, totalSize=220.1 M
2014-11-25 13:31:45,352 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/ed3883349b4848a3bfb1abba9dcd3b5d, keycount=36096, bloomtype=ROW, size=53.8 M, encoding=NONE, seqNum=26525
2014-11-25 13:31:45,352 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/f22834faec92466cb66bf7e8370e5d97, keycount=37376, bloomtype=ROW, size=55.7 M, encoding=NONE, seqNum=27261
2014-11-25 13:31:45,352 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/927dc13e646a4be49bf36e664e1bf950, keycount=38855, bloomtype=ROW, size=57.9 M, encoding=NONE, seqNum=28026
2014-11-25 13:31:45,352 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/4cb48c99e6de4ec2a903703c42d10c4b, keycount=35310, bloomtype=ROW, size=52.6 M, encoding=NONE, seqNum=28721
2014-11-25 13:31:45,601 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4681781 synced till here 4681777
2014-11-25 13:31:45,809 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893503489 with entries=2921, filesize=209.9 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893505035
2014-11-25 13:31:45,809 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=128, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:45,896 DEBUG [MemStoreFlusher.3] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/.tmp/5e1b4ae387fd4c1ab56d451fd4dd521c as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/5e1b4ae387fd4c1ab56d451fd4dd521c
2014-11-25 13:31:46,473 INFO  [MemStoreFlusher.3] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/5e1b4ae387fd4c1ab56d451fd4dd521c, entries=995640, sequenceid=46834, filesize=148.4 M
2014-11-25 13:31:46,473 INFO  [MemStoreFlusher.3] regionserver.HRegion: Finished memstore flush of ~273.5 M/286735520, currentsize=8.6 M/9051520 for region usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779. in 3438ms, sequenceid=46834, compaction requested=true
2014-11-25 13:31:46,473 DEBUG [MemStoreFlusher.3] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.3; compaction_queue=(0:5064), split_queue=0, merge_queue=0
2014-11-25 13:31:46,736 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:47,130 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4684003 synced till here 4683999
2014-11-25 13:31:47,266 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893505035 with entries=2222, filesize=158.1 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893506736
2014-11-25 13:31:47,267 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=129, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:47,785 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:48,369 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4686911 synced till here 4686910
2014-11-25 13:31:48,834 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893506736 with entries=2908, filesize=205.8 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893507785
2014-11-25 13:31:48,835 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=130, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:49,619 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:50,096 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4689683 synced till here 4689681
2014-11-25 13:31:50,331 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893507785 with entries=2772, filesize=199.0 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893509620
2014-11-25 13:31:50,332 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=131, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:51,256 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:51,268 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4691433 synced till here 4691432
2014-11-25 13:31:51,340 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893509620 with entries=1750, filesize=123.6 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893511256
2014-11-25 13:31:51,341 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=132, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:52,062 DEBUG [RpcServer.handler=122,port=60020] regionserver.HRegion: Flush requested on usertable2,user5049,1416889268210.a5d4d454c3b39a48b9a7e5c343956435.
2014-11-25 13:31:52,062 WARN  [MemStoreFlusher.28] regionserver.MemStoreFlusher: Region usertable2,user5049,1416889268210.a5d4d454c3b39a48b9a7e5c343956435. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:52,062 DEBUG [MemStoreFlusher.28] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.28; compaction_queue=(0:5065), split_queue=0, merge_queue=0
2014-11-25 13:31:52,091 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:52,125 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/.tmp/e53afea183d34ad4afd51d681a89848a as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/e53afea183d34ad4afd51d681a89848a
2014-11-25 13:31:52,577 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4694038 synced till here 4694036
2014-11-25 13:31:52,702 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:31:52,741 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893511256 with entries=2605, filesize=186.1 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893512091
2014-11-25 13:31:52,741 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=133, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:53,296 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/ed3883349b4848a3bfb1abba9dcd3b5d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/ed3883349b4848a3bfb1abba9dcd3b5d
2014-11-25 13:31:53,464 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/f22834faec92466cb66bf7e8370e5d97, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/f22834faec92466cb66bf7e8370e5d97
2014-11-25 13:31:53,629 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/927dc13e646a4be49bf36e664e1bf950, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/927dc13e646a4be49bf36e664e1bf950
2014-11-25 13:31:53,750 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:53,803 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/4cb48c99e6de4ec2a903703c42d10c4b, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/4cb48c99e6de4ec2a903703c42d10c4b
2014-11-25 13:31:53,803 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e. into e53afea183d34ad4afd51d681a89848a(size=218.6 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 8sec to execute.
2014-11-25 13:31:53,804 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e., storeName=family, fileCount=4, fileSize=220.1 M, priority=-4, time=5780129574501472; duration=8sec
2014-11-25 13:31:53,804 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5066), split_queue=0, merge_queue=0
2014-11-25 13:31:53,804 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5066), split_queue=0, merge_queue=0
2014-11-25 13:31:53,804 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:31:53,804 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 181267166 starting at candidate #13 after considering 228 permutations with 182 in ratio
2014-11-25 13:31:53,804 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 96f75ffeebd3920fdcae7936024334d9 - family: Initiating minor compaction
2014-11-25 13:31:53,804 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user1179,1416889268210.96f75ffeebd3920fdcae7936024334d9.
2014-11-25 13:31:53,804 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user1179,1416889268210.96f75ffeebd3920fdcae7936024334d9. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/96f75ffeebd3920fdcae7936024334d9/.tmp, totalSize=172.9 M
2014-11-25 13:31:53,805 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/96f75ffeebd3920fdcae7936024334d9/family/a0ab9bfb65b94714ba883c5f058d1f8b, keycount=39701, bloomtype=ROW, size=59.2 M, encoding=NONE, seqNum=19504
2014-11-25 13:31:53,805 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/96f75ffeebd3920fdcae7936024334d9/family/5e93a32f181e42d7a976502ebf5c7f19, keycount=37661, bloomtype=ROW, size=56.1 M, encoding=NONE, seqNum=20250
2014-11-25 13:31:53,805 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/96f75ffeebd3920fdcae7936024334d9/family/5b011e958942418db471f707f87e4af9, keycount=38594, bloomtype=ROW, size=57.5 M, encoding=NONE, seqNum=21009
2014-11-25 13:31:54,191 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4696661 synced till here 4696656
2014-11-25 13:31:54,327 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893512091 with entries=2623, filesize=187.7 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893513750
2014-11-25 13:31:54,327 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=134, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:54,671 DEBUG [RpcServer.handler=90,port=60020] regionserver.HRegion: Flush requested on usertable2,user2439,1416889268210.ff3135dee8bb7a7cd420992de92cf2b7.
2014-11-25 13:31:54,671 WARN  [MemStoreFlusher.6] regionserver.MemStoreFlusher: Region usertable2,user2439,1416889268210.ff3135dee8bb7a7cd420992de92cf2b7. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:54,672 DEBUG [MemStoreFlusher.6] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.6; compaction_queue=(0:5066), split_queue=0, merge_queue=0
2014-11-25 13:31:55,017 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:55,785 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4698902 synced till here 4698899
2014-11-25 13:31:55,919 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893513750 with entries=2241, filesize=158.6 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893515017
2014-11-25 13:31:55,920 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=135, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:56,596 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:56,880 DEBUG [RpcServer.handler=96,port=60020] regionserver.HRegion: Flush requested on usertable2,user7389,1416889268210.6016c39a3500c5a1a2d83eca81c57994.
2014-11-25 13:31:56,880 WARN  [MemStoreFlusher.32] regionserver.MemStoreFlusher: Region usertable2,user7389,1416889268210.6016c39a3500c5a1a2d83eca81c57994. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:56,881 DEBUG [MemStoreFlusher.32] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.32; compaction_queue=(0:5067), split_queue=0, merge_queue=0
2014-11-25 13:31:57,068 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4701531 synced till here 4701523
2014-11-25 13:31:57,219 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893515017 with entries=2629, filesize=188.5 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893516596
2014-11-25 13:31:57,220 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=136, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:57,421 WARN  [MemStoreFlusher.35] regionserver.MemStoreFlusher: Region usertable2,user6039,1416889268210.d4808c10301633d1d492aef55f9f9fb0. has too many store files; delaying flush up to 90000ms
2014-11-25 13:31:57,421 DEBUG [MemStoreFlusher.35] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.35; compaction_queue=(0:5068), split_queue=0, merge_queue=0
2014-11-25 13:31:57,422 DEBUG [RpcServer.handler=139,port=60020] regionserver.HRegion: Flush requested on usertable2,user6039,1416889268210.d4808c10301633d1d492aef55f9f9fb0.
2014-11-25 13:31:58,214 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:58,755 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4704180 synced till here 4704172
2014-11-25 13:31:59,015 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893516596 with entries=2649, filesize=189.7 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893518214
2014-11-25 13:31:59,015 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=137, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:31:59,105 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/96f75ffeebd3920fdcae7936024334d9/.tmp/70ee36fb874e4edfbe88a50cf572bf5a as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/96f75ffeebd3920fdcae7936024334d9/family/70ee36fb874e4edfbe88a50cf572bf5a
2014-11-25 13:31:59,423 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:31:59,424 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:32:00,251 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4706598 synced till here 4706593
2014-11-25 13:32:00,333 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/96f75ffeebd3920fdcae7936024334d9/family/a0ab9bfb65b94714ba883c5f058d1f8b, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/96f75ffeebd3920fdcae7936024334d9/family/a0ab9bfb65b94714ba883c5f058d1f8b
2014-11-25 13:32:00,589 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893518214 with entries=2418, filesize=170.6 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893519423
2014-11-25 13:32:00,589 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=138, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:00,803 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/96f75ffeebd3920fdcae7936024334d9/family/5e93a32f181e42d7a976502ebf5c7f19, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/96f75ffeebd3920fdcae7936024334d9/family/5e93a32f181e42d7a976502ebf5c7f19
2014-11-25 13:32:01,012 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/96f75ffeebd3920fdcae7936024334d9/family/5b011e958942418db471f707f87e4af9, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/96f75ffeebd3920fdcae7936024334d9/family/5b011e958942418db471f707f87e4af9
2014-11-25 13:32:01,013 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user1179,1416889268210.96f75ffeebd3920fdcae7936024334d9. into 70ee36fb874e4edfbe88a50cf572bf5a(size=171.7 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 7sec to execute.
2014-11-25 13:32:01,013 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user1179,1416889268210.96f75ffeebd3920fdcae7936024334d9., storeName=family, fileCount=3, fileSize=172.9 M, priority=-4, time=5780138027016544; duration=7sec
2014-11-25 13:32:01,013 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5069), split_queue=0, merge_queue=0
2014-11-25 13:32:01,013 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5069), split_queue=0, merge_queue=0
2014-11-25 13:32:01,013 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:32:01,013 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 231757036 starting at candidate #14 after considering 228 permutations with 216 in ratio
2014-11-25 13:32:01,013 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: c068f0d848be8a8d9b2a90f612ef94a1 - family: Initiating minor compaction
2014-11-25 13:32:01,013 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user4149,1416889268210.c068f0d848be8a8d9b2a90f612ef94a1.
2014-11-25 13:32:01,014 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user4149,1416889268210.c068f0d848be8a8d9b2a90f612ef94a1. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/.tmp, totalSize=221.0 M
2014-11-25 13:32:01,014 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/00a8378a66be467aad0944bea0e42f86, keycount=36034, bloomtype=ROW, size=53.7 M, encoding=NONE, seqNum=26531
2014-11-25 13:32:01,014 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/44d271feff7549b1ba6fcde5c8d8e89a, keycount=38235, bloomtype=ROW, size=57.0 M, encoding=NONE, seqNum=27283
2014-11-25 13:32:01,014 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/c31674857f544a829a4327be051798e0, keycount=37693, bloomtype=ROW, size=56.2 M, encoding=NONE, seqNum=28029
2014-11-25 13:32:01,014 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/31bd8a2aef274374b80dad3e134d3d40, keycount=36286, bloomtype=ROW, size=54.1 M, encoding=NONE, seqNum=28737
2014-11-25 13:32:01,122 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:01,620 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4709581 synced till here 4709578
2014-11-25 13:32:01,781 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893519423 with entries=2983, filesize=212.9 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893521122
2014-11-25 13:32:01,781 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=139, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:02,848 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:03,323 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4711751 synced till here 4711750
2014-11-25 13:32:03,489 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893521122 with entries=2170, filesize=155.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893522848
2014-11-25 13:32:03,489 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=140, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:03,999 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:04,454 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4714174 synced till here 4714162
2014-11-25 13:32:04,617 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893522848 with entries=2423, filesize=172.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893524000
2014-11-25 13:32:04,617 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=141, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:05,893 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:06,228 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4716247 synced till here 4716226
2014-11-25 13:32:06,241 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893524000 with entries=2073, filesize=150.8 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893525894
2014-11-25 13:32:06,242 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=142, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:06,841 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:07,473 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4718436 synced till here 4718424
2014-11-25 13:32:07,483 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893525894 with entries=2189, filesize=155.5 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893526842
2014-11-25 13:32:07,484 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=143, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:07,942 DEBUG [RpcServer.handler=5,port=60020] regionserver.HRegion: Flush requested on usertable2,user1269,1416889268210.bbe246dd324639d9e0eb2b0788d4067c.
2014-11-25 13:32:07,942 WARN  [MemStoreFlusher.21] regionserver.MemStoreFlusher: Region usertable2,user1269,1416889268210.bbe246dd324639d9e0eb2b0788d4067c. has too many store files; delaying flush up to 90000ms
2014-11-25 13:32:07,942 DEBUG [MemStoreFlusher.21] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.21; compaction_queue=(0:5069), split_queue=0, merge_queue=0
2014-11-25 13:32:08,267 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:08,336 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/.tmp/5bbc88d02c804aa5af215096159c8e1d as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/5bbc88d02c804aa5af215096159c8e1d
2014-11-25 13:32:08,741 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4721094 synced till here 4721086
2014-11-25 13:32:08,862 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:32:08,901 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893526842 with entries=2658, filesize=188.1 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893528268
2014-11-25 13:32:08,902 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=144, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:09,209 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/00a8378a66be467aad0944bea0e42f86, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/00a8378a66be467aad0944bea0e42f86
2014-11-25 13:32:09,729 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/44d271feff7549b1ba6fcde5c8d8e89a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/44d271feff7549b1ba6fcde5c8d8e89a
2014-11-25 13:32:09,800 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:09,813 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/c31674857f544a829a4327be051798e0, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/c31674857f544a829a4327be051798e0
2014-11-25 13:32:10,181 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/31bd8a2aef274374b80dad3e134d3d40, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/31bd8a2aef274374b80dad3e134d3d40
2014-11-25 13:32:10,182 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user4149,1416889268210.c068f0d848be8a8d9b2a90f612ef94a1. into 5bbc88d02c804aa5af215096159c8e1d(size=219.5 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 9sec to execute.
2014-11-25 13:32:10,182 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user4149,1416889268210.c068f0d848be8a8d9b2a90f612ef94a1., storeName=family, fileCount=4, fileSize=221.0 M, priority=-4, time=5780145236266605; duration=9sec
2014-11-25 13:32:10,182 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5070), split_queue=0, merge_queue=0
2014-11-25 13:32:10,182 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5070), split_queue=0, merge_queue=0
2014-11-25 13:32:10,182 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:32:10,182 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 171802177 starting at candidate #17 after considering 228 permutations with 219 in ratio
2014-11-25 13:32:10,182 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 9481a850e6c49524a7e44af7702d77b4 - family: Initiating minor compaction
2014-11-25 13:32:10,183 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4.
2014-11-25 13:32:10,183 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/.tmp, totalSize=163.8 M
2014-11-25 13:32:10,183 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/eda04bec04734eb0960e110c09cbe54d, keycount=35878, bloomtype=ROW, size=53.5 M, encoding=NONE, seqNum=28737
2014-11-25 13:32:10,183 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/3e11af1a0f374a04ad4169d1231ddd14, keycount=39411, bloomtype=ROW, size=58.8 M, encoding=NONE, seqNum=29510
2014-11-25 13:32:10,183 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/08facfb88b674d958fdab240432ac0a1, keycount=34606, bloomtype=ROW, size=51.6 M, encoding=NONE, seqNum=30192
2014-11-25 13:32:10,284 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4723647 synced till here 4723633
2014-11-25 13:32:10,430 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893528268 with entries=2553, filesize=180.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893529800
2014-11-25 13:32:10,430 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=145, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:11,046 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:11,508 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4726379 synced till here 4726375
2014-11-25 13:32:11,747 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893529800 with entries=2732, filesize=193.9 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893531046
2014-11-25 13:32:11,747 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=146, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:13,086 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:13,334 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4728374 synced till here 4728358
2014-11-25 13:32:13,364 INFO  [MemStoreFlusher.36] regionserver.MemStoreFlusher: Waited 90599ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6939,1416889268210.cdde512d492925f252720c79467f3309.
2014-11-25 13:32:13,364 DEBUG [MemStoreFlusher.36] regionserver.HRegion: Started memstore flush for usertable2,user6939,1416889268210.cdde512d492925f252720c79467f3309., current region memstore size 337.0 M
2014-11-25 13:32:13,526 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893531046 with entries=1995, filesize=144.0 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893533086
2014-11-25 13:32:13,527 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=147, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:13,986 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:14,847 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4730965 synced till here 4730958
2014-11-25 13:32:15,009 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893533086 with entries=2591, filesize=183.6 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893533986
2014-11-25 13:32:15,010 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=148, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:15,628 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/.tmp/e431e5d08c6546cd983f6399c4dbb097 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/e431e5d08c6546cd983f6399c4dbb097
2014-11-25 13:32:15,631 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:16,096 INFO  [MemStoreFlusher.36] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47345, memsize=337.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cdde512d492925f252720c79467f3309/.tmp/9f7853a3d88e45babbfcba7df5eea7a0
2014-11-25 13:32:16,201 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:32:16,833 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4734288 synced till here 4734283
2014-11-25 13:32:16,836 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/eda04bec04734eb0960e110c09cbe54d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/eda04bec04734eb0960e110c09cbe54d
2014-11-25 13:32:16,840 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/3e11af1a0f374a04ad4169d1231ddd14, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/3e11af1a0f374a04ad4169d1231ddd14
2014-11-25 13:32:16,840 DEBUG [MemStoreFlusher.36] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cdde512d492925f252720c79467f3309/.tmp/9f7853a3d88e45babbfcba7df5eea7a0 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cdde512d492925f252720c79467f3309/family/9f7853a3d88e45babbfcba7df5eea7a0
2014-11-25 13:32:16,844 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893533986 with entries=3323, filesize=238.7 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893535631
2014-11-25 13:32:16,844 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/08facfb88b674d958fdab240432ac0a1, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/08facfb88b674d958fdab240432ac0a1
2014-11-25 13:32:16,844 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4. into e431e5d08c6546cd983f6399c4dbb097(size=162.7 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 6sec to execute.
2014-11-25 13:32:16,844 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4., storeName=family, fileCount=3, fileSize=163.8 M, priority=-4, time=5780154405378632; duration=6sec
2014-11-25 13:32:16,845 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5070), split_queue=0, merge_queue=0
2014-11-25 13:32:16,845 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5070), split_queue=0, merge_queue=0
2014-11-25 13:32:16,845 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=149, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:16,845 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:32:16,845 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 231940618 starting at candidate #14 after considering 228 permutations with 194 in ratio
2014-11-25 13:32:16,845 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: f0600c6f184e26e751ccebaff48fbe93 - family: Initiating minor compaction
2014-11-25 13:32:16,845 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user4509,1416889268210.f0600c6f184e26e751ccebaff48fbe93.
2014-11-25 13:32:16,845 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user4509,1416889268210.f0600c6f184e26e751ccebaff48fbe93. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/.tmp, totalSize=221.2 M
2014-11-25 13:32:16,845 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/295e592049084d00a8f92c5a3661f471, keycount=36359, bloomtype=ROW, size=54.2 M, encoding=NONE, seqNum=26531
2014-11-25 13:32:16,846 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/4081a4a0e77946f695eb2a88338d94a9, keycount=38222, bloomtype=ROW, size=57.0 M, encoding=NONE, seqNum=27283
2014-11-25 13:32:16,846 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/b7f4ac1b45f84388873a4a3ef0781548, keycount=38130, bloomtype=ROW, size=56.8 M, encoding=NONE, seqNum=28029
2014-11-25 13:32:16,846 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/4ffba2b10fdf4d078e4b45624d2a9092, keycount=35654, bloomtype=ROW, size=53.2 M, encoding=NONE, seqNum=28736
2014-11-25 13:32:17,056 INFO  [MemStoreFlusher.36] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cdde512d492925f252720c79467f3309/family/9f7853a3d88e45babbfcba7df5eea7a0, entries=1226930, sequenceid=47345, filesize=182.9 M
2014-11-25 13:32:17,057 INFO  [MemStoreFlusher.36] regionserver.HRegion: Finished memstore flush of ~337.0 M/353345680, currentsize=9.1 M/9526800 for region usertable2,user6939,1416889268210.cdde512d492925f252720c79467f3309. in 3693ms, sequenceid=47345, compaction requested=true
2014-11-25 13:32:17,057 DEBUG [MemStoreFlusher.36] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.36; compaction_queue=(0:5070), split_queue=0, merge_queue=0
2014-11-25 13:32:17,531 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:18,026 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4737140 synced till here 4737135
2014-11-25 13:32:18,072 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893535631 with entries=2852, filesize=200.9 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893537531
2014-11-25 13:32:18,073 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=150, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:19,455 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:19,779 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4739140 synced till here 4739134
2014-11-25 13:32:19,945 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893537531 with entries=2000, filesize=141.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893539455
2014-11-25 13:32:19,946 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=151, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:20,568 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:20,961 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4741828 synced till here 4741823
2014-11-25 13:32:21,122 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893539455 with entries=2688, filesize=192.7 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893540568
2014-11-25 13:32:21,122 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=152, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:22,237 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:22,691 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4744122 synced till here 4744119
2014-11-25 13:32:22,811 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893540568 with entries=2294, filesize=163.3 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893542237
2014-11-25 13:32:22,812 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=153, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:23,159 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/.tmp/2285dbc7b866444cbc65fc68153162e5 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/2285dbc7b866444cbc65fc68153162e5
2014-11-25 13:32:23,332 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:23,508 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:32:23,936 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/295e592049084d00a8f92c5a3661f471, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/295e592049084d00a8f92c5a3661f471
2014-11-25 13:32:23,938 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/4081a4a0e77946f695eb2a88338d94a9, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/4081a4a0e77946f695eb2a88338d94a9
2014-11-25 13:32:23,939 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/b7f4ac1b45f84388873a4a3ef0781548, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/b7f4ac1b45f84388873a4a3ef0781548
2014-11-25 13:32:23,941 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/4ffba2b10fdf4d078e4b45624d2a9092, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/4ffba2b10fdf4d078e4b45624d2a9092
2014-11-25 13:32:23,941 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user4509,1416889268210.f0600c6f184e26e751ccebaff48fbe93. into 2285dbc7b866444cbc65fc68153162e5(size=219.7 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 7sec to execute.
2014-11-25 13:32:23,941 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user4509,1416889268210.f0600c6f184e26e751ccebaff48fbe93., storeName=family, fileCount=4, fileSize=221.2 M, priority=-4, time=5780161067903692; duration=7sec
2014-11-25 13:32:23,941 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5071), split_queue=0, merge_queue=0
2014-11-25 13:32:23,941 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5071), split_queue=0, merge_queue=0
2014-11-25 13:32:23,941 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:32:23,942 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 176907016 starting at candidate #21 after considering 228 permutations with 192 in ratio
2014-11-25 13:32:23,942 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 69aa6c4f5cb560b28b2bbcd7aeef43cd - family: Initiating minor compaction
2014-11-25 13:32:23,942 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd.
2014-11-25 13:32:23,942 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/.tmp, totalSize=168.7 M
2014-11-25 13:32:23,942 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/683c26361e3d421f94396d746f3b9664, keycount=36531, bloomtype=ROW, size=54.5 M, encoding=NONE, seqNum=30910
2014-11-25 13:32:23,942 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/845a500f772140d4bf208ce0d99678b4, keycount=39898, bloomtype=ROW, size=59.5 M, encoding=NONE, seqNum=31695
2014-11-25 13:32:23,942 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/eb843d234c394328956f7e453b9ff22c, keycount=36735, bloomtype=ROW, size=54.8 M, encoding=NONE, seqNum=32416
2014-11-25 13:32:24,171 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4746824 synced till here 4746821
2014-11-25 13:32:24,308 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893542237 with entries=2702, filesize=191.7 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893543333
2014-11-25 13:32:24,309 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=154, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:24,414 INFO  [MemStoreFlusher.10] regionserver.MemStoreFlusher: Waited 90756ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7749,1416889268210.80d2ffdd997af333255373f6d88089b7.
2014-11-25 13:32:24,414 DEBUG [MemStoreFlusher.10] regionserver.HRegion: Started memstore flush for usertable2,user7749,1416889268210.80d2ffdd997af333255373f6d88089b7., current region memstore size 344.8 M
2014-11-25 13:32:24,941 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:25,608 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4749316 synced till here 4749310
2014-11-25 13:32:25,863 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893543333 with entries=2492, filesize=178.5 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893544941
2014-11-25 13:32:25,864 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=155, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:26,862 INFO  [MemStoreFlusher.10] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47532, memsize=344.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/.tmp/62bc3e7e9b6f4408ba9c86f37c177bde
2014-11-25 13:32:27,010 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:27,252 DEBUG [MemStoreFlusher.10] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/.tmp/62bc3e7e9b6f4408ba9c86f37c177bde as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/family/62bc3e7e9b6f4408ba9c86f37c177bde
2014-11-25 13:32:27,380 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4751424 synced till here 4751409
2014-11-25 13:32:27,427 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893544941 with entries=2108, filesize=153.7 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893547011
2014-11-25 13:32:27,428 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=156, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:27,470 INFO  [MemStoreFlusher.10] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/family/62bc3e7e9b6f4408ba9c86f37c177bde, entries=1255420, sequenceid=47532, filesize=187.1 M
2014-11-25 13:32:27,470 INFO  [MemStoreFlusher.10] regionserver.HRegion: Finished memstore flush of ~344.8 M/361551920, currentsize=5.2 M/5468800 for region usertable2,user7749,1416889268210.80d2ffdd997af333255373f6d88089b7. in 3056ms, sequenceid=47532, compaction requested=true
2014-11-25 13:32:27,471 DEBUG [MemStoreFlusher.10] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.10; compaction_queue=(0:5071), split_queue=0, merge_queue=0
2014-11-25 13:32:28,019 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:28,035 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4753193 synced till here 4753171
2014-11-25 13:32:28,046 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893547011 with entries=1769, filesize=125.9 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893548019
2014-11-25 13:32:28,047 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=157, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:29,148 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/.tmp/3e746021e3b2423796a7b522105d8ffb as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/3e746021e3b2423796a7b522105d8ffb
2014-11-25 13:32:29,313 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:32:29,318 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:29,678 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/683c26361e3d421f94396d746f3b9664, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/683c26361e3d421f94396d746f3b9664
2014-11-25 13:32:29,711 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4755865 synced till here 4755849
2014-11-25 13:32:29,865 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893548019 with entries=2672, filesize=188.1 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893549319
2014-11-25 13:32:29,866 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=158, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:29,887 INFO  [MemStoreFlusher.3] regionserver.MemStoreFlusher: Waited 90540ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7929,1416889268210.66f993780f6615d093419e83e4ce0b63.
2014-11-25 13:32:29,887 DEBUG [MemStoreFlusher.3] regionserver.HRegion: Started memstore flush for usertable2,user7929,1416889268210.66f993780f6615d093419e83e4ce0b63., current region memstore size 341.8 M
2014-11-25 13:32:29,888 INFO  [MemStoreFlusher.21] regionserver.MemStoreFlusher: Waited 90084ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7659,1416889268210.94360258e2b50782cd1326e64ca622b3.
2014-11-25 13:32:29,888 DEBUG [MemStoreFlusher.21] regionserver.HRegion: Started memstore flush for usertable2,user7659,1416889268210.94360258e2b50782cd1326e64ca622b3., current region memstore size 340.6 M
2014-11-25 13:32:29,931 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/845a500f772140d4bf208ce0d99678b4, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/845a500f772140d4bf208ce0d99678b4
2014-11-25 13:32:30,066 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/eb843d234c394328956f7e453b9ff22c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/eb843d234c394328956f7e453b9ff22c
2014-11-25 13:32:30,066 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd. into 3e746021e3b2423796a7b522105d8ffb(size=167.6 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 6sec to execute.
2014-11-25 13:32:30,066 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd., storeName=family, fileCount=3, fileSize=168.7 M, priority=-4, time=5780168164707458; duration=6sec
2014-11-25 13:32:30,066 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5072), split_queue=0, merge_queue=0
2014-11-25 13:32:30,066 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5072), split_queue=0, merge_queue=0
2014-11-25 13:32:30,066 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:32:30,066 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 231688678 starting at candidate #14 after considering 228 permutations with 222 in ratio
2014-11-25 13:32:30,067 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: a8d0d190cb61bd1bf54306b4bc472da1 - family: Initiating minor compaction
2014-11-25 13:32:30,067 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user5139,1416889268210.a8d0d190cb61bd1bf54306b4bc472da1.
2014-11-25 13:32:30,067 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user5139,1416889268210.a8d0d190cb61bd1bf54306b4bc472da1. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/.tmp, totalSize=221.0 M
2014-11-25 13:32:30,067 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/7c6aa6e9e6ab43b193319a802a539e5a, keycount=36208, bloomtype=ROW, size=54.0 M, encoding=NONE, seqNum=26530
2014-11-25 13:32:30,067 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/bc4d4ca2edb8451fa472b02843df1d6c, keycount=38115, bloomtype=ROW, size=56.8 M, encoding=NONE, seqNum=27282
2014-11-25 13:32:30,067 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/2dced71d3e314cf78b811f361880fdd2, keycount=38145, bloomtype=ROW, size=56.9 M, encoding=NONE, seqNum=28029
2014-11-25 13:32:30,067 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/f87529b6a7cb4d509678f205b88bcd70, keycount=35736, bloomtype=ROW, size=53.3 M, encoding=NONE, seqNum=28736
2014-11-25 13:32:30,393 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:30,943 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4757710 synced till here 4757698
2014-11-25 13:32:31,108 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893549319 with entries=1845, filesize=128.9 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893550393
2014-11-25 13:32:31,109 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=159, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:31,998 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:32,296 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4759839 synced till here 4759810
2014-11-25 13:32:32,337 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893550393 with entries=2129, filesize=159.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893551998
2014-11-25 13:32:32,338 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=160, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:33,002 INFO  [MemStoreFlusher.13] regionserver.MemStoreFlusher: Waited 90739ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1359,1416889268210.5af9e7c1428814f12682f220113dc251.
2014-11-25 13:32:33,002 DEBUG [MemStoreFlusher.13] regionserver.HRegion: Started memstore flush for usertable2,user1359,1416889268210.5af9e7c1428814f12682f220113dc251., current region memstore size 343.3 M
2014-11-25 13:32:33,255 INFO  [MemStoreFlusher.21] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47619, memsize=340.6 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/.tmp/50fab8d04e024c84a32fc36c098f92ac
2014-11-25 13:32:33,329 INFO  [MemStoreFlusher.3] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47620, memsize=341.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f993780f6615d093419e83e4ce0b63/.tmp/205603db165144f9b13c264a30cb64c5
2014-11-25 13:32:33,542 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:33,820 DEBUG [MemStoreFlusher.21] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/.tmp/50fab8d04e024c84a32fc36c098f92ac as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/family/50fab8d04e024c84a32fc36c098f92ac
2014-11-25 13:32:33,858 DEBUG [MemStoreFlusher.3] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f993780f6615d093419e83e4ce0b63/.tmp/205603db165144f9b13c264a30cb64c5 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f993780f6615d093419e83e4ce0b63/family/205603db165144f9b13c264a30cb64c5
2014-11-25 13:32:33,927 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4762086 synced till here 4762077
2014-11-25 13:32:34,095 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893551998 with entries=2247, filesize=155.8 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893553542
2014-11-25 13:32:34,096 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=161, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:34,165 INFO  [MemStoreFlusher.21] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/family/50fab8d04e024c84a32fc36c098f92ac, entries=1240070, sequenceid=47619, filesize=184.8 M
2014-11-25 13:32:34,165 INFO  [MemStoreFlusher.21] regionserver.HRegion: Finished memstore flush of ~340.6 M/357129360, currentsize=8.7 M/9169600 for region usertable2,user7659,1416889268210.94360258e2b50782cd1326e64ca622b3. in 4277ms, sequenceid=47619, compaction requested=true
2014-11-25 13:32:34,166 DEBUG [MemStoreFlusher.21] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.21; compaction_queue=(0:5072), split_queue=0, merge_queue=0
2014-11-25 13:32:34,228 INFO  [MemStoreFlusher.3] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f993780f6615d093419e83e4ce0b63/family/205603db165144f9b13c264a30cb64c5, entries=1244340, sequenceid=47620, filesize=185.5 M
2014-11-25 13:32:34,229 INFO  [MemStoreFlusher.3] regionserver.HRegion: Finished memstore flush of ~341.8 M/358360560, currentsize=8.6 M/8979760 for region usertable2,user7929,1416889268210.66f993780f6615d093419e83e4ce0b63. in 4341ms, sequenceid=47620, compaction requested=true
2014-11-25 13:32:34,229 DEBUG [MemStoreFlusher.3] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.3; compaction_queue=(0:5073), split_queue=0, merge_queue=0
2014-11-25 13:32:34,604 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:35,024 INFO  [MemStoreFlusher.2] regionserver.MemStoreFlusher: Waited 91024ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5499,1416889268210.47c1cb50ecad10991e33a3c834624e07.
2014-11-25 13:32:35,025 DEBUG [MemStoreFlusher.2] regionserver.HRegion: Started memstore flush for usertable2,user5499,1416889268210.47c1cb50ecad10991e33a3c834624e07., current region memstore size 343.5 M
2014-11-25 13:32:35,030 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4763868 synced till here 4763865
2014-11-25 13:32:35,047 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893553542 with entries=1782, filesize=129.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893554604
2014-11-25 13:32:35,048 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=162, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:35,497 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/.tmp/62fc95adf00747a28155a092a0742c20 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/62fc95adf00747a28155a092a0742c20
2014-11-25 13:32:35,629 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:32:35,882 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/7c6aa6e9e6ab43b193319a802a539e5a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/7c6aa6e9e6ab43b193319a802a539e5a
2014-11-25 13:32:35,938 INFO  [MemStoreFlusher.13] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47682, memsize=343.3 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5af9e7c1428814f12682f220113dc251/.tmp/ad0d0ab546284a42b3f87a841b089cde
2014-11-25 13:32:36,015 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:36,149 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/bc4d4ca2edb8451fa472b02843df1d6c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/bc4d4ca2edb8451fa472b02843df1d6c
2014-11-25 13:32:36,299 DEBUG [MemStoreFlusher.13] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5af9e7c1428814f12682f220113dc251/.tmp/ad0d0ab546284a42b3f87a841b089cde as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5af9e7c1428814f12682f220113dc251/family/ad0d0ab546284a42b3f87a841b089cde
2014-11-25 13:32:36,299 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/2dced71d3e314cf78b811f361880fdd2, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/2dced71d3e314cf78b811f361880fdd2
2014-11-25 13:32:36,302 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/f87529b6a7cb4d509678f205b88bcd70, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/f87529b6a7cb4d509678f205b88bcd70
2014-11-25 13:32:36,302 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user5139,1416889268210.a8d0d190cb61bd1bf54306b4bc472da1. into 62fc95adf00747a28155a092a0742c20(size=219.5 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 6sec to execute.
2014-11-25 13:32:36,302 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user5139,1416889268210.a8d0d190cb61bd1bf54306b4bc472da1., storeName=family, fileCount=4, fileSize=221.0 M, priority=-4, time=5780174289490586; duration=6sec
2014-11-25 13:32:36,302 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5074), split_queue=0, merge_queue=0
2014-11-25 13:32:36,302 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5074), split_queue=0, merge_queue=0
2014-11-25 13:32:36,302 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:32:36,302 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 175168567 starting at candidate #21 after considering 228 permutations with 178 in ratio
2014-11-25 13:32:36,302 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 431916fdd38260d48075cd85c007564d - family: Initiating minor compaction
2014-11-25 13:32:36,302 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d.
2014-11-25 13:32:36,303 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/.tmp, totalSize=167.1 M
2014-11-25 13:32:36,303 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/8c70be4f28aa4628b83250f54a0855a5, keycount=37279, bloomtype=ROW, size=55.6 M, encoding=NONE, seqNum=30501
2014-11-25 13:32:36,303 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/fe839c8b1d2e4f468d3c00b28f10182f, keycount=36061, bloomtype=ROW, size=53.8 M, encoding=NONE, seqNum=31210
2014-11-25 13:32:36,303 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/2cb5ed2919254d2ea14f4f2c0ac86b1f, keycount=38711, bloomtype=ROW, size=57.7 M, encoding=NONE, seqNum=31972
2014-11-25 13:32:36,313 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4765713 synced till here 4765682
2014-11-25 13:32:36,323 INFO  [MemStoreFlusher.13] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5af9e7c1428814f12682f220113dc251/family/ad0d0ab546284a42b3f87a841b089cde, entries=1250130, sequenceid=47682, filesize=186.3 M
2014-11-25 13:32:36,324 INFO  [MemStoreFlusher.13] regionserver.HRegion: Finished memstore flush of ~343.3 M/360026880, currentsize=7.5 M/7888320 for region usertable2,user1359,1416889268210.5af9e7c1428814f12682f220113dc251. in 3322ms, sequenceid=47682, compaction requested=true
2014-11-25 13:32:36,324 DEBUG [MemStoreFlusher.13] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.13; compaction_queue=(0:5074), split_queue=0, merge_queue=0
2014-11-25 13:32:36,393 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893554604 with entries=1845, filesize=129.8 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893556015
2014-11-25 13:32:36,393 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=163, maxlogs=32; forcing flush of 2 regions(s): a564d3a8e2f8a1ac68e597b4dbc73db6, 82b655f81ba4c2ee7025d4948b204d0c
2014-11-25 13:32:37,349 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:37,591 INFO  [MemStoreFlusher.2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47703, memsize=343.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/.tmp/658c4ac0ec8a4ccc8176413afc07c9c6
2014-11-25 13:32:37,724 INFO  [MemStoreFlusher.8] regionserver.MemStoreFlusher: Waited 90032ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user9369,1416889268210.a564d3a8e2f8a1ac68e597b4dbc73db6.
2014-11-25 13:32:37,724 DEBUG [MemStoreFlusher.8] regionserver.HRegion: Started memstore flush for usertable2,user9369,1416889268210.a564d3a8e2f8a1ac68e597b4dbc73db6., current region memstore size 54.9 M
2014-11-25 13:32:37,726 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4767965 synced till here 4767945
2014-11-25 13:32:37,726 INFO  [MemStoreFlusher.13] regionserver.MemStoreFlusher: Waited 90034ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user9279,1416889268210.82b655f81ba4c2ee7025d4948b204d0c.
2014-11-25 13:32:37,727 DEBUG [MemStoreFlusher.13] regionserver.HRegion: Started memstore flush for usertable2,user9279,1416889268210.82b655f81ba4c2ee7025d4948b204d0c., current region memstore size 54.9 M
2014-11-25 13:32:37,829 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893556015 with entries=2252, filesize=162.1 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893557349
2014-11-25 13:32:37,876 DEBUG [MemStoreFlusher.2] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/.tmp/658c4ac0ec8a4ccc8176413afc07c9c6 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/family/658c4ac0ec8a4ccc8176413afc07c9c6
2014-11-25 13:32:37,898 INFO  [MemStoreFlusher.2] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/family/658c4ac0ec8a4ccc8176413afc07c9c6, entries=1250590, sequenceid=47703, filesize=186.4 M
2014-11-25 13:32:37,899 INFO  [MemStoreFlusher.2] regionserver.HRegion: Finished memstore flush of ~343.5 M/360161040, currentsize=5.7 M/5952800 for region usertable2,user5499,1416889268210.47c1cb50ecad10991e33a3c834624e07. in 2874ms, sequenceid=47703, compaction requested=true
2014-11-25 13:32:37,899 DEBUG [MemStoreFlusher.2] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.2; compaction_queue=(0:5075), split_queue=0, merge_queue=0
2014-11-25 13:32:38,289 INFO  [MemStoreFlusher.8] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47272, memsize=54.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a564d3a8e2f8a1ac68e597b4dbc73db6/.tmp/9dc613f8c4b4423b97139c6ec900a2fe
2014-11-25 13:32:38,306 DEBUG [RpcServer.handler=120,port=60020] regionserver.HRegion: Flush requested on usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779.
2014-11-25 13:32:38,306 WARN  [MemStoreFlusher.9] regionserver.MemStoreFlusher: Region usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779. has too many store files; delaying flush up to 90000ms
2014-11-25 13:32:38,306 DEBUG [MemStoreFlusher.9] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.9; compaction_queue=(0:5076), split_queue=0, merge_queue=0
2014-11-25 13:32:38,520 DEBUG [MemStoreFlusher.8] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a564d3a8e2f8a1ac68e597b4dbc73db6/.tmp/9dc613f8c4b4423b97139c6ec900a2fe as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a564d3a8e2f8a1ac68e597b4dbc73db6/family/9dc613f8c4b4423b97139c6ec900a2fe
2014-11-25 13:32:38,551 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:38,762 INFO  [MemStoreFlusher.13] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47200, memsize=54.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/82b655f81ba4c2ee7025d4948b204d0c/.tmp/1b079d002f764473be1053ac8d993e32
2014-11-25 13:32:38,913 INFO  [MemStoreFlusher.8] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a564d3a8e2f8a1ac68e597b4dbc73db6/family/9dc613f8c4b4423b97139c6ec900a2fe, entries=200050, sequenceid=47272, filesize=29.6 M
2014-11-25 13:32:38,914 INFO  [MemStoreFlusher.8] regionserver.HRegion: Finished memstore flush of ~54.9 M/57598560, currentsize=359.9 K/368560 for region usertable2,user9369,1416889268210.a564d3a8e2f8a1ac68e597b4dbc73db6. in 1189ms, sequenceid=47272, compaction requested=true
2014-11-25 13:32:38,914 DEBUG [MemStoreFlusher.8] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.8; compaction_queue=(0:5077), split_queue=0, merge_queue=0
2014-11-25 13:32:39,028 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4770613 synced till here 4770599
2014-11-25 13:32:39,185 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893557349 with entries=2648, filesize=186.6 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893558551
2014-11-25 13:32:39,686 DEBUG [MemStoreFlusher.13] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/82b655f81ba4c2ee7025d4948b204d0c/.tmp/1b079d002f764473be1053ac8d993e32 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/82b655f81ba4c2ee7025d4948b204d0c/family/1b079d002f764473be1053ac8d993e32
2014-11-25 13:32:39,694 INFO  [MemStoreFlusher.13] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/82b655f81ba4c2ee7025d4948b204d0c/family/1b079d002f764473be1053ac8d993e32, entries=199870, sequenceid=47200, filesize=29.6 M
2014-11-25 13:32:39,694 INFO  [MemStoreFlusher.13] regionserver.HRegion: Finished memstore flush of ~54.9 M/57547200, currentsize=475.1 K/486480 for region usertable2,user9279,1416889268210.82b655f81ba4c2ee7025d4948b204d0c. in 1968ms, sequenceid=47200, compaction requested=true
2014-11-25 13:32:39,695 DEBUG [MemStoreFlusher.13] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.13; compaction_queue=(0:5078), split_queue=0, merge_queue=0
2014-11-25 13:32:40,587 INFO  [MemStoreFlusher.26] regionserver.MemStoreFlusher: Waited 90101ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1899,1416889268210.9478768bd4d49198f76234ab9c4947db.
2014-11-25 13:32:40,587 DEBUG [MemStoreFlusher.26] regionserver.HRegion: Started memstore flush for usertable2,user1899,1416889268210.9478768bd4d49198f76234ab9c4947db., current region memstore size 339.3 M
2014-11-25 13:32:40,609 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:40,981 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4772978 synced till here 4772953
2014-11-25 13:32:41,246 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893558551 with entries=2365, filesize=168.3 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893560609
2014-11-25 13:32:41,246 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893254967
2014-11-25 13:32:41,246 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893257892
2014-11-25 13:32:41,246 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893261581
2014-11-25 13:32:41,246 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893262246
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893264581
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893267120
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893268461
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893270932
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893273037
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893273826
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893275587
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893276651
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893278178
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893279743
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893281776
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893282753
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893283788
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893285724
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893286893
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893288294
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893290019
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893291050
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893292710
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893294599
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893295715
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893296947
2014-11-25 13:32:41,247 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893297956
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893299882
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893300757
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893303065
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893303892
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893305471
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893307107
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893308501
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893309924
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893311692
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893312837
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893313971
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893315333
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893316806
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893318058
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893319470
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893321167
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893322944
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893324039
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893325690
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893327642
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893328756
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893329836
2014-11-25 13:32:41,248 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893331184
2014-11-25 13:32:41,249 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893332973
2014-11-25 13:32:41,249 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893335999
2014-11-25 13:32:41,249 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893336943
2014-11-25 13:32:41,249 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893339308
2014-11-25 13:32:41,249 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893341411
2014-11-25 13:32:41,249 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893342692
2014-11-25 13:32:41,249 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893343816
2014-11-25 13:32:41,249 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893345059
2014-11-25 13:32:41,249 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893346604
2014-11-25 13:32:41,249 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893347751
2014-11-25 13:32:41,249 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893349842
2014-11-25 13:32:42,213 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/.tmp/8ab62e625a2143688c29fa91c91dd19c as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/8ab62e625a2143688c29fa91c91dd19c
2014-11-25 13:32:42,267 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:32:42,317 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/8c70be4f28aa4628b83250f54a0855a5, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/8c70be4f28aa4628b83250f54a0855a5
2014-11-25 13:32:42,322 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/fe839c8b1d2e4f468d3c00b28f10182f, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/fe839c8b1d2e4f468d3c00b28f10182f
2014-11-25 13:32:42,326 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/2cb5ed2919254d2ea14f4f2c0ac86b1f, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/2cb5ed2919254d2ea14f4f2c0ac86b1f
2014-11-25 13:32:42,326 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d. into 8ab62e625a2143688c29fa91c91dd19c(size=165.9 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 6sec to execute.
2014-11-25 13:32:42,326 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d., storeName=family, fileCount=3, fileSize=167.1 M, priority=-4, time=5780180525227558; duration=6sec
2014-11-25 13:32:42,326 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5079), split_queue=0, merge_queue=0
2014-11-25 13:32:42,326 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5079), split_queue=0, merge_queue=0
2014-11-25 13:32:42,327 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:32:42,327 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 172748116 starting at candidate #20 after considering 228 permutations with 196 in ratio
2014-11-25 13:32:42,327 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 69b21767691ba0925d8af892eb4aa4c5 - family: Initiating minor compaction
2014-11-25 13:32:42,327 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5.
2014-11-25 13:32:42,327 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/.tmp, totalSize=164.7 M
2014-11-25 13:32:42,327 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/5ed0e3f8cc0045bb9356f1f40cd22678, keycount=37799, bloomtype=ROW, size=56.4 M, encoding=NONE, seqNum=29283
2014-11-25 13:32:42,327 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/a12d70cce7bd4813bd3beeb060d2e950, keycount=36245, bloomtype=ROW, size=54.0 M, encoding=NONE, seqNum=29998
2014-11-25 13:32:42,327 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/fbd85d6d8bbe40cd9867454737225320, keycount=36457, bloomtype=ROW, size=54.4 M, encoding=NONE, seqNum=30714
2014-11-25 13:32:43,694 INFO  [MemStoreFlusher.26] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47795, memsize=339.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9478768bd4d49198f76234ab9c4947db/.tmp/dcadba4078b040cf9bdfd1c9ad77364d
2014-11-25 13:32:44,023 DEBUG [MemStoreFlusher.39] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=24.3 G
2014-11-25 13:32:44,531 DEBUG [MemStoreFlusher.24] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=24.3 G
2014-11-25 13:32:44,531 DEBUG [MemStoreFlusher.39] regionserver.MemStoreFlusher: Under global heap pressure: Region usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156. has too many store files, but is 336.4 M vs best flushable region's 26.6 M. Choosing the bigger.
2014-11-25 13:32:44,531 INFO  [MemStoreFlusher.39] regionserver.MemStoreFlusher: Flush of region usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156. due to global heap pressure
2014-11-25 13:32:44,531 DEBUG [MemStoreFlusher.39] regionserver.HRegion: Started memstore flush for usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156., current region memstore size 336.4 M
2014-11-25 13:32:44,532 DEBUG [MemStoreFlusher.24] regionserver.MemStoreFlusher: Under global heap pressure: Region usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70. has too many store files, but is 334.8 M vs best flushable region's 26.6 M. Choosing the bigger.
2014-11-25 13:32:44,532 INFO  [MemStoreFlusher.24] regionserver.MemStoreFlusher: Flush of region usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70. due to global heap pressure
2014-11-25 13:32:44,532 DEBUG [MemStoreFlusher.24] regionserver.HRegion: Started memstore flush for usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70., current region memstore size 334.8 M
2014-11-25 13:32:44,536 DEBUG [MemStoreFlusher.34] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=24.3 G
2014-11-25 13:32:44,539 DEBUG [MemStoreFlusher.34] regionserver.MemStoreFlusher: Under global heap pressure: Region usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875. has too many store files, but is 334.1 M vs best flushable region's 26.6 M. Choosing the bigger.
2014-11-25 13:32:44,539 INFO  [MemStoreFlusher.34] regionserver.MemStoreFlusher: Flush of region usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875. due to global heap pressure
2014-11-25 13:32:44,539 DEBUG [MemStoreFlusher.34] regionserver.HRegion: Started memstore flush for usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875., current region memstore size 334.1 M
2014-11-25 13:32:44,541 DEBUG [MemStoreFlusher.30] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=24.3 G
2014-11-25 13:32:44,544 DEBUG [MemStoreFlusher.30] regionserver.MemStoreFlusher: Under global heap pressure: Region usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856. has too many store files, but is 313.6 M vs best flushable region's 26.6 M. Choosing the bigger.
2014-11-25 13:32:44,544 INFO  [MemStoreFlusher.30] regionserver.MemStoreFlusher: Flush of region usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856. due to global heap pressure
2014-11-25 13:32:44,544 DEBUG [MemStoreFlusher.30] regionserver.HRegion: Started memstore flush for usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856., current region memstore size 313.6 M
2014-11-25 13:32:44,560 DEBUG [MemStoreFlusher.26] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9478768bd4d49198f76234ab9c4947db/.tmp/dcadba4078b040cf9bdfd1c9ad77364d as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9478768bd4d49198f76234ab9c4947db/family/dcadba4078b040cf9bdfd1c9ad77364d
2014-11-25 13:32:44,599 INFO  [MemStoreFlusher.26] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9478768bd4d49198f76234ab9c4947db/family/dcadba4078b040cf9bdfd1c9ad77364d, entries=1235930, sequenceid=47795, filesize=184.2 M
2014-11-25 13:32:44,599 INFO  [MemStoreFlusher.26] regionserver.HRegion: Finished memstore flush of ~339.4 M/355937200, currentsize=9.0 M/9408720 for region usertable2,user1899,1416889268210.9478768bd4d49198f76234ab9c4947db. in 4012ms, sequenceid=47795, compaction requested=true
2014-11-25 13:32:44,599 DEBUG [MemStoreFlusher.26] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.26; compaction_queue=(0:5079), split_queue=0, merge_queue=0
2014-11-25 13:32:45,430 INFO  [MemStoreFlusher.10] regionserver.MemStoreFlusher: Waited 90063ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156.
2014-11-25 13:32:45,431 DEBUG [MemStoreFlusher.10] regionserver.HRegion: NOT flushing memstore for region usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156., flushing=true, writesEnabled=true
2014-11-25 13:32:46,055 DEBUG [MemStoreFlusher.37] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=24.3 G
2014-11-25 13:32:46,056 DEBUG [MemStoreFlusher.37] regionserver.MemStoreFlusher: Under global heap pressure: Region usertable2,user2799,1416889268210.5ff266e4e6272ab4516ca0c0f122bd3a. has too many store files, but is 315.8 M vs best flushable region's 26.9 M. Choosing the bigger.
2014-11-25 13:32:46,056 INFO  [MemStoreFlusher.37] regionserver.MemStoreFlusher: Flush of region usertable2,user2799,1416889268210.5ff266e4e6272ab4516ca0c0f122bd3a. due to global heap pressure
2014-11-25 13:32:46,056 DEBUG [MemStoreFlusher.37] regionserver.HRegion: Started memstore flush for usertable2,user2799,1416889268210.5ff266e4e6272ab4516ca0c0f122bd3a., current region memstore size 315.8 M
2014-11-25 13:32:46,617 INFO  [MemStoreFlusher.23] regionserver.MemStoreFlusher: Waited 90692ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875.
2014-11-25 13:32:46,617 DEBUG [MemStoreFlusher.23] regionserver.HRegion: NOT flushing memstore for region usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875., flushing=true, writesEnabled=true
2014-11-25 13:32:46,618 INFO  [MemStoreFlusher.23] regionserver.MemStoreFlusher: Waited 90931ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70.
2014-11-25 13:32:46,618 DEBUG [MemStoreFlusher.23] regionserver.HRegion: NOT flushing memstore for region usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70., flushing=true, writesEnabled=true
2014-11-25 13:32:46,620 DEBUG [MemStoreFlusher.23] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=24.3 G
2014-11-25 13:32:46,620 DEBUG [MemStoreFlusher.23] regionserver.MemStoreFlusher: Under global heap pressure: Region usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027. has too many store files, but is 306.9 M vs best flushable region's 26.9 M. Choosing the bigger.
2014-11-25 13:32:46,620 INFO  [MemStoreFlusher.23] regionserver.MemStoreFlusher: Flush of region usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027. due to global heap pressure
2014-11-25 13:32:46,621 DEBUG [MemStoreFlusher.23] regionserver.HRegion: Started memstore flush for usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027., current region memstore size 306.9 M
2014-11-25 13:32:46,711 DEBUG [MemStoreFlusher.25] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=24.3 G
2014-11-25 13:32:46,712 DEBUG [MemStoreFlusher.25] regionserver.MemStoreFlusher: Under global heap pressure: Region usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f. has too many store files, but is 304.6 M vs best flushable region's 26.9 M. Choosing the bigger.
2014-11-25 13:32:46,712 INFO  [MemStoreFlusher.25] regionserver.MemStoreFlusher: Flush of region usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f. due to global heap pressure
2014-11-25 13:32:46,712 DEBUG [MemStoreFlusher.25] regionserver.HRegion: Started memstore flush for usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f., current region memstore size 304.6 M
2014-11-25 13:32:46,908 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=105, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:32:46,908 WARN  [MemStoreFlusher.16] regionserver.MemStoreFlusher: Region usertable2,user9459,1416889268210.c9c93637c527ac1620cc49c084c5a363. has too many store files; delaying flush up to 90000ms
2014-11-25 13:32:46,908 WARN  [MemStoreFlusher.27] regionserver.MemStoreFlusher: Region usertable2,user9909,1416889268210.d5f2094a6ce040bca9c89f6742029d25. has too many store files; delaying flush up to 90000ms
2014-11-25 13:32:46,908 DEBUG [MemStoreFlusher.16] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.16; compaction_queue=(0:5080), split_queue=0, merge_queue=0
2014-11-25 13:32:46,909 DEBUG [MemStoreFlusher.27] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.27; compaction_queue=(0:5081), split_queue=0, merge_queue=0
2014-11-25 13:32:46,909 DEBUG [MemStoreFlusher.31] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=24.3 G
2014-11-25 13:32:46,909 DEBUG [MemStoreFlusher.35] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=24.3 G
2014-11-25 13:32:46,909 DEBUG [MemStoreFlusher.31] regionserver.MemStoreFlusher: Under global heap pressure: Region usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569. has too many store files, but is 302.7 M vs best flushable region's 27.0 M. Choosing the bigger.
2014-11-25 13:32:46,909 INFO  [MemStoreFlusher.31] regionserver.MemStoreFlusher: Flush of region usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569. due to global heap pressure
2014-11-25 13:32:46,909 DEBUG [MemStoreFlusher.35] regionserver.MemStoreFlusher: Under global heap pressure: Region usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569. has too many store files, but is 302.7 M vs best flushable region's 27.0 M. Choosing the bigger.
2014-11-25 13:32:46,909 INFO  [MemStoreFlusher.35] regionserver.MemStoreFlusher: Flush of region usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569. due to global heap pressure
2014-11-25 13:32:46,910 DEBUG [MemStoreFlusher.31] regionserver.HRegion: Started memstore flush for usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569., current region memstore size 302.7 M
2014-11-25 13:32:46,910 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:46,910 DEBUG [MemStoreFlusher.35] regionserver.HRegion: NOT flushing memstore for region usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569., flushing=true, writesEnabled=true
2014-11-25 13:32:46,915 DEBUG [MemStoreFlusher.33] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=24.3 G
2014-11-25 13:32:46,916 DEBUG [MemStoreFlusher.33] regionserver.MemStoreFlusher: Under global heap pressure: Region usertable2,user8469,1416889268210.190546a1cd2a016b3df3324d5875e49b. has too many store files, but is 297.2 M vs best flushable region's 27.0 M. Choosing the bigger.
2014-11-25 13:32:46,916 INFO  [MemStoreFlusher.33] regionserver.MemStoreFlusher: Flush of region usertable2,user8469,1416889268210.190546a1cd2a016b3df3324d5875e49b. due to global heap pressure
2014-11-25 13:32:46,916 DEBUG [MemStoreFlusher.33] regionserver.HRegion: Started memstore flush for usertable2,user8469,1416889268210.190546a1cd2a016b3df3324d5875e49b., current region memstore size 297.2 M
2014-11-25 13:32:46,952 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4781761 synced till here 4781760
2014-11-25 13:32:47,044 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893560609 with entries=8783, filesize=626.8 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893566910
2014-11-25 13:32:47,045 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=106, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:32:47,517 DEBUG [MemStoreFlusher.29] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=24.3 G
2014-11-25 13:32:47,518 DEBUG [MemStoreFlusher.29] regionserver.MemStoreFlusher: Under global heap pressure: Region usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e. has too many store files, but is 296.1 M vs best flushable region's 27.0 M. Choosing the bigger.
2014-11-25 13:32:47,518 INFO  [MemStoreFlusher.29] regionserver.MemStoreFlusher: Flush of region usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e. due to global heap pressure
2014-11-25 13:32:47,518 DEBUG [MemStoreFlusher.29] regionserver.HRegion: Started memstore flush for usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e., current region memstore size 296.1 M
2014-11-25 13:32:47,522 DEBUG [MemStoreFlusher.11] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=24.3 G
2014-11-25 13:32:47,523 DEBUG [MemStoreFlusher.11] regionserver.MemStoreFlusher: Under global heap pressure: Region usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d. has too many store files, but is 296.0 M vs best flushable region's 27.0 M. Choosing the bigger.
2014-11-25 13:32:47,523 INFO  [MemStoreFlusher.11] regionserver.MemStoreFlusher: Flush of region usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d. due to global heap pressure
2014-11-25 13:32:47,523 DEBUG [MemStoreFlusher.11] regionserver.HRegion: Started memstore flush for usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d., current region memstore size 296.0 M
2014-11-25 13:32:47,528 DEBUG [MemStoreFlusher.32] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=24.3 G
2014-11-25 13:32:47,529 DEBUG [MemStoreFlusher.32] regionserver.MemStoreFlusher: Under global heap pressure: Region usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf. has too many store files, but is 296.0 M vs best flushable region's 27.0 M. Choosing the bigger.
2014-11-25 13:32:47,529 INFO  [MemStoreFlusher.32] regionserver.MemStoreFlusher: Flush of region usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf. due to global heap pressure
2014-11-25 13:32:47,529 DEBUG [MemStoreFlusher.32] regionserver.HRegion: Started memstore flush for usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf., current region memstore size 296.0 M
2014-11-25 13:32:47,614 DEBUG [MemStoreFlusher.21] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=24.3 G
2014-11-25 13:32:47,614 DEBUG [MemStoreFlusher.21] regionserver.MemStoreFlusher: Under global heap pressure: Region usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407. has too many store files, but is 296.2 M vs best flushable region's 27.0 M. Choosing the bigger.
2014-11-25 13:32:47,614 INFO  [MemStoreFlusher.21] regionserver.MemStoreFlusher: Flush of region usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407. due to global heap pressure
2014-11-25 13:32:47,615 DEBUG [MemStoreFlusher.21] regionserver.HRegion: Started memstore flush for usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407., current region memstore size 296.2 M
2014-11-25 13:32:47,651 INFO  [MemStoreFlusher.24] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47845, memsize=334.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/.tmp/56159319e20d43b88c5f1a05cc80d367
2014-11-25 13:32:47,653 INFO  [MemStoreFlusher.39] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47848, memsize=336.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/.tmp/33649c821f8b4edc8d7f0ca2f2c275bc
2014-11-25 13:32:47,653 INFO  [MemStoreFlusher.34] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47850, memsize=334.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/.tmp/cd8a5c7905b74a7da96e5dadb7b3c595
2014-11-25 13:32:47,671 DEBUG [MemStoreFlusher.24] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/.tmp/56159319e20d43b88c5f1a05cc80d367 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/family/56159319e20d43b88c5f1a05cc80d367
2014-11-25 13:32:47,672 DEBUG [MemStoreFlusher.39] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/.tmp/33649c821f8b4edc8d7f0ca2f2c275bc as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/family/33649c821f8b4edc8d7f0ca2f2c275bc
2014-11-25 13:32:47,684 DEBUG [MemStoreFlusher.34] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/.tmp/cd8a5c7905b74a7da96e5dadb7b3c595 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/family/cd8a5c7905b74a7da96e5dadb7b3c595
2014-11-25 13:32:47,688 INFO  [MemStoreFlusher.39] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/family/33649c821f8b4edc8d7f0ca2f2c275bc, entries=1224750, sequenceid=47848, filesize=182.5 M
2014-11-25 13:32:47,688 INFO  [MemStoreFlusher.39] regionserver.HRegion: Finished memstore flush of ~336.4 M/352717440, currentsize=4.2 M/4400560 for region usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156. in 3157ms, sequenceid=47848, compaction requested=true
2014-11-25 13:32:47,688 INFO  [MemStoreFlusher.24] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/family/56159319e20d43b88c5f1a05cc80d367, entries=1219060, sequenceid=47845, filesize=181.7 M
2014-11-25 13:32:47,688 DEBUG [MemStoreFlusher.39] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.39; compaction_queue=(0:5082), split_queue=0, merge_queue=0
2014-11-25 13:32:47,688 INFO  [MemStoreFlusher.24] regionserver.HRegion: Finished memstore flush of ~334.8 M/351080000, currentsize=4.1 M/4317120 for region usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70. in 3156ms, sequenceid=47845, compaction requested=true
2014-11-25 13:32:47,688 DEBUG [MemStoreFlusher.24] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.24; compaction_queue=(0:5083), split_queue=0, merge_queue=0
2014-11-25 13:32:47,755 INFO  [MemStoreFlusher.34] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/family/cd8a5c7905b74a7da96e5dadb7b3c595, entries=1216850, sequenceid=47850, filesize=181.4 M
2014-11-25 13:32:47,755 INFO  [MemStoreFlusher.34] regionserver.HRegion: Finished memstore flush of ~334.2 M/350443280, currentsize=4.8 M/5014080 for region usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875. in 3216ms, sequenceid=47850, compaction requested=true
2014-11-25 13:32:47,755 DEBUG [MemStoreFlusher.34] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.34; compaction_queue=(0:5084), split_queue=0, merge_queue=0
2014-11-25 13:32:47,832 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/.tmp/9bfa022c82894e6e99071da554fc8ae7 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/9bfa022c82894e6e99071da554fc8ae7
2014-11-25 13:32:47,864 INFO  [MemStoreFlusher.30] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47843, memsize=313.6 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/.tmp/00122fbbb71b4b58bf1568d2c5b34232
2014-11-25 13:32:47,914 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:32:48,006 DEBUG [MemStoreFlusher.30] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/.tmp/00122fbbb71b4b58bf1568d2c5b34232 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/00122fbbb71b4b58bf1568d2c5b34232
2014-11-25 13:32:48,008 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/5ed0e3f8cc0045bb9356f1f40cd22678, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/5ed0e3f8cc0045bb9356f1f40cd22678
2014-11-25 13:32:48,012 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/a12d70cce7bd4813bd3beeb060d2e950, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/a12d70cce7bd4813bd3beeb060d2e950
2014-11-25 13:32:48,014 INFO  [MemStoreFlusher.30] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/00122fbbb71b4b58bf1568d2c5b34232, entries=1141760, sequenceid=47843, filesize=170.2 M
2014-11-25 13:32:48,014 INFO  [MemStoreFlusher.30] regionserver.HRegion: Finished memstore flush of ~313.6 M/328818480, currentsize=4.5 M/4760480 for region usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856. in 3470ms, sequenceid=47843, compaction requested=true
2014-11-25 13:32:48,014 DEBUG [MemStoreFlusher.30] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.30; compaction_queue=(0:5085), split_queue=0, merge_queue=0
2014-11-25 13:32:48,056 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/fbd85d6d8bbe40cd9867454737225320, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/fbd85d6d8bbe40cd9867454737225320
2014-11-25 13:32:48,056 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5. into 9bfa022c82894e6e99071da554fc8ae7(size=163.6 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 5sec to execute.
2014-11-25 13:32:48,056 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5., storeName=family, fileCount=3, fileSize=164.7 M, priority=-4, time=5780186549765434; duration=5sec
2014-11-25 13:32:48,056 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5086), split_queue=0, merge_queue=0
2014-11-25 13:32:48,056 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5086), split_queue=0, merge_queue=0
2014-11-25 13:32:48,056 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:32:48,056 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 180851213 starting at candidate #5 after considering 228 permutations with 159 in ratio
2014-11-25 13:32:48,057 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 5693462910d31e0fd44c368a162a3159 - family: Initiating minor compaction
2014-11-25 13:32:48,057 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159.
2014-11-25 13:32:48,057 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/.tmp, totalSize=172.5 M
2014-11-25 13:32:48,057 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/edcc1c5efdbf401f84cb58e943f923b8, keycount=38737, bloomtype=ROW, size=57.7 M, encoding=NONE, seqNum=12206
2014-11-25 13:32:48,057 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/f16d65bce2724469aa13f1073973eff9, keycount=39677, bloomtype=ROW, size=59.1 M, encoding=NONE, seqNum=12991
2014-11-25 13:32:48,057 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/29d7c5653d734bfa958bac4caa19d4a6, keycount=37276, bloomtype=ROW, size=55.6 M, encoding=NONE, seqNum=13723
2014-11-25 13:32:50,770 INFO  [MemStoreFlusher.23] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47890, memsize=307.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/.tmp/1ff4afbcd2514861b1a9357636a48b6e
2014-11-25 13:32:50,798 DEBUG [MemStoreFlusher.23] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/.tmp/1ff4afbcd2514861b1a9357636a48b6e as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/1ff4afbcd2514861b1a9357636a48b6e
2014-11-25 13:32:50,803 INFO  [MemStoreFlusher.23] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/1ff4afbcd2514861b1a9357636a48b6e, entries=1117810, sequenceid=47890, filesize=166.6 M
2014-11-25 13:32:50,803 INFO  [MemStoreFlusher.23] regionserver.HRegion: Finished memstore flush of ~307.0 M/321920080, currentsize=2.5 M/2577600 for region usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027. in 4183ms, sequenceid=47890, compaction requested=true
2014-11-25 13:32:50,803 DEBUG [MemStoreFlusher.23] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.23; compaction_queue=(0:5086), split_queue=0, merge_queue=0
2014-11-25 13:32:51,492 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:51,499 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4783474 synced till here 4783473
2014-11-25 13:32:51,509 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893566910 with entries=1713, filesize=122.5 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893571492
2014-11-25 13:32:51,509 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=107, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:32:51,720 INFO  [MemStoreFlusher.25] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47891, memsize=304.6 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/.tmp/6b11acbaa74247b6b4c4be4feaf57c3b
2014-11-25 13:32:51,813 INFO  [MemStoreFlusher.33] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47873, memsize=297.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/190546a1cd2a016b3df3324d5875e49b/.tmp/71e6a7c112e04e79b5220344e0a3585e
2014-11-25 13:32:51,915 INFO  [MemStoreFlusher.31] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47885, memsize=302.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/.tmp/5c87b1f8ad194b25b50eb434cad7ffcb
2014-11-25 13:32:51,954 DEBUG [MemStoreFlusher.25] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/.tmp/6b11acbaa74247b6b4c4be4feaf57c3b as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/6b11acbaa74247b6b4c4be4feaf57c3b
2014-11-25 13:32:52,064 DEBUG [MemStoreFlusher.33] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/190546a1cd2a016b3df3324d5875e49b/.tmp/71e6a7c112e04e79b5220344e0a3585e as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/190546a1cd2a016b3df3324d5875e49b/family/71e6a7c112e04e79b5220344e0a3585e
2014-11-25 13:32:52,064 INFO  [MemStoreFlusher.25] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/6b11acbaa74247b6b4c4be4feaf57c3b, entries=1109020, sequenceid=47891, filesize=165.3 M
2014-11-25 13:32:52,065 DEBUG [MemStoreFlusher.31] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/.tmp/5c87b1f8ad194b25b50eb434cad7ffcb as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/5c87b1f8ad194b25b50eb434cad7ffcb
2014-11-25 13:32:52,065 INFO  [MemStoreFlusher.25] regionserver.HRegion: Finished memstore flush of ~304.6 M/319388400, currentsize=3.1 M/3300320 for region usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f. in 5353ms, sequenceid=47891, compaction requested=true
2014-11-25 13:32:52,065 DEBUG [MemStoreFlusher.25] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.25; compaction_queue=(0:5087), split_queue=0, merge_queue=0
2014-11-25 13:32:52,070 INFO  [MemStoreFlusher.33] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/190546a1cd2a016b3df3324d5875e49b/family/71e6a7c112e04e79b5220344e0a3585e, entries=1082160, sequenceid=47873, filesize=161.3 M
2014-11-25 13:32:52,070 INFO  [MemStoreFlusher.33] regionserver.HRegion: Finished memstore flush of ~297.2 M/311653760, currentsize=3.0 M/3144800 for region usertable2,user8469,1416889268210.190546a1cd2a016b3df3324d5875e49b. in 5154ms, sequenceid=47873, compaction requested=true
2014-11-25 13:32:52,070 DEBUG [MemStoreFlusher.33] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.33; compaction_queue=(0:5088), split_queue=0, merge_queue=0
2014-11-25 13:32:52,113 INFO  [MemStoreFlusher.31] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/5c87b1f8ad194b25b50eb434cad7ffcb, entries=1102300, sequenceid=47885, filesize=164.3 M
2014-11-25 13:32:52,113 INFO  [MemStoreFlusher.31] regionserver.HRegion: Finished memstore flush of ~302.7 M/317453440, currentsize=2.9 M/3023920 for region usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569. in 5203ms, sequenceid=47885, compaction requested=true
2014-11-25 13:32:52,113 DEBUG [MemStoreFlusher.31] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.31; compaction_queue=(0:5089), split_queue=0, merge_queue=0
2014-11-25 13:32:52,376 INFO  [MemStoreFlusher.37] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47885, memsize=315.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/.tmp/b1a596c52e1b4c07a7680d3774e6cf37
2014-11-25 13:32:52,381 DEBUG [MemStoreFlusher.37] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/.tmp/b1a596c52e1b4c07a7680d3774e6cf37 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/b1a596c52e1b4c07a7680d3774e6cf37
2014-11-25 13:32:52,386 INFO  [MemStoreFlusher.37] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/b1a596c52e1b4c07a7680d3774e6cf37, entries=1149830, sequenceid=47885, filesize=171.4 M
2014-11-25 13:32:52,386 INFO  [MemStoreFlusher.37] regionserver.HRegion: Finished memstore flush of ~315.8 M/331141200, currentsize=3.5 M/3700640 for region usertable2,user2799,1416889268210.5ff266e4e6272ab4516ca0c0f122bd3a. in 6330ms, sequenceid=47885, compaction requested=true
2014-11-25 13:32:52,386 DEBUG [MemStoreFlusher.37] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.37; compaction_queue=(0:5090), split_queue=0, merge_queue=0
2014-11-25 13:32:54,917 INFO  [MemStoreFlusher.21] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47897, memsize=296.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/.tmp/a0487ea1153147b98427e39cebc96da0
2014-11-25 13:32:54,922 DEBUG [MemStoreFlusher.21] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/.tmp/a0487ea1153147b98427e39cebc96da0 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/a0487ea1153147b98427e39cebc96da0
2014-11-25 13:32:54,928 INFO  [MemStoreFlusher.21] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/a0487ea1153147b98427e39cebc96da0, entries=1078410, sequenceid=47897, filesize=160.7 M
2014-11-25 13:32:54,928 INFO  [MemStoreFlusher.21] regionserver.HRegion: Finished memstore flush of ~296.2 M/310572480, currentsize=3.1 M/3260000 for region usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407. in 7313ms, sequenceid=47897, compaction requested=true
2014-11-25 13:32:54,928 DEBUG [MemStoreFlusher.21] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.21; compaction_queue=(0:5091), split_queue=0, merge_queue=0
2014-11-25 13:32:54,954 INFO  [MemStoreFlusher.11] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47899, memsize=296.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/.tmp/2d4cb8a7b9bd4d8dbefdc052e145f50c
2014-11-25 13:32:54,959 DEBUG [MemStoreFlusher.11] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/.tmp/2d4cb8a7b9bd4d8dbefdc052e145f50c as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/2d4cb8a7b9bd4d8dbefdc052e145f50c
2014-11-25 13:32:54,964 INFO  [MemStoreFlusher.11] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/2d4cb8a7b9bd4d8dbefdc052e145f50c, entries=1077910, sequenceid=47899, filesize=160.7 M
2014-11-25 13:32:54,964 INFO  [MemStoreFlusher.11] regionserver.HRegion: Finished memstore flush of ~296.0 M/310429760, currentsize=3.0 M/3124560 for region usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d. in 7441ms, sequenceid=47899, compaction requested=true
2014-11-25 13:32:54,964 DEBUG [MemStoreFlusher.11] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.11; compaction_queue=(0:5092), split_queue=0, merge_queue=0
2014-11-25 13:32:55,020 INFO  [MemStoreFlusher.29] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47874, memsize=296.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/.tmp/2723d4537fd649d7a0df1f716a66738e
2014-11-25 13:32:55,030 DEBUG [MemStoreFlusher.29] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/.tmp/2723d4537fd649d7a0df1f716a66738e as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/2723d4537fd649d7a0df1f716a66738e
2014-11-25 13:32:55,036 INFO  [MemStoreFlusher.29] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/2723d4537fd649d7a0df1f716a66738e, entries=1078160, sequenceid=47874, filesize=160.7 M
2014-11-25 13:32:55,036 INFO  [MemStoreFlusher.29] regionserver.HRegion: Finished memstore flush of ~296.1 M/310500960, currentsize=4.0 M/4187440 for region usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e. in 7518ms, sequenceid=47874, compaction requested=true
2014-11-25 13:32:55,037 DEBUG [MemStoreFlusher.29] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.29; compaction_queue=(0:5093), split_queue=0, merge_queue=0
2014-11-25 13:32:55,308 INFO  [MemStoreFlusher.32] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47899, memsize=296.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/.tmp/fc7c273fa99741c29162b7a7f8c56bf1
2014-11-25 13:32:55,314 DEBUG [MemStoreFlusher.32] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/.tmp/fc7c273fa99741c29162b7a7f8c56bf1 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/fc7c273fa99741c29162b7a7f8c56bf1
2014-11-25 13:32:55,321 INFO  [MemStoreFlusher.32] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/fc7c273fa99741c29162b7a7f8c56bf1, entries=1077670, sequenceid=47899, filesize=160.6 M
2014-11-25 13:32:55,321 INFO  [MemStoreFlusher.32] regionserver.HRegion: Finished memstore flush of ~296.0 M/310360560, currentsize=3.5 M/3672000 for region usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf. in 7792ms, sequenceid=47899, compaction requested=true
2014-11-25 13:32:55,321 DEBUG [MemStoreFlusher.32] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.32; compaction_queue=(0:5094), split_queue=0, merge_queue=0
2014-11-25 13:32:55,444 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:55,625 INFO  [MemStoreFlusher.14] regionserver.MemStoreFlusher: Waited 90460ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856.
2014-11-25 13:32:55,626 DEBUG [MemStoreFlusher.14] regionserver.HRegion: Started memstore flush for usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856., current region memstore size 8.3 M
2014-11-25 13:32:55,736 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4785686 synced till here 4785663
2014-11-25 13:32:55,750 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893571492 with entries=2212, filesize=158.3 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893575444
2014-11-25 13:32:55,751 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=108, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:32:55,757 INFO  [MemStoreFlusher.14] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47904, memsize=8.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/.tmp/f0c42a89d8d24ade82c347915e941449
2014-11-25 13:32:55,764 DEBUG [MemStoreFlusher.14] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/.tmp/f0c42a89d8d24ade82c347915e941449 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/f0c42a89d8d24ade82c347915e941449
2014-11-25 13:32:55,774 INFO  [MemStoreFlusher.14] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/f0c42a89d8d24ade82c347915e941449, entries=30600, sequenceid=47904, filesize=4.6 M
2014-11-25 13:32:55,775 INFO  [MemStoreFlusher.14] regionserver.HRegion: Finished memstore flush of ~8.4 M/8812640, currentsize=731.2 K/748720 for region usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856. in 149ms, sequenceid=47904, compaction requested=true
2014-11-25 13:32:55,775 DEBUG [MemStoreFlusher.14] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.14; compaction_queue=(0:5095), split_queue=0, merge_queue=0
2014-11-25 13:32:56,440 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/.tmp/cb961059338b42a8ac73be876c3a4cd1 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/cb961059338b42a8ac73be876c3a4cd1
2014-11-25 13:32:56,459 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:32:56,658 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:56,662 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/edcc1c5efdbf401f84cb58e943f923b8, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/edcc1c5efdbf401f84cb58e943f923b8
2014-11-25 13:32:56,942 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/f16d65bce2724469aa13f1073973eff9, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/f16d65bce2724469aa13f1073973eff9
2014-11-25 13:32:57,245 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4788167 synced till here 4788161
2014-11-25 13:32:57,250 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/29d7c5653d734bfa958bac4caa19d4a6, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/29d7c5653d734bfa958bac4caa19d4a6
2014-11-25 13:32:57,250 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159. into cb961059338b42a8ac73be876c3a4cd1(size=171.3 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 9sec to execute.
2014-11-25 13:32:57,250 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159., storeName=family, fileCount=3, fileSize=172.5 M, priority=-4, time=5780192279498747; duration=9sec
2014-11-25 13:32:57,250 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5096), split_queue=0, merge_queue=0
2014-11-25 13:32:57,250 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5096), split_queue=0, merge_queue=0
2014-11-25 13:32:57,250 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:32:57,251 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 5 files of size 305534438 starting at candidate #9 after considering 236 permutations with 216 in ratio
2014-11-25 13:32:57,251 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: c39bf51be729a809eb64230aef470856 - family: Initiating minor compaction
2014-11-25 13:32:57,251 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856.
2014-11-25 13:32:57,251 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 5 file(s) in family of usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/.tmp, totalSize=291.4 M
2014-11-25 13:32:57,251 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/148d58047c2f4b27932f0898341d456a, keycount=41666, bloomtype=ROW, size=62.1 M, encoding=NONE, seqNum=18517
2014-11-25 13:32:57,251 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/6319ae527fe441f6aa1d6a1d1a466bc9, keycount=38192, bloomtype=ROW, size=56.9 M, encoding=NONE, seqNum=19266
2014-11-25 13:32:57,251 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/b1f67acb41194cc897e0841113f496cc, keycount=41099, bloomtype=ROW, size=61.3 M, encoding=NONE, seqNum=20073
2014-11-25 13:32:57,251 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/7daf515104834f74b3814dd9baef5198, keycount=38082, bloomtype=ROW, size=56.8 M, encoding=NONE, seqNum=20827
2014-11-25 13:32:57,252 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/35edee6319b2430d9b244213e6ab2a2d, keycount=36413, bloomtype=ROW, size=54.3 M, encoding=NONE, seqNum=21539
2014-11-25 13:32:57,751 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893575444 with entries=2481, filesize=173.1 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893576658
2014-11-25 13:32:57,752 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=109, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:32:58,246 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:58,623 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4790707 synced till here 4790681
2014-11-25 13:32:58,738 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893576658 with entries=2540, filesize=185.7 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893578246
2014-11-25 13:32:58,738 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=110, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:32:59,278 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:32:59,763 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4792617 synced till here 4792606
2014-11-25 13:33:00,020 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893578246 with entries=1910, filesize=128.7 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893579278
2014-11-25 13:33:00,021 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=111, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:33:00,123 INFO  [MemStoreFlusher.16] regionserver.MemStoreFlusher: Waited 90307ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027.
2014-11-25 13:33:00,123 DEBUG [MemStoreFlusher.16] regionserver.HRegion: Started memstore flush for usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027., current region memstore size 15.9 M
2014-11-25 13:33:00,416 INFO  [MemStoreFlusher.16] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48004, memsize=15.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/.tmp/6c1b3031e3a24eeb85368aa2ae2fab11
2014-11-25 13:33:00,615 DEBUG [MemStoreFlusher.16] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/.tmp/6c1b3031e3a24eeb85368aa2ae2fab11 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/6c1b3031e3a24eeb85368aa2ae2fab11
2014-11-25 13:33:00,718 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:33:01,027 INFO  [MemStoreFlusher.16] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/6c1b3031e3a24eeb85368aa2ae2fab11, entries=57790, sequenceid=48004, filesize=8.6 M
2014-11-25 13:33:01,027 INFO  [MemStoreFlusher.16] regionserver.HRegion: Finished memstore flush of ~15.9 M/16642960, currentsize=2.7 M/2779200 for region usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027. in 904ms, sequenceid=48004, compaction requested=true
2014-11-25 13:33:01,027 DEBUG [MemStoreFlusher.16] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.16; compaction_queue=(0:5096), split_queue=0, merge_queue=0
2014-11-25 13:33:01,105 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4795213 synced till here 4795202
2014-11-25 13:33:01,219 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893579278 with entries=2596, filesize=187.3 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893580719
2014-11-25 13:33:01,219 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=112, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:33:01,924 INFO  [MemStoreFlusher.13] regionserver.MemStoreFlusher: Waited 90294ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569.
2014-11-25 13:33:01,924 INFO  [MemStoreFlusher.6] regionserver.MemStoreFlusher: Waited 90823ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f.
2014-11-25 13:33:01,924 DEBUG [MemStoreFlusher.6] regionserver.HRegion: Started memstore flush for usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f., current region memstore size 19.6 M
2014-11-25 13:33:01,924 DEBUG [MemStoreFlusher.13] regionserver.HRegion: Started memstore flush for usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569., current region memstore size 20.1 M
2014-11-25 13:33:02,251 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:33:02,373 INFO  [MemStoreFlusher.13] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48030, memsize=20.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/.tmp/902094fc404b4306af83b6121dad15ef
2014-11-25 13:33:02,453 INFO  [MemStoreFlusher.6] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48034, memsize=19.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/.tmp/a0a58eaa226a4e629cdcaecc6bb730bd
2014-11-25 13:33:02,807 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4797502 synced till here 4797478
2014-11-25 13:33:03,046 DEBUG [MemStoreFlusher.13] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/.tmp/902094fc404b4306af83b6121dad15ef as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/902094fc404b4306af83b6121dad15ef
2014-11-25 13:33:03,087 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893580719 with entries=2289, filesize=162.5 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893582251
2014-11-25 13:33:03,087 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=113, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:33:03,119 DEBUG [MemStoreFlusher.6] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/.tmp/a0a58eaa226a4e629cdcaecc6bb730bd as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/a0a58eaa226a4e629cdcaecc6bb730bd
2014-11-25 13:33:03,332 INFO  [MemStoreFlusher.13] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/902094fc404b4306af83b6121dad15ef, entries=73340, sequenceid=48030, filesize=10.9 M
2014-11-25 13:33:03,332 INFO  [MemStoreFlusher.13] regionserver.HRegion: Finished memstore flush of ~20.1 M/21121120, currentsize=3.7 M/3862000 for region usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569. in 1408ms, sequenceid=48030, compaction requested=true
2014-11-25 13:33:03,332 DEBUG [MemStoreFlusher.13] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.13; compaction_queue=(0:5097), split_queue=0, merge_queue=0
2014-11-25 13:33:03,373 INFO  [MemStoreFlusher.6] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/a0a58eaa226a4e629cdcaecc6bb730bd, entries=72000, sequenceid=48034, filesize=10.7 M
2014-11-25 13:33:03,373 INFO  [MemStoreFlusher.6] regionserver.HRegion: Finished memstore flush of ~19.8 M/20735600, currentsize=4.2 M/4391920 for region usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f. in 1449ms, sequenceid=48034, compaction requested=true
2014-11-25 13:33:03,373 DEBUG [MemStoreFlusher.6] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.6; compaction_queue=(0:5098), split_queue=0, merge_queue=0
2014-11-25 13:33:03,535 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:33:04,183 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4799386 synced till here 4799370
2014-11-25 13:33:04,198 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893582251 with entries=1884, filesize=137.0 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893583535
2014-11-25 13:33:04,199 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=114, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:33:04,984 INFO  [MemStoreFlusher.7] regionserver.MemStoreFlusher: Waited 90036ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8199,1416889268210.943652e75e710b59828d58f58f4dc4fe.
2014-11-25 13:33:04,984 INFO  [MemStoreFlusher.11] regionserver.MemStoreFlusher: Waited 90084ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407.
2014-11-25 13:33:04,985 INFO  [MemStoreFlusher.31] regionserver.MemStoreFlusher: Waited 90212ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4779,1416889268210.1c65748e65f11456ce7b67d20bff3966.
2014-11-25 13:33:04,985 INFO  [MemStoreFlusher.21] regionserver.MemStoreFlusher: Waited 90398ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5319,1416889268210.c2e76bfcf0ee452319788ce49186a339.
2014-11-25 13:33:04,985 INFO  [MemStoreFlusher.5] regionserver.MemStoreFlusher: Waited 90168ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3429,1416889268210.040dc650b54378108a29bab140ceeb02.
2014-11-25 13:33:04,985 INFO  [MemStoreFlusher.14] regionserver.MemStoreFlusher: Waited 90083ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8559,1416889268210.f493ed6daa8012ad6a97726dcb83e1b6.
2014-11-25 13:33:04,985 INFO  [MemStoreFlusher.28] regionserver.MemStoreFlusher: Waited 90292ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6219,1416889268210.e452c53f69cba13d15de325c057fb970.
2014-11-25 13:33:04,985 DEBUG [MemStoreFlusher.21] regionserver.HRegion: Started memstore flush for usertable2,user5319,1416889268210.c2e76bfcf0ee452319788ce49186a339., current region memstore size 320.1 M
2014-11-25 13:33:04,985 DEBUG [MemStoreFlusher.14] regionserver.HRegion: Started memstore flush for usertable2,user8559,1416889268210.f493ed6daa8012ad6a97726dcb83e1b6., current region memstore size 318.0 M
2014-11-25 13:33:04,985 DEBUG [MemStoreFlusher.28] regionserver.HRegion: Started memstore flush for usertable2,user6219,1416889268210.e452c53f69cba13d15de325c057fb970., current region memstore size 319.6 M
2014-11-25 13:33:04,985 INFO  [MemStoreFlusher.12] regionserver.MemStoreFlusher: Waited 90196ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3699,1416889268210.b0dd08f1639152a6ac8ca032afa4d6db.
2014-11-25 13:33:04,985 INFO  [MemStoreFlusher.10] regionserver.MemStoreFlusher: Waited 90051ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d.
2014-11-25 13:33:04,985 DEBUG [MemStoreFlusher.11] regionserver.HRegion: Started memstore flush for usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407., current region memstore size 23.1 M
2014-11-25 13:33:04,985 DEBUG [MemStoreFlusher.7] regionserver.HRegion: Started memstore flush for usertable2,user8199,1416889268210.943652e75e710b59828d58f58f4dc4fe., current region memstore size 317.5 M
2014-11-25 13:33:04,985 DEBUG [MemStoreFlusher.10] regionserver.HRegion: Started memstore flush for usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d., current region memstore size 23.8 M
2014-11-25 13:33:04,985 DEBUG [MemStoreFlusher.31] regionserver.HRegion: Started memstore flush for usertable2,user4779,1416889268210.1c65748e65f11456ce7b67d20bff3966., current region memstore size 319.4 M
2014-11-25 13:33:04,986 INFO  [MemStoreFlusher.33] regionserver.MemStoreFlusher: Waited 90109ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2979,1416889268210.eb335d2faee6fcc254e5fef1453c282b.
2014-11-25 13:33:04,986 DEBUG [MemStoreFlusher.33] regionserver.HRegion: Started memstore flush for usertable2,user2979,1416889268210.eb335d2faee6fcc254e5fef1453c282b., current region memstore size 318.9 M
2014-11-25 13:33:04,985 INFO  [MemStoreFlusher.35] regionserver.MemStoreFlusher: Waited 90544ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6579,1416889268210.bff12d4267dd884829eb5659611c40f9.
2014-11-25 13:33:04,988 DEBUG [MemStoreFlusher.35] regionserver.HRegion: Started memstore flush for usertable2,user6579,1416889268210.bff12d4267dd884829eb5659611c40f9., current region memstore size 320.4 M
2014-11-25 13:33:04,989 INFO  [MemStoreFlusher.18] regionserver.MemStoreFlusher: Waited 90008ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf.
2014-11-25 13:33:04,989 INFO  [MemStoreFlusher.9] regionserver.MemStoreFlusher: Waited 90009ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5.
2014-11-25 13:33:04,989 INFO  [MemStoreFlusher.23] regionserver.MemStoreFlusher: Waited 90071ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5859,1416889268210.653390cc13d30804b9445ebffd69a81d.
2014-11-25 13:33:04,989 INFO  [MemStoreFlusher.22] regionserver.MemStoreFlusher: Waited 90233ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4959,1416889268210.3ec2e06a3605856a1dd62083096f2771.
2014-11-25 13:33:04,989 DEBUG [MemStoreFlusher.18] regionserver.HRegion: Started memstore flush for usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf., current region memstore size 23.6 M
2014-11-25 13:33:04,989 DEBUG [MemStoreFlusher.23] regionserver.HRegion: Started memstore flush for usertable2,user5859,1416889268210.653390cc13d30804b9445ebffd69a81d., current region memstore size 319.1 M
2014-11-25 13:33:04,990 DEBUG [MemStoreFlusher.22] regionserver.HRegion: Started memstore flush for usertable2,user4959,1416889268210.3ec2e06a3605856a1dd62083096f2771., current region memstore size 319.9 M
2014-11-25 13:33:04,990 INFO  [MemStoreFlusher.3] regionserver.MemStoreFlusher: Waited 90378ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49.
2014-11-25 13:33:04,990 INFO  [MemStoreFlusher.25] regionserver.MemStoreFlusher: Waited 91074ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e.
2014-11-25 13:33:04,990 DEBUG [MemStoreFlusher.3] regionserver.HRegion: Started memstore flush for usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49., current region memstore size 320.1 M
2014-11-25 13:33:04,990 DEBUG [MemStoreFlusher.25] regionserver.HRegion: Started memstore flush for usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e., current region memstore size 24.4 M
2014-11-25 13:33:04,985 DEBUG [MemStoreFlusher.12] regionserver.HRegion: Started memstore flush for usertable2,user3699,1416889268210.b0dd08f1639152a6ac8ca032afa4d6db., current region memstore size 319.7 M
2014-11-25 13:33:04,990 INFO  [MemStoreFlusher.2] regionserver.MemStoreFlusher: Waited 90276ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3519,1416889268210.fc6c0c446a315daf2015d57ba81babe0.
2014-11-25 13:33:04,989 DEBUG [MemStoreFlusher.9] regionserver.HRegion: Started memstore flush for usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5., current region memstore size 318.4 M
2014-11-25 13:33:04,991 DEBUG [MemStoreFlusher.2] regionserver.HRegion: Started memstore flush for usertable2,user3519,1416889268210.fc6c0c446a315daf2015d57ba81babe0., current region memstore size 319.9 M
2014-11-25 13:33:04,995 DEBUG [MemStoreFlusher.5] regionserver.HRegion: Started memstore flush for usertable2,user3429,1416889268210.040dc650b54378108a29bab140ceeb02., current region memstore size 319.5 M
2014-11-25 13:33:05,194 INFO  [MemStoreFlusher.10] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48069, memsize=23.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/.tmp/f4a79485d02a470b8b78608b790c7ecc
2014-11-25 13:33:05,210 INFO  [MemStoreFlusher.25] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48049, memsize=24.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/.tmp/51fa40e43c094a02a5cbb504aa706241
2014-11-25 13:33:05,223 DEBUG [MemStoreFlusher.10] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/.tmp/f4a79485d02a470b8b78608b790c7ecc as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/f4a79485d02a470b8b78608b790c7ecc
2014-11-25 13:33:05,233 DEBUG [MemStoreFlusher.25] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/.tmp/51fa40e43c094a02a5cbb504aa706241 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/51fa40e43c094a02a5cbb504aa706241
2014-11-25 13:33:05,243 INFO  [MemStoreFlusher.10] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/f4a79485d02a470b8b78608b790c7ecc, entries=86640, sequenceid=48069, filesize=12.9 M
2014-11-25 13:33:05,243 INFO  [MemStoreFlusher.10] regionserver.HRegion: Finished memstore flush of ~23.8 M/24951520, currentsize=1.0 M/1077040 for region usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d. in 258ms, sequenceid=48069, compaction requested=true
2014-11-25 13:33:05,243 DEBUG [MemStoreFlusher.10] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.10; compaction_queue=(0:5099), split_queue=0, merge_queue=0
2014-11-25 13:33:05,254 INFO  [MemStoreFlusher.25] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/51fa40e43c094a02a5cbb504aa706241, entries=88920, sequenceid=48049, filesize=13.3 M
2014-11-25 13:33:05,254 INFO  [MemStoreFlusher.25] regionserver.HRegion: Finished memstore flush of ~24.4 M/25608160, currentsize=126.6 K/129600 for region usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e. in 264ms, sequenceid=48049, compaction requested=true
2014-11-25 13:33:05,254 DEBUG [MemStoreFlusher.25] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.25; compaction_queue=(0:5100), split_queue=0, merge_queue=0
2014-11-25 13:33:05,560 INFO  [MemStoreFlusher.11] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48065, memsize=23.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/.tmp/89ad7afcf89f49f085ec31fa20cb809e
2014-11-25 13:33:05,560 INFO  [MemStoreFlusher.18] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48069, memsize=23.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/.tmp/837150e57f7f481eb215e10c6a8c36a9
2014-11-25 13:33:05,617 DEBUG [MemStoreFlusher.18] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/.tmp/837150e57f7f481eb215e10c6a8c36a9 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/837150e57f7f481eb215e10c6a8c36a9
2014-11-25 13:33:05,639 DEBUG [MemStoreFlusher.11] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/.tmp/89ad7afcf89f49f085ec31fa20cb809e as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/89ad7afcf89f49f085ec31fa20cb809e
2014-11-25 13:33:05,649 INFO  [MemStoreFlusher.18] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/837150e57f7f481eb215e10c6a8c36a9, entries=86220, sequenceid=48069, filesize=12.9 M
2014-11-25 13:33:05,649 INFO  [MemStoreFlusher.18] regionserver.HRegion: Finished memstore flush of ~23.7 M/24830800, currentsize=1.4 M/1434240 for region usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf. in 660ms, sequenceid=48069, compaction requested=true
2014-11-25 13:33:05,650 DEBUG [MemStoreFlusher.18] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.18; compaction_queue=(0:5101), split_queue=0, merge_queue=0
2014-11-25 13:33:05,652 INFO  [MemStoreFlusher.11] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/89ad7afcf89f49f085ec31fa20cb809e, entries=84150, sequenceid=48065, filesize=12.5 M
2014-11-25 13:33:05,652 INFO  [MemStoreFlusher.11] regionserver.HRegion: Finished memstore flush of ~23.1 M/24234160, currentsize=1.9 M/2001520 for region usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407. in 667ms, sequenceid=48065, compaction requested=true
2014-11-25 13:33:05,652 DEBUG [MemStoreFlusher.11] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.11; compaction_queue=(0:5102), split_queue=0, merge_queue=0
2014-11-25 13:33:05,884 INFO  [MemStoreFlusher.20] regionserver.MemStoreFlusher: Waited 90493ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8739,1416889268210.10fbbcf2b6f1389e433a4a5211bf2642.
2014-11-25 13:33:05,884 INFO  [MemStoreFlusher.30] regionserver.MemStoreFlusher: Waited 90887ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd.
2014-11-25 13:33:05,884 INFO  [MemStoreFlusher.24] regionserver.MemStoreFlusher: Waited 90025ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4149,1416889268210.c068f0d848be8a8d9b2a90f612ef94a1.
2014-11-25 13:33:05,884 DEBUG [MemStoreFlusher.20] regionserver.HRegion: Started memstore flush for usertable2,user8739,1416889268210.10fbbcf2b6f1389e433a4a5211bf2642., current region memstore size 318.5 M
2014-11-25 13:33:05,884 DEBUG [MemStoreFlusher.30] regionserver.HRegion: Started memstore flush for usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd., current region memstore size 318.9 M
2014-11-25 13:33:05,884 DEBUG [MemStoreFlusher.24] regionserver.HRegion: Started memstore flush for usertable2,user4149,1416889268210.c068f0d848be8a8d9b2a90f612ef94a1., current region memstore size 318.4 M
2014-11-25 13:33:05,885 INFO  [MemStoreFlusher.15] regionserver.MemStoreFlusher: Waited 90024ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2169,1416889268210.a6d76b3d9a5a10e578fccc6098a8444b.
2014-11-25 13:33:05,885 INFO  [MemStoreFlusher.0] regionserver.MemStoreFlusher: Waited 90468ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da.
2014-11-25 13:33:05,885 INFO  [MemStoreFlusher.37] regionserver.MemStoreFlusher: Waited 90115ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1989,1416889268210.5f25bd0630c80f4e811af5f6488c5a89.
2014-11-25 13:33:05,885 DEBUG [MemStoreFlusher.15] regionserver.HRegion: Started memstore flush for usertable2,user2169,1416889268210.a6d76b3d9a5a10e578fccc6098a8444b., current region memstore size 319.2 M
2014-11-25 13:33:05,885 INFO  [MemStoreFlusher.4] regionserver.MemStoreFlusher: Waited 90011ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user9099,1416889268210.66f19c7f25bc31928ead99dff847aa7f.
2014-11-25 13:33:05,885 INFO  [MemStoreFlusher.34] regionserver.MemStoreFlusher: Waited 90899ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4689,1416889268210.f163e7c364cbfc321d89062a8ec9a958.
2014-11-25 13:33:05,885 INFO  [MemStoreFlusher.26] regionserver.MemStoreFlusher: Waited 90464ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159.
2014-11-25 13:33:05,885 DEBUG [MemStoreFlusher.0] regionserver.HRegion: Started memstore flush for usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da., current region memstore size 318.6 M
2014-11-25 13:33:05,886 DEBUG [MemStoreFlusher.4] regionserver.HRegion: Started memstore flush for usertable2,user9099,1416889268210.66f19c7f25bc31928ead99dff847aa7f., current region memstore size 317.7 M
2014-11-25 13:33:05,885 INFO  [MemStoreFlusher.27] regionserver.MemStoreFlusher: Waited 90845ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d.
2014-11-25 13:33:05,886 INFO  [MemStoreFlusher.10] regionserver.MemStoreFlusher: Waited 90007ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5139,1416889268210.a8d0d190cb61bd1bf54306b4bc472da1.
2014-11-25 13:33:05,885 DEBUG [MemStoreFlusher.37] regionserver.HRegion: Started memstore flush for usertable2,user1989,1416889268210.5f25bd0630c80f4e811af5f6488c5a89., current region memstore size 319.8 M
2014-11-25 13:33:05,886 DEBUG [MemStoreFlusher.26] regionserver.HRegion: Started memstore flush for usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159., current region memstore size 318.8 M
2014-11-25 13:33:05,886 DEBUG [MemStoreFlusher.27] regionserver.HRegion: Started memstore flush for usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d., current region memstore size 319.2 M
2014-11-25 13:33:05,886 DEBUG [MemStoreFlusher.34] regionserver.HRegion: Started memstore flush for usertable2,user4689,1416889268210.f163e7c364cbfc321d89062a8ec9a958., current region memstore size 319.1 M
2014-11-25 13:33:05,894 INFO  [MemStoreFlusher.32] regionserver.MemStoreFlusher: Waited 90846ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4239,1416889268210.e521da13cf88c7e5aa481035feae21e5.
2014-11-25 13:33:05,895 DEBUG [MemStoreFlusher.32] regionserver.HRegion: Started memstore flush for usertable2,user4239,1416889268210.e521da13cf88c7e5aa481035feae21e5., current region memstore size 319.0 M
2014-11-25 13:33:05,886 DEBUG [MemStoreFlusher.10] regionserver.HRegion: Started memstore flush for usertable2,user5139,1416889268210.a8d0d190cb61bd1bf54306b4bc472da1., current region memstore size 317.8 M
2014-11-25 13:33:05,901 INFO  [MemStoreFlusher.29] regionserver.MemStoreFlusher: Waited 90874ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8919,1416889268210.ff707032c52bfca061ec7055b315d1ac.
2014-11-25 13:33:05,901 INFO  [MemStoreFlusher.36] regionserver.MemStoreFlusher: Waited 90894ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5.
2014-11-25 13:33:05,902 DEBUG [MemStoreFlusher.29] regionserver.HRegion: Started memstore flush for usertable2,user8919,1416889268210.ff707032c52bfca061ec7055b315d1ac., current region memstore size 318.5 M
2014-11-25 13:33:05,902 DEBUG [MemStoreFlusher.36] regionserver.HRegion: Started memstore flush for usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5., current region memstore size 318.5 M
2014-11-25 13:33:05,901 INFO  [MemStoreFlusher.1] regionserver.MemStoreFlusher: Waited 90091ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1539,1416889268210.cc10fb31d8cc1e28a698092d6c1a5416.
2014-11-25 13:33:05,903 DEBUG [MemStoreFlusher.1] regionserver.HRegion: Started memstore flush for usertable2,user1539,1416889268210.cc10fb31d8cc1e28a698092d6c1a5416., current region memstore size 319.6 M
2014-11-25 13:33:05,905 INFO  [MemStoreFlusher.13] regionserver.MemStoreFlusher: Waited 90035ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4.
2014-11-25 13:33:05,905 INFO  [MemStoreFlusher.19] regionserver.MemStoreFlusher: Waited 90009ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2529,1416889268210.b451134c60b1dc7cf526e81f6db2c433.
2014-11-25 13:33:05,905 INFO  [MemStoreFlusher.8] regionserver.MemStoreFlusher: Waited 90377ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3789,1416889268210.4cbd9216f88e34160a388d0cd31c622c.
2014-11-25 13:33:05,906 DEBUG [MemStoreFlusher.13] regionserver.HRegion: Started memstore flush for usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4., current region memstore size 317.6 M
2014-11-25 13:33:05,906 DEBUG [MemStoreFlusher.19] regionserver.HRegion: Started memstore flush for usertable2,user2529,1416889268210.b451134c60b1dc7cf526e81f6db2c433., current region memstore size 319.1 M
2014-11-25 13:33:05,906 DEBUG [MemStoreFlusher.8] regionserver.HRegion: Started memstore flush for usertable2,user3789,1416889268210.4cbd9216f88e34160a388d0cd31c622c., current region memstore size 319.0 M
2014-11-25 13:33:06,784 INFO  [MemStoreFlusher.17] regionserver.MemStoreFlusher: Waited 90893ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b.
2014-11-25 13:33:06,784 DEBUG [MemStoreFlusher.17] regionserver.HRegion: Started memstore flush for usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b., current region memstore size 319.6 M
2014-11-25 13:33:06,785 INFO  [MemStoreFlusher.38] regionserver.MemStoreFlusher: Waited 90888ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0.
2014-11-25 13:33:06,785 INFO  [MemStoreFlusher.16] regionserver.MemStoreFlusher: Waited 90541ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5589,1416889268210.cfb348ee570fa731ba8caa85099a1bd5.
2014-11-25 13:33:06,785 INFO  [MemStoreFlusher.25] regionserver.MemStoreFlusher: Waited 90723ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9.
2014-11-25 13:33:06,785 INFO  [MemStoreFlusher.39] regionserver.MemStoreFlusher: Waited 90707ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297.
2014-11-25 13:33:06,785 INFO  [MemStoreFlusher.18] regionserver.MemStoreFlusher: Waited 90512ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3159,1416889268210.09a9193727ffcc63b8838a6c82b049a5.
2014-11-25 13:33:06,785 INFO  [MemStoreFlusher.6] regionserver.MemStoreFlusher: Waited 90583ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2889,1416889268210.44276931450f87557d509a6420f58f5c.
2014-11-25 13:33:06,785 DEBUG [MemStoreFlusher.38] regionserver.HRegion: Started memstore flush for usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0., current region memstore size 318.2 M
2014-11-25 13:33:06,785 DEBUG [MemStoreFlusher.25] regionserver.HRegion: Started memstore flush for usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9., current region memstore size 318.1 M
2014-11-25 13:33:06,785 INFO  [MemStoreFlusher.11] regionserver.MemStoreFlusher: Waited 90464ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2709,1416889268210.fd0aae1076bc05c8db51754294c21e38.
2014-11-25 13:33:06,786 DEBUG [MemStoreFlusher.6] regionserver.HRegion: Started memstore flush for usertable2,user2889,1416889268210.44276931450f87557d509a6420f58f5c., current region memstore size 318.0 M
2014-11-25 13:33:06,786 DEBUG [MemStoreFlusher.11] regionserver.HRegion: Started memstore flush for usertable2,user2709,1416889268210.fd0aae1076bc05c8db51754294c21e38., current region memstore size 318.1 M
2014-11-25 13:33:06,786 DEBUG [MemStoreFlusher.18] regionserver.HRegion: Started memstore flush for usertable2,user3159,1416889268210.09a9193727ffcc63b8838a6c82b049a5., current region memstore size 317.9 M
2014-11-25 13:33:06,786 DEBUG [MemStoreFlusher.39] regionserver.HRegion: Started memstore flush for usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297., current region memstore size 319.0 M
2014-11-25 13:33:06,786 DEBUG [MemStoreFlusher.16] regionserver.HRegion: Started memstore flush for usertable2,user5589,1416889268210.cfb348ee570fa731ba8caa85099a1bd5., current region memstore size 316.9 M
2014-11-25 13:33:08,535 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/.tmp/35535947099c4791bb493cd4efbfebf2 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/35535947099c4791bb493cd4efbfebf2
2014-11-25 13:33:10,254 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:33:10,264 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/148d58047c2f4b27932f0898341d456a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/148d58047c2f4b27932f0898341d456a
2014-11-25 13:33:10,269 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/6319ae527fe441f6aa1d6a1d1a466bc9, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/6319ae527fe441f6aa1d6a1d1a466bc9
2014-11-25 13:33:10,272 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/b1f67acb41194cc897e0841113f496cc, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/b1f67acb41194cc897e0841113f496cc
2014-11-25 13:33:10,274 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/7daf515104834f74b3814dd9baef5198, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/7daf515104834f74b3814dd9baef5198
2014-11-25 13:33:10,276 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/35edee6319b2430d9b244213e6ab2a2d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/35edee6319b2430d9b244213e6ab2a2d
2014-11-25 13:33:10,277 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 5 file(s) in family of usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856. into 35535947099c4791bb493cd4efbfebf2(size=289.5 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 13sec to execute.
2014-11-25 13:33:10,277 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856., storeName=family, fileCount=5, fileSize=291.4 M, priority=-5, time=5780201473701612; duration=13sec
2014-11-25 13:33:10,277 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5103), split_queue=0, merge_queue=0
2014-11-25 13:33:10,277 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5103), split_queue=0, merge_queue=0
2014-11-25 13:33:10,277 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:33:10,277 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 175474484 starting at candidate #21 after considering 236 permutations with 196 in ratio
2014-11-25 13:33:10,277 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: ddd9bfab1f5915e5ad2048983a201027 - family: Initiating minor compaction
2014-11-25 13:33:10,277 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027.
2014-11-25 13:33:10,278 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/.tmp, totalSize=167.3 M
2014-11-25 13:33:10,278 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/3b7c42615d2c489e9567f122867ea191, keycount=36119, bloomtype=ROW, size=53.9 M, encoding=NONE, seqNum=30343
2014-11-25 13:33:10,278 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/d2fd76be038d4796b79909200a1627f2, keycount=36373, bloomtype=ROW, size=54.2 M, encoding=NONE, seqNum=31060
2014-11-25 13:33:10,278 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/6e3c893fd0b14353b600935e69c70f3f, keycount=39755, bloomtype=ROW, size=59.3 M, encoding=NONE, seqNum=31842
2014-11-25 13:33:15,499 WARN  [RpcServer.handler=135,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":12670,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893582828,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:15,549 WARN  [RpcServer.handler=14,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":12669,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893582880,"queuetimems":0,"class":"HRegionServer","responsesize":33038,"method":"Multi"}
2014-11-25 13:33:17,687 WARN  [RpcServer.handler=146,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":14650,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893583037,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:17,871 WARN  [RpcServer.handler=118,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":14780,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893583091,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:24,166 WARN  [RpcServer.handler=44,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":21015,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893583150,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:24,269 DEBUG [LruStats #0] hfile.LruBlockCache: Total=14.38 MB, free=12.79 GB, max=12.80 GB, blocks=113, accesses=1827092, hits=1489, hitRatio=0.08%, , cachingAccesses=1605, cachingHits=1376, cachingHitsRatio=85.73%, evictions=0, evicted=116, evictedPerRun=Infinity
2014-11-25 13:33:25,289 WARN  [RpcServer.handler=61,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":22089,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893583199,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:27,027 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:33:27,098 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4801134 synced till here 4801102
2014-11-25 13:33:27,200 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893583535 with entries=1748, filesize=124.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893607027
2014-11-25 13:33:27,201 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=115, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:33:27,875 WARN  [RpcServer.handler=40,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":24629,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893583246,"queuetimems":1,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:28,003 INFO  [MemStoreFlusher.5] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48063, memsize=319.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/.tmp/dee7987182974a5385ea22b7f97ed14b
2014-11-25 13:33:28,009 DEBUG [MemStoreFlusher.5] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/.tmp/dee7987182974a5385ea22b7f97ed14b as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/family/dee7987182974a5385ea22b7f97ed14b
2014-11-25 13:33:28,013 INFO  [MemStoreFlusher.5] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/family/dee7987182974a5385ea22b7f97ed14b, entries=1163220, sequenceid=48063, filesize=173.4 M
2014-11-25 13:33:28,013 INFO  [MemStoreFlusher.5] regionserver.HRegion: Finished memstore flush of ~319.5 M/334996880, currentsize=2.8 M/2923040 for region usertable2,user3429,1416889268210.040dc650b54378108a29bab140ceeb02. in 23018ms, sequenceid=48063, compaction requested=true
2014-11-25 13:33:28,013 DEBUG [MemStoreFlusher.5] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.5; compaction_queue=(0:5103), split_queue=0, merge_queue=0
2014-11-25 13:33:28,013 INFO  [MemStoreFlusher.5] regionserver.MemStoreFlusher: Waited 111673ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4059,1416889268210.a1bdaf5ad20e2ea54e0e5a2e45d102e5.
2014-11-25 13:33:28,013 DEBUG [MemStoreFlusher.5] regionserver.HRegion: Started memstore flush for usertable2,user4059,1416889268210.a1bdaf5ad20e2ea54e0e5a2e45d102e5., current region memstore size 318.5 M
2014-11-25 13:33:29,105 WARN  [RpcServer.handler=22,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":25809,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893583296,"queuetimems":0,"class":"HRegionServer","responsesize":33035,"method":"Multi"}
2014-11-25 13:33:29,846 WARN  [RpcServer.handler=131,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":26501,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893583344,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:31,092 INFO  [MemStoreFlusher.31] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48064, memsize=319.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/.tmp/58bd4e90278e4e45b1ed2cafc43bc6f1
2014-11-25 13:33:31,097 DEBUG [MemStoreFlusher.31] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/.tmp/58bd4e90278e4e45b1ed2cafc43bc6f1 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/family/58bd4e90278e4e45b1ed2cafc43bc6f1
2014-11-25 13:33:31,101 INFO  [MemStoreFlusher.31] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/family/58bd4e90278e4e45b1ed2cafc43bc6f1, entries=1163080, sequenceid=48064, filesize=173.4 M
2014-11-25 13:33:31,101 INFO  [MemStoreFlusher.31] regionserver.HRegion: Finished memstore flush of ~319.4 M/334958320, currentsize=2.5 M/2617840 for region usertable2,user4779,1416889268210.1c65748e65f11456ce7b67d20bff3966. in 26116ms, sequenceid=48064, compaction requested=true
2014-11-25 13:33:31,102 DEBUG [MemStoreFlusher.31] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.31; compaction_queue=(0:5104), split_queue=0, merge_queue=0
2014-11-25 13:33:31,102 INFO  [MemStoreFlusher.31] regionserver.MemStoreFlusher: Waited 115056ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3339,1416889268210.36dd667db34cc2a7fc0dd12698785418.
2014-11-25 13:33:31,102 DEBUG [MemStoreFlusher.31] regionserver.HRegion: Started memstore flush for usertable2,user3339,1416889268210.36dd667db34cc2a7fc0dd12698785418., current region memstore size 321.1 M
2014-11-25 13:33:31,162 INFO  [MemStoreFlusher.7] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48048, memsize=317.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/.tmp/746d307fb01b415bab14b829d34da225
2014-11-25 13:33:31,167 DEBUG [MemStoreFlusher.7] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/.tmp/746d307fb01b415bab14b829d34da225 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/746d307fb01b415bab14b829d34da225
2014-11-25 13:33:31,171 INFO  [MemStoreFlusher.7] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/746d307fb01b415bab14b829d34da225, entries=1155990, sequenceid=48048, filesize=172.3 M
2014-11-25 13:33:31,172 INFO  [MemStoreFlusher.7] regionserver.HRegion: Finished memstore flush of ~317.5 M/332915680, currentsize=2.3 M/2372880 for region usertable2,user8199,1416889268210.943652e75e710b59828d58f58f4dc4fe. in 26186ms, sequenceid=48048, compaction requested=true
2014-11-25 13:33:31,172 DEBUG [MemStoreFlusher.7] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.7; compaction_queue=(0:5105), split_queue=0, merge_queue=0
2014-11-25 13:33:31,172 INFO  [MemStoreFlusher.7] regionserver.MemStoreFlusher: Waited 114863ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5769,1416889268210.a6f20417c02c380a5937a58b862dfbb8.
2014-11-25 13:33:31,172 DEBUG [MemStoreFlusher.7] regionserver.HRegion: Started memstore flush for usertable2,user5769,1416889268210.a6f20417c02c380a5937a58b862dfbb8., current region memstore size 318.6 M
2014-11-25 13:33:32,233 INFO  [MemStoreFlusher.12] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48065, memsize=319.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/.tmp/b8d5524610ad498498530d49bafdad97
2014-11-25 13:33:32,293 DEBUG [MemStoreFlusher.12] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/.tmp/b8d5524610ad498498530d49bafdad97 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/family/b8d5524610ad498498530d49bafdad97
2014-11-25 13:33:32,300 INFO  [MemStoreFlusher.12] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/family/b8d5524610ad498498530d49bafdad97, entries=1163900, sequenceid=48065, filesize=173.5 M
2014-11-25 13:33:32,300 INFO  [MemStoreFlusher.12] regionserver.HRegion: Finished memstore flush of ~319.7 M/335193440, currentsize=3.5 M/3623040 for region usertable2,user3699,1416889268210.b0dd08f1639152a6ac8ca032afa4d6db. in 27315ms, sequenceid=48065, compaction requested=true
2014-11-25 13:33:32,300 DEBUG [MemStoreFlusher.12] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.12; compaction_queue=(0:5106), split_queue=0, merge_queue=0
2014-11-25 13:33:32,301 INFO  [MemStoreFlusher.12] regionserver.MemStoreFlusher: Waited 116349ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4599,1416889268210.eead33f80ffa1e642cc147c38794f39c.
2014-11-25 13:33:32,301 DEBUG [MemStoreFlusher.12] regionserver.HRegion: Started memstore flush for usertable2,user4599,1416889268210.eead33f80ffa1e642cc147c38794f39c., current region memstore size 319.8 M
2014-11-25 13:33:32,324 INFO  [MemStoreFlusher.2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48063, memsize=319.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/.tmp/c3ad1763694743a599e6cd137f257bc7
2014-11-25 13:33:32,331 DEBUG [MemStoreFlusher.2] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/.tmp/c3ad1763694743a599e6cd137f257bc7 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/c3ad1763694743a599e6cd137f257bc7
2014-11-25 13:33:32,339 INFO  [MemStoreFlusher.2] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/c3ad1763694743a599e6cd137f257bc7, entries=1164900, sequenceid=48063, filesize=173.6 M
2014-11-25 13:33:32,339 INFO  [MemStoreFlusher.2] regionserver.HRegion: Finished memstore flush of ~319.9 M/335482240, currentsize=3.6 M/3810080 for region usertable2,user3519,1416889268210.fc6c0c446a315daf2015d57ba81babe0. in 27348ms, sequenceid=48063, compaction requested=true
2014-11-25 13:33:32,340 DEBUG [MemStoreFlusher.2] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.2; compaction_queue=(0:5107), split_queue=0, merge_queue=0
2014-11-25 13:33:32,340 INFO  [MemStoreFlusher.2] regionserver.MemStoreFlusher: Waited 116103ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568.
2014-11-25 13:33:32,340 DEBUG [MemStoreFlusher.2] regionserver.HRegion: Started memstore flush for usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568., current region memstore size 319.7 M
2014-11-25 13:33:33,451 INFO  [MemStoreFlusher.4] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48060, memsize=317.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/.tmp/fd6bce18ce7a4ee389aa84f9f8f3304f
2014-11-25 13:33:33,457 DEBUG [MemStoreFlusher.4] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/.tmp/fd6bce18ce7a4ee389aa84f9f8f3304f as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/family/fd6bce18ce7a4ee389aa84f9f8f3304f
2014-11-25 13:33:33,460 INFO  [MemStoreFlusher.4] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/family/fd6bce18ce7a4ee389aa84f9f8f3304f, entries=1157370, sequenceid=48060, filesize=172.5 M
2014-11-25 13:33:33,461 INFO  [MemStoreFlusher.4] regionserver.HRegion: Finished memstore flush of ~317.9 M/333314160, currentsize=863.4 K/884160 for region usertable2,user9099,1416889268210.66f19c7f25bc31928ead99dff847aa7f. in 27576ms, sequenceid=48060, compaction requested=true
2014-11-25 13:33:33,461 DEBUG [MemStoreFlusher.4] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.4; compaction_queue=(0:5108), split_queue=0, merge_queue=0
2014-11-25 13:33:33,461 INFO  [MemStoreFlusher.4] regionserver.MemStoreFlusher: Waited 117343ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4509,1416889268210.f0600c6f184e26e751ccebaff48fbe93.
2014-11-25 13:33:33,461 DEBUG [MemStoreFlusher.4] regionserver.HRegion: Started memstore flush for usertable2,user4509,1416889268210.f0600c6f184e26e751ccebaff48fbe93., current region memstore size 319.8 M
2014-11-25 13:33:34,401 INFO  [MemStoreFlusher.37] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48080, memsize=320.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/.tmp/c7b3deb72d7d4bc88d7a6fafe9aa757f
2014-11-25 13:33:34,407 DEBUG [MemStoreFlusher.37] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/.tmp/c7b3deb72d7d4bc88d7a6fafe9aa757f as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/family/c7b3deb72d7d4bc88d7a6fafe9aa757f
2014-11-25 13:33:34,412 INFO  [MemStoreFlusher.37] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/family/c7b3deb72d7d4bc88d7a6fafe9aa757f, entries=1164990, sequenceid=48080, filesize=173.6 M
2014-11-25 13:33:34,412 INFO  [MemStoreFlusher.37] regionserver.HRegion: Finished memstore flush of ~320.0 M/335508880, currentsize=1.8 M/1912240 for region usertable2,user1989,1416889268210.5f25bd0630c80f4e811af5f6488c5a89. in 28527ms, sequenceid=48080, compaction requested=true
2014-11-25 13:33:34,412 DEBUG [MemStoreFlusher.37] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.37; compaction_queue=(0:5109), split_queue=0, merge_queue=0
2014-11-25 13:33:34,412 INFO  [MemStoreFlusher.37] regionserver.MemStoreFlusher: Waited 118155ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1449,1416889268210.952a6132a4e977be00a90f6ac7e69235.
2014-11-25 13:33:34,412 DEBUG [MemStoreFlusher.37] regionserver.HRegion: Started memstore flush for usertable2,user1449,1416889268210.952a6132a4e977be00a90f6ac7e69235., current region memstore size 320.3 M
2014-11-25 13:33:34,539 INFO  [MemStoreFlusher.14] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48048, memsize=318.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/.tmp/8e8870ce9b7f4b27a94cf8799f107e39
2014-11-25 13:33:34,545 DEBUG [MemStoreFlusher.14] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/.tmp/8e8870ce9b7f4b27a94cf8799f107e39 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/8e8870ce9b7f4b27a94cf8799f107e39
2014-11-25 13:33:34,551 INFO  [MemStoreFlusher.33] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48063, memsize=318.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/.tmp/98f1da2ae80a48489d5a87986e4dd4dd
2014-11-25 13:33:34,556 INFO  [MemStoreFlusher.14] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/8e8870ce9b7f4b27a94cf8799f107e39, entries=1158140, sequenceid=48048, filesize=172.6 M
2014-11-25 13:33:34,557 INFO  [MemStoreFlusher.14] regionserver.HRegion: Finished memstore flush of ~318.1 M/333535360, currentsize=2.3 M/2416320 for region usertable2,user8559,1416889268210.f493ed6daa8012ad6a97726dcb83e1b6. in 29572ms, sequenceid=48048, compaction requested=true
2014-11-25 13:33:34,557 DEBUG [MemStoreFlusher.14] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.14; compaction_queue=(0:5110), split_queue=0, merge_queue=0
2014-11-25 13:33:34,557 INFO  [MemStoreFlusher.14] regionserver.MemStoreFlusher: Waited 118253ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2349,1416889268210.69fd185ded056a5c9f0e9bc4611ff44a.
2014-11-25 13:33:34,557 DEBUG [MemStoreFlusher.14] regionserver.HRegion: Started memstore flush for usertable2,user2349,1416889268210.69fd185ded056a5c9f0e9bc4611ff44a., current region memstore size 319.7 M
2014-11-25 13:33:34,560 DEBUG [MemStoreFlusher.33] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/.tmp/98f1da2ae80a48489d5a87986e4dd4dd as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/family/98f1da2ae80a48489d5a87986e4dd4dd
2014-11-25 13:33:34,565 INFO  [MemStoreFlusher.33] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/family/98f1da2ae80a48489d5a87986e4dd4dd, entries=1161240, sequenceid=48063, filesize=173.1 M
2014-11-25 13:33:34,565 INFO  [MemStoreFlusher.33] regionserver.HRegion: Finished memstore flush of ~318.9 M/334426320, currentsize=3.7 M/3882000 for region usertable2,user2979,1416889268210.eb335d2faee6fcc254e5fef1453c282b. in 29579ms, sequenceid=48063, compaction requested=true
2014-11-25 13:33:34,566 DEBUG [MemStoreFlusher.33] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.33; compaction_queue=(0:5111), split_queue=0, merge_queue=0
2014-11-25 13:33:34,566 INFO  [MemStoreFlusher.33] regionserver.MemStoreFlusher: Waited 118474ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7209,1416889268210.fa362bc0b2fed482214114394bfa26f3.
2014-11-25 13:33:34,566 DEBUG [MemStoreFlusher.33] regionserver.HRegion: Started memstore flush for usertable2,user7209,1416889268210.fa362bc0b2fed482214114394bfa26f3., current region memstore size 319.0 M
2014-11-25 13:33:34,796 INFO  [MemStoreFlusher.3] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48061, memsize=320.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/.tmp/923f0191dafd43e7be2e9c0ce8ed3bed
2014-11-25 13:33:34,802 DEBUG [MemStoreFlusher.3] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/.tmp/923f0191dafd43e7be2e9c0ce8ed3bed as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/923f0191dafd43e7be2e9c0ce8ed3bed
2014-11-25 13:33:34,807 INFO  [MemStoreFlusher.3] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/923f0191dafd43e7be2e9c0ce8ed3bed, entries=1165840, sequenceid=48061, filesize=173.8 M
2014-11-25 13:33:34,807 INFO  [MemStoreFlusher.3] regionserver.HRegion: Finished memstore flush of ~320.2 M/335752960, currentsize=2.5 M/2638080 for region usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49. in 29817ms, sequenceid=48061, compaction requested=true
2014-11-25 13:33:34,807 DEBUG [MemStoreFlusher.3] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.3; compaction_queue=(0:5112), split_queue=0, merge_queue=0
2014-11-25 13:33:34,807 INFO  [MemStoreFlusher.3] regionserver.MemStoreFlusher: Waited 118622ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952.
2014-11-25 13:33:34,807 DEBUG [MemStoreFlusher.3] regionserver.HRegion: Started memstore flush for usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952., current region memstore size 319.8 M
2014-11-25 13:33:35,800 INFO  [MemStoreFlusher.17] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48078, memsize=319.6 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/.tmp/0062da405c8c49e19f681e79ee080250
2014-11-25 13:33:35,806 DEBUG [MemStoreFlusher.17] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/.tmp/0062da405c8c49e19f681e79ee080250 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/0062da405c8c49e19f681e79ee080250
2014-11-25 13:33:35,811 INFO  [MemStoreFlusher.17] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/0062da405c8c49e19f681e79ee080250, entries=1163600, sequenceid=48078, filesize=173.4 M
2014-11-25 13:33:35,811 INFO  [MemStoreFlusher.17] regionserver.HRegion: Finished memstore flush of ~319.6 M/335107040, currentsize=2.2 M/2263680 for region usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b. in 29027ms, sequenceid=48078, compaction requested=true
2014-11-25 13:33:35,811 DEBUG [MemStoreFlusher.17] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.17; compaction_queue=(0:5113), split_queue=0, merge_queue=0
2014-11-25 13:33:35,811 INFO  [MemStoreFlusher.17] regionserver.MemStoreFlusher: Waited 119869ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4419,1416889268210.4fa6c789550f08f213befa07da277397.
2014-11-25 13:33:35,811 DEBUG [MemStoreFlusher.17] regionserver.HRegion: Started memstore flush for usertable2,user4419,1416889268210.4fa6c789550f08f213befa07da277397., current region memstore size 320.7 M
2014-11-25 13:33:35,899 INFO  [MemStoreFlusher.35] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48057, memsize=320.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/.tmp/4bd72f2c4a2840978e5eb1b20bee9647
2014-11-25 13:33:35,913 DEBUG [MemStoreFlusher.35] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/.tmp/4bd72f2c4a2840978e5eb1b20bee9647 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/4bd72f2c4a2840978e5eb1b20bee9647
2014-11-25 13:33:35,935 INFO  [MemStoreFlusher.35] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/4bd72f2c4a2840978e5eb1b20bee9647, entries=1166420, sequenceid=48057, filesize=173.9 M
2014-11-25 13:33:35,935 INFO  [MemStoreFlusher.35] regionserver.HRegion: Finished memstore flush of ~320.4 M/335920640, currentsize=2.7 M/2802080 for region usertable2,user6579,1416889268210.bff12d4267dd884829eb5659611c40f9. in 30947ms, sequenceid=48057, compaction requested=true
2014-11-25 13:33:35,936 DEBUG [MemStoreFlusher.35] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.35; compaction_queue=(0:5114), split_queue=0, merge_queue=0
2014-11-25 13:33:35,936 INFO  [MemStoreFlusher.35] regionserver.MemStoreFlusher: Waited 119715ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3879,1416889268210.d32041fd1bd5e7014e265b483c173ddc.
2014-11-25 13:33:35,936 DEBUG [MemStoreFlusher.35] regionserver.HRegion: Started memstore flush for usertable2,user3879,1416889268210.d32041fd1bd5e7014e265b483c173ddc., current region memstore size 319.9 M
2014-11-25 13:33:35,939 INFO  [MemStoreFlusher.8] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48073, memsize=319.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/.tmp/0174b5478a9f42dd9f1b71b947045b8f
2014-11-25 13:33:35,951 DEBUG [MemStoreFlusher.8] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/.tmp/0174b5478a9f42dd9f1b71b947045b8f as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/0174b5478a9f42dd9f1b71b947045b8f
2014-11-25 13:33:35,957 INFO  [MemStoreFlusher.8] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/0174b5478a9f42dd9f1b71b947045b8f, entries=1161530, sequenceid=48073, filesize=173.1 M
2014-11-25 13:33:35,958 INFO  [MemStoreFlusher.8] regionserver.HRegion: Finished memstore flush of ~319.0 M/334511680, currentsize=2.6 M/2764720 for region usertable2,user3789,1416889268210.4cbd9216f88e34160a388d0cd31c622c. in 30052ms, sequenceid=48073, compaction requested=true
2014-11-25 13:33:35,958 DEBUG [MemStoreFlusher.8] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.8; compaction_queue=(0:5115), split_queue=0, merge_queue=0
2014-11-25 13:33:35,958 INFO  [MemStoreFlusher.8] regionserver.MemStoreFlusher: Waited 119710ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5679,1416889268210.4b90977be131e83310321e679b719b06.
2014-11-25 13:33:35,958 DEBUG [MemStoreFlusher.8] regionserver.HRegion: Started memstore flush for usertable2,user5679,1416889268210.4b90977be131e83310321e679b719b06., current region memstore size 319.1 M
2014-11-25 13:33:36,927 INFO  [MemStoreFlusher.13] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48067, memsize=317.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/.tmp/47140ec9185c47cca56d669a21ddd29e
2014-11-25 13:33:36,932 DEBUG [MemStoreFlusher.13] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/.tmp/47140ec9185c47cca56d669a21ddd29e as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/47140ec9185c47cca56d669a21ddd29e
2014-11-25 13:33:36,937 INFO  [MemStoreFlusher.13] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/47140ec9185c47cca56d669a21ddd29e, entries=1156900, sequenceid=48067, filesize=172.4 M
2014-11-25 13:33:36,937 INFO  [MemStoreFlusher.13] regionserver.HRegion: Finished memstore flush of ~317.7 M/333178080, currentsize=3.2 M/3404080 for region usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4. in 31032ms, sequenceid=48067, compaction requested=true
2014-11-25 13:33:36,938 DEBUG [MemStoreFlusher.13] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.13; compaction_queue=(0:5116), split_queue=0, merge_queue=0
2014-11-25 13:33:36,938 INFO  [MemStoreFlusher.13] regionserver.MemStoreFlusher: Waited 120691ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb.
2014-11-25 13:33:36,938 DEBUG [MemStoreFlusher.13] regionserver.HRegion: Started memstore flush for usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb., current region memstore size 318.4 M
2014-11-25 13:33:36,942 INFO  [MemStoreFlusher.9] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48058, memsize=318.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/.tmp/d465eb4f035a413f80078a5eca1c12c0
2014-11-25 13:33:36,949 DEBUG [MemStoreFlusher.9] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/.tmp/d465eb4f035a413f80078a5eca1c12c0 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/d465eb4f035a413f80078a5eca1c12c0
2014-11-25 13:33:36,954 INFO  [MemStoreFlusher.9] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/d465eb4f035a413f80078a5eca1c12c0, entries=1159270, sequenceid=48058, filesize=172.8 M
2014-11-25 13:33:36,954 INFO  [MemStoreFlusher.9] regionserver.HRegion: Finished memstore flush of ~318.4 M/333861680, currentsize=2.8 M/2885680 for region usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5. in 31965ms, sequenceid=48058, compaction requested=true
2014-11-25 13:33:36,955 DEBUG [MemStoreFlusher.9] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.9; compaction_queue=(0:5117), split_queue=0, merge_queue=0
2014-11-25 13:33:36,955 INFO  [MemStoreFlusher.9] regionserver.MemStoreFlusher: Waited 104893ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5049,1416889268210.a5d4d454c3b39a48b9a7e5c343956435.
2014-11-25 13:33:36,955 DEBUG [MemStoreFlusher.9] regionserver.HRegion: Started memstore flush for usertable2,user5049,1416889268210.a5d4d454c3b39a48b9a7e5c343956435., current region memstore size 280.5 M
2014-11-25 13:33:37,151 INFO  [MemStoreFlusher.22] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48061, memsize=319.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/.tmp/0ecc4ba05fbe459b9826dc6a3de3a651
2014-11-25 13:33:37,153 INFO  [MemStoreFlusher.23] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48062, memsize=319.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/.tmp/dbce417fe56545b3b1f8e53bcf23b234
2014-11-25 13:33:37,158 DEBUG [MemStoreFlusher.22] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/.tmp/0ecc4ba05fbe459b9826dc6a3de3a651 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/0ecc4ba05fbe459b9826dc6a3de3a651
2014-11-25 13:33:37,159 DEBUG [MemStoreFlusher.23] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/.tmp/dbce417fe56545b3b1f8e53bcf23b234 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/dbce417fe56545b3b1f8e53bcf23b234
2014-11-25 13:33:37,163 INFO  [MemStoreFlusher.22] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/0ecc4ba05fbe459b9826dc6a3de3a651, entries=1164900, sequenceid=48061, filesize=173.6 M
2014-11-25 13:33:37,163 INFO  [MemStoreFlusher.22] regionserver.HRegion: Finished memstore flush of ~319.9 M/335481840, currentsize=2.9 M/3072880 for region usertable2,user4959,1416889268210.3ec2e06a3605856a1dd62083096f2771. in 32174ms, sequenceid=48061, compaction requested=true
2014-11-25 13:33:37,163 DEBUG [MemStoreFlusher.22] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.22; compaction_queue=(0:5118), split_queue=0, merge_queue=0
2014-11-25 13:33:37,163 INFO  [MemStoreFlusher.22] regionserver.MemStoreFlusher: Waited 120344ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8109,1416889268210.4b47471f1507edfc343dfd2b4599e5cd.
2014-11-25 13:33:37,163 DEBUG [MemStoreFlusher.22] regionserver.HRegion: Started memstore flush for usertable2,user8109,1416889268210.4b47471f1507edfc343dfd2b4599e5cd., current region memstore size 315.5 M
2014-11-25 13:33:37,163 INFO  [MemStoreFlusher.23] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/dbce417fe56545b3b1f8e53bcf23b234, entries=1162150, sequenceid=48062, filesize=173.2 M
2014-11-25 13:33:37,164 INFO  [MemStoreFlusher.23] regionserver.HRegion: Finished memstore flush of ~319.2 M/334690800, currentsize=2.5 M/2640880 for region usertable2,user5859,1416889268210.653390cc13d30804b9445ebffd69a81d. in 32174ms, sequenceid=48062, compaction requested=true
2014-11-25 13:33:37,164 DEBUG [MemStoreFlusher.23] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.23; compaction_queue=(0:5119), split_queue=0, merge_queue=0
2014-11-25 13:33:37,164 INFO  [MemStoreFlusher.23] regionserver.MemStoreFlusher: Waited 120104ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,,1416889268210.a3d8de2e3c77996d502684577800bf7f.
2014-11-25 13:33:37,164 DEBUG [MemStoreFlusher.23] regionserver.HRegion: Started memstore flush for usertable2,,1416889268210.a3d8de2e3c77996d502684577800bf7f., current region memstore size 316.3 M
2014-11-25 13:33:37,707 INFO  [MemStoreFlusher.29] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48060, memsize=318.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/.tmp/86899649a2874d6092a230cba82d5568
2014-11-25 13:33:37,714 DEBUG [MemStoreFlusher.29] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/.tmp/86899649a2874d6092a230cba82d5568 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/family/86899649a2874d6092a230cba82d5568
2014-11-25 13:33:37,719 INFO  [MemStoreFlusher.29] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/family/86899649a2874d6092a230cba82d5568, entries=1159580, sequenceid=48060, filesize=172.8 M
2014-11-25 13:33:37,719 INFO  [MemStoreFlusher.29] regionserver.HRegion: Finished memstore flush of ~318.5 M/333950400, currentsize=835.3 K/855360 for region usertable2,user8919,1416889268210.ff707032c52bfca061ec7055b315d1ac. in 31818ms, sequenceid=48060, compaction requested=true
2014-11-25 13:33:37,719 DEBUG [MemStoreFlusher.29] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.29; compaction_queue=(0:5120), split_queue=0, merge_queue=0
2014-11-25 13:33:37,720 INFO  [MemStoreFlusher.29] regionserver.MemStoreFlusher: Waited 100299ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6039,1416889268210.d4808c10301633d1d492aef55f9f9fb0.
2014-11-25 13:33:37,720 DEBUG [MemStoreFlusher.29] regionserver.HRegion: Started memstore flush for usertable2,user6039,1416889268210.d4808c10301633d1d492aef55f9f9fb0., current region memstore size 267.2 M
2014-11-25 13:33:37,895 INFO  [MemStoreFlusher.16] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48065, memsize=316.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/.tmp/bc929b5621e546a4978b025a64a87f08
2014-11-25 13:33:37,900 DEBUG [MemStoreFlusher.16] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/.tmp/bc929b5621e546a4978b025a64a87f08 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/family/bc929b5621e546a4978b025a64a87f08
2014-11-25 13:33:37,904 INFO  [MemStoreFlusher.16] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/family/bc929b5621e546a4978b025a64a87f08, entries=1153690, sequenceid=48065, filesize=171.9 M
2014-11-25 13:33:37,904 INFO  [MemStoreFlusher.16] regionserver.HRegion: Finished memstore flush of ~316.9 M/332252320, currentsize=2.1 M/2252080 for region usertable2,user5589,1416889268210.cfb348ee570fa731ba8caa85099a1bd5. in 31118ms, sequenceid=48065, compaction requested=true
2014-11-25 13:33:37,904 DEBUG [MemStoreFlusher.16] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.16; compaction_queue=(0:5121), split_queue=0, merge_queue=0
2014-11-25 13:33:37,982 INFO  [MemStoreFlusher.28] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48059, memsize=319.6 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/.tmp/6e7c4325e44e4c99b743c1b14d46aecb
2014-11-25 13:33:37,987 DEBUG [MemStoreFlusher.28] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/.tmp/6e7c4325e44e4c99b743c1b14d46aecb as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/6e7c4325e44e4c99b743c1b14d46aecb
2014-11-25 13:33:37,991 INFO  [MemStoreFlusher.28] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/6e7c4325e44e4c99b743c1b14d46aecb, entries=1163610, sequenceid=48059, filesize=173.4 M
2014-11-25 13:33:37,991 INFO  [MemStoreFlusher.28] regionserver.HRegion: Finished memstore flush of ~319.6 M/335109760, currentsize=2.9 M/3021040 for region usertable2,user6219,1416889268210.e452c53f69cba13d15de325c057fb970. in 33006ms, sequenceid=48059, compaction requested=true
2014-11-25 13:33:37,991 DEBUG [MemStoreFlusher.28] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.28; compaction_queue=(0:5122), split_queue=0, merge_queue=0
2014-11-25 13:33:38,064 INFO  [MemStoreFlusher.16] regionserver.MemStoreFlusher: Waited 90122ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1269,1416889268210.bbe246dd324639d9e0eb2b0788d4067c.
2014-11-25 13:33:38,064 DEBUG [MemStoreFlusher.16] regionserver.HRegion: Started memstore flush for usertable2,user1269,1416889268210.bbe246dd324639d9e0eb2b0788d4067c., current region memstore size 243.9 M
2014-11-25 13:33:38,078 INFO  [MemStoreFlusher.18] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48076, memsize=317.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/.tmp/6d26b934dd2546ac89bcf51ed4771f85
2014-11-25 13:33:38,083 DEBUG [MemStoreFlusher.18] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/.tmp/6d26b934dd2546ac89bcf51ed4771f85 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/6d26b934dd2546ac89bcf51ed4771f85
2014-11-25 13:33:38,087 INFO  [MemStoreFlusher.18] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/6d26b934dd2546ac89bcf51ed4771f85, entries=1157570, sequenceid=48076, filesize=172.5 M
2014-11-25 13:33:38,087 INFO  [MemStoreFlusher.18] regionserver.HRegion: Finished memstore flush of ~317.9 M/333372000, currentsize=2.1 M/2211840 for region usertable2,user3159,1416889268210.09a9193727ffcc63b8838a6c82b049a5. in 31301ms, sequenceid=48076, compaction requested=true
2014-11-25 13:33:38,087 DEBUG [MemStoreFlusher.18] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.18; compaction_queue=(0:5123), split_queue=0, merge_queue=0
2014-11-25 13:33:38,276 INFO  [MemStoreFlusher.36] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48059, memsize=318.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/.tmp/0b6b43a6f0a64636872c58c21023468d
2014-11-25 13:33:38,281 DEBUG [MemStoreFlusher.36] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/.tmp/0b6b43a6f0a64636872c58c21023468d as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/0b6b43a6f0a64636872c58c21023468d
2014-11-25 13:33:38,285 INFO  [MemStoreFlusher.36] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/0b6b43a6f0a64636872c58c21023468d, entries=1159590, sequenceid=48059, filesize=172.8 M
2014-11-25 13:33:38,286 INFO  [MemStoreFlusher.36] regionserver.HRegion: Finished memstore flush of ~318.5 M/333953680, currentsize=964.7 K/987840 for region usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5. in 32384ms, sequenceid=48059, compaction requested=true
2014-11-25 13:33:38,286 DEBUG [MemStoreFlusher.36] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.36; compaction_queue=(0:5124), split_queue=0, merge_queue=0
2014-11-25 13:33:38,309 INFO  [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48060, memsize=318.6 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/.tmp/e02c6734f90a410190947f15002767d2
2014-11-25 13:33:38,315 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/.tmp/e02c6734f90a410190947f15002767d2 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/e02c6734f90a410190947f15002767d2
2014-11-25 13:33:38,321 INFO  [MemStoreFlusher.0] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/e02c6734f90a410190947f15002767d2, entries=1160020, sequenceid=48060, filesize=172.9 M
2014-11-25 13:33:38,321 INFO  [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~318.6 M/334076720, currentsize=1.1 M/1105840 for region usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da. in 32436ms, sequenceid=48060, compaction requested=true
2014-11-25 13:33:38,322 DEBUG [MemStoreFlusher.0] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.0; compaction_queue=(0:5125), split_queue=0, merge_queue=0
2014-11-25 13:33:39,143 INFO  [MemStoreFlusher.20] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48059, memsize=318.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/.tmp/217c4547031c4a03b268243fc666553f
2014-11-25 13:33:39,148 DEBUG [MemStoreFlusher.20] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/.tmp/217c4547031c4a03b268243fc666553f as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/family/217c4547031c4a03b268243fc666553f
2014-11-25 13:33:39,154 INFO  [MemStoreFlusher.20] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/family/217c4547031c4a03b268243fc666553f, entries=1159690, sequenceid=48059, filesize=172.8 M
2014-11-25 13:33:39,154 INFO  [MemStoreFlusher.20] regionserver.HRegion: Finished memstore flush of ~318.5 M/333981120, currentsize=961.6 K/984720 for region usertable2,user8739,1416889268210.10fbbcf2b6f1389e433a4a5211bf2642. in 33270ms, sequenceid=48059, compaction requested=true
2014-11-25 13:33:39,154 DEBUG [MemStoreFlusher.20] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.20; compaction_queue=(0:5126), split_queue=0, merge_queue=0
2014-11-25 13:33:39,308 INFO  [MemStoreFlusher.21] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48060, memsize=320.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/.tmp/1f7dfa3481914c46bdd9a82d8e069083
2014-11-25 13:33:39,313 DEBUG [MemStoreFlusher.21] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/.tmp/1f7dfa3481914c46bdd9a82d8e069083 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/1f7dfa3481914c46bdd9a82d8e069083
2014-11-25 13:33:39,317 INFO  [MemStoreFlusher.21] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/1f7dfa3481914c46bdd9a82d8e069083, entries=1165370, sequenceid=48060, filesize=173.7 M
2014-11-25 13:33:39,317 INFO  [MemStoreFlusher.21] regionserver.HRegion: Finished memstore flush of ~320.1 M/335618080, currentsize=2.9 M/3023920 for region usertable2,user5319,1416889268210.c2e76bfcf0ee452319788ce49186a339. in 34332ms, sequenceid=48060, compaction requested=true
2014-11-25 13:33:39,317 DEBUG [MemStoreFlusher.21] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.21; compaction_queue=(0:5127), split_queue=0, merge_queue=0
2014-11-25 13:33:39,890 INFO  [MemStoreFlusher.30] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48062, memsize=318.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/.tmp/77c0673b89514b1288de4a3827d119c5
2014-11-25 13:33:39,895 DEBUG [MemStoreFlusher.30] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/.tmp/77c0673b89514b1288de4a3827d119c5 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/77c0673b89514b1288de4a3827d119c5
2014-11-25 13:33:39,899 INFO  [MemStoreFlusher.30] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/77c0673b89514b1288de4a3827d119c5, entries=1161110, sequenceid=48062, filesize=173.1 M
2014-11-25 13:33:39,900 INFO  [MemStoreFlusher.30] regionserver.HRegion: Finished memstore flush of ~318.9 M/334389040, currentsize=1.5 M/1592640 for region usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd. in 34015ms, sequenceid=48062, compaction requested=true
2014-11-25 13:33:39,900 DEBUG [MemStoreFlusher.30] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.30; compaction_queue=(0:5128), split_queue=0, merge_queue=0
2014-11-25 13:33:40,170 WARN  [RpcServer.handler=26,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":36674,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893583495,"queuetimems":1,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:40,751 INFO  [MemStoreFlusher.11] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48078, memsize=318.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/.tmp/32f4e56d39644b6c91b75e2156f4f004
2014-11-25 13:33:40,757 DEBUG [MemStoreFlusher.11] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/.tmp/32f4e56d39644b6c91b75e2156f4f004 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/family/32f4e56d39644b6c91b75e2156f4f004
2014-11-25 13:33:40,762 INFO  [MemStoreFlusher.11] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/family/32f4e56d39644b6c91b75e2156f4f004, entries=1158050, sequenceid=48078, filesize=172.6 M
2014-11-25 13:33:40,762 INFO  [MemStoreFlusher.11] regionserver.HRegion: Finished memstore flush of ~318.1 M/333509840, currentsize=2.5 M/2666720 for region usertable2,user2709,1416889268210.fd0aae1076bc05c8db51754294c21e38. in 33976ms, sequenceid=48078, compaction requested=true
2014-11-25 13:33:40,763 DEBUG [MemStoreFlusher.11] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.11; compaction_queue=(0:5129), split_queue=0, merge_queue=0
2014-11-25 13:33:41,801 INFO  [MemStoreFlusher.34] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48067, memsize=319.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/.tmp/33f8d4f7cb404af3be79601f0410ab76
2014-11-25 13:33:41,806 DEBUG [MemStoreFlusher.34] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/.tmp/33f8d4f7cb404af3be79601f0410ab76 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/family/33f8d4f7cb404af3be79601f0410ab76
2014-11-25 13:33:41,810 INFO  [MemStoreFlusher.34] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/family/33f8d4f7cb404af3be79601f0410ab76, entries=1161890, sequenceid=48067, filesize=173.2 M
2014-11-25 13:33:41,811 INFO  [MemStoreFlusher.34] regionserver.HRegion: Finished memstore flush of ~319.1 M/334615840, currentsize=3.7 M/3835920 for region usertable2,user4689,1416889268210.f163e7c364cbfc321d89062a8ec9a958. in 35925ms, sequenceid=48067, compaction requested=true
2014-11-25 13:33:41,811 DEBUG [MemStoreFlusher.34] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.34; compaction_queue=(0:5130), split_queue=0, merge_queue=0
2014-11-25 13:33:42,355 WARN  [RpcServer.handler=62,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":38807,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893583548,"queuetimems":0,"class":"HRegionServer","responsesize":33035,"method":"Multi"}
2014-11-25 13:33:43,701 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/.tmp/66808fb87c6e4d5bbff7717bdb3d2628 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/66808fb87c6e4d5bbff7717bdb3d2628
2014-11-25 13:33:43,777 INFO  [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48079, memsize=319.6 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/.tmp/87b894937ee04d4f9e55be07a1ba77f3
2014-11-25 13:33:43,781 DEBUG [MemStoreFlusher.1] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/.tmp/87b894937ee04d4f9e55be07a1ba77f3 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/family/87b894937ee04d4f9e55be07a1ba77f3
2014-11-25 13:33:43,787 INFO  [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/family/87b894937ee04d4f9e55be07a1ba77f3, entries=1163550, sequenceid=48079, filesize=173.4 M
2014-11-25 13:33:43,787 INFO  [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~319.6 M/335093520, currentsize=2.4 M/2502640 for region usertable2,user1539,1416889268210.cc10fb31d8cc1e28a698092d6c1a5416. in 37884ms, sequenceid=48079, compaction requested=true
2014-11-25 13:33:43,787 DEBUG [MemStoreFlusher.1] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.1; compaction_queue=(0:5131), split_queue=0, merge_queue=0
2014-11-25 13:33:43,868 INFO  [MemStoreFlusher.38] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48060, memsize=318.3 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/.tmp/a58ce66ae1644b98901c75b86cd81b9e
2014-11-25 13:33:43,873 DEBUG [MemStoreFlusher.38] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/.tmp/a58ce66ae1644b98901c75b86cd81b9e as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/a58ce66ae1644b98901c75b86cd81b9e
2014-11-25 13:33:43,877 INFO  [MemStoreFlusher.38] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/a58ce66ae1644b98901c75b86cd81b9e, entries=1159110, sequenceid=48060, filesize=172.8 M
2014-11-25 13:33:43,878 INFO  [MemStoreFlusher.38] regionserver.HRegion: Finished memstore flush of ~318.3 M/333813920, currentsize=2.3 M/2439360 for region usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0. in 37092ms, sequenceid=48060, compaction requested=true
2014-11-25 13:33:43,878 DEBUG [MemStoreFlusher.38] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.38; compaction_queue=(0:5132), split_queue=0, merge_queue=0
2014-11-25 13:33:44,438 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:33:44,446 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/3b7c42615d2c489e9567f122867ea191, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/3b7c42615d2c489e9567f122867ea191
2014-11-25 13:33:44,448 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/d2fd76be038d4796b79909200a1627f2, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/d2fd76be038d4796b79909200a1627f2
2014-11-25 13:33:44,450 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/6e3c893fd0b14353b600935e69c70f3f, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/6e3c893fd0b14353b600935e69c70f3f
2014-11-25 13:33:44,450 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027. into 66808fb87c6e4d5bbff7717bdb3d2628(size=166.2 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 34sec to execute.
2014-11-25 13:33:44,450 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027., storeName=family, fileCount=3, fileSize=167.3 M, priority=-5, time=5780214500246726; duration=34sec
2014-11-25 13:33:44,450 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5133), split_queue=0, merge_queue=0
2014-11-25 13:33:44,450 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5133), split_queue=0, merge_queue=0
2014-11-25 13:33:44,450 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:33:44,450 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 190392777 starting at candidate #1 after considering 236 permutations with 194 in ratio
2014-11-25 13:33:44,450 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 20e96e23afd1acfa80469c8f368c7569 - family: Initiating minor compaction
2014-11-25 13:33:44,451 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569.
2014-11-25 13:33:44,451 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/.tmp, totalSize=181.6 M
2014-11-25 13:33:44,451 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/3e161e3a917f47c9b55880763f6cc79f, keycount=40639, bloomtype=ROW, size=60.6 M, encoding=NONE, seqNum=4438
2014-11-25 13:33:44,451 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/35fb43e78b7a437c90aff9784d41e506, keycount=43507, bloomtype=ROW, size=64.9 M, encoding=NONE, seqNum=5293
2014-11-25 13:33:44,451 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/369cc4773d3944e3af0943ba9fe18af9, keycount=37655, bloomtype=ROW, size=56.1 M, encoding=NONE, seqNum=6035
2014-11-25 13:33:48,211 INFO  [MemStoreFlusher.19] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48080, memsize=319.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/.tmp/2ff70243ae4e4d6994c747bfe08e76c6
2014-11-25 13:33:48,216 DEBUG [MemStoreFlusher.19] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/.tmp/2ff70243ae4e4d6994c747bfe08e76c6 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/2ff70243ae4e4d6994c747bfe08e76c6
2014-11-25 13:33:48,220 INFO  [MemStoreFlusher.19] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/2ff70243ae4e4d6994c747bfe08e76c6, entries=1161950, sequenceid=48080, filesize=173.2 M
2014-11-25 13:33:48,220 INFO  [MemStoreFlusher.19] regionserver.HRegion: Finished memstore flush of ~319.1 M/334631680, currentsize=2.5 M/2637920 for region usertable2,user2529,1416889268210.b451134c60b1dc7cf526e81f6db2c433. in 42315ms, sequenceid=48080, compaction requested=true
2014-11-25 13:33:48,221 DEBUG [MemStoreFlusher.19] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.19; compaction_queue=(0:5133), split_queue=0, merge_queue=0
2014-11-25 13:33:49,533 WARN  [RpcServer.handler=10,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":45785,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893583747,"queuetimems":0,"class":"HRegionServer","responsesize":33035,"method":"Multi"}
2014-11-25 13:33:49,590 WARN  [RpcServer.handler=81,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":45793,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893583797,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:49,602 WARN  [RpcServer.handler=45,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":45957,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893583645,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:49,604 WARN  [RpcServer.handler=55,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":46009,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893583594,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:50,160 WARN  [RpcServer.handler=73,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":46466,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893583693,"queuetimems":0,"class":"HRegionServer","responsesize":33035,"method":"Multi"}
2014-11-25 13:33:50,161 WARN  [RpcServer.handler=31,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":45891,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893584270,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:51,614 WARN  [RpcServer.handler=97,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":47414,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893584200,"queuetimems":1,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:51,672 WARN  [RpcServer.handler=78,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":47421,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893584250,"queuetimems":0,"class":"HRegionServer","responsesize":33034,"method":"Multi"}
2014-11-25 13:33:51,714 WARN  [RpcServer.handler=89,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":47484,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893584229,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:52,005 INFO  [MemStoreFlusher.15] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48081, memsize=319.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/.tmp/8b319a60f1a747e4b745927d63e02d53
2014-11-25 13:33:52,011 DEBUG [MemStoreFlusher.15] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/.tmp/8b319a60f1a747e4b745927d63e02d53 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/8b319a60f1a747e4b745927d63e02d53
2014-11-25 13:33:52,016 INFO  [MemStoreFlusher.15] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/8b319a60f1a747e4b745927d63e02d53, entries=1162210, sequenceid=48081, filesize=173.2 M
2014-11-25 13:33:52,016 INFO  [MemStoreFlusher.15] regionserver.HRegion: Finished memstore flush of ~319.2 M/334707440, currentsize=2.5 M/2652320 for region usertable2,user2169,1416889268210.a6d76b3d9a5a10e578fccc6098a8444b. in 46131ms, sequenceid=48081, compaction requested=true
2014-11-25 13:33:52,016 DEBUG [MemStoreFlusher.15] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.15; compaction_queue=(0:5134), split_queue=0, merge_queue=0
2014-11-25 13:33:52,786 INFO  [MemStoreFlusher.6] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48077, memsize=318.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/.tmp/adf79c96d6464fb6a832179b52e95934
2014-11-25 13:33:52,792 DEBUG [MemStoreFlusher.6] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/.tmp/adf79c96d6464fb6a832179b52e95934 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/adf79c96d6464fb6a832179b52e95934
2014-11-25 13:33:52,799 INFO  [MemStoreFlusher.6] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/adf79c96d6464fb6a832179b52e95934, entries=1157710, sequenceid=48077, filesize=172.5 M
2014-11-25 13:33:52,799 INFO  [MemStoreFlusher.6] regionserver.HRegion: Finished memstore flush of ~318.0 M/333411040, currentsize=2.8 M/2937520 for region usertable2,user2889,1416889268210.44276931450f87557d509a6420f58f5c. in 46013ms, sequenceid=48077, compaction requested=true
2014-11-25 13:33:52,799 DEBUG [MemStoreFlusher.6] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.6; compaction_queue=(0:5135), split_queue=0, merge_queue=0
2014-11-25 13:33:52,834 INFO  [MemStoreFlusher.29] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48081, memsize=267.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/.tmp/31e4e45566b94a269c8707f814677130
2014-11-25 13:33:52,839 DEBUG [MemStoreFlusher.29] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/.tmp/31e4e45566b94a269c8707f814677130 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/family/31e4e45566b94a269c8707f814677130
2014-11-25 13:33:52,845 INFO  [MemStoreFlusher.29] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/family/31e4e45566b94a269c8707f814677130, entries=972870, sequenceid=48081, filesize=145.0 M
2014-11-25 13:33:52,846 INFO  [MemStoreFlusher.29] regionserver.HRegion: Finished memstore flush of ~267.2 M/280178320, currentsize=1.6 M/1630000 for region usertable2,user6039,1416889268210.d4808c10301633d1d492aef55f9f9fb0. in 15126ms, sequenceid=48081, compaction requested=true
2014-11-25 13:33:52,846 DEBUG [MemStoreFlusher.29] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.29; compaction_queue=(0:5136), split_queue=0, merge_queue=0
2014-11-25 13:33:52,883 WARN  [RpcServer.handler=64,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":47891,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893584991,"queuetimems":0,"class":"HRegionServer","responsesize":33038,"method":"Multi"}
2014-11-25 13:33:52,898 INFO  [MemStoreFlusher.10] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48065, memsize=317.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/.tmp/f4ea55fe54cc4adfaff76d7f4577e0a5
2014-11-25 13:33:52,904 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:33:52,911 INFO  [MemStoreFlusher.27] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48065, memsize=319.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/.tmp/abcdc69533ef4b6e9e4b51735fdfa985
2014-11-25 13:33:52,945 INFO  [MemStoreFlusher.24] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48067, memsize=318.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/.tmp/66245a6d260e4abd84a777df397d3e83
2014-11-25 13:33:52,956 DEBUG [MemStoreFlusher.10] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/.tmp/f4ea55fe54cc4adfaff76d7f4577e0a5 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/f4ea55fe54cc4adfaff76d7f4577e0a5
2014-11-25 13:33:52,960 DEBUG [MemStoreFlusher.27] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/.tmp/abcdc69533ef4b6e9e4b51735fdfa985 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/abcdc69533ef4b6e9e4b51735fdfa985
2014-11-25 13:33:52,961 DEBUG [MemStoreFlusher.24] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/.tmp/66245a6d260e4abd84a777df397d3e83 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/66245a6d260e4abd84a777df397d3e83
2014-11-25 13:33:52,964 INFO  [MemStoreFlusher.10] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/f4ea55fe54cc4adfaff76d7f4577e0a5, entries=1157100, sequenceid=48065, filesize=172.5 M
2014-11-25 13:33:52,964 INFO  [MemStoreFlusher.10] regionserver.HRegion: Finished memstore flush of ~317.8 M/333235280, currentsize=4.1 M/4351360 for region usertable2,user5139,1416889268210.a8d0d190cb61bd1bf54306b4bc472da1. in 47078ms, sequenceid=48065, compaction requested=true
2014-11-25 13:33:52,964 DEBUG [MemStoreFlusher.10] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.10; compaction_queue=(0:5137), split_queue=0, merge_queue=0
2014-11-25 13:33:52,965 INFO  [MemStoreFlusher.27] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/abcdc69533ef4b6e9e4b51735fdfa985, entries=1162040, sequenceid=48065, filesize=173.2 M
2014-11-25 13:33:52,965 INFO  [MemStoreFlusher.27] regionserver.HRegion: Finished memstore flush of ~319.2 M/334658000, currentsize=4.0 M/4161440 for region usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d. in 47079ms, sequenceid=48065, compaction requested=true
2014-11-25 13:33:52,965 DEBUG [MemStoreFlusher.27] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.27; compaction_queue=(0:5138), split_queue=0, merge_queue=0
2014-11-25 13:33:53,008 INFO  [MemStoreFlusher.24] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/66245a6d260e4abd84a777df397d3e83, entries=1159270, sequenceid=48067, filesize=172.8 M
2014-11-25 13:33:53,008 INFO  [MemStoreFlusher.24] regionserver.HRegion: Finished memstore flush of ~318.4 M/333861360, currentsize=4.2 M/4389040 for region usertable2,user4149,1416889268210.c068f0d848be8a8d9b2a90f612ef94a1. in 47124ms, sequenceid=48067, compaction requested=true
2014-11-25 13:33:53,008 DEBUG [MemStoreFlusher.24] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.24; compaction_queue=(0:5139), split_queue=0, merge_queue=0
2014-11-25 13:33:53,358 INFO  [MemStoreFlusher.32] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48066, memsize=319.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/.tmp/a5a6d7c566a04441a8c625bec2677638
2014-11-25 13:33:53,362 INFO  [MemStoreFlusher.26] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48065, memsize=318.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/.tmp/bca4cdab7dfc40e6b3206cba660b1fff
2014-11-25 13:33:53,373 WARN  [RpcServer.handler=43,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":48250,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893585122,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:53,373 WARN  [RpcServer.handler=30,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":49075,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893584297,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:53,375 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4802882 synced till here 4802864
2014-11-25 13:33:53,381 DEBUG [MemStoreFlusher.32] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/.tmp/a5a6d7c566a04441a8c625bec2677638 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/family/a5a6d7c566a04441a8c625bec2677638
2014-11-25 13:33:53,394 INFO  [MemStoreFlusher.32] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/family/a5a6d7c566a04441a8c625bec2677638, entries=1161480, sequenceid=48066, filesize=173.1 M
2014-11-25 13:33:53,395 INFO  [MemStoreFlusher.32] regionserver.HRegion: Finished memstore flush of ~319.0 M/334497360, currentsize=4.3 M/4530160 for region usertable2,user4239,1416889268210.e521da13cf88c7e5aa481035feae21e5. in 47499ms, sequenceid=48066, compaction requested=true
2014-11-25 13:33:53,395 DEBUG [MemStoreFlusher.32] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.32; compaction_queue=(0:5140), split_queue=0, merge_queue=0
2014-11-25 13:33:53,429 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893607027 with entries=1748, filesize=124.5 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893632904
2014-11-25 13:33:53,430 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=116, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:33:53,437 DEBUG [MemStoreFlusher.26] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/.tmp/bca4cdab7dfc40e6b3206cba660b1fff as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/bca4cdab7dfc40e6b3206cba660b1fff
2014-11-25 13:33:53,503 INFO  [MemStoreFlusher.26] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/bca4cdab7dfc40e6b3206cba660b1fff, entries=1160720, sequenceid=48065, filesize=173.0 M
2014-11-25 13:33:53,504 INFO  [MemStoreFlusher.26] regionserver.HRegion: Finished memstore flush of ~318.8 M/334278160, currentsize=4.1 M/4337280 for region usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159. in 47618ms, sequenceid=48065, compaction requested=true
2014-11-25 13:33:53,504 DEBUG [MemStoreFlusher.26] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.26; compaction_queue=(0:5141), split_queue=0, merge_queue=0
2014-11-25 13:33:54,904 WARN  [RpcServer.handler=92,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":49725,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893585178,"queuetimems":0,"class":"HRegionServer","responsesize":33035,"method":"Multi"}
2014-11-25 13:33:54,904 WARN  [RpcServer.handler=37,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":49510,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893585393,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:54,959 INFO  [MemStoreFlusher.25] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48063, memsize=318.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/.tmp/712a8920def246369c9cc5c4caa29a3a
2014-11-25 13:33:54,998 INFO  [MemStoreFlusher.39] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48075, memsize=319.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/.tmp/98f927471e3043f2a79a6d8d0f862ac6
2014-11-25 13:33:55,018 DEBUG [MemStoreFlusher.25] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/.tmp/712a8920def246369c9cc5c4caa29a3a as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/712a8920def246369c9cc5c4caa29a3a
2014-11-25 13:33:55,018 DEBUG [MemStoreFlusher.39] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/.tmp/98f927471e3043f2a79a6d8d0f862ac6 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/98f927471e3043f2a79a6d8d0f862ac6
2014-11-25 13:33:55,025 INFO  [MemStoreFlusher.25] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/712a8920def246369c9cc5c4caa29a3a, entries=1158050, sequenceid=48063, filesize=172.6 M
2014-11-25 13:33:55,025 INFO  [MemStoreFlusher.39] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/98f927471e3043f2a79a6d8d0f862ac6, entries=1161940, sequenceid=48075, filesize=173.2 M
2014-11-25 13:33:55,025 INFO  [MemStoreFlusher.25] regionserver.HRegion: Finished memstore flush of ~318.1 M/333509360, currentsize=4.2 M/4400640 for region usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9. in 48240ms, sequenceid=48063, compaction requested=true
2014-11-25 13:33:55,025 INFO  [MemStoreFlusher.39] regionserver.HRegion: Finished memstore flush of ~319.1 M/334629040, currentsize=3.1 M/3222720 for region usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297. in 48240ms, sequenceid=48075, compaction requested=true
2014-11-25 13:33:55,026 DEBUG [MemStoreFlusher.25] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.25; compaction_queue=(0:5142), split_queue=0, merge_queue=0
2014-11-25 13:33:55,026 DEBUG [MemStoreFlusher.39] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.39; compaction_queue=(0:5143), split_queue=0, merge_queue=0
2014-11-25 13:33:55,074 WARN  [RpcServer.handler=104,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":49404,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893585669,"queuetimems":9,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:55,089 WARN  [RpcServer.handler=84,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":49143,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893585945,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:55,097 INFO  [MemStoreFlusher.35] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48090, memsize=319.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/.tmp/e7e59b6f1bf14d6295838d519dabb2b1
2014-11-25 13:33:55,200 INFO  [MemStoreFlusher.2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48089, memsize=319.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/.tmp/4a5490e446c242a9bdaee6a71ce2cea2
2014-11-25 13:33:55,200 INFO  [MemStoreFlusher.9] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48084, memsize=280.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a5d4d454c3b39a48b9a7e5c343956435/.tmp/314e2890759e4bccb144d53c4b60a662
2014-11-25 13:33:55,200 DEBUG [MemStoreFlusher.35] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/.tmp/e7e59b6f1bf14d6295838d519dabb2b1 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/family/e7e59b6f1bf14d6295838d519dabb2b1
2014-11-25 13:33:55,206 DEBUG [MemStoreFlusher.2] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/.tmp/4a5490e446c242a9bdaee6a71ce2cea2 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/4a5490e446c242a9bdaee6a71ce2cea2
2014-11-25 13:33:55,207 DEBUG [MemStoreFlusher.9] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a5d4d454c3b39a48b9a7e5c343956435/.tmp/314e2890759e4bccb144d53c4b60a662 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a5d4d454c3b39a48b9a7e5c343956435/family/314e2890759e4bccb144d53c4b60a662
2014-11-25 13:33:55,208 INFO  [MemStoreFlusher.35] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/family/e7e59b6f1bf14d6295838d519dabb2b1, entries=1164720, sequenceid=48090, filesize=173.6 M
2014-11-25 13:33:55,208 INFO  [MemStoreFlusher.35] regionserver.HRegion: Finished memstore flush of ~319.9 M/335429360, currentsize=1.2 M/1235440 for region usertable2,user3879,1416889268210.d32041fd1bd5e7014e265b483c173ddc. in 19272ms, sequenceid=48090, compaction requested=true
2014-11-25 13:33:55,209 DEBUG [MemStoreFlusher.35] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.35; compaction_queue=(0:5144), split_queue=0, merge_queue=0
2014-11-25 13:33:55,214 INFO  [MemStoreFlusher.2] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/4a5490e446c242a9bdaee6a71ce2cea2, entries=1164630, sequenceid=48089, filesize=173.6 M
2014-11-25 13:33:55,214 INFO  [MemStoreFlusher.2] regionserver.HRegion: Finished memstore flush of ~319.9 M/335404400, currentsize=1.2 M/1212400 for region usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568. in 22874ms, sequenceid=48089, compaction requested=true
2014-11-25 13:33:55,214 DEBUG [MemStoreFlusher.2] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.2; compaction_queue=(0:5145), split_queue=0, merge_queue=0
2014-11-25 13:33:55,253 INFO  [MemStoreFlusher.9] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a5d4d454c3b39a48b9a7e5c343956435/family/314e2890759e4bccb144d53c4b60a662, entries=1021200, sequenceid=48084, filesize=152.2 M
2014-11-25 13:33:55,253 INFO  [MemStoreFlusher.9] regionserver.HRegion: Finished memstore flush of ~280.5 M/294098320, currentsize=2.0 M/2076400 for region usertable2,user5049,1416889268210.a5d4d454c3b39a48b9a7e5c343956435. in 18298ms, sequenceid=48084, compaction requested=true
2014-11-25 13:33:55,253 DEBUG [MemStoreFlusher.9] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.9; compaction_queue=(0:5146), split_queue=0, merge_queue=0
2014-11-25 13:33:55,399 INFO  [MemStoreFlusher.16] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48098, memsize=243.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bbe246dd324639d9e0eb2b0788d4067c/.tmp/4a865736e2e3423fa51a67ed7bebe925
2014-11-25 13:33:55,405 DEBUG [MemStoreFlusher.16] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bbe246dd324639d9e0eb2b0788d4067c/.tmp/4a865736e2e3423fa51a67ed7bebe925 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bbe246dd324639d9e0eb2b0788d4067c/family/4a865736e2e3423fa51a67ed7bebe925
2014-11-25 13:33:55,410 INFO  [MemStoreFlusher.16] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bbe246dd324639d9e0eb2b0788d4067c/family/4a865736e2e3423fa51a67ed7bebe925, entries=887980, sequenceid=48098, filesize=132.4 M
2014-11-25 13:33:55,410 INFO  [MemStoreFlusher.16] regionserver.HRegion: Finished memstore flush of ~243.9 M/255731520, currentsize=2.2 M/2321120 for region usertable2,user1269,1416889268210.bbe246dd324639d9e0eb2b0788d4067c. in 17346ms, sequenceid=48098, compaction requested=true
2014-11-25 13:33:55,410 DEBUG [MemStoreFlusher.16] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.16; compaction_queue=(0:5147), split_queue=0, merge_queue=0
2014-11-25 13:33:55,554 INFO  [MemStoreFlusher.12] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48081, memsize=320.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/.tmp/85cbd046b3c74a13a01beab6b9573448
2014-11-25 13:33:55,560 DEBUG [MemStoreFlusher.12] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/.tmp/85cbd046b3c74a13a01beab6b9573448 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/family/85cbd046b3c74a13a01beab6b9573448
2014-11-25 13:33:55,564 INFO  [MemStoreFlusher.12] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/family/85cbd046b3c74a13a01beab6b9573448, entries=1164940, sequenceid=48081, filesize=173.6 M
2014-11-25 13:33:55,564 INFO  [MemStoreFlusher.12] regionserver.HRegion: Finished memstore flush of ~320.0 M/335494400, currentsize=2.3 M/2399040 for region usertable2,user4599,1416889268210.eead33f80ffa1e642cc147c38794f39c. in 23263ms, sequenceid=48081, compaction requested=true
2014-11-25 13:33:55,564 DEBUG [MemStoreFlusher.12] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.12; compaction_queue=(0:5148), split_queue=0, merge_queue=0
2014-11-25 13:33:56,558 INFO  [MemStoreFlusher.13] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48071, memsize=318.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/.tmp/1b2670f8c9cf4560a0db9770ae68d1cf
2014-11-25 13:33:56,563 DEBUG [MemStoreFlusher.13] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/.tmp/1b2670f8c9cf4560a0db9770ae68d1cf as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/1b2670f8c9cf4560a0db9770ae68d1cf
2014-11-25 13:33:56,569 INFO  [MemStoreFlusher.13] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/1b2670f8c9cf4560a0db9770ae68d1cf, entries=1159330, sequenceid=48071, filesize=172.8 M
2014-11-25 13:33:56,569 INFO  [MemStoreFlusher.13] regionserver.HRegion: Finished memstore flush of ~318.4 M/333877600, currentsize=3.1 M/3214000 for region usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb. in 19631ms, sequenceid=48071, compaction requested=true
2014-11-25 13:33:56,569 DEBUG [MemStoreFlusher.13] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.13; compaction_queue=(0:5149), split_queue=0, merge_queue=0
2014-11-25 13:33:56,570 INFO  [MemStoreFlusher.33] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48071, memsize=319.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/.tmp/14aa1e23e46e4b4fad9ca41cdc28c2ee
2014-11-25 13:33:56,576 DEBUG [MemStoreFlusher.33] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/.tmp/14aa1e23e46e4b4fad9ca41cdc28c2ee as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/family/14aa1e23e46e4b4fad9ca41cdc28c2ee
2014-11-25 13:33:56,581 INFO  [MemStoreFlusher.33] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/family/14aa1e23e46e4b4fad9ca41cdc28c2ee, entries=1161500, sequenceid=48071, filesize=173.1 M
2014-11-25 13:33:56,581 INFO  [MemStoreFlusher.33] regionserver.HRegion: Finished memstore flush of ~319.0 M/334503760, currentsize=3.2 M/3363840 for region usertable2,user7209,1416889268210.fa362bc0b2fed482214114394bfa26f3. in 22015ms, sequenceid=48071, compaction requested=true
2014-11-25 13:33:56,581 DEBUG [MemStoreFlusher.33] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.33; compaction_queue=(0:5150), split_queue=0, merge_queue=0
2014-11-25 13:33:56,594 WARN  [RpcServer.handler=66,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":50781,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893585813,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:56,609 WARN  [RpcServer.handler=93,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":50745,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893585864,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:56,610 INFO  [MemStoreFlusher.7] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48078, memsize=318.6 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/.tmp/a26ea4fb78cd42988ac4499e74c4a0ce
2014-11-25 13:33:56,634 DEBUG [MemStoreFlusher.7] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/.tmp/a26ea4fb78cd42988ac4499e74c4a0ce as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/family/a26ea4fb78cd42988ac4499e74c4a0ce
2014-11-25 13:33:56,684 INFO  [MemStoreFlusher.3] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48079, memsize=319.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/.tmp/7188ca95fa974d1fbca706b58d5c8e34
2014-11-25 13:33:56,688 WARN  [RpcServer.handler=132,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":50705,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893585983,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:56,692 INFO  [MemStoreFlusher.7] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/family/a26ea4fb78cd42988ac4499e74c4a0ce, entries=1160030, sequenceid=48078, filesize=172.9 M
2014-11-25 13:33:56,693 INFO  [MemStoreFlusher.7] regionserver.HRegion: Finished memstore flush of ~318.6 M/334079920, currentsize=2.6 M/2684080 for region usertable2,user5769,1416889268210.a6f20417c02c380a5937a58b862dfbb8. in 25521ms, sequenceid=48078, compaction requested=true
2014-11-25 13:33:56,693 DEBUG [MemStoreFlusher.7] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.7; compaction_queue=(0:5151), split_queue=0, merge_queue=0
2014-11-25 13:33:56,701 WARN  [RpcServer.handler=87,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":48028,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893588673,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:56,704 INFO  [MemStoreFlusher.22] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48066, memsize=315.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/.tmp/0729cd2f095e4745a832002dffa33abc
2014-11-25 13:33:56,707 WARN  [RpcServer.handler=60,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":41050,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893595656,"queuetimems":1,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:57,233 INFO  [MemStoreFlusher.37] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48096, memsize=320.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/.tmp/229820eb8a2c4160861715295eee3cce
2014-11-25 13:33:57,233 INFO  [MemStoreFlusher.31] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48089, memsize=321.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/.tmp/4053fbfbd5334f1c9e4972c864bbb1a4
2014-11-25 13:33:57,238 WARN  [RpcServer.handler=121,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":41629,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893595608,"queuetimems":1,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:57,245 DEBUG [MemStoreFlusher.31] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/.tmp/4053fbfbd5334f1c9e4972c864bbb1a4 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/4053fbfbd5334f1c9e4972c864bbb1a4
2014-11-25 13:33:57,246 DEBUG [MemStoreFlusher.3] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/.tmp/7188ca95fa974d1fbca706b58d5c8e34 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/7188ca95fa974d1fbca706b58d5c8e34
2014-11-25 13:33:57,248 DEBUG [MemStoreFlusher.22] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/.tmp/0729cd2f095e4745a832002dffa33abc as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/family/0729cd2f095e4745a832002dffa33abc
2014-11-25 13:33:57,250 INFO  [MemStoreFlusher.5] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48081, memsize=318.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/.tmp/7905606d502640c7bf060b70fcf02ace
2014-11-25 13:33:57,251 WARN  [RpcServer.handler=90,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":39290,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893597961,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:57,251 WARN  [RpcServer.handler=103,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":48643,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893588608,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:57,251 DEBUG [MemStoreFlusher.37] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/.tmp/229820eb8a2c4160861715295eee3cce as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/229820eb8a2c4160861715295eee3cce
2014-11-25 13:33:57,251 WARN  [RpcServer.handler=57,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":39406,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893597845,"queuetimems":7,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:57,252 INFO  [MemStoreFlusher.31] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/4053fbfbd5334f1c9e4972c864bbb1a4, entries=1169000, sequenceid=48089, filesize=174.2 M
2014-11-25 13:33:57,252 INFO  [MemStoreFlusher.3] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/7188ca95fa974d1fbca706b58d5c8e34, entries=1164460, sequenceid=48079, filesize=173.6 M
2014-11-25 13:33:57,253 INFO  [MemStoreFlusher.31] regionserver.HRegion: Finished memstore flush of ~321.1 M/336663040, currentsize=2.6 M/2767680 for region usertable2,user3339,1416889268210.36dd667db34cc2a7fc0dd12698785418. in 26151ms, sequenceid=48089, compaction requested=true
2014-11-25 13:33:57,253 INFO  [MemStoreFlusher.3] regionserver.HRegion: Finished memstore flush of ~319.8 M/335354880, currentsize=2.5 M/2574640 for region usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952. in 22446ms, sequenceid=48079, compaction requested=true
2014-11-25 13:33:57,253 DEBUG [MemStoreFlusher.31] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.31; compaction_queue=(0:5152), split_queue=0, merge_queue=0
2014-11-25 13:33:57,253 DEBUG [MemStoreFlusher.3] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.3; compaction_queue=(0:5153), split_queue=0, merge_queue=0
2014-11-25 13:33:57,284 INFO  [MemStoreFlusher.23] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48094, memsize=316.3 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/.tmp/57e264696886494eb5304a5a153df60a
2014-11-25 13:33:57,287 INFO  [MemStoreFlusher.22] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/family/0729cd2f095e4745a832002dffa33abc, entries=1148850, sequenceid=48066, filesize=171.2 M
2014-11-25 13:33:57,287 INFO  [MemStoreFlusher.22] regionserver.HRegion: Finished memstore flush of ~315.5 M/330859600, currentsize=3.9 M/4046400 for region usertable2,user8109,1416889268210.4b47471f1507edfc343dfd2b4599e5cd. in 20124ms, sequenceid=48066, compaction requested=true
2014-11-25 13:33:57,287 INFO  [MemStoreFlusher.37] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/229820eb8a2c4160861715295eee3cce, entries=1166810, sequenceid=48096, filesize=173.9 M
2014-11-25 13:33:57,287 DEBUG [MemStoreFlusher.22] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.22; compaction_queue=(0:5154), split_queue=0, merge_queue=0
2014-11-25 13:33:57,287 INFO  [MemStoreFlusher.37] regionserver.HRegion: Finished memstore flush of ~320.5 M/336031520, currentsize=2.8 M/2934720 for region usertable2,user1449,1416889268210.952a6132a4e977be00a90f6ac7e69235. in 22875ms, sequenceid=48096, compaction requested=true
2014-11-25 13:33:57,288 DEBUG [MemStoreFlusher.37] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.37; compaction_queue=(0:5155), split_queue=0, merge_queue=0
2014-11-25 13:33:57,303 WARN  [RpcServer.handler=138,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":33001,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893604301,"queuetimems":1,"class":"HRegionServer","responsesize":33038,"method":"Multi"}
2014-11-25 13:33:57,325 INFO  [MemStoreFlusher.17] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48086, memsize=320.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/.tmp/005c032711cd48c3a7c6134282774fc5
2014-11-25 13:33:57,355 DEBUG [MemStoreFlusher.5] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/.tmp/7905606d502640c7bf060b70fcf02ace as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/7905606d502640c7bf060b70fcf02ace
2014-11-25 13:33:57,379 WARN  [RpcServer.handler=123,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":31966,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893605412,"queuetimems":0,"class":"HRegionServer","responsesize":33038,"method":"Multi"}
2014-11-25 13:33:57,424 WARN  [RpcServer.handler=36,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":29467,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893607957,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:57,430 DEBUG [MemStoreFlusher.23] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/.tmp/57e264696886494eb5304a5a153df60a as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/family/57e264696886494eb5304a5a153df60a
2014-11-25 13:33:57,505 WARN  [RpcServer.handler=83,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":27577,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893609927,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:57,547 WARN  [RpcServer.handler=114,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":28355,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893609192,"queuetimems":0,"class":"HRegionServer","responsesize":33035,"method":"Multi"}
2014-11-25 13:33:57,756 DEBUG [MemStoreFlusher.17] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/.tmp/005c032711cd48c3a7c6134282774fc5 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/family/005c032711cd48c3a7c6134282774fc5
2014-11-25 13:33:57,756 INFO  [MemStoreFlusher.14] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48093, memsize=319.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/.tmp/0a6a685db66b40cb89655a138f66a236
2014-11-25 13:33:57,756 INFO  [MemStoreFlusher.4] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48082, memsize=319.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/.tmp/2ec9e23af24142338dc27e950b6a662f
2014-11-25 13:33:57,756 INFO  [MemStoreFlusher.8] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48081, memsize=319.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/.tmp/ecbb564035e748f0b95d63ad950815a8
2014-11-25 13:33:57,757 INFO  [MemStoreFlusher.5] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/7905606d502640c7bf060b70fcf02ace, entries=1159610, sequenceid=48081, filesize=172.8 M
2014-11-25 13:33:57,757 INFO  [MemStoreFlusher.5] regionserver.HRegion: Finished memstore flush of ~318.5 M/333958160, currentsize=4.8 M/4988160 for region usertable2,user4059,1416889268210.a1bdaf5ad20e2ea54e0e5a2e45d102e5. in 29744ms, sequenceid=48081, compaction requested=true
2014-11-25 13:33:57,758 DEBUG [MemStoreFlusher.5] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.5; compaction_queue=(0:5156), split_queue=0, merge_queue=0
2014-11-25 13:33:57,760 INFO  [MemStoreFlusher.23] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/family/57e264696886494eb5304a5a153df60a, entries=1151590, sequenceid=48094, filesize=171.6 M
2014-11-25 13:33:57,760 INFO  [MemStoreFlusher.23] regionserver.HRegion: Finished memstore flush of ~316.3 M/331648960, currentsize=3.7 M/3841840 for region usertable2,,1416889268210.a3d8de2e3c77996d502684577800bf7f. in 20596ms, sequenceid=48094, compaction requested=true
2014-11-25 13:33:57,760 DEBUG [MemStoreFlusher.23] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.23; compaction_queue=(0:5157), split_queue=0, merge_queue=0
2014-11-25 13:33:57,764 INFO  [MemStoreFlusher.17] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/family/005c032711cd48c3a7c6134282774fc5, entries=1167820, sequenceid=48086, filesize=174.1 M
2014-11-25 13:33:57,764 DEBUG [MemStoreFlusher.4] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/.tmp/2ec9e23af24142338dc27e950b6a662f as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/2ec9e23af24142338dc27e950b6a662f
2014-11-25 13:33:57,764 INFO  [MemStoreFlusher.17] regionserver.HRegion: Finished memstore flush of ~320.7 M/336322080, currentsize=3.9 M/4049120 for region usertable2,user4419,1416889268210.4fa6c789550f08f213befa07da277397. in 21953ms, sequenceid=48086, compaction requested=true
2014-11-25 13:33:57,764 DEBUG [MemStoreFlusher.14] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/.tmp/0a6a685db66b40cb89655a138f66a236 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/0a6a685db66b40cb89655a138f66a236
2014-11-25 13:33:57,764 DEBUG [MemStoreFlusher.17] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.17; compaction_queue=(0:5158), split_queue=0, merge_queue=0
2014-11-25 13:33:57,764 DEBUG [MemStoreFlusher.8] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/.tmp/ecbb564035e748f0b95d63ad950815a8 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/family/ecbb564035e748f0b95d63ad950815a8
2014-11-25 13:33:57,770 INFO  [MemStoreFlusher.4] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/2ec9e23af24142338dc27e950b6a662f, entries=1164270, sequenceid=48082, filesize=173.5 M
2014-11-25 13:33:57,770 INFO  [MemStoreFlusher.4] regionserver.HRegion: Finished memstore flush of ~319.8 M/335298880, currentsize=4.6 M/4824000 for region usertable2,user4509,1416889268210.f0600c6f184e26e751ccebaff48fbe93. in 24309ms, sequenceid=48082, compaction requested=true
2014-11-25 13:33:57,771 DEBUG [MemStoreFlusher.4] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.4; compaction_queue=(0:5159), split_queue=0, merge_queue=0
2014-11-25 13:33:57,771 INFO  [MemStoreFlusher.14] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/0a6a685db66b40cb89655a138f66a236, entries=1164080, sequenceid=48093, filesize=173.5 M
2014-11-25 13:33:57,772 INFO  [MemStoreFlusher.14] regionserver.HRegion: Finished memstore flush of ~319.7 M/335245280, currentsize=3.7 M/3931120 for region usertable2,user2349,1416889268210.69fd185ded056a5c9f0e9bc4611ff44a. in 23214ms, sequenceid=48093, compaction requested=true
2014-11-25 13:33:57,772 DEBUG [MemStoreFlusher.14] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.14; compaction_queue=(0:5160), split_queue=0, merge_queue=0
2014-11-25 13:33:57,811 INFO  [MemStoreFlusher.8] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/family/ecbb564035e748f0b95d63ad950815a8, entries=1161820, sequenceid=48081, filesize=173.2 M
2014-11-25 13:33:57,812 INFO  [MemStoreFlusher.8] regionserver.HRegion: Finished memstore flush of ~319.1 M/334595760, currentsize=4.2 M/4432240 for region usertable2,user5679,1416889268210.4b90977be131e83310321e679b719b06. in 21854ms, sequenceid=48081, compaction requested=true
2014-11-25 13:33:57,812 DEBUG [MemStoreFlusher.8] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.8; compaction_queue=(0:5161), split_queue=0, merge_queue=0
2014-11-25 13:33:58,611 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:33:58,617 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4804615 synced till here 4804584
2014-11-25 13:33:58,629 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893632904 with entries=1733, filesize=123.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893638611
2014-11-25 13:33:58,630 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=117, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:33:59,141 WARN  [RpcServer.handler=8,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":18880,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893620261,"queuetimems":0,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:59,237 WARN  [RpcServer.handler=82,port=60020] ipc.RpcServer: (responseTooSlow): {"processingtimems":16755,"call":"Multi(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MultiRequest)","client":"192.168.13.66:56553","starttimems":1416893622481,"queuetimems":1,"class":"HRegionServer","responsesize":33036,"method":"Multi"}
2014-11-25 13:33:59,701 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:33:59,988 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/.tmp/b01d6a4b00974520b7d4281a68c1e430 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/b01d6a4b00974520b7d4281a68c1e430
2014-11-25 13:34:01,312 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4808153 synced till here 4808151
2014-11-25 13:34:01,325 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893638611 with entries=3538, filesize=244.8 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893639701
2014-11-25 13:34:01,326 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=118, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:34:01,328 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:34:01,366 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/3e161e3a917f47c9b55880763f6cc79f, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/3e161e3a917f47c9b55880763f6cc79f
2014-11-25 13:34:01,482 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/35fb43e78b7a437c90aff9784d41e506, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/35fb43e78b7a437c90aff9784d41e506
2014-11-25 13:34:01,658 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/369cc4773d3944e3af0943ba9fe18af9, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/369cc4773d3944e3af0943ba9fe18af9
2014-11-25 13:34:01,659 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569. into b01d6a4b00974520b7d4281a68c1e430(size=180.4 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 17sec to execute.
2014-11-25 13:34:01,659 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569., storeName=family, fileCount=3, fileSize=181.6 M, priority=-5, time=5780248673381459; duration=17sec
2014-11-25 13:34:01,659 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5162), split_queue=0, merge_queue=0
2014-11-25 13:34:01,659 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5162), split_queue=0, merge_queue=0
2014-11-25 13:34:01,659 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:34:01,659 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 171264964 starting at candidate #18 after considering 236 permutations with 201 in ratio
2014-11-25 13:34:01,659 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 66b3f405d8a37b958df876fdb9b9d09f - family: Initiating minor compaction
2014-11-25 13:34:01,660 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f.
2014-11-25 13:34:01,660 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/.tmp, totalSize=163.3 M
2014-11-25 13:34:01,660 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/d84eafa3689c4fdf919276b416a7fa98, keycount=36746, bloomtype=ROW, size=54.8 M, encoding=NONE, seqNum=28652
2014-11-25 13:34:01,660 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/0540a16c45d14222b261399288d1396e, keycount=37001, bloomtype=ROW, size=55.2 M, encoding=NONE, seqNum=29380
2014-11-25 13:34:01,660 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/801473431fbc44c6bc335c47132d063a, keycount=35804, bloomtype=ROW, size=53.4 M, encoding=NONE, seqNum=30084
2014-11-25 13:34:02,130 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:02,821 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4810933 synced till here 4810930
2014-11-25 13:34:02,952 DEBUG [RpcServer.handler=71,port=60020] regionserver.HRegion: Flush requested on usertable2,user9189,1416889268210.136ad2e559437581aba3afba361df965.
2014-11-25 13:34:02,952 WARN  [MemStoreFlusher.9] regionserver.MemStoreFlusher: Region usertable2,user9189,1416889268210.136ad2e559437581aba3afba361df965. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:02,952 DEBUG [MemStoreFlusher.9] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.9; compaction_queue=(0:5162), split_queue=0, merge_queue=0
2014-11-25 13:34:02,971 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893639701 with entries=2780, filesize=201.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893642131
2014-11-25 13:34:02,971 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=119, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:34:04,691 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:05,223 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4813573 synced till here 4813564
2014-11-25 13:34:05,468 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893642131 with entries=2640, filesize=186.8 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893644691
2014-11-25 13:34:05,469 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=120, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:34:06,100 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:07,437 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4816104 synced till here 4816099
2014-11-25 13:34:07,447 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893644691 with entries=2531, filesize=180.9 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893646100
2014-11-25 13:34:07,447 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=121, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:34:08,173 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:08,322 INFO  [MemStoreFlusher.3] regionserver.MemStoreFlusher: Waited 90016ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779.
2014-11-25 13:34:08,322 DEBUG [MemStoreFlusher.3] regionserver.HRegion: Started memstore flush for usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779., current region memstore size 197.2 M
2014-11-25 13:34:09,350 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4819690 synced till here 4819667
2014-11-25 13:34:10,217 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/.tmp/b0143235fc024996bd5e38a4e4f0ce19 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/b0143235fc024996bd5e38a4e4f0ce19
2014-11-25 13:34:10,220 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893646100 with entries=3586, filesize=257.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893648173
2014-11-25 13:34:10,221 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=122, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:34:10,291 DEBUG [RpcServer.handler=119,port=60020] regionserver.HRegion: Flush requested on usertable2,user6939,1416889268210.cdde512d492925f252720c79467f3309.
2014-11-25 13:34:10,291 WARN  [MemStoreFlusher.9] regionserver.MemStoreFlusher: Region usertable2,user6939,1416889268210.cdde512d492925f252720c79467f3309. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:10,291 DEBUG [MemStoreFlusher.9] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.9; compaction_queue=(0:5163), split_queue=0, merge_queue=0
2014-11-25 13:34:10,312 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:34:10,386 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/d84eafa3689c4fdf919276b416a7fa98, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/d84eafa3689c4fdf919276b416a7fa98
2014-11-25 13:34:10,388 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/0540a16c45d14222b261399288d1396e, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/0540a16c45d14222b261399288d1396e
2014-11-25 13:34:10,390 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/801473431fbc44c6bc335c47132d063a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/801473431fbc44c6bc335c47132d063a
2014-11-25 13:34:10,390 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f. into b0143235fc024996bd5e38a4e4f0ce19(size=162.2 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 8sec to execute.
2014-11-25 13:34:10,390 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f., storeName=family, fileCount=3, fileSize=163.3 M, priority=-5, time=5780265882380708; duration=8sec
2014-11-25 13:34:10,390 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5164), split_queue=0, merge_queue=0
2014-11-25 13:34:10,391 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5164), split_queue=0, merge_queue=0
2014-11-25 13:34:10,391 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:34:10,391 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 240795616 starting at candidate #8 after considering 236 permutations with 202 in ratio
2014-11-25 13:34:10,391 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: e9009daeaf2fa6614dce60a34dd9fa4d - family: Initiating minor compaction
2014-11-25 13:34:10,391 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d.
2014-11-25 13:34:10,391 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/.tmp, totalSize=229.6 M
2014-11-25 13:34:10,391 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/2a7984ef6e2540bd9d62bec6be5fcc34, keycount=38103, bloomtype=ROW, size=56.8 M, encoding=NONE, seqNum=19279
2014-11-25 13:34:10,391 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/fe5ce10bf32b413392515666d51a458c, keycount=41645, bloomtype=ROW, size=62.1 M, encoding=NONE, seqNum=20098
2014-11-25 13:34:10,391 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/74304ce84c694b92806f98864bb3e398, keycount=37198, bloomtype=ROW, size=55.5 M, encoding=NONE, seqNum=20833
2014-11-25 13:34:10,391 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/5317b13dee95445d93e0bdccadfda563, keycount=37090, bloomtype=ROW, size=55.3 M, encoding=NONE, seqNum=21560
2014-11-25 13:34:10,588 INFO  [MemStoreFlusher.3] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48241, memsize=197.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/.tmp/cf71698cd24b468cbc82a9fcbc42c465
2014-11-25 13:34:10,778 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:11,045 DEBUG [MemStoreFlusher.3] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/.tmp/cf71698cd24b468cbc82a9fcbc42c465 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/cf71698cd24b468cbc82a9fcbc42c465
2014-11-25 13:34:11,049 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4821659 synced till here 4821631
2014-11-25 13:34:11,062 INFO  [MemStoreFlusher.3] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/cf71698cd24b468cbc82a9fcbc42c465, entries=718110, sequenceid=48241, filesize=107.1 M
2014-11-25 13:34:11,062 INFO  [MemStoreFlusher.3] regionserver.HRegion: Finished memstore flush of ~197.2 M/206810160, currentsize=4.4 M/4567680 for region usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779. in 2740ms, sequenceid=48241, compaction requested=true
2014-11-25 13:34:11,062 DEBUG [MemStoreFlusher.3] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.3; compaction_queue=(0:5164), split_queue=0, merge_queue=0
2014-11-25 13:34:11,100 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893648173 with entries=1969, filesize=143.6 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893650778
2014-11-25 13:34:11,100 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=123, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:34:11,528 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:12,381 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4824525 synced till here 4824522
2014-11-25 13:34:12,529 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893650778 with entries=2866, filesize=197.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893651528
2014-11-25 13:34:12,530 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=124, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:34:13,096 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:13,606 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4826902 synced till here 4826897
2014-11-25 13:34:13,761 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893651528 with entries=2377, filesize=170.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893653097
2014-11-25 13:34:13,762 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=125, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:34:14,763 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:15,260 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4829592 synced till here 4829582
2014-11-25 13:34:15,463 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893653097 with entries=2690, filesize=193.3 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893654763
2014-11-25 13:34:15,463 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=126, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:34:16,254 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:17,020 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4832125 synced till here 4832114
2014-11-25 13:34:17,500 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893654763 with entries=2533, filesize=180.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893656255
2014-11-25 13:34:17,500 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=127, maxlogs=32; forcing flush of 2 regions(s): d5f2094a6ce040bca9c89f6742029d25, c9c93637c527ac1620cc49c084c5a363
2014-11-25 13:34:17,610 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/.tmp/7336dc7e2c3f44759f88da2a2f6df55d as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/7336dc7e2c3f44759f88da2a2f6df55d
2014-11-25 13:34:17,702 INFO  [MemStoreFlusher.5] regionserver.MemStoreFlusher: Waited 90794ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user9909,1416889268210.d5f2094a6ce040bca9c89f6742029d25.
2014-11-25 13:34:17,702 INFO  [MemStoreFlusher.21] regionserver.MemStoreFlusher: Waited 90794ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user9459,1416889268210.c9c93637c527ac1620cc49c084c5a363.
2014-11-25 13:34:17,702 DEBUG [MemStoreFlusher.5] regionserver.HRegion: Started memstore flush for usertable2,user9909,1416889268210.d5f2094a6ce040bca9c89f6742029d25., current region memstore size 43.7 M
2014-11-25 13:34:17,702 DEBUG [MemStoreFlusher.21] regionserver.HRegion: Started memstore flush for usertable2,user9459,1416889268210.c9c93637c527ac1620cc49c084c5a363., current region memstore size 43.7 M
2014-11-25 13:34:17,853 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:18,272 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:34:18,507 INFO  [MemStoreFlusher.21] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47988, memsize=43.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c9c93637c527ac1620cc49c084c5a363/.tmp/bbac7c5288ef45c5a18f50240bc9ece3
2014-11-25 13:34:18,655 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4835406 synced till here 4835395
2014-11-25 13:34:19,454 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893656255 with entries=3281, filesize=234.9 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893657853
2014-11-25 13:34:19,454 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/2a7984ef6e2540bd9d62bec6be5fcc34, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/2a7984ef6e2540bd9d62bec6be5fcc34
2014-11-25 13:34:19,455 INFO  [MemStoreFlusher.5] regionserver.DefaultStoreFlusher: Flushed, sequenceid=47860, memsize=43.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d5f2094a6ce040bca9c89f6742029d25/.tmp/c7d5ef648d5f40478a3d6a4fb677f156
2014-11-25 13:34:19,492 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/fe5ce10bf32b413392515666d51a458c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/fe5ce10bf32b413392515666d51a458c
2014-11-25 13:34:19,615 DEBUG [MemStoreFlusher.21] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c9c93637c527ac1620cc49c084c5a363/.tmp/bbac7c5288ef45c5a18f50240bc9ece3 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c9c93637c527ac1620cc49c084c5a363/family/bbac7c5288ef45c5a18f50240bc9ece3
2014-11-25 13:34:19,854 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/74304ce84c694b92806f98864bb3e398, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/74304ce84c694b92806f98864bb3e398
2014-11-25 13:34:20,067 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:20,117 DEBUG [MemStoreFlusher.5] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d5f2094a6ce040bca9c89f6742029d25/.tmp/c7d5ef648d5f40478a3d6a4fb677f156 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d5f2094a6ce040bca9c89f6742029d25/family/c7d5ef648d5f40478a3d6a4fb677f156
2014-11-25 13:34:20,322 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/5317b13dee95445d93e0bdccadfda563, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/5317b13dee95445d93e0bdccadfda563
2014-11-25 13:34:20,322 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d. into 7336dc7e2c3f44759f88da2a2f6df55d(size=228.1 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 9sec to execute.
2014-11-25 13:34:20,322 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d., storeName=family, fileCount=4, fileSize=229.6 M, priority=-5, time=5780274613776650; duration=9sec
2014-11-25 13:34:20,322 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5165), split_queue=0, merge_queue=0
2014-11-25 13:34:20,322 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5165), split_queue=0, merge_queue=0
2014-11-25 13:34:20,322 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:34:20,322 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 231219928 starting at candidate #19 after considering 236 permutations with 196 in ratio
2014-11-25 13:34:20,323 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 943652e75e710b59828d58f58f4dc4fe - family: Initiating minor compaction
2014-11-25 13:34:20,323 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user8199,1416889268210.943652e75e710b59828d58f58f4dc4fe.
2014-11-25 13:34:20,323 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user8199,1416889268210.943652e75e710b59828d58f58f4dc4fe. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/.tmp, totalSize=220.5 M
2014-11-25 13:34:20,323 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/922385aa09a548208514d1b4b579f066, keycount=37395, bloomtype=ROW, size=55.8 M, encoding=NONE, seqNum=28539
2014-11-25 13:34:20,323 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/0bd9a5f0e3874f71aab303e4e8d8ae5f, keycount=37806, bloomtype=ROW, size=56.4 M, encoding=NONE, seqNum=29284
2014-11-25 13:34:20,323 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/e9058cdebd9449a0b6d7850e50c3f2e5, keycount=36308, bloomtype=ROW, size=54.1 M, encoding=NONE, seqNum=29999
2014-11-25 13:34:20,323 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/73a15355ad8c4086a06057ade6a680ef, keycount=36394, bloomtype=ROW, size=54.3 M, encoding=NONE, seqNum=30714
2014-11-25 13:34:20,374 INFO  [MemStoreFlusher.21] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c9c93637c527ac1620cc49c084c5a363/family/bbac7c5288ef45c5a18f50240bc9ece3, entries=159260, sequenceid=47988, filesize=23.6 M
2014-11-25 13:34:20,374 INFO  [MemStoreFlusher.21] regionserver.HRegion: Finished memstore flush of ~43.7 M/45854000, currentsize=607.4 K/622000 for region usertable2,user9459,1416889268210.c9c93637c527ac1620cc49c084c5a363. in 2672ms, sequenceid=47988, compaction requested=true
2014-11-25 13:34:20,375 DEBUG [MemStoreFlusher.21] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.21; compaction_queue=(0:5165), split_queue=0, merge_queue=0
2014-11-25 13:34:20,746 DEBUG [RpcServer.handler=18,port=60020] regionserver.HRegion: Flush requested on usertable2,user7749,1416889268210.80d2ffdd997af333255373f6d88089b7.
2014-11-25 13:34:20,746 WARN  [MemStoreFlusher.26] regionserver.MemStoreFlusher: Region usertable2,user7749,1416889268210.80d2ffdd997af333255373f6d88089b7. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:20,746 DEBUG [MemStoreFlusher.26] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.26; compaction_queue=(0:5166), split_queue=0, merge_queue=0
2014-11-25 13:34:20,782 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4838846 synced till here 4838839
2014-11-25 13:34:20,841 INFO  [MemStoreFlusher.5] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d5f2094a6ce040bca9c89f6742029d25/family/c7d5ef648d5f40478a3d6a4fb677f156, entries=159260, sequenceid=47860, filesize=23.6 M
2014-11-25 13:34:20,841 INFO  [MemStoreFlusher.5] regionserver.HRegion: Finished memstore flush of ~43.7 M/45853920, currentsize=826.7 K/846560 for region usertable2,user9909,1416889268210.d5f2094a6ce040bca9c89f6742029d25. in 3139ms, sequenceid=47860, compaction requested=true
2014-11-25 13:34:20,842 DEBUG [MemStoreFlusher.5] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.5; compaction_queue=(0:5167), split_queue=0, merge_queue=0
2014-11-25 13:34:21,497 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893657853 with entries=3440, filesize=244.7 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893660067
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893351475
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893352586
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893353990
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893358549
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893360057
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893361099
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893362879
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893364929
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893366559
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893368253
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893368794
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893370303
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893371825
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893373377
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893374538
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893375788
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893377391
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893378579
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893380210
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893382305
2014-11-25 13:34:21,498 DEBUG [regionserver60020.logRoller] wal.FSHLog: log file is ready for archiving hdfs://mycluster:8020/hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893382913
2014-11-25 13:34:22,861 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=108, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:23,403 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:23,408 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4840642 synced till here 4840610
2014-11-25 13:34:23,418 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893660067 with entries=1796, filesize=131.0 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893663404
2014-11-25 13:34:23,418 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=109, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:23,919 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:24,321 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4843212 synced till here 4843208
2014-11-25 13:34:24,327 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893663404 with entries=2570, filesize=177.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893663919
2014-11-25 13:34:24,328 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=110, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:25,906 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:26,222 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4845350 synced till here 4845345
2014-11-25 13:34:26,323 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893663919 with entries=2138, filesize=152.0 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893665907
2014-11-25 13:34:26,324 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=111, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:26,953 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:26,974 DEBUG [RpcServer.handler=132,port=60020] regionserver.HRegion: Flush requested on usertable2,user7659,1416889268210.94360258e2b50782cd1326e64ca622b3.
2014-11-25 13:34:26,975 WARN  [MemStoreFlusher.23] regionserver.MemStoreFlusher: Region usertable2,user7659,1416889268210.94360258e2b50782cd1326e64ca622b3. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:26,975 DEBUG [MemStoreFlusher.23] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.23; compaction_queue=(0:5168), split_queue=0, merge_queue=0
2014-11-25 13:34:27,240 DEBUG [RpcServer.handler=93,port=60020] regionserver.HRegion: Flush requested on usertable2,user7929,1416889268210.66f993780f6615d093419e83e4ce0b63.
2014-11-25 13:34:27,240 WARN  [MemStoreFlusher.4] regionserver.MemStoreFlusher: Region usertable2,user7929,1416889268210.66f993780f6615d093419e83e4ce0b63. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:27,240 DEBUG [MemStoreFlusher.4] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.4; compaction_queue=(0:5169), split_queue=0, merge_queue=0
2014-11-25 13:34:27,279 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/.tmp/ee1986f3ee7e46ffb93278a20f4018cc as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/ee1986f3ee7e46ffb93278a20f4018cc
2014-11-25 13:34:27,297 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4847627 synced till here 4847623
2014-11-25 13:34:28,202 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893665907 with entries=2277, filesize=161.8 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893666953
2014-11-25 13:34:28,203 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=112, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:28,216 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:34:28,239 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/922385aa09a548208514d1b4b579f066, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/922385aa09a548208514d1b4b579f066
2014-11-25 13:34:28,240 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/0bd9a5f0e3874f71aab303e4e8d8ae5f, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/0bd9a5f0e3874f71aab303e4e8d8ae5f
2014-11-25 13:34:28,242 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/e9058cdebd9449a0b6d7850e50c3f2e5, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/e9058cdebd9449a0b6d7850e50c3f2e5
2014-11-25 13:34:28,244 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/73a15355ad8c4086a06057ade6a680ef, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/73a15355ad8c4086a06057ade6a680ef
2014-11-25 13:34:28,244 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user8199,1416889268210.943652e75e710b59828d58f58f4dc4fe. into ee1986f3ee7e46ffb93278a20f4018cc(size=219.0 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 7sec to execute.
2014-11-25 13:34:28,244 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user8199,1416889268210.943652e75e710b59828d58f58f4dc4fe., storeName=family, fileCount=4, fileSize=220.5 M, priority=-5, time=5780284545498148; duration=7sec
2014-11-25 13:34:28,244 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5170), split_queue=0, merge_queue=0
2014-11-25 13:34:28,245 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5170), split_queue=0, merge_queue=0
2014-11-25 13:34:28,245 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:34:28,245 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 5 files of size 298883930 starting at candidate #17 after considering 236 permutations with 197 in ratio
2014-11-25 13:34:28,245 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: f493ed6daa8012ad6a97726dcb83e1b6 - family: Initiating minor compaction
2014-11-25 13:34:28,245 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user8559,1416889268210.f493ed6daa8012ad6a97726dcb83e1b6.
2014-11-25 13:34:28,245 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 5 file(s) in family of usertable2,user8559,1416889268210.f493ed6daa8012ad6a97726dcb83e1b6. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/.tmp, totalSize=285.0 M
2014-11-25 13:34:28,245 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/d2d5a363347742f2b9b0e2e7f8c7485c, keycount=36863, bloomtype=ROW, size=55.0 M, encoding=NONE, seqNum=25220
2014-11-25 13:34:28,245 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/3bad35ae1004432eaf52203a46735c7d, keycount=41781, bloomtype=ROW, size=62.3 M, encoding=NONE, seqNum=26041
2014-11-25 13:34:28,245 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/ad4892583eff485ab9c7263d5cd217ee, keycount=37465, bloomtype=ROW, size=55.9 M, encoding=NONE, seqNum=26780
2014-11-25 13:34:28,245 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/45c84e342a174691bbbef7922f3740c2, keycount=37918, bloomtype=ROW, size=56.5 M, encoding=NONE, seqNum=27526
2014-11-25 13:34:28,246 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/f21e2fd3eadd412d86c06cc1e98f64c3, keycount=37166, bloomtype=ROW, size=55.4 M, encoding=NONE, seqNum=28256
2014-11-25 13:34:28,864 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:29,237 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4849858 synced till here 4849853
2014-11-25 13:34:29,340 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893666953 with entries=2231, filesize=159.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893668865
2014-11-25 13:34:29,340 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=113, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:29,950 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:31,078 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4851967 synced till here 4851961
2014-11-25 13:34:31,818 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893668865 with entries=2109, filesize=149.5 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893669950
2014-11-25 13:34:31,818 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=114, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:31,852 DEBUG [RpcServer.handler=29,port=60020] regionserver.HRegion: Flush requested on usertable2,user1359,1416889268210.5af9e7c1428814f12682f220113dc251.
2014-11-25 13:34:31,852 WARN  [MemStoreFlusher.19] regionserver.MemStoreFlusher: Region usertable2,user1359,1416889268210.5af9e7c1428814f12682f220113dc251. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:31,852 DEBUG [MemStoreFlusher.19] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.19; compaction_queue=(0:5170), split_queue=0, merge_queue=0
2014-11-25 13:34:32,439 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:32,577 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4853779 synced till here 4853761
2014-11-25 13:34:32,592 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893669950 with entries=1812, filesize=136.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893672439
2014-11-25 13:34:32,592 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=115, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:33,047 DEBUG [RpcServer.handler=53,port=60020] regionserver.HRegion: Flush requested on usertable2,user5499,1416889268210.47c1cb50ecad10991e33a3c834624e07.
2014-11-25 13:34:33,047 WARN  [MemStoreFlusher.22] regionserver.MemStoreFlusher: Region usertable2,user5499,1416889268210.47c1cb50ecad10991e33a3c834624e07. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:33,047 DEBUG [MemStoreFlusher.22] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.22; compaction_queue=(0:5171), split_queue=0, merge_queue=0
2014-11-25 13:34:33,111 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:33,940 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4855725 synced till here 4855723
2014-11-25 13:34:33,949 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893672439 with entries=1946, filesize=130.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893673111
2014-11-25 13:34:33,949 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=116, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:34,710 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:35,072 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4858003 synced till here 4857996
2014-11-25 13:34:35,184 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893673111 with entries=2278, filesize=164.6 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893674710
2014-11-25 13:34:35,185 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=117, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:36,161 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:36,692 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4860915 synced till here 4860911
2014-11-25 13:34:36,722 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/.tmp/d15d0d9fab47471db6362c50c6185759 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/d15d0d9fab47471db6362c50c6185759
2014-11-25 13:34:36,897 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893674710 with entries=2912, filesize=206.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893676161
2014-11-25 13:34:36,897 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=118, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:37,040 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:34:37,291 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/d2d5a363347742f2b9b0e2e7f8c7485c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/d2d5a363347742f2b9b0e2e7f8c7485c
2014-11-25 13:34:37,437 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/3bad35ae1004432eaf52203a46735c7d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/3bad35ae1004432eaf52203a46735c7d
2014-11-25 13:34:37,508 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:37,612 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/ad4892583eff485ab9c7263d5cd217ee, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/ad4892583eff485ab9c7263d5cd217ee
2014-11-25 13:34:37,942 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/45c84e342a174691bbbef7922f3740c2, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/45c84e342a174691bbbef7922f3740c2
2014-11-25 13:34:37,983 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4863513 synced till here 4863511
2014-11-25 13:34:38,356 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893676161 with entries=2598, filesize=184.9 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893677508
2014-11-25 13:34:38,356 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=119, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:38,357 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/f21e2fd3eadd412d86c06cc1e98f64c3, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/f21e2fd3eadd412d86c06cc1e98f64c3
2014-11-25 13:34:38,357 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 5 file(s) in family of usertable2,user8559,1416889268210.f493ed6daa8012ad6a97726dcb83e1b6. into d15d0d9fab47471db6362c50c6185759(size=283.2 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 10sec to execute.
2014-11-25 13:34:38,358 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user8559,1416889268210.f493ed6daa8012ad6a97726dcb83e1b6., storeName=family, fileCount=5, fileSize=285.0 M, priority=-5, time=5780292467803641; duration=10sec
2014-11-25 13:34:38,358 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5172), split_queue=0, merge_queue=0
2014-11-25 13:34:38,358 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5172), split_queue=0, merge_queue=0
2014-11-25 13:34:38,358 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:34:38,358 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 175213633 starting at candidate #14 after considering 236 permutations with 224 in ratio
2014-11-25 13:34:38,358 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 89889f2dded6096cf9f3f21f17f99f8b - family: Initiating minor compaction
2014-11-25 13:34:38,358 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b.
2014-11-25 13:34:38,358 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/.tmp, totalSize=167.1 M
2014-11-25 13:34:38,358 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/37ba57dc4e1e4b00a6dcf0745a4e01fb, keycount=36751, bloomtype=ROW, size=54.8 M, encoding=NONE, seqNum=26548
2014-11-25 13:34:38,358 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/c91c2c5308444afc8853fabbb4588c85, keycount=37582, bloomtype=ROW, size=56.0 M, encoding=NONE, seqNum=27285
2014-11-25 13:34:38,358 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/b9df575db5ac47a4950051e658b12e11, keycount=37747, bloomtype=ROW, size=56.3 M, encoding=NONE, seqNum=28030
2014-11-25 13:34:38,726 DEBUG [RpcServer.handler=74,port=60020] regionserver.HRegion: Flush requested on usertable2,user1899,1416889268210.9478768bd4d49198f76234ab9c4947db.
2014-11-25 13:34:38,726 WARN  [MemStoreFlusher.33] regionserver.MemStoreFlusher: Region usertable2,user1899,1416889268210.9478768bd4d49198f76234ab9c4947db. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:38,727 DEBUG [MemStoreFlusher.33] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.33; compaction_queue=(0:5172), split_queue=0, merge_queue=0
2014-11-25 13:34:39,096 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:39,708 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893677508 with entries=2435, filesize=174.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893679096
2014-11-25 13:34:39,709 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=120, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:40,680 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:41,034 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4868207 synced till here 4868204
2014-11-25 13:34:41,136 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893679096 with entries=2259, filesize=160.3 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893680680
2014-11-25 13:34:41,136 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=121, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:41,670 DEBUG [RpcServer.handler=127,port=60020] regionserver.HRegion: Flush requested on usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70.
2014-11-25 13:34:41,670 WARN  [MemStoreFlusher.29] regionserver.MemStoreFlusher: Region usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:41,670 DEBUG [MemStoreFlusher.29] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.29; compaction_queue=(0:5173), split_queue=0, merge_queue=0
2014-11-25 13:34:41,736 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:42,027 DEBUG [RpcServer.handler=5,port=60020] regionserver.HRegion: Flush requested on usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156.
2014-11-25 13:34:42,027 WARN  [MemStoreFlusher.2] regionserver.MemStoreFlusher: Region usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:42,027 DEBUG [MemStoreFlusher.2] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.2; compaction_queue=(0:5174), split_queue=0, merge_queue=0
2014-11-25 13:34:42,061 DEBUG [RpcServer.handler=142,port=60020] regionserver.HRegion: Flush requested on usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875.
2014-11-25 13:34:42,061 WARN  [MemStoreFlusher.22] regionserver.MemStoreFlusher: Region usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:42,061 DEBUG [MemStoreFlusher.22] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.22; compaction_queue=(0:5175), split_queue=0, merge_queue=0
2014-11-25 13:34:42,145 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4870597 synced till here 4870596
2014-11-25 13:34:42,333 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893680680 with entries=2390, filesize=170.0 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893681736
2014-11-25 13:34:42,333 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=122, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:43,246 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/.tmp/f59ea21e53f14840bf0bc77f325fef82 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/f59ea21e53f14840bf0bc77f325fef82
2014-11-25 13:34:43,347 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:43,595 DEBUG [RpcServer.handler=52,port=60020] regionserver.HRegion: Flush requested on usertable2,user8469,1416889268210.190546a1cd2a016b3df3324d5875e49b.
2014-11-25 13:34:43,595 WARN  [MemStoreFlusher.34] regionserver.MemStoreFlusher: Region usertable2,user8469,1416889268210.190546a1cd2a016b3df3324d5875e49b. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:43,596 DEBUG [MemStoreFlusher.34] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.34; compaction_queue=(0:5176), split_queue=0, merge_queue=0
2014-11-25 13:34:43,702 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:34:43,743 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4873176 synced till here 4873173
2014-11-25 13:34:43,899 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893681736 with entries=2579, filesize=184.1 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893683347
2014-11-25 13:34:43,900 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=123, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:43,943 DEBUG [RpcServer.handler=137,port=60020] regionserver.HRegion: Flush requested on usertable2,user2799,1416889268210.5ff266e4e6272ab4516ca0c0f122bd3a.
2014-11-25 13:34:43,943 WARN  [MemStoreFlusher.9] regionserver.MemStoreFlusher: Region usertable2,user2799,1416889268210.5ff266e4e6272ab4516ca0c0f122bd3a. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:43,944 DEBUG [MemStoreFlusher.9] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.9; compaction_queue=(0:5177), split_queue=0, merge_queue=0
2014-11-25 13:34:43,995 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/37ba57dc4e1e4b00a6dcf0745a4e01fb, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/37ba57dc4e1e4b00a6dcf0745a4e01fb
2014-11-25 13:34:43,997 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/c91c2c5308444afc8853fabbb4588c85, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/c91c2c5308444afc8853fabbb4588c85
2014-11-25 13:34:43,998 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/b9df575db5ac47a4950051e658b12e11, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/b9df575db5ac47a4950051e658b12e11
2014-11-25 13:34:43,999 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b. into f59ea21e53f14840bf0bc77f325fef82(size=166.0 M), total size for store is 3.6 G. This selection was in queue for 0sec, and took 5sec to execute.
2014-11-25 13:34:43,999 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b., storeName=family, fileCount=3, fileSize=167.1 M, priority=-5, time=5780302580847916; duration=5sec
2014-11-25 13:34:43,999 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5178), split_queue=0, merge_queue=0
2014-11-25 13:34:43,999 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5178), split_queue=0, merge_queue=0
2014-11-25 13:34:43,999 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:34:43,999 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 231916821 starting at candidate #14 after considering 236 permutations with 230 in ratio
2014-11-25 13:34:43,999 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 09a9193727ffcc63b8838a6c82b049a5 - family: Initiating minor compaction
2014-11-25 13:34:43,999 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user3159,1416889268210.09a9193727ffcc63b8838a6c82b049a5.
2014-11-25 13:34:43,999 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user3159,1416889268210.09a9193727ffcc63b8838a6c82b049a5. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/.tmp, totalSize=221.2 M
2014-11-25 13:34:43,999 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/36a8d64ecc144cf8ba908f788fab9aea, keycount=36699, bloomtype=ROW, size=54.7 M, encoding=NONE, seqNum=26546
2014-11-25 13:34:44,000 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/1089f237a50141fb9afb6501b274139d, keycount=37544, bloomtype=ROW, size=56.0 M, encoding=NONE, seqNum=27284
2014-11-25 13:34:44,000 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/b0f11512fea745faa2227b38be3daa29, keycount=38148, bloomtype=ROW, size=56.9 M, encoding=NONE, seqNum=28030
2014-11-25 13:34:44,000 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/45b585be66564e9c81ab2481d4cb6daa, keycount=35959, bloomtype=ROW, size=53.6 M, encoding=NONE, seqNum=28739
2014-11-25 13:34:44,531 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:45,275 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893683347 with entries=2256, filesize=159.9 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893684531
2014-11-25 13:34:45,275 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=124, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:45,687 DEBUG [RpcServer.handler=31,port=60020] regionserver.HRegion: Flush requested on usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856.
2014-11-25 13:34:45,687 WARN  [MemStoreFlusher.39] regionserver.MemStoreFlusher: Region usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:45,687 DEBUG [MemStoreFlusher.39] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.39; compaction_queue=(0:5178), split_queue=0, merge_queue=0
2014-11-25 13:34:46,014 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:46,417 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4878041 synced till here 4878039
2014-11-25 13:34:46,623 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893684531 with entries=2609, filesize=185.5 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893686014
2014-11-25 13:34:46,623 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=125, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:47,657 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:48,858 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4879869 synced till here 4879837
2014-11-25 13:34:48,874 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893686014 with entries=1828, filesize=130.3 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893687657
2014-11-25 13:34:48,874 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=126, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:49,366 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:49,399 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4881586 synced till here 4881558
2014-11-25 13:34:49,411 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893687657 with entries=1717, filesize=130.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893689367
2014-11-25 13:34:49,411 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=127, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:50,273 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/.tmp/ed25cd7bd30c4209ab9fc08f1d134755 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/ed25cd7bd30c4209ab9fc08f1d134755
2014-11-25 13:34:50,309 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:34:50,415 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:50,565 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/36a8d64ecc144cf8ba908f788fab9aea, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/36a8d64ecc144cf8ba908f788fab9aea
2014-11-25 13:34:50,869 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/1089f237a50141fb9afb6501b274139d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/1089f237a50141fb9afb6501b274139d
2014-11-25 13:34:50,919 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4884084 synced till here 4884079
2014-11-25 13:34:51,125 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893689367 with entries=2498, filesize=172.5 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893690416
2014-11-25 13:34:51,125 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=128, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:51,150 DEBUG [RpcServer.handler=143,port=60020] regionserver.HRegion: Flush requested on usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027.
2014-11-25 13:34:51,150 WARN  [MemStoreFlusher.21] regionserver.MemStoreFlusher: Region usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:51,151 DEBUG [MemStoreFlusher.21] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.21; compaction_queue=(0:5179), split_queue=0, merge_queue=0
2014-11-25 13:34:51,219 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/b0f11512fea745faa2227b38be3daa29, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/b0f11512fea745faa2227b38be3daa29
2014-11-25 13:34:51,436 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/45b585be66564e9c81ab2481d4cb6daa, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/45b585be66564e9c81ab2481d4cb6daa
2014-11-25 13:34:51,437 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user3159,1416889268210.09a9193727ffcc63b8838a6c82b049a5. into ed25cd7bd30c4209ab9fc08f1d134755(size=219.7 M), total size for store is 3.6 G. This selection was in queue for 0sec, and took 7sec to execute.
2014-11-25 13:34:51,437 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user3159,1416889268210.09a9193727ffcc63b8838a6c82b049a5., storeName=family, fileCount=4, fileSize=221.2 M, priority=-5, time=5780308221970452; duration=7sec
2014-11-25 13:34:51,437 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5180), split_queue=0, merge_queue=0
2014-11-25 13:34:51,437 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5180), split_queue=0, merge_queue=0
2014-11-25 13:34:51,437 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:34:51,437 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 180808957 starting at candidate #5 after considering 236 permutations with 224 in ratio
2014-11-25 13:34:51,437 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 419a973c54b8df54b6b65c8939f875da - family: Initiating minor compaction
2014-11-25 13:34:51,437 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da.
2014-11-25 13:34:51,437 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/.tmp, totalSize=172.4 M
2014-11-25 13:34:51,438 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/4cda1d6d4e014f349119f799fac30684, keycount=39293, bloomtype=ROW, size=58.6 M, encoding=NONE, seqNum=15327
2014-11-25 13:34:51,438 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/62aff83d7df740e3a4c890a8eb495f03, keycount=40306, bloomtype=ROW, size=60.1 M, encoding=NONE, seqNum=16118
2014-11-25 13:34:51,438 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/94a21f25208e4185a126aae8d0561ae9, keycount=36064, bloomtype=ROW, size=53.8 M, encoding=NONE, seqNum=16830
2014-11-25 13:34:51,541 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:52,048 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4886827 synced till here 4886826
2014-11-25 13:34:52,220 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893690416 with entries=2743, filesize=193.3 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893691542
2014-11-25 13:34:52,221 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=129, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:52,875 DEBUG [RpcServer.handler=91,port=60020] regionserver.HRegion: Flush requested on usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f.
2014-11-25 13:34:52,875 WARN  [MemStoreFlusher.6] regionserver.MemStoreFlusher: Region usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:52,875 DEBUG [MemStoreFlusher.6] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.6; compaction_queue=(0:5180), split_queue=0, merge_queue=0
2014-11-25 13:34:53,030 DEBUG [RpcServer.handler=91,port=60020] regionserver.HRegion: Flush requested on usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569.
2014-11-25 13:34:53,030 WARN  [MemStoreFlusher.2] regionserver.MemStoreFlusher: Region usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:53,030 DEBUG [MemStoreFlusher.2] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.2; compaction_queue=(0:5181), split_queue=0, merge_queue=0
2014-11-25 13:34:53,212 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:53,345 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893691542 with entries=1900, filesize=135.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893693213
2014-11-25 13:34:53,346 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=130, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:53,957 DEBUG [RpcServer.handler=22,port=60020] regionserver.HRegion: Flush requested on usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e.
2014-11-25 13:34:53,957 WARN  [MemStoreFlusher.23] regionserver.MemStoreFlusher: Region usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:53,957 DEBUG [MemStoreFlusher.23] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.23; compaction_queue=(0:5182), split_queue=0, merge_queue=0
2014-11-25 13:34:54,089 DEBUG [RpcServer.handler=81,port=60020] regionserver.HRegion: Flush requested on usertable2,user8199,1416889268210.943652e75e710b59828d58f58f4dc4fe.
2014-11-25 13:34:54,089 WARN  [MemStoreFlusher.5] regionserver.MemStoreFlusher: Region usertable2,user8199,1416889268210.943652e75e710b59828d58f58f4dc4fe. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:54,089 DEBUG [MemStoreFlusher.5] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.5; compaction_queue=(0:5183), split_queue=0, merge_queue=0
2014-11-25 13:34:54,100 DEBUG [RpcServer.handler=81,port=60020] regionserver.HRegion: Flush requested on usertable2,user8559,1416889268210.f493ed6daa8012ad6a97726dcb83e1b6.
2014-11-25 13:34:54,100 WARN  [MemStoreFlusher.9] regionserver.MemStoreFlusher: Region usertable2,user8559,1416889268210.f493ed6daa8012ad6a97726dcb83e1b6. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:54,100 DEBUG [MemStoreFlusher.9] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.9; compaction_queue=(0:5184), split_queue=0, merge_queue=0
2014-11-25 13:34:54,137 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:54,521 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4890803 synced till here 4890798
2014-11-25 13:34:59,073 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893693213 with entries=2076, filesize=147.1 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893694137
2014-11-25 13:34:59,074 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=131, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:59,143 DEBUG [RpcServer.handler=114,port=60020] regionserver.HRegion: Flush requested on usertable2,user1539,1416889268210.cc10fb31d8cc1e28a698092d6c1a5416.
2014-11-25 13:34:59,144 WARN  [MemStoreFlusher.2] regionserver.MemStoreFlusher: Region usertable2,user1539,1416889268210.cc10fb31d8cc1e28a698092d6c1a5416. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,144 DEBUG [MemStoreFlusher.2] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.2; compaction_queue=(0:5185), split_queue=0, merge_queue=0
2014-11-25 13:34:59,159 DEBUG [RpcServer.handler=103,port=60020] regionserver.HRegion: Flush requested on usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d.
2014-11-25 13:34:59,159 WARN  [MemStoreFlusher.33] regionserver.MemStoreFlusher: Region usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,159 DEBUG [MemStoreFlusher.33] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.33; compaction_queue=(0:5186), split_queue=0, merge_queue=0
2014-11-25 13:34:59,169 DEBUG [RpcServer.handler=66,port=60020] regionserver.HRegion: Flush requested on usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf.
2014-11-25 13:34:59,169 WARN  [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,169 DEBUG [MemStoreFlusher.1] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.1; compaction_queue=(0:5187), split_queue=0, merge_queue=0
2014-11-25 13:34:59,202 DEBUG [RpcServer.handler=24,port=60020] regionserver.HRegion: Flush requested on usertable2,user1989,1416889268210.5f25bd0630c80f4e811af5f6488c5a89.
2014-11-25 13:34:59,202 WARN  [MemStoreFlusher.24] regionserver.MemStoreFlusher: Region usertable2,user1989,1416889268210.5f25bd0630c80f4e811af5f6488c5a89. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,202 DEBUG [MemStoreFlusher.24] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.24; compaction_queue=(0:5188), split_queue=0, merge_queue=0
2014-11-25 13:34:59,207 DEBUG [RpcServer.handler=92,port=60020] regionserver.HRegion: Flush requested on usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407.
2014-11-25 13:34:59,207 WARN  [MemStoreFlusher.39] regionserver.MemStoreFlusher: Region usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,208 DEBUG [MemStoreFlusher.39] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.39; compaction_queue=(0:5189), split_queue=0, merge_queue=0
2014-11-25 13:34:59,216 DEBUG [RpcServer.handler=103,port=60020] regionserver.HRegion: Flush requested on usertable2,user2169,1416889268210.a6d76b3d9a5a10e578fccc6098a8444b.
2014-11-25 13:34:59,216 WARN  [MemStoreFlusher.35] regionserver.MemStoreFlusher: Region usertable2,user2169,1416889268210.a6d76b3d9a5a10e578fccc6098a8444b. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,216 DEBUG [MemStoreFlusher.35] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.35; compaction_queue=(0:5190), split_queue=0, merge_queue=0
2014-11-25 13:34:59,240 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/.tmp/6daba2f5c5894454adca3afd53cd8f62 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/6daba2f5c5894454adca3afd53cd8f62
2014-11-25 13:34:59,251 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:34:59,256 DEBUG [RpcServer.handler=97,port=60020] regionserver.HRegion: Flush requested on usertable2,user4779,1416889268210.1c65748e65f11456ce7b67d20bff3966.
2014-11-25 13:34:59,256 WARN  [MemStoreFlusher.14] regionserver.MemStoreFlusher: Region usertable2,user4779,1416889268210.1c65748e65f11456ce7b67d20bff3966. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,256 DEBUG [MemStoreFlusher.14] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.14; compaction_queue=(0:5191), split_queue=0, merge_queue=0
2014-11-25 13:34:59,256 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/4cda1d6d4e014f349119f799fac30684, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/4cda1d6d4e014f349119f799fac30684
2014-11-25 13:34:59,258 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/62aff83d7df740e3a4c890a8eb495f03, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/62aff83d7df740e3a4c890a8eb495f03
2014-11-25 13:34:59,260 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/94a21f25208e4185a126aae8d0561ae9, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/94a21f25208e4185a126aae8d0561ae9
2014-11-25 13:34:59,260 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da. into 6daba2f5c5894454adca3afd53cd8f62(size=171.3 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 7sec to execute.
2014-11-25 13:34:59,260 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da., storeName=family, fileCount=3, fileSize=172.4 M, priority=-5, time=5780315660150872; duration=7sec
2014-11-25 13:34:59,260 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5192), split_queue=0, merge_queue=0
2014-11-25 13:34:59,260 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5192), split_queue=0, merge_queue=0
2014-11-25 13:34:59,260 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:34:59,260 DEBUG [RpcServer.handler=60,port=60020] regionserver.HRegion: Flush requested on usertable2,user2529,1416889268210.b451134c60b1dc7cf526e81f6db2c433.
2014-11-25 13:34:59,260 WARN  [MemStoreFlusher.36] regionserver.MemStoreFlusher: Region usertable2,user2529,1416889268210.b451134c60b1dc7cf526e81f6db2c433. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,260 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 176238777 starting at candidate #23 after considering 236 permutations with 213 in ratio
2014-11-25 13:34:59,260 DEBUG [MemStoreFlusher.36] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.36; compaction_queue=(0:5192), split_queue=0, merge_queue=0
2014-11-25 13:34:59,260 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: a9599695281fb69b67e424ae93f80ac0 - family: Initiating minor compaction
2014-11-25 13:34:59,261 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0.
2014-11-25 13:34:59,261 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/.tmp, totalSize=168.1 M
2014-11-25 13:34:59,261 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/c7e0b03c34f34e8fb04d2c3c9f4d82cb, keycount=36715, bloomtype=ROW, size=54.7 M, encoding=NONE, seqNum=30910
2014-11-25 13:34:59,261 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/1e9b33fbfb884e809b44e6bb6e7ca90b, keycount=39882, bloomtype=ROW, size=59.5 M, encoding=NONE, seqNum=31695
2014-11-25 13:34:59,261 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/6cbb5dae0b04478eb592772f74840b8f, keycount=36139, bloomtype=ROW, size=53.9 M, encoding=NONE, seqNum=32407
2014-11-25 13:34:59,270 DEBUG [RpcServer.handler=103,port=60020] regionserver.HRegion: Flush requested on usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b.
2014-11-25 13:34:59,271 WARN  [MemStoreFlusher.30] regionserver.MemStoreFlusher: Region usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,271 DEBUG [MemStoreFlusher.30] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.30; compaction_queue=(0:5193), split_queue=0, merge_queue=0
2014-11-25 13:34:59,280 DEBUG [RpcServer.handler=121,port=60020] regionserver.HRegion: Flush requested on usertable2,user2979,1416889268210.eb335d2faee6fcc254e5fef1453c282b.
2014-11-25 13:34:59,280 WARN  [MemStoreFlusher.19] regionserver.MemStoreFlusher: Region usertable2,user2979,1416889268210.eb335d2faee6fcc254e5fef1453c282b. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,281 DEBUG [MemStoreFlusher.19] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.19; compaction_queue=(0:5194), split_queue=0, merge_queue=0
2014-11-25 13:34:59,285 DEBUG [RpcServer.handler=24,port=60020] regionserver.HRegion: Flush requested on usertable2,user2709,1416889268210.fd0aae1076bc05c8db51754294c21e38.
2014-11-25 13:34:59,285 WARN  [MemStoreFlusher.6] regionserver.MemStoreFlusher: Region usertable2,user2709,1416889268210.fd0aae1076bc05c8db51754294c21e38. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,285 DEBUG [MemStoreFlusher.6] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.6; compaction_queue=(0:5195), split_queue=0, merge_queue=0
2014-11-25 13:34:59,291 DEBUG [RpcServer.handler=64,port=60020] regionserver.HRegion: Flush requested on usertable2,user3519,1416889268210.fc6c0c446a315daf2015d57ba81babe0.
2014-11-25 13:34:59,291 WARN  [MemStoreFlusher.22] regionserver.MemStoreFlusher: Region usertable2,user3519,1416889268210.fc6c0c446a315daf2015d57ba81babe0. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,291 DEBUG [MemStoreFlusher.22] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.22; compaction_queue=(0:5196), split_queue=0, merge_queue=0
2014-11-25 13:34:59,301 DEBUG [RpcServer.handler=57,port=60020] regionserver.HRegion: Flush requested on usertable2,user2889,1416889268210.44276931450f87557d509a6420f58f5c.
2014-11-25 13:34:59,302 WARN  [MemStoreFlusher.25] regionserver.MemStoreFlusher: Region usertable2,user2889,1416889268210.44276931450f87557d509a6420f58f5c. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,302 DEBUG [MemStoreFlusher.25] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.25; compaction_queue=(0:5197), split_queue=0, merge_queue=0
2014-11-25 13:34:59,337 DEBUG [RpcServer.handler=24,port=60020] regionserver.HRegion: Flush requested on usertable2,user3159,1416889268210.09a9193727ffcc63b8838a6c82b049a5.
2014-11-25 13:34:59,337 WARN  [MemStoreFlusher.28] regionserver.MemStoreFlusher: Region usertable2,user3159,1416889268210.09a9193727ffcc63b8838a6c82b049a5. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,338 DEBUG [MemStoreFlusher.28] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.28; compaction_queue=(0:5198), split_queue=0, merge_queue=0
2014-11-25 13:34:59,342 DEBUG [RpcServer.handler=132,port=60020] regionserver.HRegion: Flush requested on usertable2,user3429,1416889268210.040dc650b54378108a29bab140ceeb02.
2014-11-25 13:34:59,342 WARN  [MemStoreFlusher.11] regionserver.MemStoreFlusher: Region usertable2,user3429,1416889268210.040dc650b54378108a29bab140ceeb02. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,343 DEBUG [MemStoreFlusher.11] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.11; compaction_queue=(0:5199), split_queue=0, merge_queue=0
2014-11-25 13:34:59,348 DEBUG [RpcServer.handler=60,port=60020] regionserver.HRegion: Flush requested on usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297.
2014-11-25 13:34:59,348 WARN  [MemStoreFlusher.4] regionserver.MemStoreFlusher: Region usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,349 DEBUG [MemStoreFlusher.4] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.4; compaction_queue=(0:5200), split_queue=0, merge_queue=0
2014-11-25 13:34:59,354 DEBUG [RpcServer.handler=30,port=60020] regionserver.HRegion: Flush requested on usertable2,user5319,1416889268210.c2e76bfcf0ee452319788ce49186a339.
2014-11-25 13:34:59,354 WARN  [MemStoreFlusher.2] regionserver.MemStoreFlusher: Region usertable2,user5319,1416889268210.c2e76bfcf0ee452319788ce49186a339. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,354 DEBUG [MemStoreFlusher.2] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.2; compaction_queue=(0:5201), split_queue=0, merge_queue=0
2014-11-25 13:34:59,367 DEBUG [RpcServer.handler=64,port=60020] regionserver.HRegion: Flush requested on usertable2,user4149,1416889268210.c068f0d848be8a8d9b2a90f612ef94a1.
2014-11-25 13:34:59,367 WARN  [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region usertable2,user4149,1416889268210.c068f0d848be8a8d9b2a90f612ef94a1. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,367 DEBUG [MemStoreFlusher.1] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.1; compaction_queue=(0:5202), split_queue=0, merge_queue=0
2014-11-25 13:34:59,375 DEBUG [RpcServer.handler=132,port=60020] regionserver.HRegion: Flush requested on usertable2,user3699,1416889268210.b0dd08f1639152a6ac8ca032afa4d6db.
2014-11-25 13:34:59,375 WARN  [MemStoreFlusher.31] regionserver.MemStoreFlusher: Region usertable2,user3699,1416889268210.b0dd08f1639152a6ac8ca032afa4d6db. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,375 DEBUG [MemStoreFlusher.31] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.31; compaction_queue=(0:5203), split_queue=0, merge_queue=0
2014-11-25 13:34:59,379 DEBUG [RpcServer.handler=78,port=60020] regionserver.HRegion: Flush requested on usertable2,user5859,1416889268210.653390cc13d30804b9445ebffd69a81d.
2014-11-25 13:34:59,379 WARN  [MemStoreFlusher.35] regionserver.MemStoreFlusher: Region usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,379 DEBUG [RpcServer.handler=43,port=60020] regionserver.HRegion: Flush requested on usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5.
2014-11-25 13:34:59,380 WARN  [MemStoreFlusher.38] regionserver.MemStoreFlusher: Region usertable2,user5859,1416889268210.653390cc13d30804b9445ebffd69a81d. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,380 DEBUG [MemStoreFlusher.35] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.35; compaction_queue=(0:5204), split_queue=0, merge_queue=0
2014-11-25 13:34:59,380 DEBUG [MemStoreFlusher.38] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.38; compaction_queue=(0:5205), split_queue=0, merge_queue=0
2014-11-25 13:34:59,409 DEBUG [RpcServer.handler=104,port=60020] regionserver.HRegion: Flush requested on usertable2,user3789,1416889268210.4cbd9216f88e34160a388d0cd31c622c.
2014-11-25 13:34:59,409 WARN  [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region usertable2,user3789,1416889268210.4cbd9216f88e34160a388d0cd31c622c. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,409 DEBUG [MemStoreFlusher.0] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.0; compaction_queue=(0:5206), split_queue=0, merge_queue=0
2014-11-25 13:34:59,433 DEBUG [RpcServer.handler=97,port=60020] regionserver.HRegion: Flush requested on usertable2,user6219,1416889268210.e452c53f69cba13d15de325c057fb970.
2014-11-25 13:34:59,433 WARN  [MemStoreFlusher.17] regionserver.MemStoreFlusher: Region usertable2,user6219,1416889268210.e452c53f69cba13d15de325c057fb970. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,433 DEBUG [MemStoreFlusher.17] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.17; compaction_queue=(0:5207), split_queue=0, merge_queue=0
2014-11-25 13:34:59,435 DEBUG [RpcServer.handler=121,port=60020] regionserver.HRegion: Flush requested on usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4.
2014-11-25 13:34:59,435 WARN  [MemStoreFlusher.16] regionserver.MemStoreFlusher: Region usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,435 DEBUG [MemStoreFlusher.16] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.16; compaction_queue=(0:5208), split_queue=0, merge_queue=0
2014-11-25 13:34:59,444 DEBUG [RpcServer.handler=123,port=60020] regionserver.HRegion: Flush requested on usertable2,user4059,1416889268210.a1bdaf5ad20e2ea54e0e5a2e45d102e5.
2014-11-25 13:34:59,444 WARN  [MemStoreFlusher.15] regionserver.MemStoreFlusher: Region usertable2,user4059,1416889268210.a1bdaf5ad20e2ea54e0e5a2e45d102e5. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,445 DEBUG [MemStoreFlusher.15] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.15; compaction_queue=(0:5209), split_queue=0, merge_queue=0
2014-11-25 13:34:59,446 DEBUG [RpcServer.handler=64,port=60020] regionserver.HRegion: Flush requested on usertable2,user4959,1416889268210.3ec2e06a3605856a1dd62083096f2771.
2014-11-25 13:34:59,446 WARN  [MemStoreFlusher.3] regionserver.MemStoreFlusher: Region usertable2,user4959,1416889268210.3ec2e06a3605856a1dd62083096f2771. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,447 DEBUG [MemStoreFlusher.3] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.3; compaction_queue=(0:5210), split_queue=0, merge_queue=0
2014-11-25 13:34:59,449 DEBUG [RpcServer.handler=82,port=60020] regionserver.HRegion: Flush requested on usertable2,user4239,1416889268210.e521da13cf88c7e5aa481035feae21e5.
2014-11-25 13:34:59,449 WARN  [MemStoreFlusher.36] regionserver.MemStoreFlusher: Region usertable2,user4239,1416889268210.e521da13cf88c7e5aa481035feae21e5. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,449 DEBUG [MemStoreFlusher.36] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.36; compaction_queue=(0:5211), split_queue=0, merge_queue=0
2014-11-25 13:34:59,451 DEBUG [RpcServer.handler=78,port=60020] regionserver.HRegion: Flush requested on usertable2,user6579,1416889268210.bff12d4267dd884829eb5659611c40f9.
2014-11-25 13:34:59,451 WARN  [MemStoreFlusher.19] regionserver.MemStoreFlusher: Region usertable2,user6579,1416889268210.bff12d4267dd884829eb5659611c40f9. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,451 DEBUG [MemStoreFlusher.19] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.19; compaction_queue=(0:5212), split_queue=0, merge_queue=0
2014-11-25 13:34:59,474 DEBUG [RpcServer.handler=64,port=60020] regionserver.HRegion: Flush requested on usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49.
2014-11-25 13:34:59,474 WARN  [MemStoreFlusher.22] regionserver.MemStoreFlusher: Region usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,474 DEBUG [MemStoreFlusher.22] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.22; compaction_queue=(0:5213), split_queue=0, merge_queue=0
2014-11-25 13:34:59,482 DEBUG [RpcServer.handler=97,port=60020] regionserver.HRegion: Flush requested on usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9.
2014-11-25 13:34:59,482 WARN  [MemStoreFlusher.18] regionserver.MemStoreFlusher: Region usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,482 DEBUG [MemStoreFlusher.18] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.18; compaction_queue=(0:5214), split_queue=0, merge_queue=0
2014-11-25 13:34:59,483 DEBUG [RpcServer.handler=87,port=60020] regionserver.HRegion: Flush requested on usertable2,user4689,1416889268210.f163e7c364cbfc321d89062a8ec9a958.
2014-11-25 13:34:59,483 WARN  [MemStoreFlusher.9] regionserver.MemStoreFlusher: Region usertable2,user4689,1416889268210.f163e7c364cbfc321d89062a8ec9a958. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,483 DEBUG [MemStoreFlusher.9] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.9; compaction_queue=(0:5215), split_queue=0, merge_queue=0
2014-11-25 13:34:59,493 DEBUG [RpcServer.handler=123,port=60020] regionserver.HRegion: Flush requested on usertable2,user4509,1416889268210.f0600c6f184e26e751ccebaff48fbe93.
2014-11-25 13:34:59,494 WARN  [MemStoreFlusher.27] regionserver.MemStoreFlusher: Region usertable2,user4509,1416889268210.f0600c6f184e26e751ccebaff48fbe93. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,494 DEBUG [MemStoreFlusher.27] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.27; compaction_queue=(0:5216), split_queue=0, merge_queue=0
2014-11-25 13:34:59,500 DEBUG [RpcServer.handler=66,port=60020] regionserver.HRegion: Flush requested on usertable2,user4599,1416889268210.eead33f80ffa1e642cc147c38794f39c.
2014-11-25 13:34:59,500 WARN  [MemStoreFlusher.28] regionserver.MemStoreFlusher: Region usertable2,user4599,1416889268210.eead33f80ffa1e642cc147c38794f39c. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,500 DEBUG [MemStoreFlusher.28] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.28; compaction_queue=(0:5217), split_queue=0, merge_queue=0
2014-11-25 13:34:59,526 DEBUG [RpcServer.handler=87,port=60020] regionserver.HRegion: Flush requested on usertable2,user5139,1416889268210.a8d0d190cb61bd1bf54306b4bc472da1.
2014-11-25 13:34:59,526 WARN  [MemStoreFlusher.34] regionserver.MemStoreFlusher: Region usertable2,user5139,1416889268210.a8d0d190cb61bd1bf54306b4bc472da1. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,526 DEBUG [MemStoreFlusher.34] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.34; compaction_queue=(0:5218), split_queue=0, merge_queue=0
2014-11-25 13:34:59,548 DEBUG [RpcServer.handler=132,port=60020] regionserver.HRegion: Flush requested on usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159.
2014-11-25 13:34:59,548 WARN  [MemStoreFlusher.2] regionserver.MemStoreFlusher: Region usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,549 DEBUG [MemStoreFlusher.2] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.2; compaction_queue=(0:5219), split_queue=0, merge_queue=0
2014-11-25 13:34:59,551 DEBUG [RpcServer.handler=138,port=60020] regionserver.HRegion: Flush requested on usertable2,user5049,1416889268210.a5d4d454c3b39a48b9a7e5c343956435.
2014-11-25 13:34:59,551 WARN  [MemStoreFlusher.37] regionserver.MemStoreFlusher: Region usertable2,user5049,1416889268210.a5d4d454c3b39a48b9a7e5c343956435. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,551 DEBUG [MemStoreFlusher.37] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.37; compaction_queue=(0:5220), split_queue=0, merge_queue=0
2014-11-25 13:34:59,566 DEBUG [RpcServer.handler=132,port=60020] regionserver.HRegion: Flush requested on usertable2,user5589,1416889268210.cfb348ee570fa731ba8caa85099a1bd5.
2014-11-25 13:34:59,566 WARN  [MemStoreFlusher.26] regionserver.MemStoreFlusher: Region usertable2,user5589,1416889268210.cfb348ee570fa731ba8caa85099a1bd5. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,566 DEBUG [MemStoreFlusher.26] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.26; compaction_queue=(0:5221), split_queue=0, merge_queue=0
2014-11-25 13:34:59,570 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:34:59,576 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4892426 synced till here 4892408
2014-11-25 13:34:59,586 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893694137 with entries=1623, filesize=124.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893699570
2014-11-25 13:34:59,586 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=132, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:34:59,592 DEBUG [RpcServer.handler=97,port=60020] regionserver.HRegion: Flush requested on usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da.
2014-11-25 13:34:59,592 WARN  [MemStoreFlusher.31] regionserver.MemStoreFlusher: Region usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,592 DEBUG [MemStoreFlusher.31] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.31; compaction_queue=(0:5222), split_queue=0, merge_queue=0
2014-11-25 13:34:59,623 DEBUG [RpcServer.handler=54,port=60020] regionserver.HRegion: Flush requested on usertable2,user5679,1416889268210.4b90977be131e83310321e679b719b06.
2014-11-25 13:34:59,623 WARN  [MemStoreFlusher.38] regionserver.MemStoreFlusher: Region usertable2,user5679,1416889268210.4b90977be131e83310321e679b719b06. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,623 DEBUG [MemStoreFlusher.38] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.38; compaction_queue=(0:5223), split_queue=0, merge_queue=0
2014-11-25 13:34:59,633 DEBUG [RpcServer.handler=54,port=60020] regionserver.HRegion: Flush requested on usertable2,user5769,1416889268210.a6f20417c02c380a5937a58b862dfbb8.
2014-11-25 13:34:59,633 WARN  [MemStoreFlusher.17] regionserver.MemStoreFlusher: Region usertable2,user5769,1416889268210.a6f20417c02c380a5937a58b862dfbb8. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,633 DEBUG [MemStoreFlusher.17] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.17; compaction_queue=(0:5224), split_queue=0, merge_queue=0
2014-11-25 13:34:59,639 DEBUG [RpcServer.handler=97,port=60020] regionserver.HRegion: Flush requested on usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5.
2014-11-25 13:34:59,639 WARN  [MemStoreFlusher.15] regionserver.MemStoreFlusher: Region usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,640 DEBUG [MemStoreFlusher.15] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.15; compaction_queue=(0:5225), split_queue=0, merge_queue=0
2014-11-25 13:34:59,650 DEBUG [RpcServer.handler=24,port=60020] regionserver.HRegion: Flush requested on usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952.
2014-11-25 13:34:59,650 WARN  [MemStoreFlusher.36] regionserver.MemStoreFlusher: Region usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,650 DEBUG [MemStoreFlusher.36] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.36; compaction_queue=(0:5226), split_queue=0, merge_queue=0
2014-11-25 13:34:59,655 DEBUG [RpcServer.handler=31,port=60020] regionserver.HRegion: Flush requested on usertable2,user8739,1416889268210.10fbbcf2b6f1389e433a4a5211bf2642.
2014-11-25 13:34:59,655 WARN  [MemStoreFlusher.22] regionserver.MemStoreFlusher: Region usertable2,user8739,1416889268210.10fbbcf2b6f1389e433a4a5211bf2642. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,655 DEBUG [MemStoreFlusher.22] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.22; compaction_queue=(0:5227), split_queue=0, merge_queue=0
2014-11-25 13:34:59,659 DEBUG [RpcServer.handler=89,port=60020] regionserver.HRegion: Flush requested on usertable2,user9099,1416889268210.66f19c7f25bc31928ead99dff847aa7f.
2014-11-25 13:34:59,659 WARN  [MemStoreFlusher.9] regionserver.MemStoreFlusher: Region usertable2,user9099,1416889268210.66f19c7f25bc31928ead99dff847aa7f. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,659 DEBUG [MemStoreFlusher.9] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.9; compaction_queue=(0:5228), split_queue=0, merge_queue=0
2014-11-25 13:34:59,664 DEBUG [RpcServer.handler=138,port=60020] regionserver.HRegion: Flush requested on usertable2,user6039,1416889268210.d4808c10301633d1d492aef55f9f9fb0.
2014-11-25 13:34:59,664 WARN  [MemStoreFlusher.24] regionserver.MemStoreFlusher: Region usertable2,user6039,1416889268210.d4808c10301633d1d492aef55f9f9fb0. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,665 DEBUG [MemStoreFlusher.24] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.24; compaction_queue=(0:5229), split_queue=0, merge_queue=0
2014-11-25 13:34:59,669 DEBUG [RpcServer.handler=121,port=60020] regionserver.HRegion: Flush requested on usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d.
2014-11-25 13:34:59,669 WARN  [MemStoreFlusher.8] regionserver.MemStoreFlusher: Region usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,669 DEBUG [MemStoreFlusher.8] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.8; compaction_queue=(0:5230), split_queue=0, merge_queue=0
2014-11-25 13:34:59,676 DEBUG [RpcServer.handler=31,port=60020] regionserver.HRegion: Flush requested on usertable2,user8919,1416889268210.ff707032c52bfca061ec7055b315d1ac.
2014-11-25 13:34:59,677 WARN  [MemStoreFlusher.10] regionserver.MemStoreFlusher: Region usertable2,user8919,1416889268210.ff707032c52bfca061ec7055b315d1ac. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,677 DEBUG [MemStoreFlusher.10] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.10; compaction_queue=(0:5231), split_queue=0, merge_queue=0
2014-11-25 13:34:59,695 DEBUG [RpcServer.handler=83,port=60020] regionserver.HRegion: Flush requested on usertable2,user4419,1416889268210.4fa6c789550f08f213befa07da277397.
2014-11-25 13:34:59,695 WARN  [MemStoreFlusher.23] regionserver.MemStoreFlusher: Region usertable2,user4419,1416889268210.4fa6c789550f08f213befa07da277397. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,695 DEBUG [MemStoreFlusher.23] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.23; compaction_queue=(0:5232), split_queue=0, merge_queue=0
2014-11-25 13:34:59,704 DEBUG [RpcServer.handler=64,port=60020] regionserver.HRegion: Flush requested on usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd.
2014-11-25 13:34:59,704 WARN  [MemStoreFlusher.33] regionserver.MemStoreFlusher: Region usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,704 DEBUG [MemStoreFlusher.33] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.33; compaction_queue=(0:5233), split_queue=0, merge_queue=0
2014-11-25 13:34:59,757 DEBUG [RpcServer.handler=24,port=60020] regionserver.HRegion: Flush requested on usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb.
2014-11-25 13:34:59,757 WARN  [MemStoreFlusher.39] regionserver.MemStoreFlusher: Region usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,757 DEBUG [MemStoreFlusher.39] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.39; compaction_queue=(0:5234), split_queue=0, merge_queue=0
2014-11-25 13:34:59,758 DEBUG [RpcServer.handler=93,port=60020] regionserver.HRegion: Flush requested on usertable2,user7209,1416889268210.fa362bc0b2fed482214114394bfa26f3.
2014-11-25 13:34:59,758 WARN  [MemStoreFlusher.14] regionserver.MemStoreFlusher: Region usertable2,user7209,1416889268210.fa362bc0b2fed482214114394bfa26f3. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,758 DEBUG [MemStoreFlusher.14] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.14; compaction_queue=(0:5235), split_queue=0, merge_queue=0
2014-11-25 13:34:59,783 DEBUG [RpcServer.handler=92,port=60020] regionserver.HRegion: Flush requested on usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0.
2014-11-25 13:34:59,783 WARN  [MemStoreFlusher.29] regionserver.MemStoreFlusher: Region usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,784 DEBUG [MemStoreFlusher.29] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.29; compaction_queue=(0:5236), split_queue=0, merge_queue=0
2014-11-25 13:34:59,814 DEBUG [RpcServer.handler=121,port=60020] regionserver.HRegion: Flush requested on usertable2,user8109,1416889268210.4b47471f1507edfc343dfd2b4599e5cd.
2014-11-25 13:34:59,814 WARN  [MemStoreFlusher.11] regionserver.MemStoreFlusher: Region usertable2,user8109,1416889268210.4b47471f1507edfc343dfd2b4599e5cd. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,815 DEBUG [MemStoreFlusher.11] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.11; compaction_queue=(0:5237), split_queue=0, merge_queue=0
2014-11-25 13:34:59,999 DEBUG [RpcServer.handler=141,port=60020] regionserver.HRegion: Flush requested on usertable2,user3339,1416889268210.36dd667db34cc2a7fc0dd12698785418.
2014-11-25 13:34:59,999 WARN  [MemStoreFlusher.34] regionserver.MemStoreFlusher: Region usertable2,user3339,1416889268210.36dd667db34cc2a7fc0dd12698785418. has too many store files; delaying flush up to 90000ms
2014-11-25 13:34:59,999 DEBUG [MemStoreFlusher.34] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.34; compaction_queue=(0:5238), split_queue=0, merge_queue=0
2014-11-25 13:35:00,013 DEBUG [RpcServer.handler=1,port=60020] regionserver.HRegion: Flush requested on usertable2,user2349,1416889268210.69fd185ded056a5c9f0e9bc4611ff44a.
2014-11-25 13:35:00,013 WARN  [MemStoreFlusher.37] regionserver.MemStoreFlusher: Region usertable2,user2349,1416889268210.69fd185ded056a5c9f0e9bc4611ff44a. has too many store files; delaying flush up to 90000ms
2014-11-25 13:35:00,013 DEBUG [MemStoreFlusher.37] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.37; compaction_queue=(0:5239), split_queue=0, merge_queue=0
2014-11-25 13:35:00,026 DEBUG [RpcServer.handler=96,port=60020] regionserver.HRegion: Flush requested on usertable2,user3879,1416889268210.d32041fd1bd5e7014e265b483c173ddc.
2014-11-25 13:35:00,026 WARN  [MemStoreFlusher.31] regionserver.MemStoreFlusher: Region usertable2,user3879,1416889268210.d32041fd1bd5e7014e265b483c173ddc. has too many store files; delaying flush up to 90000ms
2014-11-25 13:35:00,026 DEBUG [MemStoreFlusher.31] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.31; compaction_queue=(0:5240), split_queue=0, merge_queue=0
2014-11-25 13:35:00,107 DEBUG [RpcServer.handler=17,port=60020] regionserver.HRegion: Flush requested on usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568.
2014-11-25 13:35:00,107 WARN  [MemStoreFlusher.9] regionserver.MemStoreFlusher: Region usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568. has too many store files; delaying flush up to 90000ms
2014-11-25 13:35:00,107 DEBUG [MemStoreFlusher.9] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.9; compaction_queue=(0:5241), split_queue=0, merge_queue=0
2014-11-25 13:35:00,114 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:00,306 DEBUG [RpcServer.handler=76,port=60020] regionserver.HRegion: Flush requested on usertable2,user1269,1416889268210.bbe246dd324639d9e0eb2b0788d4067c.
2014-11-25 13:35:00,306 WARN  [MemStoreFlusher.27] regionserver.MemStoreFlusher: Region usertable2,user1269,1416889268210.bbe246dd324639d9e0eb2b0788d4067c. has too many store files; delaying flush up to 90000ms
2014-11-25 13:35:00,306 DEBUG [MemStoreFlusher.27] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.27; compaction_queue=(0:5242), split_queue=0, merge_queue=0
2014-11-25 13:35:00,393 DEBUG [RpcServer.handler=59,port=60020] regionserver.HRegion: Flush requested on usertable2,user1449,1416889268210.952a6132a4e977be00a90f6ac7e69235.
2014-11-25 13:35:00,393 WARN  [MemStoreFlusher.15] regionserver.MemStoreFlusher: Region usertable2,user1449,1416889268210.952a6132a4e977be00a90f6ac7e69235. has too many store files; delaying flush up to 90000ms
2014-11-25 13:35:00,394 DEBUG [MemStoreFlusher.15] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.15; compaction_queue=(0:5243), split_queue=0, merge_queue=0
2014-11-25 13:35:01,137 DEBUG [RpcServer.handler=98,port=60020] regionserver.HRegion: Flush requested on usertable2,,1416889268210.a3d8de2e3c77996d502684577800bf7f.
2014-11-25 13:35:01,137 WARN  [MemStoreFlusher.32] regionserver.MemStoreFlusher: Region usertable2,,1416889268210.a3d8de2e3c77996d502684577800bf7f. has too many store files; delaying flush up to 90000ms
2014-11-25 13:35:01,137 DEBUG [MemStoreFlusher.32] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.32; compaction_queue=(0:5244), split_queue=0, merge_queue=0
2014-11-25 13:35:01,624 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4896156 synced till here 4896143
2014-11-25 13:35:01,991 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893699570 with entries=3730, filesize=257.0 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893700114
2014-11-25 13:35:01,991 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=133, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:02,403 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:03,165 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4898658 synced till here 4898650
2014-11-25 13:35:03,175 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893700114 with entries=2502, filesize=179.8 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893702403
2014-11-25 13:35:03,175 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=134, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:03,925 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:04,491 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4901708 synced till here 4901705
2014-11-25 13:35:04,975 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/.tmp/ea7e027763db4efdb0fc12d193bf8b1f as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/ea7e027763db4efdb0fc12d193bf8b1f
2014-11-25 13:35:05,377 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893702403 with entries=3050, filesize=217.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893703925
2014-11-25 13:35:05,378 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=135, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:05,818 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:35:06,108 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/c7e0b03c34f34e8fb04d2c3c9f4d82cb, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/c7e0b03c34f34e8fb04d2c3c9f4d82cb
2014-11-25 13:35:06,111 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/1e9b33fbfb884e809b44e6bb6e7ca90b, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/1e9b33fbfb884e809b44e6bb6e7ca90b
2014-11-25 13:35:06,112 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/6cbb5dae0b04478eb592772f74840b8f, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/6cbb5dae0b04478eb592772f74840b8f
2014-11-25 13:35:06,113 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0. into ea7e027763db4efdb0fc12d193bf8b1f(size=166.9 M), total size for store is 3.6 G. This selection was in queue for 0sec, and took 6sec to execute.
2014-11-25 13:35:06,113 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0., storeName=family, fileCount=3, fileSize=168.1 M, priority=-5, time=5780323483335832; duration=6sec
2014-11-25 13:35:06,113 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5245), split_queue=0, merge_queue=0
2014-11-25 13:35:06,113 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5245), split_queue=0, merge_queue=0
2014-11-25 13:35:06,113 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:35:06,113 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 181147881 starting at candidate #5 after considering 236 permutations with 167 in ratio
2014-11-25 13:35:06,113 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: d0745af13f4e085f5d9be212fde5cee9 - family: Initiating minor compaction
2014-11-25 13:35:06,113 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9.
2014-11-25 13:35:06,113 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/.tmp, totalSize=172.8 M
2014-11-25 13:35:06,114 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/2e5c87fced984e9a9334cf300fcc165d, keycount=38593, bloomtype=ROW, size=57.5 M, encoding=NONE, seqNum=12205
2014-11-25 13:35:06,114 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/feac5741c8694c878f57e5fa9e57ab7e, keycount=39971, bloomtype=ROW, size=59.6 M, encoding=NONE, seqNum=12990
2014-11-25 13:35:06,114 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/2531f71270774268b2d7ebba988bf5f5, keycount=37316, bloomtype=ROW, size=55.6 M, encoding=NONE, seqNum=13722
2014-11-25 13:35:06,249 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:06,389 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4903471 synced till here 4903439
2014-11-25 13:35:06,543 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893703925 with entries=1763, filesize=130.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893706249
2014-11-25 13:35:06,545 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=136, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:07,089 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:07,356 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4905539 synced till here 4905538
2014-11-25 13:35:07,563 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893706249 with entries=2068, filesize=139.1 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893707089
2014-11-25 13:35:07,563 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=137, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:08,607 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:09,099 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4907565 synced till here 4907555
2014-11-25 13:35:09,247 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893707089 with entries=2026, filesize=146.5 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893708607
2014-11-25 13:35:09,247 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=138, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:09,789 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:10,046 DEBUG [RpcServer.handler=1,port=60020] regionserver.HRegion: Flush requested on usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779.
2014-11-25 13:35:10,046 WARN  [MemStoreFlusher.9] regionserver.MemStoreFlusher: Region usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779. has too many store files; delaying flush up to 90000ms
2014-11-25 13:35:10,046 DEBUG [MemStoreFlusher.9] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.9; compaction_queue=(0:5245), split_queue=0, merge_queue=0
2014-11-25 13:35:10,306 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4910485 synced till here 4910477
2014-11-25 13:35:10,694 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893708607 with entries=2920, filesize=209.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893709789
2014-11-25 13:35:10,694 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=139, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:11,463 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/.tmp/48a8d3f15a2c46bbb75551fe1ebad2d8 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/48a8d3f15a2c46bbb75551fe1ebad2d8
2014-11-25 13:35:11,593 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:12,108 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:35:12,196 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4913504 synced till here 4913490
2014-11-25 13:35:12,419 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893709789 with entries=3019, filesize=215.3 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893711593
2014-11-25 13:35:12,419 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=140, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:12,681 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/2e5c87fced984e9a9334cf300fcc165d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/2e5c87fced984e9a9334cf300fcc165d
2014-11-25 13:35:13,072 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/feac5741c8694c878f57e5fa9e57ab7e, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/feac5741c8694c878f57e5fa9e57ab7e
2014-11-25 13:35:13,074 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/2531f71270774268b2d7ebba988bf5f5, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/2531f71270774268b2d7ebba988bf5f5
2014-11-25 13:35:13,074 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9. into 48a8d3f15a2c46bbb75551fe1ebad2d8(size=171.6 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 6sec to execute.
2014-11-25 13:35:13,074 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9., storeName=family, fileCount=3, fileSize=172.8 M, priority=-5, time=5780330336037616; duration=6sec
2014-11-25 13:35:13,075 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5246), split_queue=0, merge_queue=0
2014-11-25 13:35:13,075 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5246), split_queue=0, merge_queue=0
2014-11-25 13:35:13,075 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:35:13,075 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 175529328 starting at candidate #22 after considering 236 permutations with 196 in ratio
2014-11-25 13:35:13,075 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 8bde118a62f612929db8d58958ecb297 - family: Initiating minor compaction
2014-11-25 13:35:13,075 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297.
2014-11-25 13:35:13,075 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/.tmp, totalSize=167.4 M
2014-11-25 13:35:13,075 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/1aa09da4f7d1407db7a92093cdd78292, keycount=36066, bloomtype=ROW, size=53.8 M, encoding=NONE, seqNum=30341
2014-11-25 13:35:13,075 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/3a88813f7e35411dab1999f3a208d873, keycount=36453, bloomtype=ROW, size=54.3 M, encoding=NONE, seqNum=31058
2014-11-25 13:35:13,076 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/ae5c206e61ec426b9de3e83f583f1794, keycount=39763, bloomtype=ROW, size=59.3 M, encoding=NONE, seqNum=31839
2014-11-25 13:35:13,379 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:13,880 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4915920 synced till here 4915913
2014-11-25 13:35:14,041 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893711593 with entries=2416, filesize=171.7 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893713379
2014-11-25 13:35:14,042 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=141, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:14,544 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:15,057 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4918754 synced till here 4918745
2014-11-25 13:35:15,554 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893713379 with entries=2834, filesize=201.1 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893714545
2014-11-25 13:35:15,555 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=142, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:16,448 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:16,957 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4921616 synced till here 4921605
2014-11-25 13:35:17,121 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893714545 with entries=2862, filesize=205.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893716448
2014-11-25 13:35:17,121 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=143, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:18,217 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:18,869 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4923650 synced till here 4923641
2014-11-25 13:35:19,160 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893716448 with entries=2034, filesize=144.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893718217
2014-11-25 13:35:19,161 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=144, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:19,230 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/.tmp/763c97de72f04ce8b05d0c9e59eb88ac as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/763c97de72f04ce8b05d0c9e59eb88ac
2014-11-25 13:35:19,410 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:35:19,503 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:19,814 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/1aa09da4f7d1407db7a92093cdd78292, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/1aa09da4f7d1407db7a92093cdd78292
2014-11-25 13:35:19,853 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4926139 synced till here 4926113
2014-11-25 13:35:19,995 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893718217 with entries=2489, filesize=181.3 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893719503
2014-11-25 13:35:19,996 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=145, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:20,037 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/3a88813f7e35411dab1999f3a208d873, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/3a88813f7e35411dab1999f3a208d873
2014-11-25 13:35:20,064 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/ae5c206e61ec426b9de3e83f583f1794, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/ae5c206e61ec426b9de3e83f583f1794
2014-11-25 13:35:20,064 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297. into 763c97de72f04ce8b05d0c9e59eb88ac(size=166.3 M), total size for store is 3.6 G. This selection was in queue for 0sec, and took 6sec to execute.
2014-11-25 13:35:20,064 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297., storeName=family, fileCount=3, fileSize=167.4 M, priority=-5, time=5780337297882225; duration=6sec
2014-11-25 13:35:20,064 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5246), split_queue=0, merge_queue=0
2014-11-25 13:35:20,064 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5246), split_queue=0, merge_queue=0
2014-11-25 13:35:20,064 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:35:20,065 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 175496886 starting at candidate #22 after considering 236 permutations with 197 in ratio
2014-11-25 13:35:20,065 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 68e213930bf7032812a6e5212205b568 - family: Initiating minor compaction
2014-11-25 13:35:20,065 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568.
2014-11-25 13:35:20,065 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/.tmp, totalSize=167.4 M
2014-11-25 13:35:20,065 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/28953c4015994b1a8185db39ed5a3b9b, keycount=36028, bloomtype=ROW, size=53.7 M, encoding=NONE, seqNum=30339
2014-11-25 13:35:20,065 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/9616fdc2bd63404585987c55f46dc0c3, keycount=36514, bloomtype=ROW, size=54.4 M, encoding=NONE, seqNum=31058
2014-11-25 13:35:20,065 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/d5f22c6e151f4f47b2c48acb09fb7b05, keycount=39719, bloomtype=ROW, size=59.2 M, encoding=NONE, seqNum=31838
2014-11-25 13:35:20,992 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:21,360 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4928387 synced till here 4928378
2014-11-25 13:35:21,495 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893719503 with entries=2248, filesize=155.4 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893720992
2014-11-25 13:35:21,495 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=146, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:21,968 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:22,863 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4931058 synced till here 4931054
2014-11-25 13:35:22,871 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893720992 with entries=2671, filesize=188.7 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893721968
2014-11-25 13:35:22,872 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=147, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:23,697 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:24,080 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4933156 synced till here 4933145
2014-11-25 13:35:24,305 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893721968 with entries=2098, filesize=149.8 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893723697
2014-11-25 13:35:24,305 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=148, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:24,765 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:25,534 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4934904 synced till here 4934898
2014-11-25 13:35:25,544 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893723697 with entries=1748, filesize=126.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893724765
2014-11-25 13:35:25,544 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=149, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:26,405 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/.tmp/bc6c9370b1204c3a9c04c7a46e857405 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/bc6c9370b1204c3a9c04c7a46e857405
2014-11-25 13:35:26,416 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:26,995 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:35:27,244 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4938294 synced till here 4938288
2014-11-25 13:35:27,492 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/28953c4015994b1a8185db39ed5a3b9b, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/28953c4015994b1a8185db39ed5a3b9b
2014-11-25 13:35:27,545 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893724765 with entries=3390, filesize=241.9 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893726416
2014-11-25 13:35:27,545 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=150, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:28,246 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/9616fdc2bd63404585987c55f46dc0c3, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/9616fdc2bd63404585987c55f46dc0c3
2014-11-25 13:35:28,252 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/d5f22c6e151f4f47b2c48acb09fb7b05, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/d5f22c6e151f4f47b2c48acb09fb7b05
2014-11-25 13:35:28,252 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568. into bc6c9370b1204c3a9c04c7a46e857405(size=166.2 M), total size for store is 3.6 G. This selection was in queue for 0sec, and took 8sec to execute.
2014-11-25 13:35:28,252 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568., storeName=family, fileCount=3, fileSize=167.4 M, priority=-5, time=5780344287523579; duration=8sec
2014-11-25 13:35:28,253 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5246), split_queue=0, merge_queue=0
2014-11-25 13:35:28,253 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5246), split_queue=0, merge_queue=0
2014-11-25 13:35:28,253 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:35:28,253 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 185880951 starting at candidate #5 after considering 236 permutations with 212 in ratio
2014-11-25 13:35:28,253 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: f6b6e25b89562f389a05d71d6ba3decb - family: Initiating minor compaction
2014-11-25 13:35:28,253 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb.
2014-11-25 13:35:28,253 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/.tmp, totalSize=177.3 M
2014-11-25 13:35:28,253 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/cfe246421b5d492d8c9884aea1c2dc1a, keycount=37163, bloomtype=ROW, size=55.4 M, encoding=NONE, seqNum=13721
2014-11-25 13:35:28,254 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/d9d6de389752447a8aa8077b36e46434, keycount=42491, bloomtype=ROW, size=63.3 M, encoding=NONE, seqNum=14558
2014-11-25 13:35:28,254 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/8b5fb180f4b9499fa9095a682ec45c9e, keycount=39257, bloomtype=ROW, size=58.5 M, encoding=NONE, seqNum=15327
2014-11-25 13:35:28,829 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:29,329 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4940822 synced till here 4940806
2014-11-25 13:35:29,498 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893726416 with entries=2528, filesize=178.0 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893728830
2014-11-25 13:35:29,498 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=151, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:30,483 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:32,712 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4942690 synced till here 4942666
2014-11-25 13:35:32,959 INFO  [MemStoreFlusher.37] regionserver.MemStoreFlusher: Waited 90007ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user9189,1416889268210.136ad2e559437581aba3afba361df965.
2014-11-25 13:35:32,959 DEBUG [MemStoreFlusher.37] regionserver.HRegion: Started memstore flush for usertable2,user9189,1416889268210.136ad2e559437581aba3afba361df965., current region memstore size 210.4 M
2014-11-25 13:35:33,206 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893728830 with entries=1868, filesize=130.1 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893730483
2014-11-25 13:35:33,206 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=152, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:33,831 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/.tmp/35844de599c14dc8b0d62d489f0c9c2f as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/35844de599c14dc8b0d62d489f0c9c2f
2014-11-25 13:35:33,867 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:33,869 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:35:33,917 DEBUG [regionserver60020.logRoller] wal.FSHLog: cleanupCurrentWriter  waiting for transactions to get synced  total 4944439 synced till here 4944415
2014-11-25 13:35:34,280 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/cfe246421b5d492d8c9884aea1c2dc1a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/cfe246421b5d492d8c9884aea1c2dc1a
2014-11-25 13:35:34,283 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/d9d6de389752447a8aa8077b36e46434, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/d9d6de389752447a8aa8077b36e46434
2014-11-25 13:35:34,285 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/8b5fb180f4b9499fa9095a682ec45c9e, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/8b5fb180f4b9499fa9095a682ec45c9e
2014-11-25 13:35:34,285 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb. into 35844de599c14dc8b0d62d489f0c9c2f(size=176.1 M), total size for store is 3.6 G. This selection was in queue for 0sec, and took 6sec to execute.
2014-11-25 13:35:34,285 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb., storeName=family, fileCount=3, fileSize=177.3 M, priority=-5, time=5780352475926001; duration=6sec
2014-11-25 13:35:34,285 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5246), split_queue=0, merge_queue=0
2014-11-25 13:35:34,285 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5246), split_queue=0, merge_queue=0
2014-11-25 13:35:34,285 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:35:34,286 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 5 files of size 300190820 starting at candidate #17 after considering 236 permutations with 196 in ratio
2014-11-25 13:35:34,286 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 36dd667db34cc2a7fc0dd12698785418 - family: Initiating minor compaction
2014-11-25 13:35:34,286 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user3339,1416889268210.36dd667db34cc2a7fc0dd12698785418.
2014-11-25 13:35:34,286 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 5 file(s) in family of usertable2,user3339,1416889268210.36dd667db34cc2a7fc0dd12698785418. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/.tmp, totalSize=286.3 M
2014-11-25 13:35:34,286 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/fee9f085dafa4aaaa1a1d99010ca672f, keycount=38867, bloomtype=ROW, size=57.9 M, encoding=NONE, seqNum=25216
2014-11-25 13:35:34,286 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/2350b00a5a804752a15b82ef8aacbf37, keycount=41437, bloomtype=ROW, size=61.8 M, encoding=NONE, seqNum=26030
2014-11-25 13:35:34,286 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/9ff4948273114e2bbb78e477bc2de79e, keycount=37150, bloomtype=ROW, size=55.4 M, encoding=NONE, seqNum=26760
2014-11-25 13:35:34,286 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/0e93d6183bfd46798ca9b90e1e43a691, keycount=38094, bloomtype=ROW, size=56.8 M, encoding=NONE, seqNum=27513
2014-11-25 13:35:34,286 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/442993702d974dcb960f511ce6123836, keycount=36482, bloomtype=ROW, size=54.4 M, encoding=NONE, seqNum=28229
2014-11-25 13:35:34,324 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893730483 with entries=1749, filesize=129.5 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893733867
2014-11-25 13:35:34,325 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=153, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:35,080 INFO  [MemStoreFlusher.37] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49483, memsize=210.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/.tmp/40cc7cfa1be745d5bd46c903ab343654
2014-11-25 13:35:35,204 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:35,334 DEBUG [MemStoreFlusher.37] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/.tmp/40cc7cfa1be745d5bd46c903ab343654 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/40cc7cfa1be745d5bd46c903ab343654
2014-11-25 13:35:35,346 INFO  [MemStoreFlusher.37] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/40cc7cfa1be745d5bd46c903ab343654, entries=766170, sequenceid=49483, filesize=114.1 M
2014-11-25 13:35:35,346 INFO  [MemStoreFlusher.37] regionserver.HRegion: Finished memstore flush of ~210.4 M/220644640, currentsize=2.7 M/2859440 for region usertable2,user9189,1416889268210.136ad2e559437581aba3afba361df965. in 2387ms, sequenceid=49483, compaction requested=true
2014-11-25 13:35:35,347 DEBUG [MemStoreFlusher.37] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.37; compaction_queue=(0:5246), split_queue=0, merge_queue=0
2014-11-25 13:35:35,382 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893733867 with entries=1932, filesize=128.8 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893735205
2014-11-25 13:35:35,382 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=154, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:37,320 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:38,416 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893735205 with entries=2135, filesize=151.1 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893737320
2014-11-25 13:35:38,417 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=155, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:39,712 DEBUG [regionserver60020.logRoller] regionserver.LogRoller: HLog roll requested
2014-11-25 13:35:39,905 INFO  [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893737320 with entries=1766, filesize=123.2 M; new WAL /hbase/test_bucketcache/WALs/l-hbase10.dba.cn1.qunar.com,60020,1416889404151/l-hbase10.dba.cn1.qunar.com%2C60020%2C1416889404151.1416893739712
2014-11-25 13:35:39,905 INFO  [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=156, maxlogs=32; forcing flush of 3 regions(s): 7573f845d035393053c158d59b42c9e2, 96f75ffeebd3920fdcae7936024334d9, e75fdc0fd4cf03697d993c7cf910e273
2014-11-25 13:35:40,310 INFO  [MemStoreFlusher.27] regionserver.MemStoreFlusher: Waited 90019ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6939,1416889268210.cdde512d492925f252720c79467f3309.
2014-11-25 13:35:40,310 DEBUG [MemStoreFlusher.27] regionserver.HRegion: Started memstore flush for usertable2,user6939,1416889268210.cdde512d492925f252720c79467f3309., current region memstore size 312.0 M
2014-11-25 13:35:41,094 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/.tmp/127afb1ccd0a49119835f1b66a8573e9 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/127afb1ccd0a49119835f1b66a8573e9
2014-11-25 13:35:41,117 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:35:41,124 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/fee9f085dafa4aaaa1a1d99010ca672f, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/fee9f085dafa4aaaa1a1d99010ca672f
2014-11-25 13:35:41,132 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/2350b00a5a804752a15b82ef8aacbf37, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/2350b00a5a804752a15b82ef8aacbf37
2014-11-25 13:35:41,133 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/9ff4948273114e2bbb78e477bc2de79e, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/9ff4948273114e2bbb78e477bc2de79e
2014-11-25 13:35:41,135 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/0e93d6183bfd46798ca9b90e1e43a691, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/0e93d6183bfd46798ca9b90e1e43a691
2014-11-25 13:35:41,138 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/442993702d974dcb960f511ce6123836, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/442993702d974dcb960f511ce6123836
2014-11-25 13:35:41,138 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 5 file(s) in family of usertable2,user3339,1416889268210.36dd667db34cc2a7fc0dd12698785418. into 127afb1ccd0a49119835f1b66a8573e9(size=284.4 M), total size for store is 3.6 G. This selection was in queue for 0sec, and took 6sec to execute.
2014-11-25 13:35:41,139 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user3339,1416889268210.36dd667db34cc2a7fc0dd12698785418., storeName=family, fileCount=5, fileSize=286.3 M, priority=-5, time=5780358508535863; duration=6sec
2014-11-25 13:35:41,139 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5247), split_queue=0, merge_queue=0
2014-11-25 13:35:41,139 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5247), split_queue=0, merge_queue=0
2014-11-25 13:35:41,139 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:35:41,139 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 177136401 starting at candidate #21 after considering 236 permutations with 200 in ratio
2014-11-25 13:35:41,139 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 775f28e1bbbfca269f5e02c6cf4f5952 - family: Initiating minor compaction
2014-11-25 13:35:41,139 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952.
2014-11-25 13:35:41,140 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/.tmp, totalSize=168.9 M
2014-11-25 13:35:41,140 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/ae6b71c543f4463ca37dc11d8feb374d, keycount=36618, bloomtype=ROW, size=54.6 M, encoding=NONE, seqNum=30912
2014-11-25 13:35:41,140 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/fd274ee2424f46aebe0366864183a2be, keycount=40065, bloomtype=ROW, size=59.7 M, encoding=NONE, seqNum=31698
2014-11-25 13:35:41,140 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/ad1b75c76f524f2fafc253b1c4e3930c, keycount=36628, bloomtype=ROW, size=54.6 M, encoding=NONE, seqNum=32421
2014-11-25 13:35:41,759 INFO  [MemStoreFlusher.27] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=312.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cdde512d492925f252720c79467f3309/.tmp/a55b418d7f904c73b7f43e3b2f7928b6
2014-11-25 13:35:41,764 DEBUG [MemStoreFlusher.27] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cdde512d492925f252720c79467f3309/.tmp/a55b418d7f904c73b7f43e3b2f7928b6 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cdde512d492925f252720c79467f3309/family/a55b418d7f904c73b7f43e3b2f7928b6
2014-11-25 13:35:41,778 INFO  [MemStoreFlusher.27] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cdde512d492925f252720c79467f3309/family/a55b418d7f904c73b7f43e3b2f7928b6, entries=1135950, sequenceid=49579, filesize=169.3 M
2014-11-25 13:35:41,778 INFO  [MemStoreFlusher.27] regionserver.HRegion: Finished memstore flush of ~312.0 M/327144080, currentsize=0/0 for region usertable2,user6939,1416889268210.cdde512d492925f252720c79467f3309. in 1468ms, sequenceid=49579, compaction requested=true
2014-11-25 13:35:41,778 DEBUG [MemStoreFlusher.27] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.27; compaction_queue=(0:5247), split_queue=0, merge_queue=0
2014-11-25 13:35:46,063 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/.tmp/d4a9caf27c494a05ae6c859c4f5adfa2 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/d4a9caf27c494a05ae6c859c4f5adfa2
2014-11-25 13:35:46,068 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:35:46,073 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/ae6b71c543f4463ca37dc11d8feb374d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/ae6b71c543f4463ca37dc11d8feb374d
2014-11-25 13:35:46,075 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/fd274ee2424f46aebe0366864183a2be, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/fd274ee2424f46aebe0366864183a2be
2014-11-25 13:35:46,077 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/ad1b75c76f524f2fafc253b1c4e3930c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/ad1b75c76f524f2fafc253b1c4e3930c
2014-11-25 13:35:46,077 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952. into d4a9caf27c494a05ae6c859c4f5adfa2(size=167.8 M), total size for store is 3.6 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:35:46,077 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952., storeName=family, fileCount=3, fileSize=168.9 M, priority=-5, time=5780365361885811; duration=4sec
2014-11-25 13:35:46,077 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5248), split_queue=0, merge_queue=0
2014-11-25 13:35:46,077 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5248), split_queue=0, merge_queue=0
2014-11-25 13:35:46,077 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:35:46,077 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 231552942 starting at candidate #14 after considering 236 permutations with 228 in ratio
2014-11-25 13:35:46,077 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 69fd185ded056a5c9f0e9bc4611ff44a - family: Initiating minor compaction
2014-11-25 13:35:46,077 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user2349,1416889268210.69fd185ded056a5c9f0e9bc4611ff44a.
2014-11-25 13:35:46,077 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user2349,1416889268210.69fd185ded056a5c9f0e9bc4611ff44a. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/.tmp, totalSize=220.8 M
2014-11-25 13:35:46,077 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/68009496860c4d50bba1b93199ad2fc1, keycount=36653, bloomtype=ROW, size=54.6 M, encoding=NONE, seqNum=26548
2014-11-25 13:35:46,078 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/c72c16241e3742c487397d4df36dcf99, keycount=37437, bloomtype=ROW, size=55.8 M, encoding=NONE, seqNum=27286
2014-11-25 13:35:46,078 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/e7f52d0d0d7541629cfdaf243b64cc4e, keycount=38071, bloomtype=ROW, size=56.8 M, encoding=NONE, seqNum=28030
2014-11-25 13:35:46,078 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/ebd06420843842808042444876f26ae9, keycount=35956, bloomtype=ROW, size=53.6 M, encoding=NONE, seqNum=28741
2014-11-25 13:35:50,227 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/.tmp/7df7f539e3f24dd2869946d9415a4fd1 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/7df7f539e3f24dd2869946d9415a4fd1
2014-11-25 13:35:50,232 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:35:50,238 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/68009496860c4d50bba1b93199ad2fc1, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/68009496860c4d50bba1b93199ad2fc1
2014-11-25 13:35:50,240 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/c72c16241e3742c487397d4df36dcf99, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/c72c16241e3742c487397d4df36dcf99
2014-11-25 13:35:50,241 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/e7f52d0d0d7541629cfdaf243b64cc4e, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/e7f52d0d0d7541629cfdaf243b64cc4e
2014-11-25 13:35:50,243 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/ebd06420843842808042444876f26ae9, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/ebd06420843842808042444876f26ae9
2014-11-25 13:35:50,243 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user2349,1416889268210.69fd185ded056a5c9f0e9bc4611ff44a. into 7df7f539e3f24dd2869946d9415a4fd1(size=219.4 M), total size for store is 3.6 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:35:50,243 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user2349,1416889268210.69fd185ded056a5c9f0e9bc4611ff44a., storeName=family, fileCount=4, fileSize=220.8 M, priority=-5, time=5780370300134855; duration=4sec
2014-11-25 13:35:50,243 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5248), split_queue=0, merge_queue=0
2014-11-25 13:35:50,243 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5248), split_queue=0, merge_queue=0
2014-11-25 13:35:50,244 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:35:50,244 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 175612198 starting at candidate #14 after considering 228 permutations with 194 in ratio
2014-11-25 13:35:50,244 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 0cd39e0518695cae7f35da4afc8c7d16 - family: Initiating minor compaction
2014-11-25 13:35:50,244 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user6849,1416889268210.0cd39e0518695cae7f35da4afc8c7d16.
2014-11-25 13:35:50,244 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user6849,1416889268210.0cd39e0518695cae7f35da4afc8c7d16. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/0cd39e0518695cae7f35da4afc8c7d16/.tmp, totalSize=167.5 M
2014-11-25 13:35:50,244 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/0cd39e0518695cae7f35da4afc8c7d16/family/1e808a157be74bb0a9d75784b4df1176, keycount=36025, bloomtype=ROW, size=53.7 M, encoding=NONE, seqNum=26527
2014-11-25 13:35:50,244 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/0cd39e0518695cae7f35da4afc8c7d16/family/33b554584f9b40cf939a1f5d567e66cf, keycount=37362, bloomtype=ROW, size=55.7 M, encoding=NONE, seqNum=27264
2014-11-25 13:35:50,244 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/0cd39e0518695cae7f35da4afc8c7d16/family/44ccec09f6844201b7610f35e3e31f51, keycount=38948, bloomtype=ROW, size=58.1 M, encoding=NONE, seqNum=28026
2014-11-25 13:35:51,150 INFO  [MemStoreFlusher.21] regionserver.MemStoreFlusher: Waited 90404ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7749,1416889268210.80d2ffdd997af333255373f6d88089b7.
2014-11-25 13:35:51,150 DEBUG [MemStoreFlusher.21] regionserver.HRegion: Started memstore flush for usertable2,user7749,1416889268210.80d2ffdd997af333255373f6d88089b7., current region memstore size 286.0 M
2014-11-25 13:35:54,021 INFO  [MemStoreFlusher.21] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49577, memsize=286.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/.tmp/d00f36bd4de141d79040dd6c01a5ad75
2014-11-25 13:35:54,026 DEBUG [MemStoreFlusher.21] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/.tmp/d00f36bd4de141d79040dd6c01a5ad75 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/family/d00f36bd4de141d79040dd6c01a5ad75
2014-11-25 13:35:54,031 INFO  [MemStoreFlusher.21] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/family/d00f36bd4de141d79040dd6c01a5ad75, entries=1041210, sequenceid=49577, filesize=155.2 M
2014-11-25 13:35:54,031 INFO  [MemStoreFlusher.21] regionserver.HRegion: Finished memstore flush of ~286.0 M/299859520, currentsize=0/0 for region usertable2,user7749,1416889268210.80d2ffdd997af333255373f6d88089b7. in 2881ms, sequenceid=49577, compaction requested=true
2014-11-25 13:35:54,031 DEBUG [MemStoreFlusher.21] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.21; compaction_queue=(0:5248), split_queue=0, merge_queue=0
2014-11-25 13:35:56,082 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/0cd39e0518695cae7f35da4afc8c7d16/.tmp/fd4bb8932f6c4481be6f54f0e92828cd as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/0cd39e0518695cae7f35da4afc8c7d16/family/fd4bb8932f6c4481be6f54f0e92828cd
2014-11-25 13:35:56,088 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:35:56,093 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/0cd39e0518695cae7f35da4afc8c7d16/family/1e808a157be74bb0a9d75784b4df1176, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/0cd39e0518695cae7f35da4afc8c7d16/family/1e808a157be74bb0a9d75784b4df1176
2014-11-25 13:35:56,094 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/0cd39e0518695cae7f35da4afc8c7d16/family/33b554584f9b40cf939a1f5d567e66cf, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/0cd39e0518695cae7f35da4afc8c7d16/family/33b554584f9b40cf939a1f5d567e66cf
2014-11-25 13:35:56,096 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/0cd39e0518695cae7f35da4afc8c7d16/family/44ccec09f6844201b7610f35e3e31f51, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/0cd39e0518695cae7f35da4afc8c7d16/family/44ccec09f6844201b7610f35e3e31f51
2014-11-25 13:35:56,096 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user6849,1416889268210.0cd39e0518695cae7f35da4afc8c7d16. into fd4bb8932f6c4481be6f54f0e92828cd(size=166.4 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 5sec to execute.
2014-11-25 13:35:56,096 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user6849,1416889268210.0cd39e0518695cae7f35da4afc8c7d16., storeName=family, fileCount=3, fileSize=167.5 M, priority=-4, time=5780374466663316; duration=5sec
2014-11-25 13:35:56,096 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5249), split_queue=0, merge_queue=0
2014-11-25 13:35:56,096 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5249), split_queue=0, merge_queue=0
2014-11-25 13:35:56,097 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:35:56,097 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 231456769 starting at candidate #14 after considering 228 permutations with 216 in ratio
2014-11-25 13:35:56,097 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 42e403f1a3a1e328a3b74e3f61f62542 - family: Initiating minor compaction
2014-11-25 13:35:56,097 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user3069,1416889268210.42e403f1a3a1e328a3b74e3f61f62542.
2014-11-25 13:35:56,097 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user3069,1416889268210.42e403f1a3a1e328a3b74e3f61f62542. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/.tmp, totalSize=220.7 M
2014-11-25 13:35:56,097 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/family/a556fa7ed32d48e7895342a360652420, keycount=36581, bloomtype=ROW, size=54.5 M, encoding=NONE, seqNum=26547
2014-11-25 13:35:56,097 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/family/2bf5bcfefca247a486497593166f2571, keycount=37407, bloomtype=ROW, size=55.8 M, encoding=NONE, seqNum=27284
2014-11-25 13:35:56,097 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/family/3ca5e8017d26456fa1d6cf42e9408bb3, keycount=37958, bloomtype=ROW, size=56.6 M, encoding=NONE, seqNum=28030
2014-11-25 13:35:56,097 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/family/72f4d50cd9ba4fcd859df0ade7f3da5e, keycount=36109, bloomtype=ROW, size=53.8 M, encoding=NONE, seqNum=28739
2014-11-25 13:35:57,470 INFO  [MemStoreFlusher.11] regionserver.MemStoreFlusher: Waited 90231ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7929,1416889268210.66f993780f6615d093419e83e4ce0b63.
2014-11-25 13:35:57,471 DEBUG [MemStoreFlusher.11] regionserver.HRegion: Started memstore flush for usertable2,user7929,1416889268210.66f993780f6615d093419e83e4ce0b63., current region memstore size 273.4 M
2014-11-25 13:35:57,471 INFO  [MemStoreFlusher.14] regionserver.MemStoreFlusher: Waited 90497ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7659,1416889268210.94360258e2b50782cd1326e64ca622b3.
2014-11-25 13:35:57,471 DEBUG [MemStoreFlusher.14] regionserver.HRegion: Started memstore flush for usertable2,user7659,1416889268210.94360258e2b50782cd1326e64ca622b3., current region memstore size 273.9 M
2014-11-25 13:35:58,593 INFO  [MemStoreFlusher.14] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=273.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/.tmp/fb2054fc8630408aa9ea8a982c864957
2014-11-25 13:35:58,598 DEBUG [MemStoreFlusher.14] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/.tmp/fb2054fc8630408aa9ea8a982c864957 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/family/fb2054fc8630408aa9ea8a982c864957
2014-11-25 13:35:58,602 INFO  [MemStoreFlusher.14] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/family/fb2054fc8630408aa9ea8a982c864957, entries=997210, sequenceid=49578, filesize=148.6 M
2014-11-25 13:35:58,602 INFO  [MemStoreFlusher.14] regionserver.HRegion: Finished memstore flush of ~273.9 M/287188000, currentsize=0/0 for region usertable2,user7659,1416889268210.94360258e2b50782cd1326e64ca622b3. in 1131ms, sequenceid=49578, compaction requested=true
2014-11-25 13:35:58,603 DEBUG [MemStoreFlusher.14] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.14; compaction_queue=(0:5249), split_queue=0, merge_queue=0
2014-11-25 13:35:58,653 INFO  [MemStoreFlusher.11] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=273.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f993780f6615d093419e83e4ce0b63/.tmp/878f89da1dcc42049ec7b79bc9ca9314
2014-11-25 13:35:58,658 DEBUG [MemStoreFlusher.11] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f993780f6615d093419e83e4ce0b63/.tmp/878f89da1dcc42049ec7b79bc9ca9314 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f993780f6615d093419e83e4ce0b63/family/878f89da1dcc42049ec7b79bc9ca9314
2014-11-25 13:35:58,662 INFO  [MemStoreFlusher.11] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f993780f6615d093419e83e4ce0b63/family/878f89da1dcc42049ec7b79bc9ca9314, entries=995560, sequenceid=49579, filesize=148.4 M
2014-11-25 13:35:58,662 INFO  [MemStoreFlusher.11] regionserver.HRegion: Finished memstore flush of ~273.4 M/286713600, currentsize=0/0 for region usertable2,user7929,1416889268210.66f993780f6615d093419e83e4ce0b63. in 1191ms, sequenceid=49579, compaction requested=true
2014-11-25 13:35:58,662 DEBUG [MemStoreFlusher.11] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.11; compaction_queue=(0:5250), split_queue=0, merge_queue=0
2014-11-25 13:35:59,452 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/.tmp/c2e08601df1d4567a4ad46a57dcbef5b as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/family/c2e08601df1d4567a4ad46a57dcbef5b
2014-11-25 13:35:59,457 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:35:59,463 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/family/a556fa7ed32d48e7895342a360652420, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/family/a556fa7ed32d48e7895342a360652420
2014-11-25 13:35:59,465 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/family/2bf5bcfefca247a486497593166f2571, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/family/2bf5bcfefca247a486497593166f2571
2014-11-25 13:35:59,466 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/family/3ca5e8017d26456fa1d6cf42e9408bb3, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/family/3ca5e8017d26456fa1d6cf42e9408bb3
2014-11-25 13:35:59,468 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/family/72f4d50cd9ba4fcd859df0ade7f3da5e, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/42e403f1a3a1e328a3b74e3f61f62542/family/72f4d50cd9ba4fcd859df0ade7f3da5e
2014-11-25 13:35:59,468 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user3069,1416889268210.42e403f1a3a1e328a3b74e3f61f62542. into c2e08601df1d4567a4ad46a57dcbef5b(size=219.3 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:35:59,468 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user3069,1416889268210.42e403f1a3a1e328a3b74e3f61f62542., storeName=family, fileCount=4, fileSize=220.7 M, priority=-4, time=5780380319856122; duration=3sec
2014-11-25 13:35:59,468 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5251), split_queue=0, merge_queue=0
2014-11-25 13:35:59,468 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5251), split_queue=0, merge_queue=0
2014-11-25 13:35:59,468 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:35:59,468 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 171779094 starting at candidate #17 after considering 228 permutations with 187 in ratio
2014-11-25 13:35:59,468 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 69e080ff87f23f27833ae28e5f74fc61 - family: Initiating minor compaction
2014-11-25 13:35:59,468 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user6399,1416889268210.69e080ff87f23f27833ae28e5f74fc61.
2014-11-25 13:35:59,468 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user6399,1416889268210.69e080ff87f23f27833ae28e5f74fc61. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69e080ff87f23f27833ae28e5f74fc61/.tmp, totalSize=163.8 M
2014-11-25 13:35:59,469 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69e080ff87f23f27833ae28e5f74fc61/family/08480a2c19fe4e39a64354a25451a158, keycount=35429, bloomtype=ROW, size=52.8 M, encoding=NONE, seqNum=28725
2014-11-25 13:35:59,469 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69e080ff87f23f27833ae28e5f74fc61/family/1f35b52dab34436295f7f7e232564e5a, keycount=39792, bloomtype=ROW, size=59.3 M, encoding=NONE, seqNum=29510
2014-11-25 13:35:59,469 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69e080ff87f23f27833ae28e5f74fc61/family/260348214ec3472392dee6f78b0dcad2, keycount=34659, bloomtype=ROW, size=51.7 M, encoding=NONE, seqNum=30190
2014-11-25 13:36:01,972 INFO  [MemStoreFlusher.33] regionserver.MemStoreFlusher: Waited 90120ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1359,1416889268210.5af9e7c1428814f12682f220113dc251.
2014-11-25 13:36:01,972 DEBUG [MemStoreFlusher.33] regionserver.HRegion: Started memstore flush for usertable2,user1359,1416889268210.5af9e7c1428814f12682f220113dc251., current region memstore size 266.1 M
2014-11-25 13:36:03,498 INFO  [MemStoreFlusher.33] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49581, memsize=266.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5af9e7c1428814f12682f220113dc251/.tmp/c4e86ceb9853472094c7dc8c0b1cf051
2014-11-25 13:36:03,505 DEBUG [MemStoreFlusher.33] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5af9e7c1428814f12682f220113dc251/.tmp/c4e86ceb9853472094c7dc8c0b1cf051 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5af9e7c1428814f12682f220113dc251/family/c4e86ceb9853472094c7dc8c0b1cf051
2014-11-25 13:36:03,510 INFO  [MemStoreFlusher.33] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5af9e7c1428814f12682f220113dc251/family/c4e86ceb9853472094c7dc8c0b1cf051, entries=968690, sequenceid=49581, filesize=144.4 M
2014-11-25 13:36:03,510 INFO  [MemStoreFlusher.33] regionserver.HRegion: Finished memstore flush of ~266.1 M/278975920, currentsize=0/0 for region usertable2,user1359,1416889268210.5af9e7c1428814f12682f220113dc251. in 1538ms, sequenceid=49581, compaction requested=true
2014-11-25 13:36:03,511 DEBUG [MemStoreFlusher.33] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.33; compaction_queue=(0:5251), split_queue=0, merge_queue=0
2014-11-25 13:36:03,772 INFO  [MemStoreFlusher.21] regionserver.MemStoreFlusher: Waited 90725ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5499,1416889268210.47c1cb50ecad10991e33a3c834624e07.
2014-11-25 13:36:03,773 DEBUG [MemStoreFlusher.21] regionserver.HRegion: Started memstore flush for usertable2,user5499,1416889268210.47c1cb50ecad10991e33a3c834624e07., current region memstore size 262.7 M
2014-11-25 13:36:03,910 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69e080ff87f23f27833ae28e5f74fc61/.tmp/013bfb44bec142159c0acb3a05070a90 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69e080ff87f23f27833ae28e5f74fc61/family/013bfb44bec142159c0acb3a05070a90
2014-11-25 13:36:03,915 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:36:03,920 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69e080ff87f23f27833ae28e5f74fc61/family/08480a2c19fe4e39a64354a25451a158, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69e080ff87f23f27833ae28e5f74fc61/family/08480a2c19fe4e39a64354a25451a158
2014-11-25 13:36:03,921 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69e080ff87f23f27833ae28e5f74fc61/family/1f35b52dab34436295f7f7e232564e5a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69e080ff87f23f27833ae28e5f74fc61/family/1f35b52dab34436295f7f7e232564e5a
2014-11-25 13:36:03,923 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69e080ff87f23f27833ae28e5f74fc61/family/260348214ec3472392dee6f78b0dcad2, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69e080ff87f23f27833ae28e5f74fc61/family/260348214ec3472392dee6f78b0dcad2
2014-11-25 13:36:03,923 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user6399,1416889268210.69e080ff87f23f27833ae28e5f74fc61. into 013bfb44bec142159c0acb3a05070a90(size=162.7 M), total size for store is 3.4 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:36:03,923 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user6399,1416889268210.69e080ff87f23f27833ae28e5f74fc61., storeName=family, fileCount=3, fileSize=163.8 M, priority=-4, time=5780383691216282; duration=4sec
2014-11-25 13:36:03,923 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5252), split_queue=0, merge_queue=0
2014-11-25 13:36:03,923 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5252), split_queue=0, merge_queue=0
2014-11-25 13:36:03,923 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:36:03,923 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 176837457 starting at candidate #21 after considering 228 permutations with 193 in ratio
2014-11-25 13:36:03,923 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 39519f1bfa399735e212124b59b4c156 - family: Initiating minor compaction
2014-11-25 13:36:03,923 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156.
2014-11-25 13:36:03,924 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/.tmp, totalSize=168.6 M
2014-11-25 13:36:03,924 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/family/d56ca6458e214001a8304348f12a5376, keycount=36651, bloomtype=ROW, size=54.6 M, encoding=NONE, seqNum=30910
2014-11-25 13:36:03,924 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/family/b441d09b29d9435eb4edc668cb345a12, keycount=39964, bloomtype=ROW, size=59.6 M, encoding=NONE, seqNum=31697
2014-11-25 13:36:03,924 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/family/b0ee21cf1abe45108c92b0dfeb9b8084, keycount=36505, bloomtype=ROW, size=54.4 M, encoding=NONE, seqNum=32417
2014-11-25 13:36:04,813 INFO  [MemStoreFlusher.21] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=262.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/.tmp/fe6802c57ffd412f9c25b23b4fa531b2
2014-11-25 13:36:04,818 DEBUG [MemStoreFlusher.21] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/.tmp/fe6802c57ffd412f9c25b23b4fa531b2 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/family/fe6802c57ffd412f9c25b23b4fa531b2
2014-11-25 13:36:04,822 INFO  [MemStoreFlusher.21] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/family/fe6802c57ffd412f9c25b23b4fa531b2, entries=956620, sequenceid=49578, filesize=142.6 M
2014-11-25 13:36:04,822 INFO  [MemStoreFlusher.21] regionserver.HRegion: Finished memstore flush of ~262.7 M/275499040, currentsize=0/0 for region usertable2,user5499,1416889268210.47c1cb50ecad10991e33a3c834624e07. in 1050ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:04,823 DEBUG [MemStoreFlusher.21] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.21; compaction_queue=(0:5252), split_queue=0, merge_queue=0
2014-11-25 13:36:08,101 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/.tmp/5bc19ae517a04c89aa1e1b22c60de755 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/family/5bc19ae517a04c89aa1e1b22c60de755
2014-11-25 13:36:08,107 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:36:08,112 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/family/d56ca6458e214001a8304348f12a5376, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/39519f1bfa399735e212124b59b4c156/family/d56ca6458e214001a8304348f12a5376
2014-11-25 13:36:08,113 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/family/b441d09b29d9435eb4edc668cb345a12, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/39519f1bfa399735e212124b59b4c156/family/b441d09b29d9435eb4edc668cb345a12
2014-11-25 13:36:08,115 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/family/b0ee21cf1abe45108c92b0dfeb9b8084, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/39519f1bfa399735e212124b59b4c156/family/b0ee21cf1abe45108c92b0dfeb9b8084
2014-11-25 13:36:08,115 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156. into 5bc19ae517a04c89aa1e1b22c60de755(size=167.5 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:36:08,115 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156., storeName=family, fileCount=3, fileSize=168.6 M, priority=-4, time=5780388146308086; duration=4sec
2014-11-25 13:36:08,115 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5253), split_queue=0, merge_queue=0
2014-11-25 13:36:08,115 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5253), split_queue=0, merge_queue=0
2014-11-25 13:36:08,115 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:36:08,116 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 7 files of size 435035180 starting at candidate #8 after considering 228 permutations with 185 in ratio
2014-11-25 13:36:08,116 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: cb66f3d563aa73e7146474485c0d7edf - family: Initiating minor compaction
2014-11-25 13:36:08,116 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf.
2014-11-25 13:36:08,116 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 7 file(s) in family of usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/.tmp, totalSize=414.9 M
2014-11-25 13:36:08,116 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/aa9beea0e4ad4d32a86777980752d156, keycount=40701, bloomtype=ROW, size=60.7 M, encoding=NONE, seqNum=16254
2014-11-25 13:36:08,116 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/6f5164f833644d79abd5d237da68b65f, keycount=35812, bloomtype=ROW, size=53.4 M, encoding=NONE, seqNum=16958
2014-11-25 13:36:08,116 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/46f0245d61c0447b97d82d494e8efd8d, keycount=43385, bloomtype=ROW, size=64.7 M, encoding=NONE, seqNum=17810
2014-11-25 13:36:08,116 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/17082ab115c64fdbb7fbe03025a323ef, keycount=42418, bloomtype=ROW, size=63.2 M, encoding=NONE, seqNum=18649
2014-11-25 13:36:08,116 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/376cdeaa79014a60891f872e53072751, keycount=40248, bloomtype=ROW, size=60.0 M, encoding=NONE, seqNum=19440
2014-11-25 13:36:08,116 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/af1d5ddb5ad64de3bd5efa7e61cb13e3, keycount=37954, bloomtype=ROW, size=56.6 M, encoding=NONE, seqNum=20183
2014-11-25 13:36:08,116 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/3f7810c156c7497b841a057193cd1272, keycount=37782, bloomtype=ROW, size=56.3 M, encoding=NONE, seqNum=20928
2014-11-25 13:36:09,173 INFO  [MemStoreFlusher.15] regionserver.MemStoreFlusher: Waited 90447ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1899,1416889268210.9478768bd4d49198f76234ab9c4947db.
2014-11-25 13:36:09,173 DEBUG [MemStoreFlusher.15] regionserver.HRegion: Started memstore flush for usertable2,user1899,1416889268210.9478768bd4d49198f76234ab9c4947db., current region memstore size 248.9 M
2014-11-25 13:36:10,389 INFO  [MemStoreFlusher.15] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=248.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9478768bd4d49198f76234ab9c4947db/.tmp/9c8670bb67384803a52991816a6f49dc
2014-11-25 13:36:10,395 DEBUG [MemStoreFlusher.15] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9478768bd4d49198f76234ab9c4947db/.tmp/9c8670bb67384803a52991816a6f49dc as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9478768bd4d49198f76234ab9c4947db/family/9c8670bb67384803a52991816a6f49dc
2014-11-25 13:36:10,400 INFO  [MemStoreFlusher.15] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9478768bd4d49198f76234ab9c4947db/family/9c8670bb67384803a52991816a6f49dc, entries=906340, sequenceid=49578, filesize=135.1 M
2014-11-25 13:36:10,400 INFO  [MemStoreFlusher.15] regionserver.HRegion: Finished memstore flush of ~248.9 M/261018320, currentsize=0/0 for region usertable2,user1899,1416889268210.9478768bd4d49198f76234ab9c4947db. in 1227ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:10,400 DEBUG [MemStoreFlusher.15] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.15; compaction_queue=(0:5253), split_queue=0, merge_queue=0
2014-11-25 13:36:11,873 INFO  [MemStoreFlusher.14] regionserver.MemStoreFlusher: Waited 90203ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70.
2014-11-25 13:36:11,874 DEBUG [MemStoreFlusher.14] regionserver.HRegion: Started memstore flush for usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70., current region memstore size 242.2 M
2014-11-25 13:36:12,773 INFO  [MemStoreFlusher.29] regionserver.MemStoreFlusher: Waited 90746ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156.
2014-11-25 13:36:12,773 INFO  [MemStoreFlusher.25] regionserver.MemStoreFlusher: Waited 90712ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875.
2014-11-25 13:36:12,773 DEBUG [MemStoreFlusher.25] regionserver.HRegion: Started memstore flush for usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875., current region memstore size 241.5 M
2014-11-25 13:36:12,773 DEBUG [MemStoreFlusher.29] regionserver.HRegion: Started memstore flush for usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156., current region memstore size 241.7 M
2014-11-25 13:36:12,883 INFO  [MemStoreFlusher.14] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=242.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/.tmp/405e805bcc5e4b2a905bc5b19331c2ac
2014-11-25 13:36:12,888 DEBUG [MemStoreFlusher.14] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/.tmp/405e805bcc5e4b2a905bc5b19331c2ac as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/family/405e805bcc5e4b2a905bc5b19331c2ac
2014-11-25 13:36:12,893 INFO  [MemStoreFlusher.14] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/family/405e805bcc5e4b2a905bc5b19331c2ac, entries=881720, sequenceid=49578, filesize=131.4 M
2014-11-25 13:36:12,893 INFO  [MemStoreFlusher.14] regionserver.HRegion: Finished memstore flush of ~242.2 M/253928560, currentsize=0/0 for region usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70. in 1019ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:12,894 DEBUG [MemStoreFlusher.14] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.14; compaction_queue=(0:5254), split_queue=0, merge_queue=0
2014-11-25 13:36:13,673 INFO  [MemStoreFlusher.15] regionserver.MemStoreFlusher: Waited 90078ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8469,1416889268210.190546a1cd2a016b3df3324d5875e49b.
2014-11-25 13:36:13,673 DEBUG [MemStoreFlusher.15] regionserver.HRegion: Started memstore flush for usertable2,user8469,1416889268210.190546a1cd2a016b3df3324d5875e49b., current region memstore size 238.7 M
2014-11-25 13:36:13,749 INFO  [MemStoreFlusher.29] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=241.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/.tmp/8fd262a8d0284cdc8529c80d4fbcb9ea
2014-11-25 13:36:13,754 DEBUG [MemStoreFlusher.29] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/.tmp/8fd262a8d0284cdc8529c80d4fbcb9ea as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/family/8fd262a8d0284cdc8529c80d4fbcb9ea
2014-11-25 13:36:13,759 INFO  [MemStoreFlusher.29] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/39519f1bfa399735e212124b59b4c156/family/8fd262a8d0284cdc8529c80d4fbcb9ea, entries=880160, sequenceid=49578, filesize=131.2 M
2014-11-25 13:36:13,759 INFO  [MemStoreFlusher.29] regionserver.HRegion: Finished memstore flush of ~241.7 M/253478880, currentsize=0/0 for region usertable2,user7029,1416889268210.39519f1bfa399735e212124b59b4c156. in 986ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:13,759 DEBUG [MemStoreFlusher.29] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.29; compaction_queue=(0:5255), split_queue=0, merge_queue=0
2014-11-25 13:36:13,797 INFO  [MemStoreFlusher.25] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=241.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/.tmp/c2c70ee41d464affbabc7af90b211de8
2014-11-25 13:36:13,802 DEBUG [MemStoreFlusher.25] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/.tmp/c2c70ee41d464affbabc7af90b211de8 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/family/c2c70ee41d464affbabc7af90b211de8
2014-11-25 13:36:13,807 INFO  [MemStoreFlusher.25] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/family/c2c70ee41d464affbabc7af90b211de8, entries=879130, sequenceid=49578, filesize=131.0 M
2014-11-25 13:36:13,807 INFO  [MemStoreFlusher.25] regionserver.HRegion: Finished memstore flush of ~241.5 M/253182560, currentsize=0/0 for region usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875. in 1034ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:13,807 DEBUG [MemStoreFlusher.25] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.25; compaction_queue=(0:5256), split_queue=0, merge_queue=0
2014-11-25 13:36:14,572 INFO  [MemStoreFlusher.39] regionserver.MemStoreFlusher: Waited 90629ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2799,1416889268210.5ff266e4e6272ab4516ca0c0f122bd3a.
2014-11-25 13:36:14,572 DEBUG [MemStoreFlusher.39] regionserver.HRegion: Started memstore flush for usertable2,user2799,1416889268210.5ff266e4e6272ab4516ca0c0f122bd3a., current region memstore size 236.2 M
2014-11-25 13:36:14,573 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/.tmp/32aa374d625d4ed6aa10dc7da286910d as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/32aa374d625d4ed6aa10dc7da286910d
2014-11-25 13:36:14,578 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:36:14,586 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/aa9beea0e4ad4d32a86777980752d156, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/aa9beea0e4ad4d32a86777980752d156
2014-11-25 13:36:14,587 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/6f5164f833644d79abd5d237da68b65f, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/6f5164f833644d79abd5d237da68b65f
2014-11-25 13:36:14,589 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/46f0245d61c0447b97d82d494e8efd8d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/46f0245d61c0447b97d82d494e8efd8d
2014-11-25 13:36:14,590 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/17082ab115c64fdbb7fbe03025a323ef, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/17082ab115c64fdbb7fbe03025a323ef
2014-11-25 13:36:14,592 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/376cdeaa79014a60891f872e53072751, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/376cdeaa79014a60891f872e53072751
2014-11-25 13:36:14,593 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/af1d5ddb5ad64de3bd5efa7e61cb13e3, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/af1d5ddb5ad64de3bd5efa7e61cb13e3
2014-11-25 13:36:14,595 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/3f7810c156c7497b841a057193cd1272, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/3f7810c156c7497b841a057193cd1272
2014-11-25 13:36:14,595 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 7 file(s) in family of usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf. into 32aa374d625d4ed6aa10dc7da286910d(size=412.2 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 6sec to execute.
2014-11-25 13:36:14,595 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf., storeName=family, fileCount=7, fileSize=414.9 M, priority=-4, time=5780392338598883; duration=6sec
2014-11-25 13:36:14,595 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5256), split_queue=0, merge_queue=0
2014-11-25 13:36:14,595 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:36:14,595 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 187061550 starting at candidate #8 after considering 228 permutations with 186 in ratio
2014-11-25 13:36:14,595 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 070a5af646dd1859830cccdc23f86407 - family: Initiating minor compaction
2014-11-25 13:36:14,596 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407.
2014-11-25 13:36:14,596 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/.tmp, totalSize=178.4 M
2014-11-25 13:36:14,596 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/8813fbf680224470bf104e8d0170ab9a, keycount=40516, bloomtype=ROW, size=60.4 M, encoding=NONE, seqNum=16253
2014-11-25 13:36:14,596 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/28945bd17cdd4e1b8b9b8195cd9162e2, keycount=35663, bloomtype=ROW, size=53.2 M, encoding=NONE, seqNum=16956
2014-11-25 13:36:14,596 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/ac3e9c0ec43542edb3019efe3b2a60c1, keycount=43488, bloomtype=ROW, size=64.8 M, encoding=NONE, seqNum=17809
2014-11-25 13:36:14,781 INFO  [MemStoreFlusher.15] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=238.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/190546a1cd2a016b3df3324d5875e49b/.tmp/da42cac0969f4d58a638c8a1de4fb04f
2014-11-25 13:36:14,786 DEBUG [MemStoreFlusher.15] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/190546a1cd2a016b3df3324d5875e49b/.tmp/da42cac0969f4d58a638c8a1de4fb04f as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/190546a1cd2a016b3df3324d5875e49b/family/da42cac0969f4d58a638c8a1de4fb04f
2014-11-25 13:36:14,791 INFO  [MemStoreFlusher.15] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/190546a1cd2a016b3df3324d5875e49b/family/da42cac0969f4d58a638c8a1de4fb04f, entries=869100, sequenceid=49579, filesize=129.5 M
2014-11-25 13:36:14,791 INFO  [MemStoreFlusher.15] regionserver.HRegion: Finished memstore flush of ~238.7 M/250293440, currentsize=0/0 for region usertable2,user8469,1416889268210.190546a1cd2a016b3df3324d5875e49b. in 1118ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:14,791 DEBUG [MemStoreFlusher.15] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.15; compaction_queue=(0:5256), split_queue=0, merge_queue=0
2014-11-25 13:36:15,474 DEBUG [MemStoreFlusher.26] regionserver.HRegion: Started memstore flush for usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf., current region memstore size 211.0 M
2014-11-25 13:36:15,557 INFO  [MemStoreFlusher.39] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49577, memsize=236.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/.tmp/2963333f8b6f4e469e0b36d379673c8b
2014-11-25 13:36:15,563 DEBUG [MemStoreFlusher.39] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/.tmp/2963333f8b6f4e469e0b36d379673c8b as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/2963333f8b6f4e469e0b36d379673c8b
2014-11-25 13:36:15,569 INFO  [MemStoreFlusher.39] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/2963333f8b6f4e469e0b36d379673c8b, entries=859930, sequenceid=49577, filesize=128.2 M
2014-11-25 13:36:15,569 INFO  [MemStoreFlusher.39] regionserver.HRegion: Finished memstore flush of ~236.2 M/247652640, currentsize=0/0 for region usertable2,user2799,1416889268210.5ff266e4e6272ab4516ca0c0f122bd3a. in 997ms, sequenceid=49577, compaction requested=true
2014-11-25 13:36:15,569 DEBUG [MemStoreFlusher.39] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.39; compaction_queue=(0:5257), split_queue=0, merge_queue=0
2014-11-25 13:36:16,373 INFO  [MemStoreFlusher.5] regionserver.MemStoreFlusher: Waited 90686ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856.
2014-11-25 13:36:16,373 DEBUG [MemStoreFlusher.5] regionserver.HRegion: Started memstore flush for usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856., current region memstore size 233.5 M
2014-11-25 13:36:16,452 INFO  [MemStoreFlusher.26] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=211.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/.tmp/e947a9ba02364fb8a1783c81cb183c66
2014-11-25 13:36:16,458 DEBUG [MemStoreFlusher.26] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/.tmp/e947a9ba02364fb8a1783c81cb183c66 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/e947a9ba02364fb8a1783c81cb183c66
2014-11-25 13:36:16,463 INFO  [MemStoreFlusher.26] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cb66f3d563aa73e7146474485c0d7edf/family/e947a9ba02364fb8a1783c81cb183c66, entries=768210, sequenceid=49579, filesize=114.5 M
2014-11-25 13:36:16,463 INFO  [MemStoreFlusher.26] regionserver.HRegion: Finished memstore flush of ~211.0 M/221238560, currentsize=0/0 for region usertable2,user1809,1416889268210.cb66f3d563aa73e7146474485c0d7edf. in 989ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:16,463 DEBUG [MemStoreFlusher.26] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.26; compaction_queue=(0:5258), split_queue=0, merge_queue=0
2014-11-25 13:36:17,847 INFO  [MemStoreFlusher.5] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=233.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/.tmp/a9abfc474ec8420c8f9ccf400cf8262e
2014-11-25 13:36:17,876 DEBUG [MemStoreFlusher.5] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/.tmp/a9abfc474ec8420c8f9ccf400cf8262e as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/a9abfc474ec8420c8f9ccf400cf8262e
2014-11-25 13:36:17,882 INFO  [MemStoreFlusher.5] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c39bf51be729a809eb64230aef470856/family/a9abfc474ec8420c8f9ccf400cf8262e, entries=850030, sequenceid=49578, filesize=126.7 M
2014-11-25 13:36:17,882 INFO  [MemStoreFlusher.5] regionserver.HRegion: Finished memstore flush of ~233.5 M/244802240, currentsize=0/0 for region usertable2,user8829,1416889268210.c39bf51be729a809eb64230aef470856. in 1509ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:17,882 DEBUG [MemStoreFlusher.5] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.5; compaction_queue=(0:5259), split_queue=0, merge_queue=0
2014-11-25 13:36:19,303 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/.tmp/a1675179eb2945a2b4e81b403290b24b as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/a1675179eb2945a2b4e81b403290b24b
2014-11-25 13:36:19,308 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:36:19,312 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/8813fbf680224470bf104e8d0170ab9a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/8813fbf680224470bf104e8d0170ab9a
2014-11-25 13:36:19,314 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/28945bd17cdd4e1b8b9b8195cd9162e2, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/28945bd17cdd4e1b8b9b8195cd9162e2
2014-11-25 13:36:19,316 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/ac3e9c0ec43542edb3019efe3b2a60c1, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/ac3e9c0ec43542edb3019efe3b2a60c1
2014-11-25 13:36:19,316 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407. into a1675179eb2945a2b4e81b403290b24b(size=177.2 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:36:19,316 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407., storeName=family, fileCount=3, fileSize=178.4 M, priority=-4, time=5780398818376082; duration=4sec
2014-11-25 13:36:19,316 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5260), split_queue=0, merge_queue=0
2014-11-25 13:36:19,316 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5260), split_queue=0, merge_queue=0
2014-11-25 13:36:19,316 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:36:19,316 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 190050604 starting at candidate #1 after considering 228 permutations with 185 in ratio
2014-11-25 13:36:19,316 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 040dc650b54378108a29bab140ceeb02 - family: Initiating minor compaction
2014-11-25 13:36:19,316 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user3429,1416889268210.040dc650b54378108a29bab140ceeb02.
2014-11-25 13:36:19,317 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user3429,1416889268210.040dc650b54378108a29bab140ceeb02. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/.tmp, totalSize=181.2 M
2014-11-25 13:36:19,317 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/family/f5fa50d68beb475d9b1b40827bd920ed, keycount=40446, bloomtype=ROW, size=60.3 M, encoding=NONE, seqNum=4439
2014-11-25 13:36:19,317 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/family/da159eed498d459ba86aabc628ba0bd7, keycount=43411, bloomtype=ROW, size=64.7 M, encoding=NONE, seqNum=5293
2014-11-25 13:36:19,317 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/family/f09a3e4011ae48fc84f118e675a80e5a, keycount=37725, bloomtype=ROW, size=56.2 M, encoding=NONE, seqNum=6035
2014-11-25 13:36:21,775 INFO  [MemStoreFlusher.32] regionserver.MemStoreFlusher: Waited 90625ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027.
2014-11-25 13:36:21,775 DEBUG [MemStoreFlusher.32] regionserver.HRegion: Started memstore flush for usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027., current region memstore size 220.2 M
2014-11-25 13:36:22,740 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/.tmp/631e825a97b44f8fa3f9c77c04b6f018 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/family/631e825a97b44f8fa3f9c77c04b6f018
2014-11-25 13:36:22,746 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:36:22,754 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/family/f5fa50d68beb475d9b1b40827bd920ed, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/040dc650b54378108a29bab140ceeb02/family/f5fa50d68beb475d9b1b40827bd920ed
2014-11-25 13:36:22,755 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/family/da159eed498d459ba86aabc628ba0bd7, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/040dc650b54378108a29bab140ceeb02/family/da159eed498d459ba86aabc628ba0bd7
2014-11-25 13:36:22,757 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/family/f09a3e4011ae48fc84f118e675a80e5a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/040dc650b54378108a29bab140ceeb02/family/f09a3e4011ae48fc84f118e675a80e5a
2014-11-25 13:36:22,757 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user3429,1416889268210.040dc650b54378108a29bab140ceeb02. into 631e825a97b44f8fa3f9c77c04b6f018(size=180.0 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:36:22,757 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user3429,1416889268210.040dc650b54378108a29bab140ceeb02., storeName=family, fileCount=3, fileSize=181.2 M, priority=-4, time=5780403539320185; duration=3sec
2014-11-25 13:36:22,757 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5260), split_queue=0, merge_queue=0
2014-11-25 13:36:22,757 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5260), split_queue=0, merge_queue=0
2014-11-25 13:36:22,758 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:36:22,758 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 175648268 starting at candidate #21 after considering 228 permutations with 188 in ratio
2014-11-25 13:36:22,758 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: b0dd08f1639152a6ac8ca032afa4d6db - family: Initiating minor compaction
2014-11-25 13:36:22,758 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user3699,1416889268210.b0dd08f1639152a6ac8ca032afa4d6db.
2014-11-25 13:36:22,758 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user3699,1416889268210.b0dd08f1639152a6ac8ca032afa4d6db. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/.tmp, totalSize=167.5 M
2014-11-25 13:36:22,758 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/family/e3db22183d434939948631168349c0e6, keycount=36112, bloomtype=ROW, size=53.8 M, encoding=NONE, seqNum=30340
2014-11-25 13:36:22,758 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/family/e7bb4a1b00ce4472b9bb369827104c25, keycount=36527, bloomtype=ROW, size=54.5 M, encoding=NONE, seqNum=31059
2014-11-25 13:36:22,758 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/family/c88ea21e26ca41e6a1a279f44dde9f91, keycount=39719, bloomtype=ROW, size=59.2 M, encoding=NONE, seqNum=31839
2014-11-25 13:36:22,858 INFO  [MemStoreFlusher.32] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49581, memsize=220.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/.tmp/3af4e37156224c4eb3a727e922bb5329
2014-11-25 13:36:22,864 DEBUG [MemStoreFlusher.32] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/.tmp/3af4e37156224c4eb3a727e922bb5329 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/3af4e37156224c4eb3a727e922bb5329
2014-11-25 13:36:22,870 INFO  [MemStoreFlusher.32] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/3af4e37156224c4eb3a727e922bb5329, entries=801770, sequenceid=49581, filesize=119.5 M
2014-11-25 13:36:22,870 INFO  [MemStoreFlusher.32] regionserver.HRegion: Finished memstore flush of ~220.2 M/230903360, currentsize=0/0 for region usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027. in 1095ms, sequenceid=49581, compaction requested=true
2014-11-25 13:36:22,870 DEBUG [MemStoreFlusher.32] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.32; compaction_queue=(0:5260), split_queue=0, merge_queue=0
2014-11-25 13:36:23,574 INFO  [MemStoreFlusher.35] regionserver.MemStoreFlusher: Waited 90544ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569.
2014-11-25 13:36:23,575 INFO  [MemStoreFlusher.6] regionserver.MemStoreFlusher: Waited 90701ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f.
2014-11-25 13:36:23,575 DEBUG [MemStoreFlusher.35] regionserver.HRegion: Started memstore flush for usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569., current region memstore size 216.4 M
2014-11-25 13:36:23,575 DEBUG [MemStoreFlusher.6] regionserver.HRegion: Started memstore flush for usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f., current region memstore size 215.7 M
2014-11-25 13:36:24,704 INFO  [MemStoreFlusher.27] regionserver.MemStoreFlusher: Waited 90615ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8199,1416889268210.943652e75e710b59828d58f58f4dc4fe.
2014-11-25 13:36:24,704 INFO  [MemStoreFlusher.25] regionserver.MemStoreFlusher: Waited 90604ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8559,1416889268210.f493ed6daa8012ad6a97726dcb83e1b6.
2014-11-25 13:36:24,704 INFO  [MemStoreFlusher.2] regionserver.MemStoreFlusher: Waited 90747ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e.
2014-11-25 13:36:24,705 DEBUG [MemStoreFlusher.27] regionserver.HRegion: Started memstore flush for usertable2,user8199,1416889268210.943652e75e710b59828d58f58f4dc4fe., current region memstore size 213.4 M
2014-11-25 13:36:24,705 DEBUG [MemStoreFlusher.2] regionserver.HRegion: Started memstore flush for usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e., current region memstore size 213.8 M
2014-11-25 13:36:24,705 DEBUG [MemStoreFlusher.25] regionserver.HRegion: Started memstore flush for usertable2,user8559,1416889268210.f493ed6daa8012ad6a97726dcb83e1b6., current region memstore size 213.6 M
2014-11-25 13:36:24,780 INFO  [MemStoreFlusher.35] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=216.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/.tmp/60ff97ce76034f598b0c833c3dfb44db
2014-11-25 13:36:24,786 DEBUG [MemStoreFlusher.35] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/.tmp/60ff97ce76034f598b0c833c3dfb44db as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/60ff97ce76034f598b0c833c3dfb44db
2014-11-25 13:36:24,791 INFO  [MemStoreFlusher.35] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/60ff97ce76034f598b0c833c3dfb44db, entries=788000, sequenceid=49579, filesize=117.5 M
2014-11-25 13:36:24,792 INFO  [MemStoreFlusher.35] regionserver.HRegion: Finished memstore flush of ~216.4 M/226938160, currentsize=0/0 for region usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569. in 1217ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:24,792 DEBUG [MemStoreFlusher.35] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.35; compaction_queue=(0:5261), split_queue=0, merge_queue=0
2014-11-25 13:36:24,885 INFO  [MemStoreFlusher.6] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=215.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/.tmp/4658e774b3fb4ca189fff068b79d9fa3
2014-11-25 13:36:24,892 DEBUG [MemStoreFlusher.6] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/.tmp/4658e774b3fb4ca189fff068b79d9fa3 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/4658e774b3fb4ca189fff068b79d9fa3
2014-11-25 13:36:24,898 INFO  [MemStoreFlusher.6] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/4658e774b3fb4ca189fff068b79d9fa3, entries=785540, sequenceid=49579, filesize=117.1 M
2014-11-25 13:36:24,898 INFO  [MemStoreFlusher.6] regionserver.HRegion: Finished memstore flush of ~215.7 M/226229040, currentsize=0/0 for region usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f. in 1323ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:24,898 DEBUG [MemStoreFlusher.6] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.6; compaction_queue=(0:5262), split_queue=0, merge_queue=0
2014-11-25 13:36:25,564 INFO  [MemStoreFlusher.2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=213.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/.tmp/f3ceb1344a01491688ac1ff877c1ac26
2014-11-25 13:36:25,569 DEBUG [MemStoreFlusher.2] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/.tmp/f3ceb1344a01491688ac1ff877c1ac26 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/f3ceb1344a01491688ac1ff877c1ac26
2014-11-25 13:36:25,574 INFO  [MemStoreFlusher.2] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/f3ceb1344a01491688ac1ff877c1ac26, entries=778410, sequenceid=49579, filesize=116.0 M
2014-11-25 13:36:25,574 INFO  [MemStoreFlusher.2] regionserver.HRegion: Finished memstore flush of ~213.8 M/224176160, currentsize=0/0 for region usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e. in 869ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:25,574 DEBUG [MemStoreFlusher.2] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.2; compaction_queue=(0:5263), split_queue=0, merge_queue=0
2014-11-25 13:36:25,591 INFO  [MemStoreFlusher.25] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=213.6 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/.tmp/947fc5ba7ddb4dd2a535e915d8ec25bb
2014-11-25 13:36:25,597 DEBUG [MemStoreFlusher.25] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/.tmp/947fc5ba7ddb4dd2a535e915d8ec25bb as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/947fc5ba7ddb4dd2a535e915d8ec25bb
2014-11-25 13:36:25,602 INFO  [MemStoreFlusher.25] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f493ed6daa8012ad6a97726dcb83e1b6/family/947fc5ba7ddb4dd2a535e915d8ec25bb, entries=777700, sequenceid=49578, filesize=115.9 M
2014-11-25 13:36:25,602 INFO  [MemStoreFlusher.25] regionserver.HRegion: Finished memstore flush of ~213.6 M/223971440, currentsize=0/0 for region usertable2,user8559,1416889268210.f493ed6daa8012ad6a97726dcb83e1b6. in 898ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:25,602 DEBUG [MemStoreFlusher.25] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.25; compaction_queue=(0:5264), split_queue=0, merge_queue=0
2014-11-25 13:36:25,637 INFO  [MemStoreFlusher.27] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=213.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/.tmp/52f20a2e07f848ecae6512aaad5df03b
2014-11-25 13:36:25,642 DEBUG [MemStoreFlusher.27] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/.tmp/52f20a2e07f848ecae6512aaad5df03b as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/52f20a2e07f848ecae6512aaad5df03b
2014-11-25 13:36:25,647 INFO  [MemStoreFlusher.27] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/943652e75e710b59828d58f58f4dc4fe/family/52f20a2e07f848ecae6512aaad5df03b, entries=776920, sequenceid=49578, filesize=115.8 M
2014-11-25 13:36:25,647 INFO  [MemStoreFlusher.27] regionserver.HRegion: Finished memstore flush of ~213.4 M/223746480, currentsize=0/0 for region usertable2,user8199,1416889268210.943652e75e710b59828d58f58f4dc4fe. in 943ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:25,647 DEBUG [MemStoreFlusher.27] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.27; compaction_queue=(0:5265), split_queue=0, merge_queue=0
2014-11-25 13:36:25,925 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/.tmp/6476feda76c44fcd8729e03d952e3ddb as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/family/6476feda76c44fcd8729e03d952e3ddb
2014-11-25 13:36:25,929 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:36:25,934 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/family/e3db22183d434939948631168349c0e6, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/family/e3db22183d434939948631168349c0e6
2014-11-25 13:36:25,936 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/family/e7bb4a1b00ce4472b9bb369827104c25, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/family/e7bb4a1b00ce4472b9bb369827104c25
2014-11-25 13:36:25,937 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/family/c88ea21e26ca41e6a1a279f44dde9f91, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/family/c88ea21e26ca41e6a1a279f44dde9f91
2014-11-25 13:36:25,937 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user3699,1416889268210.b0dd08f1639152a6ac8ca032afa4d6db. into 6476feda76c44fcd8729e03d952e3ddb(size=166.4 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:36:25,938 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user3699,1416889268210.b0dd08f1639152a6ac8ca032afa4d6db., storeName=family, fileCount=3, fileSize=167.5 M, priority=-4, time=5780406980705998; duration=3sec
2014-11-25 13:36:25,938 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5266), split_queue=0, merge_queue=0
2014-11-25 13:36:25,938 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5266), split_queue=0, merge_queue=0
2014-11-25 13:36:25,938 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:36:25,938 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 186919191 starting at candidate #12 after considering 228 permutations with 173 in ratio
2014-11-25 13:36:25,938 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 1c65748e65f11456ce7b67d20bff3966 - family: Initiating minor compaction
2014-11-25 13:36:25,938 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user4779,1416889268210.1c65748e65f11456ce7b67d20bff3966.
2014-11-25 13:36:25,938 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user4779,1416889268210.1c65748e65f11456ce7b67d20bff3966. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/.tmp, totalSize=178.3 M
2014-11-25 13:36:25,938 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/family/290de05496b6455f9b9285d76d9cae9b, keycount=41179, bloomtype=ROW, size=61.4 M, encoding=NONE, seqNum=18744
2014-11-25 13:36:25,938 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/family/38adb7106d47497fb78503ecdf0f144c, keycount=40076, bloomtype=ROW, size=59.7 M, encoding=NONE, seqNum=19530
2014-11-25 13:36:25,938 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/family/918bc887c2d44ac295d613ef72cffdda, keycount=38321, bloomtype=ROW, size=57.1 M, encoding=NONE, seqNum=20286
2014-11-25 13:36:29,175 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/.tmp/95abcb829bcc42de8ae410adeefbd358 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/family/95abcb829bcc42de8ae410adeefbd358
2014-11-25 13:36:29,180 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:36:29,185 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/family/290de05496b6455f9b9285d76d9cae9b, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/family/290de05496b6455f9b9285d76d9cae9b
2014-11-25 13:36:29,187 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/family/38adb7106d47497fb78503ecdf0f144c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/family/38adb7106d47497fb78503ecdf0f144c
2014-11-25 13:36:29,189 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/family/918bc887c2d44ac295d613ef72cffdda, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/family/918bc887c2d44ac295d613ef72cffdda
2014-11-25 13:36:29,189 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user4779,1416889268210.1c65748e65f11456ce7b67d20bff3966. into 95abcb829bcc42de8ae410adeefbd358(size=177.1 M), total size for store is 3.5 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:36:29,189 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user4779,1416889268210.1c65748e65f11456ce7b67d20bff3966., storeName=family, fileCount=3, fileSize=178.3 M, priority=-4, time=5780410160924737; duration=3sec
2014-11-25 13:36:29,189 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5266), split_queue=0, merge_queue=0
2014-11-25 13:36:29,189 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5266), split_queue=0, merge_queue=0
2014-11-25 13:36:29,189 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:36:29,189 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 175817825 starting at candidate #21 after considering 228 permutations with 188 in ratio
2014-11-25 13:36:29,189 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 5f25bd0630c80f4e811af5f6488c5a89 - family: Initiating minor compaction
2014-11-25 13:36:29,189 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user1989,1416889268210.5f25bd0630c80f4e811af5f6488c5a89.
2014-11-25 13:36:29,189 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user1989,1416889268210.5f25bd0630c80f4e811af5f6488c5a89. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/.tmp, totalSize=167.7 M
2014-11-25 13:36:29,190 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/family/a387845662ad47abac0adf8dde8ef0fb, keycount=36069, bloomtype=ROW, size=53.8 M, encoding=NONE, seqNum=30342
2014-11-25 13:36:29,190 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/family/423dd35d93864e49bf1e554a81837009, keycount=36407, bloomtype=ROW, size=54.3 M, encoding=NONE, seqNum=31059
2014-11-25 13:36:29,190 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/family/b83dc511d9f24e3cbbdfc6d877d6d7f4, keycount=39991, bloomtype=ROW, size=59.6 M, encoding=NONE, seqNum=31841
2014-11-25 13:36:29,205 INFO  [MemStoreFlusher.18] regionserver.MemStoreFlusher: Waited 90046ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d.
2014-11-25 13:36:29,205 INFO  [MemStoreFlusher.28] regionserver.MemStoreFlusher: Waited 90062ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1539,1416889268210.cc10fb31d8cc1e28a698092d6c1a5416.
2014-11-25 13:36:29,205 INFO  [MemStoreFlusher.36] regionserver.MemStoreFlusher: Waited 90003ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1989,1416889268210.5f25bd0630c80f4e811af5f6488c5a89.
2014-11-25 13:36:29,206 DEBUG [MemStoreFlusher.28] regionserver.HRegion: Started memstore flush for usertable2,user1539,1416889268210.cc10fb31d8cc1e28a698092d6c1a5416., current region memstore size 209.9 M
2014-11-25 13:36:29,206 DEBUG [MemStoreFlusher.18] regionserver.HRegion: Started memstore flush for usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d., current region memstore size 210.8 M
2014-11-25 13:36:29,206 DEBUG [MemStoreFlusher.36] regionserver.HRegion: Started memstore flush for usertable2,user1989,1416889268210.5f25bd0630c80f4e811af5f6488c5a89., current region memstore size 209.7 M
2014-11-25 13:36:30,030 INFO  [MemStoreFlusher.36] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=209.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/.tmp/950f26bc2e2b4a3bbd834daae58b91f6
2014-11-25 13:36:30,036 DEBUG [MemStoreFlusher.36] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/.tmp/950f26bc2e2b4a3bbd834daae58b91f6 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/family/950f26bc2e2b4a3bbd834daae58b91f6
2014-11-25 13:36:30,042 INFO  [MemStoreFlusher.36] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/family/950f26bc2e2b4a3bbd834daae58b91f6, entries=763340, sequenceid=49578, filesize=113.8 M
2014-11-25 13:36:30,042 INFO  [MemStoreFlusher.36] regionserver.HRegion: Finished memstore flush of ~209.7 M/219835840, currentsize=0/0 for region usertable2,user1989,1416889268210.5f25bd0630c80f4e811af5f6488c5a89. in 836ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:30,043 DEBUG [MemStoreFlusher.36] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.36; compaction_queue=(0:5266), split_queue=0, merge_queue=0
2014-11-25 13:36:30,053 INFO  [MemStoreFlusher.28] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49577, memsize=209.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/.tmp/ba7118a05da14fc8bb6cc0bd88727579
2014-11-25 13:36:30,058 DEBUG [MemStoreFlusher.28] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/.tmp/ba7118a05da14fc8bb6cc0bd88727579 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/family/ba7118a05da14fc8bb6cc0bd88727579
2014-11-25 13:36:30,063 INFO  [MemStoreFlusher.28] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/family/ba7118a05da14fc8bb6cc0bd88727579, entries=764170, sequenceid=49577, filesize=113.9 M
2014-11-25 13:36:30,064 INFO  [MemStoreFlusher.28] regionserver.HRegion: Finished memstore flush of ~209.9 M/220075360, currentsize=0/0 for region usertable2,user1539,1416889268210.cc10fb31d8cc1e28a698092d6c1a5416. in 857ms, sequenceid=49577, compaction requested=true
2014-11-25 13:36:30,064 DEBUG [MemStoreFlusher.28] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.28; compaction_queue=(0:5267), split_queue=0, merge_queue=0
2014-11-25 13:36:30,066 INFO  [MemStoreFlusher.18] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=210.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/.tmp/9ebe5700135d4cd09ad5f84c8118b6a5
2014-11-25 13:36:30,071 DEBUG [MemStoreFlusher.18] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/.tmp/9ebe5700135d4cd09ad5f84c8118b6a5 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/9ebe5700135d4cd09ad5f84c8118b6a5
2014-11-25 13:36:30,076 INFO  [MemStoreFlusher.18] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e9009daeaf2fa6614dce60a34dd9fa4d/family/9ebe5700135d4cd09ad5f84c8118b6a5, entries=767390, sequenceid=49579, filesize=114.4 M
2014-11-25 13:36:30,076 INFO  [MemStoreFlusher.18] regionserver.HRegion: Finished memstore flush of ~210.8 M/221000880, currentsize=0/0 for region usertable2,user1719,1416889268210.e9009daeaf2fa6614dce60a34dd9fa4d. in 871ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:30,076 DEBUG [MemStoreFlusher.18] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.18; compaction_queue=(0:5268), split_queue=0, merge_queue=0
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.15] regionserver.MemStoreFlusher: Waited 90093ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2349,1416889268210.69fd185ded056a5c9f0e9bc4611ff44a.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.27] regionserver.MemStoreFlusher: Waited 90402ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.26] regionserver.MemStoreFlusher: Waited 90758ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.24] regionserver.MemStoreFlusher: Waited 90442ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6039,1416889268210.d4808c10301633d1d492aef55f9f9fb0.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.6] regionserver.MemStoreFlusher: Waited 90430ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8919,1416889268210.ff707032c52bfca061ec7055b315d1ac.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.11] regionserver.MemStoreFlusher: Waited 90662ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4059,1416889268210.a1bdaf5ad20e2ea54e0e5a2e45d102e5.
2014-11-25 13:36:30,106 DEBUG [MemStoreFlusher.27] regionserver.HRegion: Started memstore flush for usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd., current region memstore size 211.9 M
2014-11-25 13:36:30,106 DEBUG [MemStoreFlusher.24] regionserver.HRegion: Started memstore flush for usertable2,user6039,1416889268210.d4808c10301633d1d492aef55f9f9fb0., current region memstore size 209.2 M
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.35] regionserver.MemStoreFlusher: Waited 90483ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5679,1416889268210.4b90977be131e83310321e679b719b06.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.29] regionserver.MemStoreFlusher: Waited 90348ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7209,1416889268210.fa362bc0b2fed482214114394bfa26f3.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.17] regionserver.MemStoreFlusher: Waited 90890ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2169,1416889268210.a6d76b3d9a5a10e578fccc6098a8444b.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.7] regionserver.MemStoreFlusher: Waited 90107ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3339,1416889268210.36dd667db34cc2a7fc0dd12698785418.
2014-11-25 13:36:30,106 DEBUG [MemStoreFlusher.29] regionserver.HRegion: Started memstore flush for usertable2,user7209,1416889268210.fa362bc0b2fed482214114394bfa26f3., current region memstore size 211.3 M
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.19] regionserver.MemStoreFlusher: Waited 90514ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.8] regionserver.MemStoreFlusher: Waited 90451ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8739,1416889268210.10fbbcf2b6f1389e433a4a5211bf2642.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.32] regionserver.MemStoreFlusher: Waited 90739ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4149,1416889268210.c068f0d848be8a8d9b2a90f612ef94a1.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.25] regionserver.MemStoreFlusher: Waited 90558ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159.
2014-11-25 13:36:30,106 DEBUG [MemStoreFlusher.8] regionserver.HRegion: Started memstore flush for usertable2,user8739,1416889268210.10fbbcf2b6f1389e433a4a5211bf2642., current region memstore size 212.6 M
2014-11-25 13:36:30,106 DEBUG [MemStoreFlusher.15] regionserver.HRegion: Started memstore flush for usertable2,user2349,1416889268210.69fd185ded056a5c9f0e9bc4611ff44a., current region memstore size 207.1 M
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.13] regionserver.MemStoreFlusher: Waited 90292ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8109,1416889268210.4b47471f1507edfc343dfd2b4599e5cd.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.9] regionserver.MemStoreFlusher: Waited 90437ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.0] regionserver.MemStoreFlusher: Waited 90613ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4509,1416889268210.f0600c6f184e26e751ccebaff48fbe93.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.39] regionserver.MemStoreFlusher: Waited 90447ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user9099,1416889268210.66f19c7f25bc31928ead99dff847aa7f.
2014-11-25 13:36:30,107 DEBUG [MemStoreFlusher.9] regionserver.HRegion: Started memstore flush for usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d., current region memstore size 211.7 M
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.31] regionserver.MemStoreFlusher: Waited 90473ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5769,1416889268210.a6f20417c02c380a5937a58b862dfbb8.
2014-11-25 13:36:30,107 DEBUG [MemStoreFlusher.39] regionserver.HRegion: Started memstore flush for usertable2,user9099,1416889268210.66f19c7f25bc31928ead99dff847aa7f., current region memstore size 212.3 M
2014-11-25 13:36:30,107 DEBUG [MemStoreFlusher.0] regionserver.HRegion: Started memstore flush for usertable2,user4509,1416889268210.f0600c6f184e26e751ccebaff48fbe93., current region memstore size 208.7 M
2014-11-25 13:36:30,107 DEBUG [MemStoreFlusher.13] regionserver.HRegion: Started memstore flush for usertable2,user8109,1416889268210.4b47471f1507edfc343dfd2b4599e5cd., current region memstore size 211.3 M
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.28] regionserver.MemStoreFlusher: Waited 90764ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3429,1416889268210.040dc650b54378108a29bab140ceeb02.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.18] regionserver.MemStoreFlusher: Waited 90323ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0.
2014-11-25 13:36:30,106 DEBUG [MemStoreFlusher.25] regionserver.HRegion: Started memstore flush for usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159., current region memstore size 211.5 M
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.36] regionserver.MemStoreFlusher: Waited 90752ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5319,1416889268210.c2e76bfcf0ee452319788ce49186a339.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.2] regionserver.MemStoreFlusher: Waited 90580ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5139,1416889268210.a8d0d190cb61bd1bf54306b4bc472da1.
2014-11-25 13:36:30,107 DEBUG [MemStoreFlusher.36] regionserver.HRegion: Started memstore flush for usertable2,user5319,1416889268210.c2e76bfcf0ee452319788ce49186a339., current region memstore size 211.9 M
2014-11-25 13:36:30,106 DEBUG [MemStoreFlusher.32] regionserver.HRegion: Started memstore flush for usertable2,user4149,1416889268210.c068f0d848be8a8d9b2a90f612ef94a1., current region memstore size 211.8 M
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.4] regionserver.MemStoreFlusher: Waited 90899ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.20] regionserver.MemStoreFlusher: Waited 90456ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952.
2014-11-25 13:36:30,106 DEBUG [MemStoreFlusher.19] regionserver.HRegion: Started memstore flush for usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da., current region memstore size 212.4 M
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.22] regionserver.MemStoreFlusher: Waited 90731ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3699,1416889268210.b0dd08f1639152a6ac8ca032afa4d6db.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.34] regionserver.MemStoreFlusher: Waited 90836ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.38] regionserver.MemStoreFlusher: Waited 90805ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2889,1416889268210.44276931450f87557d509a6420f58f5c.
2014-11-25 13:36:30,107 DEBUG [MemStoreFlusher.22] regionserver.HRegion: Started memstore flush for usertable2,user3699,1416889268210.b0dd08f1639152a6ac8ca032afa4d6db., current region memstore size 211.8 M
2014-11-25 13:36:30,106 DEBUG [MemStoreFlusher.7] regionserver.HRegion: Started memstore flush for usertable2,user3339,1416889268210.36dd667db34cc2a7fc0dd12698785418., current region memstore size 207.9 M
2014-11-25 13:36:30,108 DEBUG [MemStoreFlusher.38] regionserver.HRegion: Started memstore flush for usertable2,user2889,1416889268210.44276931450f87557d509a6420f58f5c., current region memstore size 210.1 M
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.14] regionserver.MemStoreFlusher: Waited 90080ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3879,1416889268210.d32041fd1bd5e7014e265b483c173ddc.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.16] regionserver.MemStoreFlusher: Waited 90467ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.1] regionserver.MemStoreFlusher: Waited 90555ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5049,1416889268210.a5d4d454c3b39a48b9a7e5c343956435.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.33] regionserver.MemStoreFlusher: Waited 90624ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9.
2014-11-25 13:36:30,108 DEBUG [MemStoreFlusher.16] regionserver.HRegion: Started memstore flush for usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5., current region memstore size 212.3 M
2014-11-25 13:36:30,106 DEBUG [MemStoreFlusher.17] regionserver.HRegion: Started memstore flush for usertable2,user2169,1416889268210.a6d76b3d9a5a10e578fccc6098a8444b., current region memstore size 209.8 M
2014-11-25 13:36:30,108 DEBUG [MemStoreFlusher.33] regionserver.HRegion: Started memstore flush for usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9., current region memstore size 211.8 M
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.30] regionserver.MemStoreFlusher: Waited 90412ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4419,1416889268210.4fa6c789550f08f213befa07da277397.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.5] regionserver.MemStoreFlusher: Waited 90727ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5859,1416889268210.653390cc13d30804b9445ebffd69a81d.
2014-11-25 13:36:30,117 DEBUG [MemStoreFlusher.30] regionserver.HRegion: Started memstore flush for usertable2,user4419,1416889268210.4fa6c789550f08f213befa07da277397., current region memstore size 208.3 M
2014-11-25 13:36:30,118 DEBUG [MemStoreFlusher.5] regionserver.HRegion: Started memstore flush for usertable2,user5859,1416889268210.653390cc13d30804b9445ebffd69a81d., current region memstore size 212.2 M
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.10] regionserver.MemStoreFlusher: Waited 90727ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5.
2014-11-25 13:36:30,106 DEBUG [MemStoreFlusher.35] regionserver.HRegion: Started memstore flush for usertable2,user5679,1416889268210.4b90977be131e83310321e679b719b06., current region memstore size 209.6 M
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.37] regionserver.MemStoreFlusher: Waited 90815ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3519,1416889268210.fc6c0c446a315daf2015d57ba81babe0.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.12] regionserver.MemStoreFlusher: Waited 90826ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2979,1416889268210.eb335d2faee6fcc254e5fef1453c282b.
2014-11-25 13:36:30,106 DEBUG [MemStoreFlusher.26] regionserver.HRegion: Started memstore flush for usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297., current region memstore size 209.9 M
2014-11-25 13:36:30,106 DEBUG [MemStoreFlusher.11] regionserver.HRegion: Started memstore flush for usertable2,user4059,1416889268210.a1bdaf5ad20e2ea54e0e5a2e45d102e5., current region memstore size 209.1 M
2014-11-25 13:36:30,129 DEBUG [MemStoreFlusher.10] regionserver.HRegion: Started memstore flush for usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5., current region memstore size 212.5 M
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.21] regionserver.MemStoreFlusher: Waited 90632ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49.
2014-11-25 13:36:30,129 DEBUG [MemStoreFlusher.21] regionserver.HRegion: Started memstore flush for usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49., current region memstore size 212.2 M
2014-11-25 13:36:30,106 DEBUG [MemStoreFlusher.6] regionserver.HRegion: Started memstore flush for usertable2,user8919,1416889268210.ff707032c52bfca061ec7055b315d1ac., current region memstore size 212.5 M
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.23] regionserver.MemStoreFlusher: Waited 90660ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4959,1416889268210.3ec2e06a3605856a1dd62083096f2771.
2014-11-25 13:36:30,106 INFO  [MemStoreFlusher.3] regionserver.MemStoreFlusher: Waited 90850ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4779,1416889268210.1c65748e65f11456ce7b67d20bff3966.
2014-11-25 13:36:30,129 DEBUG [MemStoreFlusher.12] regionserver.HRegion: Started memstore flush for usertable2,user2979,1416889268210.eb335d2faee6fcc254e5fef1453c282b., current region memstore size 211.5 M
2014-11-25 13:36:30,140 DEBUG [MemStoreFlusher.23] regionserver.HRegion: Started memstore flush for usertable2,user4959,1416889268210.3ec2e06a3605856a1dd62083096f2771., current region memstore size 211.7 M
2014-11-25 13:36:30,129 DEBUG [MemStoreFlusher.37] regionserver.HRegion: Started memstore flush for usertable2,user3519,1416889268210.fc6c0c446a315daf2015d57ba81babe0., current region memstore size 212.0 M
2014-11-25 13:36:30,108 DEBUG [MemStoreFlusher.1] regionserver.HRegion: Started memstore flush for usertable2,user5049,1416889268210.a5d4d454c3b39a48b9a7e5c343956435., current region memstore size 208.7 M
2014-11-25 13:36:30,108 DEBUG [MemStoreFlusher.14] regionserver.HRegion: Started memstore flush for usertable2,user3879,1416889268210.d32041fd1bd5e7014e265b483c173ddc., current region memstore size 207.8 M
2014-11-25 13:36:30,108 DEBUG [MemStoreFlusher.34] regionserver.HRegion: Started memstore flush for usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b., current region memstore size 210.3 M
2014-11-25 13:36:30,107 DEBUG [MemStoreFlusher.20] regionserver.HRegion: Started memstore flush for usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952., current region memstore size 209.9 M
2014-11-25 13:36:30,107 DEBUG [MemStoreFlusher.4] regionserver.HRegion: Started memstore flush for usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407., current region memstore size 211.5 M
2014-11-25 13:36:30,107 DEBUG [MemStoreFlusher.2] regionserver.HRegion: Started memstore flush for usertable2,user5139,1416889268210.a8d0d190cb61bd1bf54306b4bc472da1., current region memstore size 211.1 M
2014-11-25 13:36:30,107 DEBUG [MemStoreFlusher.18] regionserver.HRegion: Started memstore flush for usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0., current region memstore size 211.7 M
2014-11-25 13:36:30,107 DEBUG [MemStoreFlusher.28] regionserver.HRegion: Started memstore flush for usertable2,user3429,1416889268210.040dc650b54378108a29bab140ceeb02., current region memstore size 211.4 M
2014-11-25 13:36:30,107 DEBUG [MemStoreFlusher.31] regionserver.HRegion: Started memstore flush for usertable2,user5769,1416889268210.a6f20417c02c380a5937a58b862dfbb8., current region memstore size 209.1 M
2014-11-25 13:36:30,140 DEBUG [MemStoreFlusher.3] regionserver.HRegion: Started memstore flush for usertable2,user4779,1416889268210.1c65748e65f11456ce7b67d20bff3966., current region memstore size 212.3 M
2014-11-25 13:36:33,459 INFO  [MemStoreFlusher.17] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49580, memsize=209.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/.tmp/94b3322dfe7a4610a6cc10785cf1b283
2014-11-25 13:36:33,463 INFO  [MemStoreFlusher.7] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=207.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/.tmp/ebddccd9231940ae9042d9d47af9abd1
2014-11-25 13:36:33,479 DEBUG [MemStoreFlusher.17] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/.tmp/94b3322dfe7a4610a6cc10785cf1b283 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/94b3322dfe7a4610a6cc10785cf1b283
2014-11-25 13:36:33,487 INFO  [MemStoreFlusher.17] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/94b3322dfe7a4610a6cc10785cf1b283, entries=763760, sequenceid=49580, filesize=113.9 M
2014-11-25 13:36:33,487 INFO  [MemStoreFlusher.17] regionserver.HRegion: Finished memstore flush of ~209.8 M/219956800, currentsize=0/0 for region usertable2,user2169,1416889268210.a6d76b3d9a5a10e578fccc6098a8444b. in 3381ms, sequenceid=49580, compaction requested=true
2014-11-25 13:36:33,488 DEBUG [MemStoreFlusher.17] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.17; compaction_queue=(0:5269), split_queue=0, merge_queue=0
2014-11-25 13:36:33,488 INFO  [MemStoreFlusher.17] regionserver.MemStoreFlusher: Waited 93731ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb.
2014-11-25 13:36:33,488 DEBUG [MemStoreFlusher.7] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/.tmp/ebddccd9231940ae9042d9d47af9abd1 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/ebddccd9231940ae9042d9d47af9abd1
2014-11-25 13:36:33,488 DEBUG [MemStoreFlusher.17] regionserver.HRegion: Started memstore flush for usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb., current region memstore size 210.3 M
2014-11-25 13:36:33,499 INFO  [MemStoreFlusher.7] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/36dd667db34cc2a7fc0dd12698785418/family/ebddccd9231940ae9042d9d47af9abd1, entries=756790, sequenceid=49578, filesize=112.8 M
2014-11-25 13:36:33,499 INFO  [MemStoreFlusher.7] regionserver.HRegion: Finished memstore flush of ~207.9 M/217949040, currentsize=0/0 for region usertable2,user3339,1416889268210.36dd667db34cc2a7fc0dd12698785418. in 3393ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:33,499 DEBUG [MemStoreFlusher.7] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.7; compaction_queue=(0:5270), split_queue=0, merge_queue=0
2014-11-25 13:36:33,499 INFO  [MemStoreFlusher.7] regionserver.MemStoreFlusher: Waited 94048ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6579,1416889268210.bff12d4267dd884829eb5659611c40f9.
2014-11-25 13:36:33,499 DEBUG [MemStoreFlusher.7] regionserver.HRegion: Started memstore flush for usertable2,user6579,1416889268210.bff12d4267dd884829eb5659611c40f9., current region memstore size 212.9 M
2014-11-25 13:36:33,653 INFO  [MemStoreFlusher.23] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49577, memsize=211.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/.tmp/64bcfc9bc7914929a6e0a00d6870d8d3
2014-11-25 13:36:33,675 DEBUG [MemStoreFlusher.23] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/.tmp/64bcfc9bc7914929a6e0a00d6870d8d3 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/64bcfc9bc7914929a6e0a00d6870d8d3
2014-11-25 13:36:33,834 INFO  [MemStoreFlusher.23] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/64bcfc9bc7914929a6e0a00d6870d8d3, entries=770870, sequenceid=49577, filesize=114.9 M
2014-11-25 13:36:33,834 INFO  [MemStoreFlusher.23] regionserver.HRegion: Finished memstore flush of ~211.7 M/222003760, currentsize=0/0 for region usertable2,user4959,1416889268210.3ec2e06a3605856a1dd62083096f2771. in 3694ms, sequenceid=49577, compaction requested=true
2014-11-25 13:36:33,835 DEBUG [MemStoreFlusher.23] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.23; compaction_queue=(0:5271), split_queue=0, merge_queue=0
2014-11-25 13:36:33,835 INFO  [MemStoreFlusher.23] regionserver.MemStoreFlusher: Waited 94335ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4599,1416889268210.eead33f80ffa1e642cc147c38794f39c.
2014-11-25 13:36:33,835 DEBUG [MemStoreFlusher.23] regionserver.HRegion: Started memstore flush for usertable2,user4599,1416889268210.eead33f80ffa1e642cc147c38794f39c., current region memstore size 209.4 M
2014-11-25 13:36:33,890 INFO  [MemStoreFlusher.11] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=209.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/.tmp/04efc00d4a8140e48fc6536eb3a1f92c
2014-11-25 13:36:33,926 DEBUG [MemStoreFlusher.11] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/.tmp/04efc00d4a8140e48fc6536eb3a1f92c as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/04efc00d4a8140e48fc6536eb3a1f92c
2014-11-25 13:36:33,937 INFO  [MemStoreFlusher.11] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/04efc00d4a8140e48fc6536eb3a1f92c, entries=761500, sequenceid=49579, filesize=113.5 M
2014-11-25 13:36:33,937 INFO  [MemStoreFlusher.11] regionserver.HRegion: Finished memstore flush of ~209.1 M/219305840, currentsize=0/0 for region usertable2,user4059,1416889268210.a1bdaf5ad20e2ea54e0e5a2e45d102e5. in 3831ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:33,937 DEBUG [MemStoreFlusher.11] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.11; compaction_queue=(0:5272), split_queue=0, merge_queue=0
2014-11-25 13:36:33,937 INFO  [MemStoreFlusher.11] regionserver.MemStoreFlusher: Waited 94528ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3789,1416889268210.4cbd9216f88e34160a388d0cd31c622c.
2014-11-25 13:36:33,937 DEBUG [MemStoreFlusher.11] regionserver.HRegion: Started memstore flush for usertable2,user3789,1416889268210.4cbd9216f88e34160a388d0cd31c622c., current region memstore size 210.6 M
2014-11-25 13:36:33,965 INFO  [MemStoreFlusher.32] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=211.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/.tmp/88ffdac5bb4345aca35b9079e7eaa308
2014-11-25 13:36:33,988 INFO  [MemStoreFlusher.27] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=211.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/.tmp/a346afcde1ba49469cdb64e11ed6103b
2014-11-25 13:36:33,990 DEBUG [MemStoreFlusher.32] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/.tmp/88ffdac5bb4345aca35b9079e7eaa308 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/88ffdac5bb4345aca35b9079e7eaa308
2014-11-25 13:36:34,001 INFO  [MemStoreFlusher.32] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c068f0d848be8a8d9b2a90f612ef94a1/family/88ffdac5bb4345aca35b9079e7eaa308, entries=771140, sequenceid=49579, filesize=115.0 M
2014-11-25 13:36:34,002 INFO  [MemStoreFlusher.32] regionserver.HRegion: Finished memstore flush of ~211.8 M/222082320, currentsize=0/0 for region usertable2,user4149,1416889268210.c068f0d848be8a8d9b2a90f612ef94a1. in 3896ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:34,002 DEBUG [MemStoreFlusher.32] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.32; compaction_queue=(0:5273), split_queue=0, merge_queue=0
2014-11-25 13:36:34,002 INFO  [MemStoreFlusher.32] regionserver.MemStoreFlusher: Waited 94569ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user6219,1416889268210.e452c53f69cba13d15de325c057fb970.
2014-11-25 13:36:34,002 DEBUG [MemStoreFlusher.32] regionserver.HRegion: Started memstore flush for usertable2,user6219,1416889268210.e452c53f69cba13d15de325c057fb970., current region memstore size 211.7 M
2014-11-25 13:36:34,016 DEBUG [MemStoreFlusher.27] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/.tmp/a346afcde1ba49469cdb64e11ed6103b as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/a346afcde1ba49469cdb64e11ed6103b
2014-11-25 13:36:34,028 INFO  [MemStoreFlusher.27] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/a346afcde1ba49469cdb64e11ed6103b, entries=771550, sequenceid=49579, filesize=115.0 M
2014-11-25 13:36:34,029 INFO  [MemStoreFlusher.27] regionserver.HRegion: Finished memstore flush of ~211.9 M/222200640, currentsize=0/0 for region usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd. in 3923ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:34,029 DEBUG [MemStoreFlusher.27] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.27; compaction_queue=(0:5274), split_queue=0, merge_queue=0
2014-11-25 13:36:34,029 INFO  [MemStoreFlusher.27] regionserver.MemStoreFlusher: Waited 92892ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,,1416889268210.a3d8de2e3c77996d502684577800bf7f.
2014-11-25 13:36:34,029 DEBUG [MemStoreFlusher.27] regionserver.HRegion: Started memstore flush for usertable2,,1416889268210.a3d8de2e3c77996d502684577800bf7f., current region memstore size 204.1 M
2014-11-25 13:36:34,038 INFO  [MemStoreFlusher.33] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=211.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/.tmp/6b82091552d44dc19919f367b1913e3b
2014-11-25 13:36:34,053 INFO  [MemStoreFlusher.15] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=207.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/.tmp/6448fda20bde4116bcf1209e8e8e003a
2014-11-25 13:36:34,059 DEBUG [MemStoreFlusher.33] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/.tmp/6b82091552d44dc19919f367b1913e3b as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/6b82091552d44dc19919f367b1913e3b
2014-11-25 13:36:34,069 INFO  [MemStoreFlusher.33] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/6b82091552d44dc19919f367b1913e3b, entries=771270, sequenceid=49579, filesize=115.0 M
2014-11-25 13:36:34,070 INFO  [MemStoreFlusher.33] regionserver.HRegion: Finished memstore flush of ~211.8 M/222119600, currentsize=0/0 for region usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9. in 3961ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:34,070 DEBUG [MemStoreFlusher.33] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.33; compaction_queue=(0:5275), split_queue=0, merge_queue=0
2014-11-25 13:36:34,070 INFO  [MemStoreFlusher.33] regionserver.MemStoreFlusher: Waited 94733ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3159,1416889268210.09a9193727ffcc63b8838a6c82b049a5.
2014-11-25 13:36:34,070 DEBUG [MemStoreFlusher.33] regionserver.HRegion: Started memstore flush for usertable2,user3159,1416889268210.09a9193727ffcc63b8838a6c82b049a5., current region memstore size 209.7 M
2014-11-25 13:36:34,071 INFO  [MemStoreFlusher.30] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49577, memsize=208.3 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/.tmp/8579373cdb1d412e9472448233b959a9
2014-11-25 13:36:34,073 DEBUG [MemStoreFlusher.15] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/.tmp/6448fda20bde4116bcf1209e8e8e003a as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/6448fda20bde4116bcf1209e8e8e003a
2014-11-25 13:36:34,083 DEBUG [MemStoreFlusher.30] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/.tmp/8579373cdb1d412e9472448233b959a9 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/family/8579373cdb1d412e9472448233b959a9
2014-11-25 13:36:34,091 INFO  [MemStoreFlusher.15] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69fd185ded056a5c9f0e9bc4611ff44a/family/6448fda20bde4116bcf1209e8e8e003a, entries=753870, sequenceid=49579, filesize=112.4 M
2014-11-25 13:36:34,092 INFO  [MemStoreFlusher.15] regionserver.HRegion: Finished memstore flush of ~207.1 M/217108560, currentsize=0/0 for region usertable2,user2349,1416889268210.69fd185ded056a5c9f0e9bc4611ff44a. in 3986ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:34,092 DEBUG [MemStoreFlusher.15] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.15; compaction_queue=(0:5276), split_queue=0, merge_queue=0
2014-11-25 13:36:34,092 INFO  [MemStoreFlusher.15] regionserver.MemStoreFlusher: Waited 94526ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user5589,1416889268210.cfb348ee570fa731ba8caa85099a1bd5.
2014-11-25 13:36:34,092 DEBUG [MemStoreFlusher.15] regionserver.HRegion: Started memstore flush for usertable2,user5589,1416889268210.cfb348ee570fa731ba8caa85099a1bd5., current region memstore size 210.9 M
2014-11-25 13:36:34,105 INFO  [MemStoreFlusher.30] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/family/8579373cdb1d412e9472448233b959a9, entries=758410, sequenceid=49577, filesize=113.1 M
2014-11-25 13:36:34,105 INFO  [MemStoreFlusher.30] regionserver.HRegion: Finished memstore flush of ~208.3 M/218417280, currentsize=0/0 for region usertable2,user4419,1416889268210.4fa6c789550f08f213befa07da277397. in 3988ms, sequenceid=49577, compaction requested=true
2014-11-25 13:36:34,106 DEBUG [MemStoreFlusher.30] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.30; compaction_queue=(0:5277), split_queue=0, merge_queue=0
2014-11-25 13:36:34,106 INFO  [MemStoreFlusher.30] regionserver.MemStoreFlusher: Waited 94846ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2529,1416889268210.b451134c60b1dc7cf526e81f6db2c433.
2014-11-25 13:36:34,106 DEBUG [MemStoreFlusher.30] regionserver.HRegion: Started memstore flush for usertable2,user2529,1416889268210.b451134c60b1dc7cf526e81f6db2c433., current region memstore size 209.2 M
2014-11-25 13:36:34,182 INFO  [MemStoreFlusher.24] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=209.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/.tmp/74de72fe2180426483bf5fc22d94f193
2014-11-25 13:36:34,193 INFO  [MemStoreFlusher.10] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49577, memsize=212.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/.tmp/eb8277fe826346e7a3c7c08c778062b4
2014-11-25 13:36:34,209 DEBUG [MemStoreFlusher.24] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/.tmp/74de72fe2180426483bf5fc22d94f193 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/family/74de72fe2180426483bf5fc22d94f193
2014-11-25 13:36:34,213 INFO  [MemStoreFlusher.26] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=209.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/.tmp/d1493791697e4655aec1a3cdbd1b86d9
2014-11-25 13:36:34,221 INFO  [MemStoreFlusher.24] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/family/74de72fe2180426483bf5fc22d94f193, entries=761600, sequenceid=49579, filesize=113.5 M
2014-11-25 13:36:34,221 INFO  [MemStoreFlusher.24] regionserver.HRegion: Finished memstore flush of ~209.2 M/219334480, currentsize=0/0 for region usertable2,user6039,1416889268210.d4808c10301633d1d492aef55f9f9fb0. in 4115ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:34,221 DEBUG [MemStoreFlusher.10] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/.tmp/eb8277fe826346e7a3c7c08c778062b4 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/eb8277fe826346e7a3c7c08c778062b4
2014-11-25 13:36:34,221 DEBUG [MemStoreFlusher.24] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.24; compaction_queue=(0:5278), split_queue=0, merge_queue=0
2014-11-25 13:36:34,222 INFO  [MemStoreFlusher.24] regionserver.MemStoreFlusher: Waited 94773ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4239,1416889268210.e521da13cf88c7e5aa481035feae21e5.
2014-11-25 13:36:34,222 DEBUG [MemStoreFlusher.24] regionserver.HRegion: Started memstore flush for usertable2,user4239,1416889268210.e521da13cf88c7e5aa481035feae21e5., current region memstore size 211.3 M
2014-11-25 13:36:34,232 INFO  [MemStoreFlusher.10] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/eb8277fe826346e7a3c7c08c778062b4, entries=773800, sequenceid=49577, filesize=115.4 M
2014-11-25 13:36:34,232 INFO  [MemStoreFlusher.10] regionserver.HRegion: Finished memstore flush of ~212.5 M/222848320, currentsize=0/0 for region usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5. in 4104ms, sequenceid=49577, compaction requested=true
2014-11-25 13:36:34,232 DEBUG [MemStoreFlusher.10] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.10; compaction_queue=(0:5279), split_queue=0, merge_queue=0
2014-11-25 13:36:34,232 INFO  [MemStoreFlusher.10] regionserver.MemStoreFlusher: Waited 94749ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4689,1416889268210.f163e7c364cbfc321d89062a8ec9a958.
2014-11-25 13:36:34,232 DEBUG [MemStoreFlusher.10] regionserver.HRegion: Started memstore flush for usertable2,user4689,1416889268210.f163e7c364cbfc321d89062a8ec9a958., current region memstore size 211.3 M
2014-11-25 13:36:34,244 DEBUG [MemStoreFlusher.26] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/.tmp/d1493791697e4655aec1a3cdbd1b86d9 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/d1493791697e4655aec1a3cdbd1b86d9
2014-11-25 13:36:34,255 INFO  [MemStoreFlusher.26] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/d1493791697e4655aec1a3cdbd1b86d9, entries=764080, sequenceid=49578, filesize=113.9 M
2014-11-25 13:36:34,255 INFO  [MemStoreFlusher.26] regionserver.HRegion: Finished memstore flush of ~209.9 M/220049280, currentsize=0/0 for region usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297. in 4149ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:34,255 DEBUG [MemStoreFlusher.26] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.26; compaction_queue=(0:5280), split_queue=0, merge_queue=0
2014-11-25 13:36:34,256 INFO  [MemStoreFlusher.26] regionserver.MemStoreFlusher: Waited 94821ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4.
2014-11-25 13:36:34,256 DEBUG [MemStoreFlusher.26] regionserver.HRegion: Started memstore flush for usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4., current region memstore size 211.5 M
2014-11-25 13:36:34,273 INFO  [MemStoreFlusher.39] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49580, memsize=212.3 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/.tmp/a67e6a3f476b4ce19f47b1ae5d6bd184
2014-11-25 13:36:34,308 DEBUG [MemStoreFlusher.39] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/.tmp/a67e6a3f476b4ce19f47b1ae5d6bd184 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/family/a67e6a3f476b4ce19f47b1ae5d6bd184
2014-11-25 13:36:34,316 INFO  [MemStoreFlusher.39] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/family/a67e6a3f476b4ce19f47b1ae5d6bd184, entries=773100, sequenceid=49580, filesize=115.3 M
2014-11-25 13:36:34,316 INFO  [MemStoreFlusher.39] regionserver.HRegion: Finished memstore flush of ~212.3 M/222646480, currentsize=0/0 for region usertable2,user9099,1416889268210.66f19c7f25bc31928ead99dff847aa7f. in 4209ms, sequenceid=49580, compaction requested=true
2014-11-25 13:36:34,316 DEBUG [MemStoreFlusher.39] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.39; compaction_queue=(0:5281), split_queue=0, merge_queue=0
2014-11-25 13:36:34,316 INFO  [MemStoreFlusher.39] regionserver.MemStoreFlusher: Waited 94209ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568.
2014-11-25 13:36:34,317 DEBUG [MemStoreFlusher.39] regionserver.HRegion: Started memstore flush for usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568., current region memstore size 207.4 M
2014-11-25 13:36:34,338 INFO  [MemStoreFlusher.13] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=211.3 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/.tmp/871490bcc5dd44f380d42b0188a810c0
2014-11-25 13:36:34,349 INFO  [MemStoreFlusher.19] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=212.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/.tmp/6a9fb64fdb42407ea30c3afb864553d8
2014-11-25 13:36:34,361 DEBUG [MemStoreFlusher.13] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/.tmp/871490bcc5dd44f380d42b0188a810c0 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/family/871490bcc5dd44f380d42b0188a810c0
2014-11-25 13:36:34,370 INFO  [MemStoreFlusher.13] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/family/871490bcc5dd44f380d42b0188a810c0, entries=769240, sequenceid=49578, filesize=114.7 M
2014-11-25 13:36:34,370 INFO  [MemStoreFlusher.13] regionserver.HRegion: Finished memstore flush of ~211.3 M/221534560, currentsize=0/0 for region usertable2,user8109,1416889268210.4b47471f1507edfc343dfd2b4599e5cd. in 4263ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:34,370 DEBUG [MemStoreFlusher.13] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.13; compaction_queue=(0:5282), split_queue=0, merge_queue=0
2014-11-25 13:36:34,370 INFO  [MemStoreFlusher.13] regionserver.MemStoreFlusher: Waited 95085ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user2709,1416889268210.fd0aae1076bc05c8db51754294c21e38.
2014-11-25 13:36:34,371 DEBUG [MemStoreFlusher.13] regionserver.HRegion: Started memstore flush for usertable2,user2709,1416889268210.fd0aae1076bc05c8db51754294c21e38., current region memstore size 209.6 M
2014-11-25 13:36:34,374 DEBUG [MemStoreFlusher.19] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/.tmp/6a9fb64fdb42407ea30c3afb864553d8 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/6a9fb64fdb42407ea30c3afb864553d8
2014-11-25 13:36:34,431 INFO  [MemStoreFlusher.19] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/6a9fb64fdb42407ea30c3afb864553d8, entries=773230, sequenceid=49578, filesize=115.3 M
2014-11-25 13:36:34,431 INFO  [MemStoreFlusher.19] regionserver.HRegion: Finished memstore flush of ~212.4 M/222683600, currentsize=0/0 for region usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da. in 4325ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:34,431 DEBUG [MemStoreFlusher.19] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.19; compaction_queue=(0:5283), split_queue=0, merge_queue=0
2014-11-25 13:36:34,431 INFO  [MemStoreFlusher.19] regionserver.MemStoreFlusher: Waited 94038ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1449,1416889268210.952a6132a4e977be00a90f6ac7e69235.
2014-11-25 13:36:34,432 DEBUG [MemStoreFlusher.19] regionserver.HRegion: Started memstore flush for usertable2,user1449,1416889268210.952a6132a4e977be00a90f6ac7e69235., current region memstore size 206.9 M
2014-11-25 13:36:34,445 INFO  [MemStoreFlusher.18] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=211.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/.tmp/efef984e8e9c42debecbb77e3b7f0615
2014-11-25 13:36:34,446 INFO  [MemStoreFlusher.9] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=211.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/.tmp/0fbd4325925b40f1acb427dc5eefd0a1
2014-11-25 13:36:34,462 INFO  [MemStoreFlusher.38] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=210.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/.tmp/71d5ba0ffd244ec39b5ab5b3045b6bda
2014-11-25 13:36:34,463 DEBUG [MemStoreFlusher.18] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/.tmp/efef984e8e9c42debecbb77e3b7f0615 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/efef984e8e9c42debecbb77e3b7f0615
2014-11-25 13:36:34,471 DEBUG [MemStoreFlusher.9] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/.tmp/0fbd4325925b40f1acb427dc5eefd0a1 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/0fbd4325925b40f1acb427dc5eefd0a1
2014-11-25 13:36:34,472 DEBUG [MemStoreFlusher.38] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/.tmp/71d5ba0ffd244ec39b5ab5b3045b6bda as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/71d5ba0ffd244ec39b5ab5b3045b6bda
2014-11-25 13:36:34,485 INFO  [MemStoreFlusher.18] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/efef984e8e9c42debecbb77e3b7f0615, entries=770850, sequenceid=49578, filesize=114.9 M
2014-11-25 13:36:34,485 INFO  [MemStoreFlusher.18] regionserver.HRegion: Finished memstore flush of ~211.7 M/221999360, currentsize=0/0 for region usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0. in 4378ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:34,485 DEBUG [MemStoreFlusher.18] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.18; compaction_queue=(0:5284), split_queue=0, merge_queue=0
2014-11-25 13:36:34,485 INFO  [MemStoreFlusher.18] regionserver.MemStoreFlusher: Waited 94180ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user1269,1416889268210.bbe246dd324639d9e0eb2b0788d4067c.
2014-11-25 13:36:34,486 DEBUG [MemStoreFlusher.18] regionserver.HRegion: Started memstore flush for usertable2,user1269,1416889268210.bbe246dd324639d9e0eb2b0788d4067c., current region memstore size 207.0 M
2014-11-25 13:36:34,489 INFO  [MemStoreFlusher.8] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=212.6 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/.tmp/047b17d1574a4b6da506d7b6b9ec5b1f
2014-11-25 13:36:34,490 INFO  [MemStoreFlusher.9] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/0fbd4325925b40f1acb427dc5eefd0a1, entries=770810, sequenceid=49579, filesize=114.9 M
2014-11-25 13:36:34,491 INFO  [MemStoreFlusher.9] regionserver.HRegion: Finished memstore flush of ~211.7 M/221987360, currentsize=0/0 for region usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d. in 4384ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:34,491 DEBUG [MemStoreFlusher.9] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.9; compaction_queue=(0:5285), split_queue=0, merge_queue=0
2014-11-25 13:36:34,492 INFO  [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=208.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/.tmp/6a509789c90b46dca8ab47645c352155
2014-11-25 13:36:34,494 INFO  [MemStoreFlusher.29] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=211.3 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/.tmp/461f2ae151f64b1996af61ad3918ba5c
2014-11-25 13:36:34,500 INFO  [MemStoreFlusher.38] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/71d5ba0ffd244ec39b5ab5b3045b6bda, entries=764970, sequenceid=49578, filesize=114.0 M
2014-11-25 13:36:34,500 INFO  [MemStoreFlusher.38] regionserver.HRegion: Finished memstore flush of ~210.1 M/220305520, currentsize=0/0 for region usertable2,user2889,1416889268210.44276931450f87557d509a6420f58f5c. in 4392ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:34,500 DEBUG [MemStoreFlusher.38] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.38; compaction_queue=(0:5286), split_queue=0, merge_queue=0
2014-11-25 13:36:34,518 DEBUG [MemStoreFlusher.8] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/.tmp/047b17d1574a4b6da506d7b6b9ec5b1f as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/family/047b17d1574a4b6da506d7b6b9ec5b1f
2014-11-25 13:36:34,518 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/.tmp/6a509789c90b46dca8ab47645c352155 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/6a509789c90b46dca8ab47645c352155
2014-11-25 13:36:34,527 INFO  [MemStoreFlusher.8] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/family/047b17d1574a4b6da506d7b6b9ec5b1f, entries=774130, sequenceid=49578, filesize=115.4 M
2014-11-25 13:36:34,527 INFO  [MemStoreFlusher.8] regionserver.HRegion: Finished memstore flush of ~212.6 M/222943200, currentsize=0/0 for region usertable2,user8739,1416889268210.10fbbcf2b6f1389e433a4a5211bf2642. in 4421ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:34,527 DEBUG [MemStoreFlusher.8] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.8; compaction_queue=(0:5287), split_queue=0, merge_queue=0
2014-11-25 13:36:34,551 DEBUG [MemStoreFlusher.29] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/.tmp/461f2ae151f64b1996af61ad3918ba5c as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/family/461f2ae151f64b1996af61ad3918ba5c
2014-11-25 13:36:34,552 INFO  [MemStoreFlusher.0] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f0600c6f184e26e751ccebaff48fbe93/family/6a509789c90b46dca8ab47645c352155, entries=759940, sequenceid=49579, filesize=113.3 M
2014-11-25 13:36:34,553 INFO  [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~208.7 M/218856320, currentsize=0/0 for region usertable2,user4509,1416889268210.f0600c6f184e26e751ccebaff48fbe93. in 4446ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:34,553 DEBUG [MemStoreFlusher.0] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.0; compaction_queue=(0:5288), split_queue=0, merge_queue=0
2014-11-25 13:36:34,570 INFO  [MemStoreFlusher.29] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/family/461f2ae151f64b1996af61ad3918ba5c, entries=769160, sequenceid=49578, filesize=114.7 M
2014-11-25 13:36:34,571 INFO  [MemStoreFlusher.29] regionserver.HRegion: Finished memstore flush of ~211.3 M/221512160, currentsize=0/0 for region usertable2,user7209,1416889268210.fa362bc0b2fed482214114394bfa26f3. in 4465ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:34,571 DEBUG [MemStoreFlusher.29] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.29; compaction_queue=(0:5289), split_queue=0, merge_queue=0
2014-11-25 13:36:36,151 INFO  [MemStoreFlusher.14] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=207.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/.tmp/e1ef57d9a5c545b98a3e020e90de570c
2014-11-25 13:36:36,164 DEBUG [MemStoreFlusher.14] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/.tmp/e1ef57d9a5c545b98a3e020e90de570c as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/family/e1ef57d9a5c545b98a3e020e90de570c
2014-11-25 13:36:36,173 INFO  [MemStoreFlusher.14] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/family/e1ef57d9a5c545b98a3e020e90de570c, entries=756610, sequenceid=49578, filesize=112.8 M
2014-11-25 13:36:36,173 INFO  [MemStoreFlusher.14] regionserver.HRegion: Finished memstore flush of ~207.8 M/217898000, currentsize=0/0 for region usertable2,user3879,1416889268210.d32041fd1bd5e7014e265b483c173ddc. in 6065ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:36,173 DEBUG [MemStoreFlusher.14] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.14; compaction_queue=(0:5290), split_queue=0, merge_queue=0
2014-11-25 13:36:37,178 INFO  [MemStoreFlusher.6] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=212.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/.tmp/5f53021eeee54f2b960dbbffe1f4c6d5
2014-11-25 13:36:37,184 DEBUG [MemStoreFlusher.6] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/.tmp/5f53021eeee54f2b960dbbffe1f4c6d5 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/family/5f53021eeee54f2b960dbbffe1f4c6d5
2014-11-25 13:36:37,189 INFO  [MemStoreFlusher.6] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/family/5f53021eeee54f2b960dbbffe1f4c6d5, entries=773720, sequenceid=49579, filesize=115.3 M
2014-11-25 13:36:37,189 INFO  [MemStoreFlusher.6] regionserver.HRegion: Finished memstore flush of ~212.5 M/222825520, currentsize=0/0 for region usertable2,user8919,1416889268210.ff707032c52bfca061ec7055b315d1ac. in 7083ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:37,190 DEBUG [MemStoreFlusher.6] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.6; compaction_queue=(0:5291), split_queue=0, merge_queue=0
2014-11-25 13:36:38,355 INFO  [MemStoreFlusher.31] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=209.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/.tmp/6b0e8bd8b34a46c39c924fe216d5e0cd
2014-11-25 13:36:38,362 DEBUG [MemStoreFlusher.31] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/.tmp/6b0e8bd8b34a46c39c924fe216d5e0cd as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/family/6b0e8bd8b34a46c39c924fe216d5e0cd
2014-11-25 13:36:38,368 INFO  [MemStoreFlusher.31] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/family/6b0e8bd8b34a46c39c924fe216d5e0cd, entries=761500, sequenceid=49578, filesize=113.5 M
2014-11-25 13:36:38,368 INFO  [MemStoreFlusher.31] regionserver.HRegion: Finished memstore flush of ~209.1 M/219306560, currentsize=0/0 for region usertable2,user5769,1416889268210.a6f20417c02c380a5937a58b862dfbb8. in 8261ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:38,368 DEBUG [MemStoreFlusher.31] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.31; compaction_queue=(0:5292), split_queue=0, merge_queue=0
2014-11-25 13:36:38,861 INFO  [MemStoreFlusher.5] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=212.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/.tmp/f43b8888fd7042d59ef06a3cb7cc2c44
2014-11-25 13:36:38,862 INFO  [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49580, memsize=208.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a5d4d454c3b39a48b9a7e5c343956435/.tmp/b867afa3fcda41b1b1e132ce73de63b6
2014-11-25 13:36:38,867 DEBUG [MemStoreFlusher.5] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/.tmp/f43b8888fd7042d59ef06a3cb7cc2c44 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/f43b8888fd7042d59ef06a3cb7cc2c44
2014-11-25 13:36:38,867 DEBUG [MemStoreFlusher.1] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a5d4d454c3b39a48b9a7e5c343956435/.tmp/b867afa3fcda41b1b1e132ce73de63b6 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a5d4d454c3b39a48b9a7e5c343956435/family/b867afa3fcda41b1b1e132ce73de63b6
2014-11-25 13:36:38,872 INFO  [MemStoreFlusher.5] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/f43b8888fd7042d59ef06a3cb7cc2c44, entries=772580, sequenceid=49579, filesize=115.2 M
2014-11-25 13:36:38,872 INFO  [MemStoreFlusher.5] regionserver.HRegion: Finished memstore flush of ~212.2 M/222496880, currentsize=0/0 for region usertable2,user5859,1416889268210.653390cc13d30804b9445ebffd69a81d. in 8755ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:38,872 INFO  [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a5d4d454c3b39a48b9a7e5c343956435/family/b867afa3fcda41b1b1e132ce73de63b6, entries=759960, sequenceid=49580, filesize=113.3 M
2014-11-25 13:36:38,873 DEBUG [MemStoreFlusher.5] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.5; compaction_queue=(0:5293), split_queue=0, merge_queue=0
2014-11-25 13:36:38,873 INFO  [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~208.7 M/218862320, currentsize=0/0 for region usertable2,user5049,1416889268210.a5d4d454c3b39a48b9a7e5c343956435. in 8765ms, sequenceid=49580, compaction requested=true
2014-11-25 13:36:38,873 DEBUG [MemStoreFlusher.1] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.1; compaction_queue=(0:5294), split_queue=0, merge_queue=0
2014-11-25 13:36:39,008 INFO  [MemStoreFlusher.12] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49577, memsize=211.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/.tmp/d2d1e503d58140218fd63ee0a8ebdd69
2014-11-25 13:36:39,014 DEBUG [MemStoreFlusher.12] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/.tmp/d2d1e503d58140218fd63ee0a8ebdd69 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/family/d2d1e503d58140218fd63ee0a8ebdd69
2014-11-25 13:36:39,022 INFO  [MemStoreFlusher.12] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/family/d2d1e503d58140218fd63ee0a8ebdd69, entries=770050, sequenceid=49577, filesize=114.8 M
2014-11-25 13:36:39,022 INFO  [MemStoreFlusher.12] regionserver.HRegion: Finished memstore flush of ~211.5 M/221768240, currentsize=0/0 for region usertable2,user2979,1416889268210.eb335d2faee6fcc254e5fef1453c282b. in 8893ms, sequenceid=49577, compaction requested=true
2014-11-25 13:36:39,022 DEBUG [MemStoreFlusher.12] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.12; compaction_queue=(0:5295), split_queue=0, merge_queue=0
2014-11-25 13:36:39,286 INFO  [MemStoreFlusher.28] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=211.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/.tmp/89f61b6c86f6436989e51e07e5ccbef1
2014-11-25 13:36:39,292 DEBUG [MemStoreFlusher.28] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/.tmp/89f61b6c86f6436989e51e07e5ccbef1 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/family/89f61b6c86f6436989e51e07e5ccbef1
2014-11-25 13:36:39,296 INFO  [MemStoreFlusher.28] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/040dc650b54378108a29bab140ceeb02/family/89f61b6c86f6436989e51e07e5ccbef1, entries=769530, sequenceid=49578, filesize=114.7 M
2014-11-25 13:36:39,296 INFO  [MemStoreFlusher.28] regionserver.HRegion: Finished memstore flush of ~211.4 M/221618560, currentsize=0/0 for region usertable2,user3429,1416889268210.040dc650b54378108a29bab140ceeb02. in 9189ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:39,297 DEBUG [MemStoreFlusher.28] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.28; compaction_queue=(0:5296), split_queue=0, merge_queue=0
2014-11-25 13:36:39,650 INFO  [MemStoreFlusher.35] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=209.6 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/.tmp/42b7d8792f6c4e279d9fb22d32c6fc63
2014-11-25 13:36:39,657 DEBUG [MemStoreFlusher.35] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/.tmp/42b7d8792f6c4e279d9fb22d32c6fc63 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/family/42b7d8792f6c4e279d9fb22d32c6fc63
2014-11-25 13:36:39,665 INFO  [MemStoreFlusher.35] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/family/42b7d8792f6c4e279d9fb22d32c6fc63, entries=763140, sequenceid=49579, filesize=113.8 M
2014-11-25 13:36:39,665 INFO  [MemStoreFlusher.35] regionserver.HRegion: Finished memstore flush of ~209.6 M/219778000, currentsize=0/0 for region usertable2,user5679,1416889268210.4b90977be131e83310321e679b719b06. in 9559ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:39,666 DEBUG [MemStoreFlusher.35] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.35; compaction_queue=(0:5297), split_queue=0, merge_queue=0
2014-11-25 13:36:39,691 INFO  [MemStoreFlusher.16] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=212.3 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/.tmp/744e27bf51de43bbb44000d95a738eb8
2014-11-25 13:36:39,697 DEBUG [MemStoreFlusher.16] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/.tmp/744e27bf51de43bbb44000d95a738eb8 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/744e27bf51de43bbb44000d95a738eb8
2014-11-25 13:36:39,701 INFO  [MemStoreFlusher.16] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/744e27bf51de43bbb44000d95a738eb8, entries=772870, sequenceid=49578, filesize=115.2 M
2014-11-25 13:36:39,701 INFO  [MemStoreFlusher.16] regionserver.HRegion: Finished memstore flush of ~212.3 M/222579680, currentsize=0/0 for region usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5. in 9593ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:39,701 DEBUG [MemStoreFlusher.16] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.16; compaction_queue=(0:5298), split_queue=0, merge_queue=0
2014-11-25 13:36:40,393 INFO  [MemStoreFlusher.22] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49580, memsize=211.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/.tmp/ab1e1a61439748a48dd99908e25885b7
2014-11-25 13:36:40,397 INFO  [MemStoreFlusher.25] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=211.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/.tmp/1f87026cedad4f938491ed16430168f0
2014-11-25 13:36:40,400 DEBUG [MemStoreFlusher.22] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/.tmp/ab1e1a61439748a48dd99908e25885b7 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/family/ab1e1a61439748a48dd99908e25885b7
2014-11-25 13:36:40,403 DEBUG [MemStoreFlusher.25] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/.tmp/1f87026cedad4f938491ed16430168f0 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/1f87026cedad4f938491ed16430168f0
2014-11-25 13:36:40,405 INFO  [MemStoreFlusher.22] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b0dd08f1639152a6ac8ca032afa4d6db/family/ab1e1a61439748a48dd99908e25885b7, entries=771220, sequenceid=49580, filesize=115.0 M
2014-11-25 13:36:40,406 INFO  [MemStoreFlusher.22] regionserver.HRegion: Finished memstore flush of ~211.8 M/222105040, currentsize=0/0 for region usertable2,user3699,1416889268210.b0dd08f1639152a6ac8ca032afa4d6db. in 10299ms, sequenceid=49580, compaction requested=true
2014-11-25 13:36:40,406 DEBUG [MemStoreFlusher.22] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.22; compaction_queue=(0:5299), split_queue=0, merge_queue=0
2014-11-25 13:36:40,418 INFO  [MemStoreFlusher.25] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/1f87026cedad4f938491ed16430168f0, entries=770110, sequenceid=49579, filesize=114.8 M
2014-11-25 13:36:40,418 INFO  [MemStoreFlusher.25] regionserver.HRegion: Finished memstore flush of ~211.5 M/221785040, currentsize=0/0 for region usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159. in 10312ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:40,418 DEBUG [MemStoreFlusher.25] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.25; compaction_queue=(0:5300), split_queue=0, merge_queue=0
2014-11-25 13:36:40,792 INFO  [MemStoreFlusher.9] regionserver.MemStoreFlusher: Waited 90746ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779.
2014-11-25 13:36:40,792 DEBUG [MemStoreFlusher.9] regionserver.HRegion: Started memstore flush for usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779., current region memstore size 186.8 M
2014-11-25 13:36:40,839 INFO  [MemStoreFlusher.4] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=211.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/.tmp/9f29a370dab143ed917cf6394533af1e
2014-11-25 13:36:40,844 DEBUG [MemStoreFlusher.4] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/.tmp/9f29a370dab143ed917cf6394533af1e as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/9f29a370dab143ed917cf6394533af1e
2014-11-25 13:36:40,849 INFO  [MemStoreFlusher.4] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/070a5af646dd1859830cccdc23f86407/family/9f29a370dab143ed917cf6394533af1e, entries=770000, sequenceid=49579, filesize=114.8 M
2014-11-25 13:36:40,849 INFO  [MemStoreFlusher.4] regionserver.HRegion: Finished memstore flush of ~211.5 M/221754480, currentsize=0/0 for region usertable2,user2259,1416889268210.070a5af646dd1859830cccdc23f86407. in 10742ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:40,849 DEBUG [MemStoreFlusher.4] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.4; compaction_queue=(0:5301), split_queue=0, merge_queue=0
2014-11-25 13:36:40,857 INFO  [MemStoreFlusher.20] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=209.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/.tmp/913d1b5b69d84f08b2d760c22e9dd9b8
2014-11-25 13:36:40,863 DEBUG [MemStoreFlusher.20] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/.tmp/913d1b5b69d84f08b2d760c22e9dd9b8 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/913d1b5b69d84f08b2d760c22e9dd9b8
2014-11-25 13:36:40,868 INFO  [MemStoreFlusher.20] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/913d1b5b69d84f08b2d760c22e9dd9b8, entries=764250, sequenceid=49579, filesize=113.9 M
2014-11-25 13:36:40,868 INFO  [MemStoreFlusher.20] regionserver.HRegion: Finished memstore flush of ~209.9 M/220097920, currentsize=0/0 for region usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952. in 10761ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:40,868 DEBUG [MemStoreFlusher.20] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.20; compaction_queue=(0:5302), split_queue=0, merge_queue=0
2014-11-25 13:36:41,654 INFO  [MemStoreFlusher.2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=211.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/.tmp/bfaa679be4524d3f9065696c23bef502
2014-11-25 13:36:41,663 DEBUG [MemStoreFlusher.2] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/.tmp/bfaa679be4524d3f9065696c23bef502 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/bfaa679be4524d3f9065696c23bef502
2014-11-25 13:36:41,665 INFO  [MemStoreFlusher.36] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49577, memsize=211.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/.tmp/24519f719df74abebab74575ef5091d5
2014-11-25 13:36:41,668 INFO  [MemStoreFlusher.34] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=210.3 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/.tmp/0a158b9a42624ca4a9ae9963a9f3b998
2014-11-25 13:36:41,670 INFO  [MemStoreFlusher.2] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a8d0d190cb61bd1bf54306b4bc472da1/family/bfaa679be4524d3f9065696c23bef502, entries=768690, sequenceid=49579, filesize=114.6 M
2014-11-25 13:36:41,671 INFO  [MemStoreFlusher.2] regionserver.HRegion: Finished memstore flush of ~211.1 M/221376000, currentsize=0/0 for region usertable2,user5139,1416889268210.a8d0d190cb61bd1bf54306b4bc472da1. in 11564ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:41,671 DEBUG [MemStoreFlusher.2] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.2; compaction_queue=(0:5303), split_queue=0, merge_queue=0
2014-11-25 13:36:41,673 DEBUG [MemStoreFlusher.36] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/.tmp/24519f719df74abebab74575ef5091d5 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/24519f719df74abebab74575ef5091d5
2014-11-25 13:36:41,676 DEBUG [MemStoreFlusher.34] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/.tmp/0a158b9a42624ca4a9ae9963a9f3b998 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/0a158b9a42624ca4a9ae9963a9f3b998
2014-11-25 13:36:41,679 INFO  [MemStoreFlusher.36] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/24519f719df74abebab74575ef5091d5, entries=771570, sequenceid=49577, filesize=115.0 M
2014-11-25 13:36:41,679 INFO  [MemStoreFlusher.36] regionserver.HRegion: Finished memstore flush of ~211.9 M/222205840, currentsize=0/0 for region usertable2,user5319,1416889268210.c2e76bfcf0ee452319788ce49186a339. in 11572ms, sequenceid=49577, compaction requested=true
2014-11-25 13:36:41,680 DEBUG [MemStoreFlusher.36] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.36; compaction_queue=(0:5304), split_queue=0, merge_queue=0
2014-11-25 13:36:41,683 INFO  [MemStoreFlusher.34] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/0a158b9a42624ca4a9ae9963a9f3b998, entries=765840, sequenceid=49579, filesize=114.2 M
2014-11-25 13:36:41,683 INFO  [MemStoreFlusher.34] regionserver.HRegion: Finished memstore flush of ~210.3 M/220556160, currentsize=0/0 for region usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b. in 11576ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:41,683 DEBUG [MemStoreFlusher.34] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.34; compaction_queue=(0:5305), split_queue=0, merge_queue=0
2014-11-25 13:36:41,849 INFO  [MemStoreFlusher.27] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49576, memsize=204.1 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/.tmp/8b13072e0c484e5f8b187df141a0015b
2014-11-25 13:36:41,859 DEBUG [MemStoreFlusher.27] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/.tmp/8b13072e0c484e5f8b187df141a0015b as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/family/8b13072e0c484e5f8b187df141a0015b
2014-11-25 13:36:41,869 INFO  [MemStoreFlusher.27] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/family/8b13072e0c484e5f8b187df141a0015b, entries=743290, sequenceid=49576, filesize=110.8 M
2014-11-25 13:36:41,869 INFO  [MemStoreFlusher.27] regionserver.HRegion: Finished memstore flush of ~204.1 M/214061600, currentsize=0/0 for region usertable2,,1416889268210.a3d8de2e3c77996d502684577800bf7f. in 7840ms, sequenceid=49576, compaction requested=true
2014-11-25 13:36:41,869 DEBUG [MemStoreFlusher.27] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.27; compaction_queue=(0:5306), split_queue=0, merge_queue=0
2014-11-25 13:36:41,925 INFO  [MemStoreFlusher.17] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=210.3 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/.tmp/08df055b9d8744a0a4633d2ac3dd3d4d
2014-11-25 13:36:41,943 DEBUG [MemStoreFlusher.17] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/.tmp/08df055b9d8744a0a4633d2ac3dd3d4d as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/08df055b9d8744a0a4633d2ac3dd3d4d
2014-11-25 13:36:41,954 INFO  [MemStoreFlusher.17] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/08df055b9d8744a0a4633d2ac3dd3d4d, entries=765570, sequenceid=49578, filesize=114.1 M
2014-11-25 13:36:41,954 INFO  [MemStoreFlusher.17] regionserver.HRegion: Finished memstore flush of ~210.3 M/220477040, currentsize=0/0 for region usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb. in 8466ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:41,954 DEBUG [MemStoreFlusher.17] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.17; compaction_queue=(0:5307), split_queue=0, merge_queue=0
2014-11-25 13:36:42,121 INFO  [MemStoreFlusher.37] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49577, memsize=212.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/.tmp/51cd96bfb7cc4bc0ae525d138b4e4be8
2014-11-25 13:36:42,128 DEBUG [MemStoreFlusher.37] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/.tmp/51cd96bfb7cc4bc0ae525d138b4e4be8 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/51cd96bfb7cc4bc0ae525d138b4e4be8
2014-11-25 13:36:42,129 INFO  [MemStoreFlusher.7] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49576, memsize=212.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/.tmp/6d3b418ccd7c456784cdb1821fe45174
2014-11-25 13:36:42,132 INFO  [MemStoreFlusher.21] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49577, memsize=212.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/.tmp/c8676fb9265b49459f71bdcc2dfe35f6
2014-11-25 13:36:42,134 INFO  [MemStoreFlusher.3] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49581, memsize=212.3 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/.tmp/5f4e412a79694c1d898d0fad78b9b9e3
2014-11-25 13:36:42,136 DEBUG [MemStoreFlusher.7] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/.tmp/6d3b418ccd7c456784cdb1821fe45174 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/6d3b418ccd7c456784cdb1821fe45174
2014-11-25 13:36:42,136 INFO  [MemStoreFlusher.37] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/51cd96bfb7cc4bc0ae525d138b4e4be8, entries=771990, sequenceid=49577, filesize=115.1 M
2014-11-25 13:36:42,137 INFO  [MemStoreFlusher.37] regionserver.HRegion: Finished memstore flush of ~212.0 M/222327440, currentsize=0/0 for region usertable2,user3519,1416889268210.fc6c0c446a315daf2015d57ba81babe0. in 12008ms, sequenceid=49577, compaction requested=true
2014-11-25 13:36:42,137 DEBUG [MemStoreFlusher.37] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.37; compaction_queue=(0:5308), split_queue=0, merge_queue=0
2014-11-25 13:36:42,244 DEBUG [MemStoreFlusher.21] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/.tmp/c8676fb9265b49459f71bdcc2dfe35f6 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/c8676fb9265b49459f71bdcc2dfe35f6
2014-11-25 13:36:42,246 DEBUG [MemStoreFlusher.3] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/.tmp/5f4e412a79694c1d898d0fad78b9b9e3 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/family/5f4e412a79694c1d898d0fad78b9b9e3
2014-11-25 13:36:42,255 INFO  [MemStoreFlusher.32] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=211.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/.tmp/e6a6f4d6d8974f338a0826e0f4718fba
2014-11-25 13:36:42,256 INFO  [MemStoreFlusher.7] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/6d3b418ccd7c456784cdb1821fe45174, entries=775300, sequenceid=49576, filesize=115.6 M
2014-11-25 13:36:42,256 INFO  [MemStoreFlusher.7] regionserver.HRegion: Finished memstore flush of ~212.9 M/223280880, currentsize=0/0 for region usertable2,user6579,1416889268210.bff12d4267dd884829eb5659611c40f9. in 8757ms, sequenceid=49576, compaction requested=true
2014-11-25 13:36:42,256 DEBUG [MemStoreFlusher.7] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.7; compaction_queue=(0:5309), split_queue=0, merge_queue=0
2014-11-25 13:36:42,257 INFO  [MemStoreFlusher.21] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/c8676fb9265b49459f71bdcc2dfe35f6, entries=772680, sequenceid=49577, filesize=115.2 M
2014-11-25 13:36:42,257 INFO  [MemStoreFlusher.21] regionserver.HRegion: Finished memstore flush of ~212.2 M/222526000, currentsize=0/0 for region usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49. in 12128ms, sequenceid=49577, compaction requested=true
2014-11-25 13:36:42,257 DEBUG [MemStoreFlusher.21] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.21; compaction_queue=(0:5310), split_queue=0, merge_queue=0
2014-11-25 13:36:42,261 INFO  [MemStoreFlusher.3] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1c65748e65f11456ce7b67d20bff3966/family/5f4e412a79694c1d898d0fad78b9b9e3, entries=772880, sequenceid=49581, filesize=115.2 M
2014-11-25 13:36:42,261 INFO  [MemStoreFlusher.3] regionserver.HRegion: Finished memstore flush of ~212.3 M/222583360, currentsize=0/0 for region usertable2,user4779,1416889268210.1c65748e65f11456ce7b67d20bff3966. in 12121ms, sequenceid=49581, compaction requested=true
2014-11-25 13:36:42,262 DEBUG [MemStoreFlusher.3] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.3; compaction_queue=(0:5311), split_queue=0, merge_queue=0
2014-11-25 13:36:42,305 DEBUG [MemStoreFlusher.32] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/.tmp/e6a6f4d6d8974f338a0826e0f4718fba as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/e6a6f4d6d8974f338a0826e0f4718fba
2014-11-25 13:36:42,310 INFO  [MemStoreFlusher.32] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e452c53f69cba13d15de325c057fb970/family/e6a6f4d6d8974f338a0826e0f4718fba, entries=770710, sequenceid=49578, filesize=114.9 M
2014-11-25 13:36:42,311 INFO  [MemStoreFlusher.32] regionserver.HRegion: Finished memstore flush of ~211.7 M/221958320, currentsize=0/0 for region usertable2,user6219,1416889268210.e452c53f69cba13d15de325c057fb970. in 8309ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:42,311 DEBUG [MemStoreFlusher.32] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.32; compaction_queue=(0:5312), split_queue=0, merge_queue=0
2014-11-25 13:36:42,406 INFO  [MemStoreFlusher.26] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=211.5 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/.tmp/18466bfa961a47369f2105b9ffa64507
2014-11-25 13:36:42,413 DEBUG [MemStoreFlusher.26] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/.tmp/18466bfa961a47369f2105b9ffa64507 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/18466bfa961a47369f2105b9ffa64507
2014-11-25 13:36:42,418 INFO  [MemStoreFlusher.26] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/18466bfa961a47369f2105b9ffa64507, entries=770060, sequenceid=49579, filesize=114.8 M
2014-11-25 13:36:42,419 INFO  [MemStoreFlusher.26] regionserver.HRegion: Finished memstore flush of ~211.5 M/221771760, currentsize=0/0 for region usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4. in 8163ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:42,419 DEBUG [MemStoreFlusher.26] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.26; compaction_queue=(0:5313), split_queue=0, merge_queue=0
2014-11-25 13:36:42,581 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/.tmp/b2c182fb869f492693a91ca37aeefc9e as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/family/b2c182fb869f492693a91ca37aeefc9e
2014-11-25 13:36:42,618 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:36:42,623 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/family/a387845662ad47abac0adf8dde8ef0fb, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/family/a387845662ad47abac0adf8dde8ef0fb
2014-11-25 13:36:42,625 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/family/423dd35d93864e49bf1e554a81837009, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/family/423dd35d93864e49bf1e554a81837009
2014-11-25 13:36:42,627 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/family/b83dc511d9f24e3cbbdfc6d877d6d7f4, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5f25bd0630c80f4e811af5f6488c5a89/family/b83dc511d9f24e3cbbdfc6d877d6d7f4
2014-11-25 13:36:42,627 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user1989,1416889268210.5f25bd0630c80f4e811af5f6488c5a89. into b2c182fb869f492693a91ca37aeefc9e(size=166.5 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 13sec to execute.
2014-11-25 13:36:42,627 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user1989,1416889268210.5f25bd0630c80f4e811af5f6488c5a89., storeName=family, fileCount=3, fileSize=167.7 M, priority=-4, time=5780413412252808; duration=13sec
2014-11-25 13:36:42,627 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5314), split_queue=0, merge_queue=0
2014-11-25 13:36:42,627 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5314), split_queue=0, merge_queue=0
2014-11-25 13:36:42,627 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:36:42,627 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 179404179 starting at candidate #2 after considering 236 permutations with 227 in ratio
2014-11-25 13:36:42,627 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: cc10fb31d8cc1e28a698092d6c1a5416 - family: Initiating minor compaction
2014-11-25 13:36:42,627 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user1539,1416889268210.cc10fb31d8cc1e28a698092d6c1a5416.
2014-11-25 13:36:42,627 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user1539,1416889268210.cc10fb31d8cc1e28a698092d6c1a5416. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/.tmp, totalSize=171.1 M
2014-11-25 13:36:42,628 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/family/5d3fa0015fbf4fc2bbfd65d26918f89c, keycount=36260, bloomtype=ROW, size=54.1 M, encoding=NONE, seqNum=11449
2014-11-25 13:36:42,628 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/family/a04972d688a44db7b72391b4f87fe2cd, keycount=38534, bloomtype=ROW, size=57.4 M, encoding=NONE, seqNum=12209
2014-11-25 13:36:42,628 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/family/7a6f4952a59a45d19d2004878d997631, keycount=39969, bloomtype=ROW, size=59.6 M, encoding=NONE, seqNum=12995
2014-11-25 13:36:43,371 INFO  [MemStoreFlusher.11] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49580, memsize=210.6 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/.tmp/6cf1e783a357416299444e2ddd3d9623
2014-11-25 13:36:43,376 DEBUG [MemStoreFlusher.11] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/.tmp/6cf1e783a357416299444e2ddd3d9623 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/6cf1e783a357416299444e2ddd3d9623
2014-11-25 13:36:43,381 INFO  [MemStoreFlusher.11] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/6cf1e783a357416299444e2ddd3d9623, entries=766700, sequenceid=49580, filesize=114.3 M
2014-11-25 13:36:43,381 INFO  [MemStoreFlusher.11] regionserver.HRegion: Finished memstore flush of ~210.6 M/220804240, currentsize=0/0 for region usertable2,user3789,1416889268210.4cbd9216f88e34160a388d0cd31c622c. in 9444ms, sequenceid=49580, compaction requested=true
2014-11-25 13:36:43,381 DEBUG [MemStoreFlusher.11] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.11; compaction_queue=(0:5314), split_queue=0, merge_queue=0
2014-11-25 13:36:45,808 INFO  [MemStoreFlusher.19] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=206.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/.tmp/d11c46dfaa7a4d2c9465beb127191bc8
2014-11-25 13:36:45,815 DEBUG [MemStoreFlusher.19] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/.tmp/d11c46dfaa7a4d2c9465beb127191bc8 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/d11c46dfaa7a4d2c9465beb127191bc8
2014-11-25 13:36:45,821 INFO  [MemStoreFlusher.18] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49580, memsize=207.0 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bbe246dd324639d9e0eb2b0788d4067c/.tmp/c93dab68313940e586590b29592dc575
2014-11-25 13:36:45,822 INFO  [MemStoreFlusher.19] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/d11c46dfaa7a4d2c9465beb127191bc8, entries=753190, sequenceid=49578, filesize=112.3 M
2014-11-25 13:36:45,822 INFO  [MemStoreFlusher.19] regionserver.HRegion: Finished memstore flush of ~206.9 M/216912320, currentsize=0/0 for region usertable2,user1449,1416889268210.952a6132a4e977be00a90f6ac7e69235. in 11390ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:45,823 DEBUG [MemStoreFlusher.19] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.19; compaction_queue=(0:5315), split_queue=0, merge_queue=0
2014-11-25 13:36:45,823 INFO  [MemStoreFlusher.15] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=210.9 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/.tmp/2cf800d28a0b496f9b339d72e946b9ca
2014-11-25 13:36:45,830 DEBUG [MemStoreFlusher.15] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/.tmp/2cf800d28a0b496f9b339d72e946b9ca as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/family/2cf800d28a0b496f9b339d72e946b9ca
2014-11-25 13:36:45,831 DEBUG [MemStoreFlusher.18] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bbe246dd324639d9e0eb2b0788d4067c/.tmp/c93dab68313940e586590b29592dc575 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bbe246dd324639d9e0eb2b0788d4067c/family/c93dab68313940e586590b29592dc575
2014-11-25 13:36:45,837 INFO  [MemStoreFlusher.23] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=209.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/.tmp/fb3fdcd11efb48d5a08310b35f49851e
2014-11-25 13:36:45,837 INFO  [MemStoreFlusher.15] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/family/2cf800d28a0b496f9b339d72e946b9ca, entries=767820, sequenceid=49579, filesize=114.5 M
2014-11-25 13:36:45,837 INFO  [MemStoreFlusher.15] regionserver.HRegion: Finished memstore flush of ~210.9 M/221126080, currentsize=0/0 for region usertable2,user5589,1416889268210.cfb348ee570fa731ba8caa85099a1bd5. in 11745ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:45,837 INFO  [MemStoreFlusher.30] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49580, memsize=209.2 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/.tmp/49b1689a7e354cb9b7020fc0631d3b14
2014-11-25 13:36:45,838 DEBUG [MemStoreFlusher.15] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.15; compaction_queue=(0:5316), split_queue=0, merge_queue=0
2014-11-25 13:36:45,839 INFO  [MemStoreFlusher.18] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bbe246dd324639d9e0eb2b0788d4067c/family/c93dab68313940e586590b29592dc575, entries=753600, sequenceid=49580, filesize=112.4 M
2014-11-25 13:36:45,839 INFO  [MemStoreFlusher.18] regionserver.HRegion: Finished memstore flush of ~207.0 M/217029840, currentsize=0/0 for region usertable2,user1269,1416889268210.bbe246dd324639d9e0eb2b0788d4067c. in 11353ms, sequenceid=49580, compaction requested=true
2014-11-25 13:36:45,839 DEBUG [MemStoreFlusher.18] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.18; compaction_queue=(0:5317), split_queue=0, merge_queue=0
2014-11-25 13:36:45,849 DEBUG [MemStoreFlusher.23] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/.tmp/fb3fdcd11efb48d5a08310b35f49851e as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/family/fb3fdcd11efb48d5a08310b35f49851e
2014-11-25 13:36:45,850 INFO  [MemStoreFlusher.33] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=209.7 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/.tmp/752ff11cd93346a18bec54d731dee35d
2014-11-25 13:36:45,850 DEBUG [MemStoreFlusher.30] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/.tmp/49b1689a7e354cb9b7020fc0631d3b14 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/49b1689a7e354cb9b7020fc0631d3b14
2014-11-25 13:36:45,855 INFO  [MemStoreFlusher.23] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/family/fb3fdcd11efb48d5a08310b35f49851e, entries=762350, sequenceid=49578, filesize=113.7 M
2014-11-25 13:36:45,856 INFO  [MemStoreFlusher.23] regionserver.HRegion: Finished memstore flush of ~209.4 M/219551520, currentsize=0/0 for region usertable2,user4599,1416889268210.eead33f80ffa1e642cc147c38794f39c. in 12021ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:45,856 DEBUG [MemStoreFlusher.23] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.23; compaction_queue=(0:5318), split_queue=0, merge_queue=0
2014-11-25 13:36:45,857 DEBUG [MemStoreFlusher.33] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/.tmp/752ff11cd93346a18bec54d731dee35d as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/752ff11cd93346a18bec54d731dee35d
2014-11-25 13:36:45,857 INFO  [MemStoreFlusher.24] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=211.3 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/.tmp/6b9c02acc45745e4ac0e481628685914
2014-11-25 13:36:45,860 INFO  [MemStoreFlusher.30] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/49b1689a7e354cb9b7020fc0631d3b14, entries=761560, sequenceid=49580, filesize=113.5 M
2014-11-25 13:36:45,861 INFO  [MemStoreFlusher.30] regionserver.HRegion: Finished memstore flush of ~209.2 M/219323520, currentsize=0/0 for region usertable2,user2529,1416889268210.b451134c60b1dc7cf526e81f6db2c433. in 11754ms, sequenceid=49580, compaction requested=true
2014-11-25 13:36:45,861 DEBUG [MemStoreFlusher.30] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.30; compaction_queue=(0:5319), split_queue=0, merge_queue=0
2014-11-25 13:36:45,867 INFO  [MemStoreFlusher.33] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/09a9193727ffcc63b8838a6c82b049a5/family/752ff11cd93346a18bec54d731dee35d, entries=763460, sequenceid=49579, filesize=113.8 M
2014-11-25 13:36:45,868 INFO  [MemStoreFlusher.33] regionserver.HRegion: Finished memstore flush of ~209.7 M/219870560, currentsize=0/0 for region usertable2,user3159,1416889268210.09a9193727ffcc63b8838a6c82b049a5. in 11798ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:45,868 DEBUG [MemStoreFlusher.33] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.33; compaction_queue=(0:5320), split_queue=0, merge_queue=0
2014-11-25 13:36:45,905 DEBUG [MemStoreFlusher.24] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/.tmp/6b9c02acc45745e4ac0e481628685914 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/family/6b9c02acc45745e4ac0e481628685914
2014-11-25 13:36:45,912 INFO  [MemStoreFlusher.24] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/family/6b9c02acc45745e4ac0e481628685914, entries=769210, sequenceid=49578, filesize=114.7 M
2014-11-25 13:36:45,912 INFO  [MemStoreFlusher.24] regionserver.HRegion: Finished memstore flush of ~211.3 M/221526560, currentsize=0/0 for region usertable2,user4239,1416889268210.e521da13cf88c7e5aa481035feae21e5. in 11690ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:45,912 DEBUG [MemStoreFlusher.24] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.24; compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:36:46,212 INFO  [MemStoreFlusher.10] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49580, memsize=211.3 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/.tmp/ccb3e6dfabd5421d983fc7e5782e539e
2014-11-25 13:36:46,215 INFO  [MemStoreFlusher.39] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=207.4 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/.tmp/6b171efc04a3425a95cd4a446927be49
2014-11-25 13:36:46,218 DEBUG [MemStoreFlusher.10] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/.tmp/ccb3e6dfabd5421d983fc7e5782e539e as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/family/ccb3e6dfabd5421d983fc7e5782e539e
2014-11-25 13:36:46,220 DEBUG [MemStoreFlusher.39] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/.tmp/6b171efc04a3425a95cd4a446927be49 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/6b171efc04a3425a95cd4a446927be49
2014-11-25 13:36:46,222 INFO  [MemStoreFlusher.10] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/family/ccb3e6dfabd5421d983fc7e5782e539e, entries=769290, sequenceid=49580, filesize=114.7 M
2014-11-25 13:36:46,223 INFO  [MemStoreFlusher.10] regionserver.HRegion: Finished memstore flush of ~211.3 M/221549600, currentsize=0/0 for region usertable2,user4689,1416889268210.f163e7c364cbfc321d89062a8ec9a958. in 11990ms, sequenceid=49580, compaction requested=true
2014-11-25 13:36:46,223 DEBUG [MemStoreFlusher.10] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.10; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:36:46,226 INFO  [MemStoreFlusher.39] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/6b171efc04a3425a95cd4a446927be49, entries=755250, sequenceid=49578, filesize=112.6 M
2014-11-25 13:36:46,226 INFO  [MemStoreFlusher.39] regionserver.HRegion: Finished memstore flush of ~207.4 M/217505760, currentsize=0/0 for region usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568. in 11909ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:46,226 DEBUG [MemStoreFlusher.39] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.39; compaction_queue=(0:5323), split_queue=0, merge_queue=0
2014-11-25 13:36:46,347 INFO  [MemStoreFlusher.13] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49578, memsize=209.6 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/.tmp/1ae844b34eff4e38b4db9aeeb4adc0f5
2014-11-25 13:36:46,352 INFO  [MemStoreFlusher.9] regionserver.DefaultStoreFlusher: Flushed, sequenceid=49579, memsize=186.8 M, hasBloomFilter=true, into tmp file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/.tmp/594dad7db6d74133a118876a0277f885
2014-11-25 13:36:46,353 DEBUG [MemStoreFlusher.13] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/.tmp/1ae844b34eff4e38b4db9aeeb4adc0f5 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/family/1ae844b34eff4e38b4db9aeeb4adc0f5
2014-11-25 13:36:46,358 DEBUG [MemStoreFlusher.9] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/.tmp/594dad7db6d74133a118876a0277f885 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/594dad7db6d74133a118876a0277f885
2014-11-25 13:36:46,359 INFO  [MemStoreFlusher.13] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/family/1ae844b34eff4e38b4db9aeeb4adc0f5, entries=763150, sequenceid=49578, filesize=113.8 M
2014-11-25 13:36:46,359 INFO  [MemStoreFlusher.13] regionserver.HRegion: Finished memstore flush of ~209.6 M/219780960, currentsize=0/0 for region usertable2,user2709,1416889268210.fd0aae1076bc05c8db51754294c21e38. in 11988ms, sequenceid=49578, compaction requested=true
2014-11-25 13:36:46,359 DEBUG [MemStoreFlusher.13] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.13; compaction_queue=(0:5324), split_queue=0, merge_queue=0
2014-11-25 13:36:46,363 INFO  [MemStoreFlusher.9] regionserver.HStore: Added hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/594dad7db6d74133a118876a0277f885, entries=680230, sequenceid=49579, filesize=101.4 M
2014-11-25 13:36:46,363 INFO  [MemStoreFlusher.9] regionserver.HRegion: Finished memstore flush of ~186.8 M/195900720, currentsize=0/0 for region usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779. in 5571ms, sequenceid=49579, compaction requested=true
2014-11-25 13:36:46,364 DEBUG [MemStoreFlusher.9] regionserver.CompactSplitThread: Small Compaction requested: system; Because: MemStoreFlusher.9; compaction_queue=(0:5325), split_queue=0, merge_queue=0
2014-11-25 13:36:48,073 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/.tmp/2592c1c78e5e43a7a25569c866583f27 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/family/2592c1c78e5e43a7a25569c866583f27
2014-11-25 13:36:48,078 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:36:48,091 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/family/5d3fa0015fbf4fc2bbfd65d26918f89c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/family/5d3fa0015fbf4fc2bbfd65d26918f89c
2014-11-25 13:36:48,108 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/family/a04972d688a44db7b72391b4f87fe2cd, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/family/a04972d688a44db7b72391b4f87fe2cd
2014-11-25 13:36:48,123 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/family/7a6f4952a59a45d19d2004878d997631, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/cc10fb31d8cc1e28a698092d6c1a5416/family/7a6f4952a59a45d19d2004878d997631
2014-11-25 13:36:48,123 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user1539,1416889268210.cc10fb31d8cc1e28a698092d6c1a5416. into 2592c1c78e5e43a7a25569c866583f27(size=169.9 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 5sec to execute.
2014-11-25 13:36:48,123 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user1539,1416889268210.cc10fb31d8cc1e28a698092d6c1a5416., storeName=family, fileCount=3, fileSize=171.1 M, priority=-5, time=5780426850218507; duration=5sec
2014-11-25 13:36:48,123 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:36:48,123 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:36:48,123 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:36:48,123 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 240759196 starting at candidate #8 after considering 236 permutations with 202 in ratio
2014-11-25 13:36:48,123 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 3ec2e06a3605856a1dd62083096f2771 - family: Initiating minor compaction
2014-11-25 13:36:48,124 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user4959,1416889268210.3ec2e06a3605856a1dd62083096f2771.
2014-11-25 13:36:48,124 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user4959,1416889268210.3ec2e06a3605856a1dd62083096f2771. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/.tmp, totalSize=229.6 M
2014-11-25 13:36:48,124 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/6a549dbebd144ac28d5253607460b4f0, keycount=38063, bloomtype=ROW, size=56.7 M, encoding=NONE, seqNum=19271
2014-11-25 13:36:48,124 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/507f6b1edfa2416a8ef8fa7808f9ea28, keycount=41698, bloomtype=ROW, size=62.2 M, encoding=NONE, seqNum=20089
2014-11-25 13:36:48,124 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/7124ed3604a14cf3a4928cb7ac845169, keycount=37533, bloomtype=ROW, size=56.0 M, encoding=NONE, seqNum=20830
2014-11-25 13:36:48,124 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/b06df918f9574bc3be8109e0fbfec172, keycount=36719, bloomtype=ROW, size=54.7 M, encoding=NONE, seqNum=21550
2014-11-25 13:36:52,501 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/.tmp/3e865733b3b34540ab0749d7c97bd6db as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/3e865733b3b34540ab0749d7c97bd6db
2014-11-25 13:36:52,507 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:36:52,513 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/6a549dbebd144ac28d5253607460b4f0, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/6a549dbebd144ac28d5253607460b4f0
2014-11-25 13:36:52,515 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/507f6b1edfa2416a8ef8fa7808f9ea28, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/507f6b1edfa2416a8ef8fa7808f9ea28
2014-11-25 13:36:52,517 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/7124ed3604a14cf3a4928cb7ac845169, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/7124ed3604a14cf3a4928cb7ac845169
2014-11-25 13:36:52,518 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/b06df918f9574bc3be8109e0fbfec172, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/3ec2e06a3605856a1dd62083096f2771/family/b06df918f9574bc3be8109e0fbfec172
2014-11-25 13:36:52,519 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user4959,1416889268210.3ec2e06a3605856a1dd62083096f2771. into 3e865733b3b34540ab0749d7c97bd6db(size=228.1 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:36:52,519 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user4959,1416889268210.3ec2e06a3605856a1dd62083096f2771., storeName=family, fileCount=4, fileSize=229.6 M, priority=-5, time=5780432346401335; duration=4sec
2014-11-25 13:36:52,519 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:36:52,519 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:36:52,519 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:36:52,519 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 177663102 starting at candidate #20 after considering 236 permutations with 178 in ratio
2014-11-25 13:36:52,519 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: d4808c10301633d1d492aef55f9f9fb0 - family: Initiating minor compaction
2014-11-25 13:36:52,519 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user6039,1416889268210.d4808c10301633d1d492aef55f9f9fb0.
2014-11-25 13:36:52,519 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user6039,1416889268210.d4808c10301633d1d492aef55f9f9fb0. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/.tmp, totalSize=169.4 M
2014-11-25 13:36:52,520 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/family/79cdd7c3bdcc45a2942b02b23af8a7ff, keycount=37069, bloomtype=ROW, size=55.3 M, encoding=NONE, seqNum=30997
2014-11-25 13:36:52,520 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/family/6bb07998efb94a62be280d930af36d97, keycount=39390, bloomtype=ROW, size=58.7 M, encoding=NONE, seqNum=31771
2014-11-25 13:36:52,520 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/family/482c25008c554b17a7a87df38aba9923, keycount=37189, bloomtype=ROW, size=55.4 M, encoding=NONE, seqNum=32503
2014-11-25 13:36:56,464 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/.tmp/80303e17717b410faa57b01bcfb07525 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/family/80303e17717b410faa57b01bcfb07525
2014-11-25 13:36:56,471 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:36:56,477 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/family/79cdd7c3bdcc45a2942b02b23af8a7ff, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/family/79cdd7c3bdcc45a2942b02b23af8a7ff
2014-11-25 13:36:56,479 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/family/6bb07998efb94a62be280d930af36d97, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/family/6bb07998efb94a62be280d930af36d97
2014-11-25 13:36:56,481 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/family/482c25008c554b17a7a87df38aba9923, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/d4808c10301633d1d492aef55f9f9fb0/family/482c25008c554b17a7a87df38aba9923
2014-11-25 13:36:56,481 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user6039,1416889268210.d4808c10301633d1d492aef55f9f9fb0. into 80303e17717b410faa57b01bcfb07525(size=168.3 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:36:56,481 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user6039,1416889268210.d4808c10301633d1d492aef55f9f9fb0., storeName=family, fileCount=3, fileSize=169.4 M, priority=-5, time=5780436741875587; duration=3sec
2014-11-25 13:36:56,481 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:36:56,481 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:36:56,481 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:36:56,482 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 184386194 starting at candidate #17 after considering 236 permutations with 204 in ratio
2014-11-25 13:36:56,482 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: b1d10532684e17b8d5ab026af3486dc5 - family: Initiating minor compaction
2014-11-25 13:36:56,482 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5.
2014-11-25 13:36:56,482 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/.tmp, totalSize=175.8 M
2014-11-25 13:36:56,482 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/65a5f0c3d95c4739a16afdbde8e97396, keycount=39944, bloomtype=ROW, size=59.5 M, encoding=NONE, seqNum=25112
2014-11-25 13:36:56,482 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/bcdf877ae0f74251acdde4baf13396f0, keycount=41400, bloomtype=ROW, size=61.7 M, encoding=NONE, seqNum=25926
2014-11-25 13:36:56,482 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/9c8cf98b02c84f95adfc3fc7c15a17ee, keycount=36610, bloomtype=ROW, size=54.6 M, encoding=NONE, seqNum=26647
2014-11-25 13:36:59,981 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/.tmp/35e77f2a4db54d1f97d4537f006273c8 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/35e77f2a4db54d1f97d4537f006273c8
2014-11-25 13:36:59,987 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:36:59,994 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/65a5f0c3d95c4739a16afdbde8e97396, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/65a5f0c3d95c4739a16afdbde8e97396
2014-11-25 13:36:59,996 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/bcdf877ae0f74251acdde4baf13396f0, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/bcdf877ae0f74251acdde4baf13396f0
2014-11-25 13:36:59,997 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/9c8cf98b02c84f95adfc3fc7c15a17ee, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/9c8cf98b02c84f95adfc3fc7c15a17ee
2014-11-25 13:36:59,998 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5. into 35e77f2a4db54d1f97d4537f006273c8(size=174.7 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:36:59,998 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5., storeName=family, fileCount=3, fileSize=175.8 M, priority=-5, time=5780440704509977; duration=3sec
2014-11-25 13:36:59,998 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:36:59,998 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:36:59,998 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:36:59,998 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 187093899 starting at candidate #1 after considering 236 permutations with 178 in ratio
2014-11-25 13:36:59,998 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 66f19c7f25bc31928ead99dff847aa7f - family: Initiating minor compaction
2014-11-25 13:36:59,998 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user9099,1416889268210.66f19c7f25bc31928ead99dff847aa7f.
2014-11-25 13:36:59,998 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user9099,1416889268210.66f19c7f25bc31928ead99dff847aa7f. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/.tmp, totalSize=178.4 M
2014-11-25 13:36:59,998 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/family/dad8302027f7470fba148182399f9007, keycount=39476, bloomtype=ROW, size=58.8 M, encoding=NONE, seqNum=4378
2014-11-25 13:36:59,998 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/family/975e76cd128440c19b5eee2fe6d37420, keycount=44029, bloomtype=ROW, size=65.6 M, encoding=NONE, seqNum=5244
2014-11-25 13:36:59,998 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/family/884e0e7e27e04891b4e849ee83714216, keycount=36183, bloomtype=ROW, size=53.9 M, encoding=NONE, seqNum=5955
2014-11-25 13:37:06,127 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/.tmp/210b00a04e644317a6bffdbbef366509 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/family/210b00a04e644317a6bffdbbef366509
2014-11-25 13:37:06,132 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:06,137 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/family/dad8302027f7470fba148182399f9007, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/family/dad8302027f7470fba148182399f9007
2014-11-25 13:37:06,139 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/family/975e76cd128440c19b5eee2fe6d37420, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/family/975e76cd128440c19b5eee2fe6d37420
2014-11-25 13:37:06,141 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/family/884e0e7e27e04891b4e849ee83714216, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/66f19c7f25bc31928ead99dff847aa7f/family/884e0e7e27e04891b4e849ee83714216
2014-11-25 13:37:06,141 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user9099,1416889268210.66f19c7f25bc31928ead99dff847aa7f. into 210b00a04e644317a6bffdbbef366509(size=177.2 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 6sec to execute.
2014-11-25 13:37:06,141 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user9099,1416889268210.66f19c7f25bc31928ead99dff847aa7f., storeName=family, fileCount=3, fileSize=178.4 M, priority=-5, time=5780444220862910; duration=6sec
2014-11-25 13:37:06,141 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:06,141 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:06,141 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:06,141 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 182229929 starting at candidate #12 after considering 236 permutations with 187 in ratio
2014-11-25 13:37:06,141 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 4b47471f1507edfc343dfd2b4599e5cd - family: Initiating minor compaction
2014-11-25 13:37:06,141 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user8109,1416889268210.4b47471f1507edfc343dfd2b4599e5cd.
2014-11-25 13:37:06,141 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user8109,1416889268210.4b47471f1507edfc343dfd2b4599e5cd. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/.tmp, totalSize=173.8 M
2014-11-25 13:37:06,141 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/family/a5edf0e5bc2040acae74ddc83d93066a, keycount=39509, bloomtype=ROW, size=58.9 M, encoding=NONE, seqNum=19511
2014-11-25 13:37:06,142 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/family/65c3ae825f8e48949e713587bb2c40c4, keycount=39176, bloomtype=ROW, size=58.4 M, encoding=NONE, seqNum=20282
2014-11-25 13:37:06,142 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/family/6624cd5c43744d34b42f2fa1a548f777, keycount=37888, bloomtype=ROW, size=56.5 M, encoding=NONE, seqNum=21028
2014-11-25 13:37:09,167 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/.tmp/eaedc9764e7b4f6f808c36eb7fedcff6 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/family/eaedc9764e7b4f6f808c36eb7fedcff6
2014-11-25 13:37:09,172 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:09,178 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/family/a5edf0e5bc2040acae74ddc83d93066a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/family/a5edf0e5bc2040acae74ddc83d93066a
2014-11-25 13:37:09,180 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/family/65c3ae825f8e48949e713587bb2c40c4, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/family/65c3ae825f8e48949e713587bb2c40c4
2014-11-25 13:37:09,182 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/family/6624cd5c43744d34b42f2fa1a548f777, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/4b47471f1507edfc343dfd2b4599e5cd/family/6624cd5c43744d34b42f2fa1a548f777
2014-11-25 13:37:09,182 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user8109,1416889268210.4b47471f1507edfc343dfd2b4599e5cd. into eaedc9764e7b4f6f808c36eb7fedcff6(size=172.6 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:37:09,182 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user8109,1416889268210.4b47471f1507edfc343dfd2b4599e5cd., storeName=family, fileCount=3, fileSize=173.8 M, priority=-5, time=5780450364158825; duration=3sec
2014-11-25 13:37:09,182 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:09,182 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:09,182 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:09,182 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 175069381 starting at candidate #20 after considering 236 permutations with 181 in ratio
2014-11-25 13:37:09,182 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: d32041fd1bd5e7014e265b483c173ddc - family: Initiating minor compaction
2014-11-25 13:37:09,183 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user3879,1416889268210.d32041fd1bd5e7014e265b483c173ddc.
2014-11-25 13:37:09,183 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user3879,1416889268210.d32041fd1bd5e7014e265b483c173ddc. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/.tmp, totalSize=167.0 M
2014-11-25 13:37:09,183 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/family/06b83b65bee742e1af356ab567d69e2e, keycount=35580, bloomtype=ROW, size=53.0 M, encoding=NONE, seqNum=30269
2014-11-25 13:37:09,183 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/family/8ba3e92dba44436199e4772e9148b732, keycount=37380, bloomtype=ROW, size=55.7 M, encoding=NONE, seqNum=31001
2014-11-25 13:37:09,183 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/family/99285192c23f41f5a1eaf65da8822eeb, keycount=39027, bloomtype=ROW, size=58.2 M, encoding=NONE, seqNum=31772
2014-11-25 13:37:12,207 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/.tmp/7fe1f7cf85934dd49b8f7cb91347a40b as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/family/7fe1f7cf85934dd49b8f7cb91347a40b
2014-11-25 13:37:12,213 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:12,218 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/family/06b83b65bee742e1af356ab567d69e2e, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/family/06b83b65bee742e1af356ab567d69e2e
2014-11-25 13:37:12,220 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/family/8ba3e92dba44436199e4772e9148b732, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/family/8ba3e92dba44436199e4772e9148b732
2014-11-25 13:37:12,221 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/family/99285192c23f41f5a1eaf65da8822eeb, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/d32041fd1bd5e7014e265b483c173ddc/family/99285192c23f41f5a1eaf65da8822eeb
2014-11-25 13:37:12,222 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user3879,1416889268210.d32041fd1bd5e7014e265b483c173ddc. into 7fe1f7cf85934dd49b8f7cb91347a40b(size=165.8 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:37:12,222 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user3879,1416889268210.d32041fd1bd5e7014e265b483c173ddc., storeName=family, fileCount=3, fileSize=167.0 M, priority=-5, time=5780453405411314; duration=3sec
2014-11-25 13:37:12,222 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:12,222 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:12,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:12,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 176950994 starting at candidate #20 after considering 236 permutations with 181 in ratio
2014-11-25 13:37:12,222 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: ff707032c52bfca061ec7055b315d1ac - family: Initiating minor compaction
2014-11-25 13:37:12,222 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user8919,1416889268210.ff707032c52bfca061ec7055b315d1ac.
2014-11-25 13:37:12,222 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user8919,1416889268210.ff707032c52bfca061ec7055b315d1ac. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/.tmp, totalSize=168.8 M
2014-11-25 13:37:12,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/family/e3c0a543507b41ea8b2c3b688af210f8, keycount=36588, bloomtype=ROW, size=54.5 M, encoding=NONE, seqNum=30974
2014-11-25 13:37:12,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/family/b1790ebab5374f2ca68626acafc7ec9c, keycount=39316, bloomtype=ROW, size=58.6 M, encoding=NONE, seqNum=31746
2014-11-25 13:37:12,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/family/d30478f2d334491dbc5a72c629d01f23, keycount=37288, bloomtype=ROW, size=55.6 M, encoding=NONE, seqNum=32480
2014-11-25 13:37:15,020 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/.tmp/97c9b953de7f4c4ba5b545032cf71632 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/family/97c9b953de7f4c4ba5b545032cf71632
2014-11-25 13:37:15,026 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:15,031 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/family/e3c0a543507b41ea8b2c3b688af210f8, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/family/e3c0a543507b41ea8b2c3b688af210f8
2014-11-25 13:37:15,033 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/family/b1790ebab5374f2ca68626acafc7ec9c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/family/b1790ebab5374f2ca68626acafc7ec9c
2014-11-25 13:37:15,035 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/family/d30478f2d334491dbc5a72c629d01f23, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/ff707032c52bfca061ec7055b315d1ac/family/d30478f2d334491dbc5a72c629d01f23
2014-11-25 13:37:15,035 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user8919,1416889268210.ff707032c52bfca061ec7055b315d1ac. into 97c9b953de7f4c4ba5b545032cf71632(size=167.6 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 2sec to execute.
2014-11-25 13:37:15,035 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user8919,1416889268210.ff707032c52bfca061ec7055b315d1ac., storeName=family, fileCount=3, fileSize=168.8 M, priority=-5, time=5780456444896938; duration=2sec
2014-11-25 13:37:15,035 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:15,035 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:15,035 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:15,035 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 186104406 starting at candidate #8 after considering 236 permutations with 190 in ratio
2014-11-25 13:37:15,035 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: a6f20417c02c380a5937a58b862dfbb8 - family: Initiating minor compaction
2014-11-25 13:37:15,036 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user5769,1416889268210.a6f20417c02c380a5937a58b862dfbb8.
2014-11-25 13:37:15,036 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user5769,1416889268210.a6f20417c02c380a5937a58b862dfbb8. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/.tmp, totalSize=177.5 M
2014-11-25 13:37:15,036 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/family/fca4070c9af5427b9ac4c0610dea1aec, keycount=40684, bloomtype=ROW, size=60.6 M, encoding=NONE, seqNum=16249
2014-11-25 13:37:15,036 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/family/0655ce8bfcaf47e1a6e54b240ff473c8, keycount=35773, bloomtype=ROW, size=53.3 M, encoding=NONE, seqNum=16953
2014-11-25 13:37:15,036 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/family/3e45009cc12443daab48101e79fd195a, keycount=42597, bloomtype=ROW, size=63.5 M, encoding=NONE, seqNum=17791
2014-11-25 13:37:18,969 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/.tmp/5defb34982174cbf84c6d1ee2d2f39a9 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/family/5defb34982174cbf84c6d1ee2d2f39a9
2014-11-25 13:37:18,975 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:18,980 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/family/fca4070c9af5427b9ac4c0610dea1aec, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/family/fca4070c9af5427b9ac4c0610dea1aec
2014-11-25 13:37:18,982 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/family/0655ce8bfcaf47e1a6e54b240ff473c8, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/family/0655ce8bfcaf47e1a6e54b240ff473c8
2014-11-25 13:37:18,984 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/family/3e45009cc12443daab48101e79fd195a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a6f20417c02c380a5937a58b862dfbb8/family/3e45009cc12443daab48101e79fd195a
2014-11-25 13:37:18,984 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user5769,1416889268210.a6f20417c02c380a5937a58b862dfbb8. into 5defb34982174cbf84c6d1ee2d2f39a9(size=176.3 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:37:18,984 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user5769,1416889268210.a6f20417c02c380a5937a58b862dfbb8., storeName=family, fileCount=3, fileSize=177.5 M, priority=-5, time=5780459258379888; duration=3sec
2014-11-25 13:37:18,984 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:18,984 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:18,984 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:18,984 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 175179573 starting at candidate #19 after considering 236 permutations with 182 in ratio
2014-11-25 13:37:18,984 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 4b90977be131e83310321e679b719b06 - family: Initiating minor compaction
2014-11-25 13:37:18,984 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user5679,1416889268210.4b90977be131e83310321e679b719b06.
2014-11-25 13:37:18,984 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user5679,1416889268210.4b90977be131e83310321e679b719b06. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/.tmp, totalSize=167.1 M
2014-11-25 13:37:18,984 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/family/c8acf80a2ef445079e8e41cf41e6542c, keycount=35644, bloomtype=ROW, size=53.1 M, encoding=NONE, seqNum=30267
2014-11-25 13:37:18,984 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/family/e3adaee8d5e34d7aab898ee5527bcce1, keycount=37167, bloomtype=ROW, size=55.4 M, encoding=NONE, seqNum=30998
2014-11-25 13:37:18,984 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/family/5de728568a5b429799d82be02355cf7b, keycount=39246, bloomtype=ROW, size=58.5 M, encoding=NONE, seqNum=31771
2014-11-25 13:37:22,762 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/.tmp/8ce9901c392d4d13adc6675ac4ba7682 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/family/8ce9901c392d4d13adc6675ac4ba7682
2014-11-25 13:37:22,768 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:22,773 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/family/c8acf80a2ef445079e8e41cf41e6542c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/4b90977be131e83310321e679b719b06/family/c8acf80a2ef445079e8e41cf41e6542c
2014-11-25 13:37:22,775 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/family/e3adaee8d5e34d7aab898ee5527bcce1, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/4b90977be131e83310321e679b719b06/family/e3adaee8d5e34d7aab898ee5527bcce1
2014-11-25 13:37:22,777 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4b90977be131e83310321e679b719b06/family/5de728568a5b429799d82be02355cf7b, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/4b90977be131e83310321e679b719b06/family/5de728568a5b429799d82be02355cf7b
2014-11-25 13:37:22,777 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user5679,1416889268210.4b90977be131e83310321e679b719b06. into 8ce9901c392d4d13adc6675ac4ba7682(size=165.9 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:37:22,777 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user5679,1416889268210.4b90977be131e83310321e679b719b06., storeName=family, fileCount=3, fileSize=167.1 M, priority=-5, time=5780463207024056; duration=3sec
2014-11-25 13:37:22,777 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:22,777 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:22,777 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:22,778 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 241009557 starting at candidate #8 after considering 236 permutations with 202 in ratio
2014-11-25 13:37:22,778 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: c2e76bfcf0ee452319788ce49186a339 - family: Initiating minor compaction
2014-11-25 13:37:22,778 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user5319,1416889268210.c2e76bfcf0ee452319788ce49186a339.
2014-11-25 13:37:22,778 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user5319,1416889268210.c2e76bfcf0ee452319788ce49186a339. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/.tmp, totalSize=229.8 M
2014-11-25 13:37:22,778 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/aff3b8319a2544dfa1a651d11601e0a2, keycount=38316, bloomtype=ROW, size=57.1 M, encoding=NONE, seqNum=19271
2014-11-25 13:37:22,778 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/494634223fe047eda14d83242245a9fe, keycount=41481, bloomtype=ROW, size=61.8 M, encoding=NONE, seqNum=20088
2014-11-25 13:37:22,778 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/017abafe91254d76a58f49fceeecbf00, keycount=37726, bloomtype=ROW, size=56.2 M, encoding=NONE, seqNum=20830
2014-11-25 13:37:22,778 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/5e4f919a8ebc4c38bffbf320141062a6, keycount=36650, bloomtype=ROW, size=54.6 M, encoding=NONE, seqNum=21550
2014-11-25 13:37:26,817 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/.tmp/5f9ab27c12f24bdb93213f641b922c40 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/5f9ab27c12f24bdb93213f641b922c40
2014-11-25 13:37:26,822 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:26,828 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/aff3b8319a2544dfa1a651d11601e0a2, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/aff3b8319a2544dfa1a651d11601e0a2
2014-11-25 13:37:26,830 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/494634223fe047eda14d83242245a9fe, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/494634223fe047eda14d83242245a9fe
2014-11-25 13:37:26,831 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/017abafe91254d76a58f49fceeecbf00, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/017abafe91254d76a58f49fceeecbf00
2014-11-25 13:37:26,833 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/5e4f919a8ebc4c38bffbf320141062a6, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c2e76bfcf0ee452319788ce49186a339/family/5e4f919a8ebc4c38bffbf320141062a6
2014-11-25 13:37:26,833 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user5319,1416889268210.c2e76bfcf0ee452319788ce49186a339. into 5f9ab27c12f24bdb93213f641b922c40(size=228.3 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:37:26,833 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user5319,1416889268210.c2e76bfcf0ee452319788ce49186a339., storeName=family, fileCount=4, fileSize=229.8 M, priority=-5, time=5780467000508289; duration=4sec
2014-11-25 13:37:26,833 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:26,833 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:26,833 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:26,834 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 184885622 starting at candidate #11 after considering 236 permutations with 208 in ratio
2014-11-25 13:37:26,834 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: a3d8de2e3c77996d502684577800bf7f - family: Initiating minor compaction
2014-11-25 13:37:26,834 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,,1416889268210.a3d8de2e3c77996d502684577800bf7f.
2014-11-25 13:37:26,834 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,,1416889268210.a3d8de2e3c77996d502684577800bf7f. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/.tmp, totalSize=176.3 M
2014-11-25 13:37:26,834 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/family/f5b2c03049aa4cffa67dea25d0fa07d2, keycount=41454, bloomtype=ROW, size=61.8 M, encoding=NONE, seqNum=18721
2014-11-25 13:37:26,834 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/family/7fbc234ab2b74a74a6ae40620cbdfb17, keycount=39226, bloomtype=ROW, size=58.5 M, encoding=NONE, seqNum=19501
2014-11-25 13:37:26,834 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/family/990eaa19bfe0421bb088b4ac48ffc0c7, keycount=37594, bloomtype=ROW, size=56.0 M, encoding=NONE, seqNum=20247
2014-11-25 13:37:30,364 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/.tmp/67d563b290fe491fa25ac47fd6a4c0af as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/family/67d563b290fe491fa25ac47fd6a4c0af
2014-11-25 13:37:30,369 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:30,374 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/family/f5b2c03049aa4cffa67dea25d0fa07d2, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/family/f5b2c03049aa4cffa67dea25d0fa07d2
2014-11-25 13:37:30,376 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/family/7fbc234ab2b74a74a6ae40620cbdfb17, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/family/7fbc234ab2b74a74a6ae40620cbdfb17
2014-11-25 13:37:30,377 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/family/990eaa19bfe0421bb088b4ac48ffc0c7, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a3d8de2e3c77996d502684577800bf7f/family/990eaa19bfe0421bb088b4ac48ffc0c7
2014-11-25 13:37:30,377 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,,1416889268210.a3d8de2e3c77996d502684577800bf7f. into 67d563b290fe491fa25ac47fd6a4c0af(size=175.2 M), total size for store is 3.6 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:37:30,378 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,,1416889268210.a3d8de2e3c77996d502684577800bf7f., storeName=family, fileCount=3, fileSize=176.3 M, priority=-5, time=5780471056589776; duration=3sec
2014-11-25 13:37:30,378 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:30,378 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5326), split_queue=0, merge_queue=0
2014-11-25 13:37:30,378 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:30,378 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 7 files of size 435243028 starting at candidate #8 after considering 236 permutations with 209 in ratio
2014-11-25 13:37:30,378 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: bff12d4267dd884829eb5659611c40f9 - family: Initiating minor compaction
2014-11-25 13:37:30,378 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user6579,1416889268210.bff12d4267dd884829eb5659611c40f9.
2014-11-25 13:37:30,378 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 7 file(s) in family of usertable2,user6579,1416889268210.bff12d4267dd884829eb5659611c40f9. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/.tmp, totalSize=415.1 M
2014-11-25 13:37:30,378 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/8d423455917d4ed7ae04a0af3484b690, keycount=41138, bloomtype=ROW, size=61.3 M, encoding=NONE, seqNum=16183
2014-11-25 13:37:30,378 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/1ed1b0cdca86447db53133cf4d3df846, keycount=36064, bloomtype=ROW, size=53.8 M, encoding=NONE, seqNum=16892
2014-11-25 13:37:30,378 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/fedc268d49a54c06b3e14b28f14a3812, keycount=43125, bloomtype=ROW, size=64.3 M, encoding=NONE, seqNum=17739
2014-11-25 13:37:30,378 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/5801f5ef6e0f4757b6956578a701a4ab, keycount=42526, bloomtype=ROW, size=63.4 M, encoding=NONE, seqNum=18572
2014-11-25 13:37:30,378 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/77dc5e0f81b3491ea7660649269d95e2, keycount=39161, bloomtype=ROW, size=58.4 M, encoding=NONE, seqNum=19346
2014-11-25 13:37:30,378 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/3c39b9b8ddbe482f9c5f3c25a31a4940, keycount=39633, bloomtype=ROW, size=59.1 M, encoding=NONE, seqNum=20124
2014-11-25 13:37:30,379 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/86e1d7d4db4c421f8f935625834b8e5a, keycount=36787, bloomtype=ROW, size=54.8 M, encoding=NONE, seqNum=20842
2014-11-25 13:37:35,870 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/.tmp/68b57e333dc5461c91ffaa0d3ba3dd52 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/68b57e333dc5461c91ffaa0d3ba3dd52
2014-11-25 13:37:35,874 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:35,882 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/8d423455917d4ed7ae04a0af3484b690, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/8d423455917d4ed7ae04a0af3484b690
2014-11-25 13:37:35,884 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/1ed1b0cdca86447db53133cf4d3df846, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/1ed1b0cdca86447db53133cf4d3df846
2014-11-25 13:37:35,885 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/fedc268d49a54c06b3e14b28f14a3812, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/fedc268d49a54c06b3e14b28f14a3812
2014-11-25 13:37:35,887 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/5801f5ef6e0f4757b6956578a701a4ab, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/5801f5ef6e0f4757b6956578a701a4ab
2014-11-25 13:37:35,888 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/77dc5e0f81b3491ea7660649269d95e2, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/77dc5e0f81b3491ea7660649269d95e2
2014-11-25 13:37:35,889 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/3c39b9b8ddbe482f9c5f3c25a31a4940, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/3c39b9b8ddbe482f9c5f3c25a31a4940
2014-11-25 13:37:35,891 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/86e1d7d4db4c421f8f935625834b8e5a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/bff12d4267dd884829eb5659611c40f9/family/86e1d7d4db4c421f8f935625834b8e5a
2014-11-25 13:37:35,891 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 7 file(s) in family of usertable2,user6579,1416889268210.bff12d4267dd884829eb5659611c40f9. into 68b57e333dc5461c91ffaa0d3ba3dd52(size=412.4 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 5sec to execute.
2014-11-25 13:37:35,891 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user6579,1416889268210.bff12d4267dd884829eb5659611c40f9., storeName=family, fileCount=7, fileSize=415.1 M, priority=-5, time=5780474600822774; duration=5sec
2014-11-25 13:37:35,891 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5325), split_queue=0, merge_queue=0
2014-11-25 13:37:35,891 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:35,892 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 190010911 starting at candidate #1 after considering 236 permutations with 194 in ratio
2014-11-25 13:37:35,892 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 251b8abbd56330bf749080625b3bed49 - family: Initiating minor compaction
2014-11-25 13:37:35,892 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49.
2014-11-25 13:37:35,892 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/.tmp, totalSize=181.2 M
2014-11-25 13:37:35,892 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/795f4e13c34045d3b882e6b5c571fbc0, keycount=40808, bloomtype=ROW, size=60.8 M, encoding=NONE, seqNum=4437
2014-11-25 13:37:35,892 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/854046b762864daa95258659ed3afd82, keycount=43326, bloomtype=ROW, size=64.6 M, encoding=NONE, seqNum=5291
2014-11-25 13:37:35,892 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/163846fea9054a1f8c51e16b59c93622, keycount=37422, bloomtype=ROW, size=55.8 M, encoding=NONE, seqNum=6031
2014-11-25 13:37:40,772 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/.tmp/8319922a57874387ad3ed195c570542c as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/8319922a57874387ad3ed195c570542c
2014-11-25 13:37:40,777 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:40,782 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/795f4e13c34045d3b882e6b5c571fbc0, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/795f4e13c34045d3b882e6b5c571fbc0
2014-11-25 13:37:40,784 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/854046b762864daa95258659ed3afd82, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/854046b762864daa95258659ed3afd82
2014-11-25 13:37:40,785 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/163846fea9054a1f8c51e16b59c93622, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/163846fea9054a1f8c51e16b59c93622
2014-11-25 13:37:40,785 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49. into 8319922a57874387ad3ed195c570542c(size=180.0 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:37:40,785 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49., storeName=family, fileCount=3, fileSize=181.2 M, priority=-5, time=5780480114499192; duration=4sec
2014-11-25 13:37:40,786 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5325), split_queue=0, merge_queue=0
2014-11-25 13:37:40,786 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5325), split_queue=0, merge_queue=0
2014-11-25 13:37:40,786 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:40,786 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 7 files of size 434985088 starting at candidate #8 after considering 236 permutations with 190 in ratio
2014-11-25 13:37:40,786 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 952a6132a4e977be00a90f6ac7e69235 - family: Initiating minor compaction
2014-11-25 13:37:40,786 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user1449,1416889268210.952a6132a4e977be00a90f6ac7e69235.
2014-11-25 13:37:40,786 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 7 file(s) in family of usertable2,user1449,1416889268210.952a6132a4e977be00a90f6ac7e69235. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/.tmp, totalSize=414.8 M
2014-11-25 13:37:40,786 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/51d35c5e755b4d159e98f66ccd6984cb, keycount=40465, bloomtype=ROW, size=60.3 M, encoding=NONE, seqNum=16254
2014-11-25 13:37:40,786 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/dd82e47e0a6d47208e3bfb7546088665, keycount=35982, bloomtype=ROW, size=53.6 M, encoding=NONE, seqNum=16958
2014-11-25 13:37:40,786 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/c625f988721e47528271b0e31674b28c, keycount=43311, bloomtype=ROW, size=64.6 M, encoding=NONE, seqNum=17811
2014-11-25 13:37:40,786 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/95bb38e11d2a42148416ddad42499569, keycount=42890, bloomtype=ROW, size=63.9 M, encoding=NONE, seqNum=18650
2014-11-25 13:37:40,786 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/c08eec9ca12742f484c9536ab0fd1932, keycount=40100, bloomtype=ROW, size=59.8 M, encoding=NONE, seqNum=19441
2014-11-25 13:37:40,786 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/ed8f879eac704f1086e883f637b9a5bd, keycount=37634, bloomtype=ROW, size=56.1 M, encoding=NONE, seqNum=20183
2014-11-25 13:37:40,786 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/0b720d2f6cbf4ee7babc48bfb2846d16, keycount=37887, bloomtype=ROW, size=56.5 M, encoding=NONE, seqNum=20928
2014-11-25 13:37:46,061 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/.tmp/5b897fb71b6445d8bbeb17b3fd049834 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/5b897fb71b6445d8bbeb17b3fd049834
2014-11-25 13:37:46,067 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:46,075 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/51d35c5e755b4d159e98f66ccd6984cb, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/51d35c5e755b4d159e98f66ccd6984cb
2014-11-25 13:37:46,077 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/dd82e47e0a6d47208e3bfb7546088665, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/dd82e47e0a6d47208e3bfb7546088665
2014-11-25 13:37:46,078 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/c625f988721e47528271b0e31674b28c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/c625f988721e47528271b0e31674b28c
2014-11-25 13:37:46,080 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/95bb38e11d2a42148416ddad42499569, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/95bb38e11d2a42148416ddad42499569
2014-11-25 13:37:46,081 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/c08eec9ca12742f484c9536ab0fd1932, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/c08eec9ca12742f484c9536ab0fd1932
2014-11-25 13:37:46,083 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/ed8f879eac704f1086e883f637b9a5bd, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/ed8f879eac704f1086e883f637b9a5bd
2014-11-25 13:37:46,084 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/0b720d2f6cbf4ee7babc48bfb2846d16, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/952a6132a4e977be00a90f6ac7e69235/family/0b720d2f6cbf4ee7babc48bfb2846d16
2014-11-25 13:37:46,084 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 7 file(s) in family of usertable2,user1449,1416889268210.952a6132a4e977be00a90f6ac7e69235. into 5b897fb71b6445d8bbeb17b3fd049834(size=412.1 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 5sec to execute.
2014-11-25 13:37:46,084 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user1449,1416889268210.952a6132a4e977be00a90f6ac7e69235., storeName=family, fileCount=7, fileSize=414.8 M, priority=-5, time=5780485008729509; duration=5sec
2014-11-25 13:37:46,085 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5324), split_queue=0, merge_queue=0
2014-11-25 13:37:46,085 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:46,085 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 175219587 starting at candidate #19 after considering 236 permutations with 182 in ratio
2014-11-25 13:37:46,085 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: cfb348ee570fa731ba8caa85099a1bd5 - family: Initiating minor compaction
2014-11-25 13:37:46,085 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user5589,1416889268210.cfb348ee570fa731ba8caa85099a1bd5.
2014-11-25 13:37:46,085 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user5589,1416889268210.cfb348ee570fa731ba8caa85099a1bd5. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/.tmp, totalSize=167.1 M
2014-11-25 13:37:46,085 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/family/54c1d4d0cdcc483c8bfb604f98d06527, keycount=35557, bloomtype=ROW, size=53.0 M, encoding=NONE, seqNum=30267
2014-11-25 13:37:46,085 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/family/fd006135ce3c4c7a87f612f3c6b8df92, keycount=37311, bloomtype=ROW, size=55.6 M, encoding=NONE, seqNum=30998
2014-11-25 13:37:46,085 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/family/490464db8c11492696b75d70f12a585c, keycount=39216, bloomtype=ROW, size=58.5 M, encoding=NONE, seqNum=31771
2014-11-25 13:37:50,457 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/.tmp/3177a0abe5a74ed6af6abd8452d60dcf as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/family/3177a0abe5a74ed6af6abd8452d60dcf
2014-11-25 13:37:50,463 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:50,469 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/family/54c1d4d0cdcc483c8bfb604f98d06527, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/family/54c1d4d0cdcc483c8bfb604f98d06527
2014-11-25 13:37:50,471 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/family/fd006135ce3c4c7a87f612f3c6b8df92, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/family/fd006135ce3c4c7a87f612f3c6b8df92
2014-11-25 13:37:50,473 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/family/490464db8c11492696b75d70f12a585c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/cfb348ee570fa731ba8caa85099a1bd5/family/490464db8c11492696b75d70f12a585c
2014-11-25 13:37:50,473 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user5589,1416889268210.cfb348ee570fa731ba8caa85099a1bd5. into 3177a0abe5a74ed6af6abd8452d60dcf(size=166.0 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:37:50,473 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user5589,1416889268210.cfb348ee570fa731ba8caa85099a1bd5., storeName=family, fileCount=3, fileSize=167.1 M, priority=-5, time=5780490307758600; duration=4sec
2014-11-25 13:37:50,473 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5324), split_queue=0, merge_queue=0
2014-11-25 13:37:50,473 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5324), split_queue=0, merge_queue=0
2014-11-25 13:37:50,473 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:50,473 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 171121498 starting at candidate #17 after considering 236 permutations with 207 in ratio
2014-11-25 13:37:50,473 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: eead33f80ffa1e642cc147c38794f39c - family: Initiating minor compaction
2014-11-25 13:37:50,473 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user4599,1416889268210.eead33f80ffa1e642cc147c38794f39c.
2014-11-25 13:37:50,473 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user4599,1416889268210.eead33f80ffa1e642cc147c38794f39c. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/.tmp, totalSize=163.2 M
2014-11-25 13:37:50,473 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/family/8005bc8732e341c69cf0458dbd71e216, keycount=36926, bloomtype=ROW, size=55.1 M, encoding=NONE, seqNum=28839
2014-11-25 13:37:50,474 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/family/f810daafbac041ccad51badc00732246, keycount=36890, bloomtype=ROW, size=55.0 M, encoding=NONE, seqNum=29566
2014-11-25 13:37:50,474 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/family/e26771a195144c8a975b64f1e94abb53, keycount=35643, bloomtype=ROW, size=53.1 M, encoding=NONE, seqNum=30267
2014-11-25 13:37:53,360 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/.tmp/26283ea537cb44ee886372af7a15427f as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/family/26283ea537cb44ee886372af7a15427f
2014-11-25 13:37:53,365 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:53,370 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/family/8005bc8732e341c69cf0458dbd71e216, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/family/8005bc8732e341c69cf0458dbd71e216
2014-11-25 13:37:53,372 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/family/f810daafbac041ccad51badc00732246, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/family/f810daafbac041ccad51badc00732246
2014-11-25 13:37:53,373 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/family/e26771a195144c8a975b64f1e94abb53, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/eead33f80ffa1e642cc147c38794f39c/family/e26771a195144c8a975b64f1e94abb53
2014-11-25 13:37:53,373 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user4599,1416889268210.eead33f80ffa1e642cc147c38794f39c. into 26283ea537cb44ee886372af7a15427f(size=162.1 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 2sec to execute.
2014-11-25 13:37:53,374 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user4599,1416889268210.eead33f80ffa1e642cc147c38794f39c., storeName=family, fileCount=3, fileSize=163.2 M, priority=-5, time=5780494696157534; duration=2sec
2014-11-25 13:37:53,374 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5324), split_queue=0, merge_queue=0
2014-11-25 13:37:53,374 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5324), split_queue=0, merge_queue=0
2014-11-25 13:37:53,374 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:53,374 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 175414744 starting at candidate #21 after considering 236 permutations with 196 in ratio
2014-11-25 13:37:53,374 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: e521da13cf88c7e5aa481035feae21e5 - family: Initiating minor compaction
2014-11-25 13:37:53,374 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user4239,1416889268210.e521da13cf88c7e5aa481035feae21e5.
2014-11-25 13:37:53,374 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user4239,1416889268210.e521da13cf88c7e5aa481035feae21e5. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/.tmp, totalSize=167.3 M
2014-11-25 13:37:53,374 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/family/945331fd09384d65ba385053d08d4082, keycount=36083, bloomtype=ROW, size=53.8 M, encoding=NONE, seqNum=30339
2014-11-25 13:37:53,374 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/family/f2cbe8f6a6154cb78df128f0ebdc4227, keycount=36441, bloomtype=ROW, size=54.3 M, encoding=NONE, seqNum=31057
2014-11-25 13:37:53,374 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/family/7e944b4e427e4bd2889b139df7004f22, keycount=39684, bloomtype=ROW, size=59.2 M, encoding=NONE, seqNum=31837
2014-11-25 13:37:56,178 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/.tmp/794c71eab330436f98d3468060fa6231 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/family/794c71eab330436f98d3468060fa6231
2014-11-25 13:37:56,184 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:56,189 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/family/945331fd09384d65ba385053d08d4082, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/family/945331fd09384d65ba385053d08d4082
2014-11-25 13:37:56,191 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/family/f2cbe8f6a6154cb78df128f0ebdc4227, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/family/f2cbe8f6a6154cb78df128f0ebdc4227
2014-11-25 13:37:56,192 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/family/7e944b4e427e4bd2889b139df7004f22, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/e521da13cf88c7e5aa481035feae21e5/family/7e944b4e427e4bd2889b139df7004f22
2014-11-25 13:37:56,193 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user4239,1416889268210.e521da13cf88c7e5aa481035feae21e5. into 794c71eab330436f98d3468060fa6231(size=166.2 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 2sec to execute.
2014-11-25 13:37:56,193 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user4239,1416889268210.e521da13cf88c7e5aa481035feae21e5., storeName=family, fileCount=3, fileSize=167.3 M, priority=-5, time=5780497596783825; duration=2sec
2014-11-25 13:37:56,193 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5324), split_queue=0, merge_queue=0
2014-11-25 13:37:56,193 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5324), split_queue=0, merge_queue=0
2014-11-25 13:37:56,193 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:56,193 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 186724652 starting at candidate #12 after considering 236 permutations with 181 in ratio
2014-11-25 13:37:56,193 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: f163e7c364cbfc321d89062a8ec9a958 - family: Initiating minor compaction
2014-11-25 13:37:56,193 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user4689,1416889268210.f163e7c364cbfc321d89062a8ec9a958.
2014-11-25 13:37:56,193 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user4689,1416889268210.f163e7c364cbfc321d89062a8ec9a958. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/.tmp, totalSize=178.1 M
2014-11-25 13:37:56,193 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/family/b1ad3a0a90e54c898a0259600ca968a9, keycount=41059, bloomtype=ROW, size=61.2 M, encoding=NONE, seqNum=18744
2014-11-25 13:37:56,193 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/family/4b7085a2e1954de98fdf0eeb0828af6a, keycount=40192, bloomtype=ROW, size=59.9 M, encoding=NONE, seqNum=19531
2014-11-25 13:37:56,193 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/family/488d4b1c1ad7483f8e7fd6d0a309d099, keycount=38201, bloomtype=ROW, size=57.0 M, encoding=NONE, seqNum=20286
2014-11-25 13:37:59,168 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/.tmp/b3659ecd3aa74fa5bfe657d3b2d18847 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/family/b3659ecd3aa74fa5bfe657d3b2d18847
2014-11-25 13:37:59,173 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:37:59,179 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/family/b1ad3a0a90e54c898a0259600ca968a9, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/family/b1ad3a0a90e54c898a0259600ca968a9
2014-11-25 13:37:59,180 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/family/4b7085a2e1954de98fdf0eeb0828af6a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/family/4b7085a2e1954de98fdf0eeb0828af6a
2014-11-25 13:37:59,182 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/family/488d4b1c1ad7483f8e7fd6d0a309d099, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f163e7c364cbfc321d89062a8ec9a958/family/488d4b1c1ad7483f8e7fd6d0a309d099
2014-11-25 13:37:59,182 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user4689,1416889268210.f163e7c364cbfc321d89062a8ec9a958. into b3659ecd3aa74fa5bfe657d3b2d18847(size=176.9 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 2sec to execute.
2014-11-25 13:37:59,182 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user4689,1416889268210.f163e7c364cbfc321d89062a8ec9a958., storeName=family, fileCount=3, fileSize=178.1 M, priority=-5, time=5780500415920729; duration=2sec
2014-11-25 13:37:59,183 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5324), split_queue=0, merge_queue=0
2014-11-25 13:37:59,183 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5324), split_queue=0, merge_queue=0
2014-11-25 13:37:59,183 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:37:59,183 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 179088740 starting at candidate #7 after considering 236 permutations with 187 in ratio
2014-11-25 13:37:59,183 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: fd0aae1076bc05c8db51754294c21e38 - family: Initiating minor compaction
2014-11-25 13:37:59,183 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user2709,1416889268210.fd0aae1076bc05c8db51754294c21e38.
2014-11-25 13:37:59,183 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user2709,1416889268210.fd0aae1076bc05c8db51754294c21e38. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/.tmp, totalSize=170.8 M
2014-11-25 13:37:59,183 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/family/2cf3525439a94e96af3213779543bb84, keycount=38145, bloomtype=ROW, size=56.9 M, encoding=NONE, seqNum=15453
2014-11-25 13:37:59,183 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/family/e571732d51d442fa921b4657cfeacb69, keycount=40711, bloomtype=ROW, size=60.7 M, encoding=NONE, seqNum=16253
2014-11-25 13:37:59,183 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/family/35e2cb49bf6f406aa786a992ac9c34c6, keycount=35706, bloomtype=ROW, size=53.2 M, encoding=NONE, seqNum=16955
2014-11-25 13:38:02,208 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/.tmp/a18288626ef5442a90a88f255963cde3 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/family/a18288626ef5442a90a88f255963cde3
2014-11-25 13:38:02,213 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:02,218 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/family/2cf3525439a94e96af3213779543bb84, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/family/2cf3525439a94e96af3213779543bb84
2014-11-25 13:38:02,220 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/family/e571732d51d442fa921b4657cfeacb69, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/family/e571732d51d442fa921b4657cfeacb69
2014-11-25 13:38:02,221 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/family/35e2cb49bf6f406aa786a992ac9c34c6, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/fd0aae1076bc05c8db51754294c21e38/family/35e2cb49bf6f406aa786a992ac9c34c6
2014-11-25 13:38:02,222 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user2709,1416889268210.fd0aae1076bc05c8db51754294c21e38. into a18288626ef5442a90a88f255963cde3(size=169.6 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:38:02,222 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user2709,1416889268210.fd0aae1076bc05c8db51754294c21e38., storeName=family, fileCount=3, fileSize=170.8 M, priority=-5, time=5780503405733763; duration=3sec
2014-11-25 13:38:02,222 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5324), split_queue=0, merge_queue=0
2014-11-25 13:38:02,222 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5324), split_queue=0, merge_queue=0
2014-11-25 13:38:02,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 35 store files, 0 compacting, 35 eligible, 30 blocking
2014-11-25 13:38:02,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 191263423 starting at candidate #1 after considering 236 permutations with 187 in ratio
2014-11-25 13:38:02,222 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 5d70ff594fe15127d73fa8e2efb51779 - family: Initiating minor compaction
2014-11-25 13:38:02,222 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779.
2014-11-25 13:38:02,222 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/.tmp, totalSize=182.4 M
2014-11-25 13:38:02,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/00d0abe016df4e1c88a83638ad5a188a, keycount=41071, bloomtype=ROW, size=61.2 M, encoding=NONE, seqNum=4430
2014-11-25 13:38:02,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/d4fa174ad1194045b01edab7d2b5e478, keycount=43698, bloomtype=ROW, size=65.1 M, encoding=NONE, seqNum=5289
2014-11-25 13:38:02,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/207dd7e2672243bcb90674dabddca79d, keycount=37589, bloomtype=ROW, size=56.0 M, encoding=NONE, seqNum=6030
2014-11-25 13:38:05,184 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/.tmp/0234210de51641878051217283c901bd as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/0234210de51641878051217283c901bd
2014-11-25 13:38:05,189 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:05,194 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/00d0abe016df4e1c88a83638ad5a188a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/00d0abe016df4e1c88a83638ad5a188a
2014-11-25 13:38:05,196 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/d4fa174ad1194045b01edab7d2b5e478, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/d4fa174ad1194045b01edab7d2b5e478
2014-11-25 13:38:05,197 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/207dd7e2672243bcb90674dabddca79d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5d70ff594fe15127d73fa8e2efb51779/family/207dd7e2672243bcb90674dabddca79d
2014-11-25 13:38:05,197 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779. into 0234210de51641878051217283c901bd(size=181.2 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 2sec to execute.
2014-11-25 13:38:05,197 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user7299,1416889268210.5d70ff594fe15127d73fa8e2efb51779., storeName=family, fileCount=3, fileSize=182.4 M, priority=-5, time=5780506444939523; duration=2sec
2014-11-25 13:38:05,198 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5324), split_queue=0, merge_queue=0
2014-11-25 13:38:05,198 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5324), split_queue=0, merge_queue=0
2014-11-25 13:38:05,198 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:05,198 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 7 files of size 184094355 starting at candidate #17 after considering 228 permutations with 193 in ratio
2014-11-25 13:38:05,198 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 136ad2e559437581aba3afba361df965 - family: Initiating minor compaction
2014-11-25 13:38:05,198 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user9189,1416889268210.136ad2e559437581aba3afba361df965.
2014-11-25 13:38:05,199 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 7 file(s) in family of usertable2,user9189,1416889268210.136ad2e559437581aba3afba361df965. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/.tmp, totalSize=175.6 M
2014-11-25 13:38:05,199 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/cbe3e8f0eb5a4390ac3c9d3897bbae95, keycount=19183, bloomtype=ROW, size=28.6 M, encoding=NONE, seqNum=25816
2014-11-25 13:38:05,199 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/d3f60dd77de64431a339f0c575c92da4, keycount=15956, bloomtype=ROW, size=23.8 M, encoding=NONE, seqNum=26523
2014-11-25 13:38:05,199 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/9a0999a99a7f4640bfb523e179b2fba2, keycount=16635, bloomtype=ROW, size=24.8 M, encoding=NONE, seqNum=27261
2014-11-25 13:38:05,199 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/8055d43c0d2d44d5b5156a963c5bd933, keycount=17232, bloomtype=ROW, size=25.7 M, encoding=NONE, seqNum=28025
2014-11-25 13:38:05,199 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/91125be05f234fca998c08a2b107b477, keycount=15605, bloomtype=ROW, size=23.2 M, encoding=NONE, seqNum=28716
2014-11-25 13:38:05,199 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/a47c8790345d482c90d2cc9c4ef42eeb, keycount=17846, bloomtype=ROW, size=26.6 M, encoding=NONE, seqNum=29506
2014-11-25 13:38:05,199 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/20577080a61c4f30ab95c8926ef9d868, keycount=15392, bloomtype=ROW, size=22.9 M, encoding=NONE, seqNum=30188
2014-11-25 13:38:09,404 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/.tmp/832ebb1be92c42cc841af9340a5b33ac as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/832ebb1be92c42cc841af9340a5b33ac
2014-11-25 13:38:09,410 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:09,418 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/cbe3e8f0eb5a4390ac3c9d3897bbae95, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/136ad2e559437581aba3afba361df965/family/cbe3e8f0eb5a4390ac3c9d3897bbae95
2014-11-25 13:38:09,420 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/d3f60dd77de64431a339f0c575c92da4, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/136ad2e559437581aba3afba361df965/family/d3f60dd77de64431a339f0c575c92da4
2014-11-25 13:38:09,421 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/9a0999a99a7f4640bfb523e179b2fba2, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/136ad2e559437581aba3afba361df965/family/9a0999a99a7f4640bfb523e179b2fba2
2014-11-25 13:38:09,423 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/8055d43c0d2d44d5b5156a963c5bd933, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/136ad2e559437581aba3afba361df965/family/8055d43c0d2d44d5b5156a963c5bd933
2014-11-25 13:38:09,424 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/91125be05f234fca998c08a2b107b477, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/136ad2e559437581aba3afba361df965/family/91125be05f234fca998c08a2b107b477
2014-11-25 13:38:09,426 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/a47c8790345d482c90d2cc9c4ef42eeb, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/136ad2e559437581aba3afba361df965/family/a47c8790345d482c90d2cc9c4ef42eeb
2014-11-25 13:38:09,427 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/136ad2e559437581aba3afba361df965/family/20577080a61c4f30ab95c8926ef9d868, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/136ad2e559437581aba3afba361df965/family/20577080a61c4f30ab95c8926ef9d868
2014-11-25 13:38:09,428 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 7 file(s) in family of usertable2,user9189,1416889268210.136ad2e559437581aba3afba361df965. into 832ebb1be92c42cc841af9340a5b33ac(size=174.4 M), total size for store is 1.6 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:38:09,428 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user9189,1416889268210.136ad2e559437581aba3afba361df965., storeName=family, fileCount=7, fileSize=175.6 M, priority=-4, time=5780509421319114; duration=4sec
2014-11-25 13:38:09,428 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5323), split_queue=0, merge_queue=0
2014-11-25 13:38:09,428 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:09,428 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 177006501 starting at candidate #20 after considering 228 permutations with 171 in ratio
2014-11-25 13:38:09,428 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 31d99d676ef27660d1bc87f691629c70 - family: Initiating minor compaction
2014-11-25 13:38:09,428 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70.
2014-11-25 13:38:09,428 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/.tmp, totalSize=168.8 M
2014-11-25 13:38:09,428 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/family/16a2a436c43a4b4592159d0263cd348b, keycount=36600, bloomtype=ROW, size=54.6 M, encoding=NONE, seqNum=30974
2014-11-25 13:38:09,428 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/family/e687d8585afa4256af726fc6dddfc0e3, keycount=39333, bloomtype=ROW, size=58.6 M, encoding=NONE, seqNum=31746
2014-11-25 13:38:09,428 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/family/c223de3fa4364ca6a5135e1268c0a39d, keycount=37295, bloomtype=ROW, size=55.6 M, encoding=NONE, seqNum=32480
2014-11-25 13:38:13,415 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/.tmp/7e1d2803ffa94042ae769e3d95533063 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/family/7e1d2803ffa94042ae769e3d95533063
2014-11-25 13:38:13,420 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:13,425 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/family/16a2a436c43a4b4592159d0263cd348b, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/family/16a2a436c43a4b4592159d0263cd348b
2014-11-25 13:38:13,427 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/family/e687d8585afa4256af726fc6dddfc0e3, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/family/e687d8585afa4256af726fc6dddfc0e3
2014-11-25 13:38:13,429 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/family/c223de3fa4364ca6a5135e1268c0a39d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/31d99d676ef27660d1bc87f691629c70/family/c223de3fa4364ca6a5135e1268c0a39d
2014-11-25 13:38:13,429 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70. into 7e1d2803ffa94042ae769e3d95533063(size=167.7 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:38:13,429 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user9009,1416889268210.31d99d676ef27660d1bc87f691629c70., storeName=family, fileCount=3, fileSize=168.8 M, priority=-4, time=5780513651006728; duration=4sec
2014-11-25 13:38:13,429 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5323), split_queue=0, merge_queue=0
2014-11-25 13:38:13,429 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5323), split_queue=0, merge_queue=0
2014-11-25 13:38:13,429 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:13,429 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 186985766 starting at candidate #2 after considering 228 permutations with 169 in ratio
2014-11-25 13:38:13,429 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 1781b4b5aab5824f312622e4cf5dc875 - family: Initiating minor compaction
2014-11-25 13:38:13,430 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875.
2014-11-25 13:38:13,430 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/.tmp, totalSize=178.3 M
2014-11-25 13:38:13,430 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/family/dcd16e0564604a1cbc0d7ced0f0d757d, keycount=39644, bloomtype=ROW, size=59.1 M, encoding=NONE, seqNum=4386
2014-11-25 13:38:13,430 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/family/535cfe123aa74de08c0e0f774d0d7d9f, keycount=43735, bloomtype=ROW, size=65.2 M, encoding=NONE, seqNum=5245
2014-11-25 13:38:13,430 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/family/b1d2061c053748c8838b69488190a5c8, keycount=36240, bloomtype=ROW, size=54.0 M, encoding=NONE, seqNum=5958
2014-11-25 13:38:17,732 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/.tmp/13110b75a2ee446e83e2e79720d8c4ca as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/family/13110b75a2ee446e83e2e79720d8c4ca
2014-11-25 13:38:17,738 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:17,743 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/family/dcd16e0564604a1cbc0d7ced0f0d757d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/family/dcd16e0564604a1cbc0d7ced0f0d757d
2014-11-25 13:38:17,744 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/family/535cfe123aa74de08c0e0f774d0d7d9f, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/family/535cfe123aa74de08c0e0f774d0d7d9f
2014-11-25 13:38:17,746 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/family/b1d2061c053748c8838b69488190a5c8, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/1781b4b5aab5824f312622e4cf5dc875/family/b1d2061c053748c8838b69488190a5c8
2014-11-25 13:38:17,746 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875. into 13110b75a2ee446e83e2e79720d8c4ca(size=177.1 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:38:17,746 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user6309,1416889268210.1781b4b5aab5824f312622e4cf5dc875., storeName=family, fileCount=3, fileSize=178.3 M, priority=-4, time=5780517652365980; duration=4sec
2014-11-25 13:38:17,746 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5323), split_queue=0, merge_queue=0
2014-11-25 13:38:17,746 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5323), split_queue=0, merge_queue=0
2014-11-25 13:38:17,746 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:17,746 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 7 files of size 434943467 starting at candidate #8 after considering 228 permutations with 182 in ratio
2014-11-25 13:38:17,746 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 5ff266e4e6272ab4516ca0c0f122bd3a - family: Initiating minor compaction
2014-11-25 13:38:17,747 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user2799,1416889268210.5ff266e4e6272ab4516ca0c0f122bd3a.
2014-11-25 13:38:17,747 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 7 file(s) in family of usertable2,user2799,1416889268210.5ff266e4e6272ab4516ca0c0f122bd3a. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/.tmp, totalSize=414.8 M
2014-11-25 13:38:17,747 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/cf9c4bcaf22a4b438cec1f3582e8b040, keycount=40684, bloomtype=ROW, size=60.6 M, encoding=NONE, seqNum=16253
2014-11-25 13:38:17,747 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/dc848d847c0f427a9d0d82e07419eb34, keycount=35707, bloomtype=ROW, size=53.2 M, encoding=NONE, seqNum=16955
2014-11-25 13:38:17,747 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/869e7aab83274813acbb75f5f686afd0, keycount=43503, bloomtype=ROW, size=64.8 M, encoding=NONE, seqNum=17809
2014-11-25 13:38:17,747 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/e93fdfc7c3064a9e9fc5a46d9e4b372d, keycount=42299, bloomtype=ROW, size=63.1 M, encoding=NONE, seqNum=18644
2014-11-25 13:38:17,747 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/15af5253f67e49689c5ce62adfd6bc41, keycount=39993, bloomtype=ROW, size=59.6 M, encoding=NONE, seqNum=19430
2014-11-25 13:38:17,747 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/c5a9a9514ded4bc997fc7325f446ba28, keycount=38290, bloomtype=ROW, size=57.1 M, encoding=NONE, seqNum=20182
2014-11-25 13:38:17,747 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/57ab3380a15744f8b19cb63426746699, keycount=37766, bloomtype=ROW, size=56.3 M, encoding=NONE, seqNum=20927
2014-11-25 13:38:23,480 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/.tmp/f668b97854bd4cafa6b4509ef85e791b as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/f668b97854bd4cafa6b4509ef85e791b
2014-11-25 13:38:23,485 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:23,493 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/cf9c4bcaf22a4b438cec1f3582e8b040, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/cf9c4bcaf22a4b438cec1f3582e8b040
2014-11-25 13:38:23,494 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/dc848d847c0f427a9d0d82e07419eb34, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/dc848d847c0f427a9d0d82e07419eb34
2014-11-25 13:38:23,496 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/869e7aab83274813acbb75f5f686afd0, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/869e7aab83274813acbb75f5f686afd0
2014-11-25 13:38:23,497 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/e93fdfc7c3064a9e9fc5a46d9e4b372d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/e93fdfc7c3064a9e9fc5a46d9e4b372d
2014-11-25 13:38:23,499 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/15af5253f67e49689c5ce62adfd6bc41, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/15af5253f67e49689c5ce62adfd6bc41
2014-11-25 13:38:23,500 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/c5a9a9514ded4bc997fc7325f446ba28, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/c5a9a9514ded4bc997fc7325f446ba28
2014-11-25 13:38:23,502 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/57ab3380a15744f8b19cb63426746699, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5ff266e4e6272ab4516ca0c0f122bd3a/family/57ab3380a15744f8b19cb63426746699
2014-11-25 13:38:23,502 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 7 file(s) in family of usertable2,user2799,1416889268210.5ff266e4e6272ab4516ca0c0f122bd3a. into f668b97854bd4cafa6b4509ef85e791b(size=412.1 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 5sec to execute.
2014-11-25 13:38:23,502 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user2799,1416889268210.5ff266e4e6272ab4516ca0c0f122bd3a., storeName=family, fileCount=7, fileSize=414.8 M, priority=-4, time=5780521969375040; duration=5sec
2014-11-25 13:38:23,502 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:23,502 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:23,502 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 257107918 starting at candidate #2 after considering 228 permutations with 192 in ratio
2014-11-25 13:38:23,502 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: ddd9bfab1f5915e5ad2048983a201027 - family: Initiating minor compaction
2014-11-25 13:38:23,502 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027.
2014-11-25 13:38:23,502 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/.tmp, totalSize=245.2 M
2014-11-25 13:38:23,503 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/14ae117a01bc417b96d9d4e9b96eda0b, keycount=42926, bloomtype=ROW, size=64.0 M, encoding=NONE, seqNum=3649
2014-11-25 13:38:23,503 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/ca9f6d62ff724f2699290787af1ac317, keycount=40180, bloomtype=ROW, size=59.9 M, encoding=NONE, seqNum=4441
2014-11-25 13:38:23,503 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/40006bc4c107415f8b7f59149eaa6644, keycount=43495, bloomtype=ROW, size=64.8 M, encoding=NONE, seqNum=5295
2014-11-25 13:38:23,503 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/643f1ea441994e6d9f553775a4268ee1, keycount=37882, bloomtype=ROW, size=56.5 M, encoding=NONE, seqNum=6037
2014-11-25 13:38:24,269 DEBUG [LruStats #0] hfile.LruBlockCache: Total=14.38 MB, free=12.79 GB, max=12.80 GB, blocks=113, accesses=1993400, hits=1602, hitRatio=0.08%, , cachingAccesses=1718, cachingHits=1489, cachingHitsRatio=86.67%, evictions=0, evicted=116, evictedPerRun=Infinity
2014-11-25 13:38:27,405 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/.tmp/f19a0bae8f754da2823bb54b418ebb52 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/f19a0bae8f754da2823bb54b418ebb52
2014-11-25 13:38:27,410 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:27,415 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/14ae117a01bc417b96d9d4e9b96eda0b, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/14ae117a01bc417b96d9d4e9b96eda0b
2014-11-25 13:38:27,416 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/ca9f6d62ff724f2699290787af1ac317, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/ca9f6d62ff724f2699290787af1ac317
2014-11-25 13:38:27,418 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/40006bc4c107415f8b7f59149eaa6644, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/40006bc4c107415f8b7f59149eaa6644
2014-11-25 13:38:27,419 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/643f1ea441994e6d9f553775a4268ee1, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/ddd9bfab1f5915e5ad2048983a201027/family/643f1ea441994e6d9f553775a4268ee1
2014-11-25 13:38:27,419 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027. into f19a0bae8f754da2823bb54b418ebb52(size=243.6 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:38:27,420 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user2079,1416889268210.ddd9bfab1f5915e5ad2048983a201027., storeName=family, fileCount=4, fileSize=245.2 M, priority=-4, time=5780527725213648; duration=3sec
2014-11-25 13:38:27,420 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:27,420 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:27,420 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:27,420 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 5 files of size 318020475 starting at candidate #7 after considering 228 permutations with 191 in ratio
2014-11-25 13:38:27,420 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 20e96e23afd1acfa80469c8f368c7569 - family: Initiating minor compaction
2014-11-25 13:38:27,420 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569.
2014-11-25 13:38:27,420 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 5 file(s) in family of usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/.tmp, totalSize=303.3 M
2014-11-25 13:38:27,420 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/52dffa646b104f00b03ed360fb8b6bdb, keycount=45253, bloomtype=ROW, size=67.5 M, encoding=NONE, seqNum=17892
2014-11-25 13:38:27,420 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/958b330604584f0cbcdb1a64c383aa7c, keycount=41514, bloomtype=ROW, size=61.9 M, encoding=NONE, seqNum=18702
2014-11-25 13:38:27,420 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/eef120d7d91d40f2961f3da364580edb, keycount=40549, bloomtype=ROW, size=60.4 M, encoding=NONE, seqNum=19500
2014-11-25 13:38:27,420 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/eed8b1682fca4e04bb9de137e94bc9be, keycount=37325, bloomtype=ROW, size=55.6 M, encoding=NONE, seqNum=20238
2014-11-25 13:38:27,420 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/51e2acd9692344c3916a477cd2098596, keycount=38808, bloomtype=ROW, size=57.9 M, encoding=NONE, seqNum=20998
2014-11-25 13:38:32,049 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/.tmp/393c4dd31ef84875b5e2f27032d9b891 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/393c4dd31ef84875b5e2f27032d9b891
2014-11-25 13:38:32,054 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:32,060 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/52dffa646b104f00b03ed360fb8b6bdb, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/52dffa646b104f00b03ed360fb8b6bdb
2014-11-25 13:38:32,062 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/958b330604584f0cbcdb1a64c383aa7c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/958b330604584f0cbcdb1a64c383aa7c
2014-11-25 13:38:32,063 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/eef120d7d91d40f2961f3da364580edb, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/eef120d7d91d40f2961f3da364580edb
2014-11-25 13:38:32,065 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/eed8b1682fca4e04bb9de137e94bc9be, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/eed8b1682fca4e04bb9de137e94bc9be
2014-11-25 13:38:32,066 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/51e2acd9692344c3916a477cd2098596, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/20e96e23afd1acfa80469c8f368c7569/family/51e2acd9692344c3916a477cd2098596
2014-11-25 13:38:32,066 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 5 file(s) in family of usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569. into 393c4dd31ef84875b5e2f27032d9b891(size=301.3 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:38:32,067 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user3969,1416889268210.20e96e23afd1acfa80469c8f368c7569., storeName=family, fileCount=5, fileSize=303.3 M, priority=-4, time=5780531642855343; duration=4sec
2014-11-25 13:38:32,067 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:32,067 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:32,067 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:32,067 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 183812469 starting at candidate #2 after considering 228 permutations with 193 in ratio
2014-11-25 13:38:32,067 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 66b3f405d8a37b958df876fdb9b9d09f - family: Initiating minor compaction
2014-11-25 13:38:32,067 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f.
2014-11-25 13:38:32,067 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/.tmp, totalSize=175.3 M
2014-11-25 13:38:32,067 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/650c836c04544098a4630a295346246d, keycount=39432, bloomtype=ROW, size=58.8 M, encoding=NONE, seqNum=7589
2014-11-25 13:38:32,067 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/6a96bafb337c4a099d22e3a1b4eff506, keycount=39336, bloomtype=ROW, size=58.6 M, encoding=NONE, seqNum=8362
2014-11-25 13:38:32,067 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/a17de08cee3b4056beedb33bdd722e39, keycount=38818, bloomtype=ROW, size=57.9 M, encoding=NONE, seqNum=9126
2014-11-25 13:38:36,208 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/.tmp/f70422418cb74bd4b20e9652325deb7e as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/f70422418cb74bd4b20e9652325deb7e
2014-11-25 13:38:36,213 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:36,218 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/650c836c04544098a4630a295346246d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/650c836c04544098a4630a295346246d
2014-11-25 13:38:36,220 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/6a96bafb337c4a099d22e3a1b4eff506, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/6a96bafb337c4a099d22e3a1b4eff506
2014-11-25 13:38:36,221 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/a17de08cee3b4056beedb33bdd722e39, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/66b3f405d8a37b958df876fdb9b9d09f/family/a17de08cee3b4056beedb33bdd722e39
2014-11-25 13:38:36,222 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f. into f70422418cb74bd4b20e9652325deb7e(size=174.1 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:38:36,222 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user1089,1416889268210.66b3f405d8a37b958df876fdb9b9d09f., storeName=family, fileCount=3, fileSize=175.3 M, priority=-4, time=5780536289803996; duration=4sec
2014-11-25 13:38:36,222 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:36,222 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:36,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:36,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 174267692 starting at candidate #16 after considering 228 permutations with 201 in ratio
2014-11-25 13:38:36,222 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: c6657d5e07dcb6e9f983742c5fe2079e - family: Initiating minor compaction
2014-11-25 13:38:36,222 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e.
2014-11-25 13:38:36,222 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/.tmp, totalSize=166.2 M
2014-11-25 13:38:36,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/5cd57600f2c64ebfbe2f37d2ac0d44a0, keycount=40025, bloomtype=ROW, size=59.7 M, encoding=NONE, seqNum=29508
2014-11-25 13:38:36,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/4215bcd69875490ebd77b477bcb8779e, keycount=34641, bloomtype=ROW, size=51.6 M, encoding=NONE, seqNum=30189
2014-11-25 13:38:36,222 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/f2175af946a94f2abfcbdcf4d463ce18, keycount=36808, bloomtype=ROW, size=54.9 M, encoding=NONE, seqNum=30911
2014-11-25 13:38:39,279 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/.tmp/f1f106b184ab4abb9caf74a429bc33d9 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/f1f106b184ab4abb9caf74a429bc33d9
2014-11-25 13:38:39,285 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:39,290 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/5cd57600f2c64ebfbe2f37d2ac0d44a0, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/5cd57600f2c64ebfbe2f37d2ac0d44a0
2014-11-25 13:38:39,291 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/4215bcd69875490ebd77b477bcb8779e, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/4215bcd69875490ebd77b477bcb8779e
2014-11-25 13:38:39,293 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/f2175af946a94f2abfcbdcf4d463ce18, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/c6657d5e07dcb6e9f983742c5fe2079e/family/f2175af946a94f2abfcbdcf4d463ce18
2014-11-25 13:38:39,293 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e. into f1f106b184ab4abb9caf74a429bc33d9(size=165.1 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:38:39,293 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user8649,1416889268210.c6657d5e07dcb6e9f983742c5fe2079e., storeName=family, fileCount=3, fileSize=166.2 M, priority=-4, time=5780540444860638; duration=3sec
2014-11-25 13:38:39,293 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:39,293 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:39,293 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:39,294 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 173530372 starting at candidate #19 after considering 228 permutations with 181 in ratio
2014-11-25 13:38:39,294 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 94360258e2b50782cd1326e64ca622b3 - family: Initiating minor compaction
2014-11-25 13:38:39,294 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user7659,1416889268210.94360258e2b50782cd1326e64ca622b3.
2014-11-25 13:38:39,294 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user7659,1416889268210.94360258e2b50782cd1326e64ca622b3. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/.tmp, totalSize=165.5 M
2014-11-25 13:38:39,294 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/family/42095fcd4f2f4f0eb88e4bec7caeaf47, keycount=38271, bloomtype=ROW, size=57.1 M, encoding=NONE, seqNum=29520
2014-11-25 13:38:39,294 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/family/d8e07cadbc424109b5ef05e45567ae09, keycount=35764, bloomtype=ROW, size=53.3 M, encoding=NONE, seqNum=30224
2014-11-25 13:38:39,294 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/family/d72d0252e6164005a404606cdc1f9e06, keycount=36967, bloomtype=ROW, size=55.1 M, encoding=NONE, seqNum=30951
2014-11-25 13:38:42,042 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/.tmp/5fc719cf39c4479faf8d5a58e4c62ad6 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/family/5fc719cf39c4479faf8d5a58e4c62ad6
2014-11-25 13:38:42,047 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:42,053 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/family/42095fcd4f2f4f0eb88e4bec7caeaf47, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/family/42095fcd4f2f4f0eb88e4bec7caeaf47
2014-11-25 13:38:42,054 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/family/d8e07cadbc424109b5ef05e45567ae09, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/family/d8e07cadbc424109b5ef05e45567ae09
2014-11-25 13:38:42,056 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/family/d72d0252e6164005a404606cdc1f9e06, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/94360258e2b50782cd1326e64ca622b3/family/d72d0252e6164005a404606cdc1f9e06
2014-11-25 13:38:42,056 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user7659,1416889268210.94360258e2b50782cd1326e64ca622b3. into 5fc719cf39c4479faf8d5a58e4c62ad6(size=164.4 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 2sec to execute.
2014-11-25 13:38:42,056 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user7659,1416889268210.94360258e2b50782cd1326e64ca622b3., storeName=family, fileCount=3, fileSize=165.5 M, priority=-4, time=5780543516571924; duration=2sec
2014-11-25 13:38:42,056 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:42,056 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:42,056 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:42,056 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 177527445 starting at candidate #20 after considering 228 permutations with 170 in ratio
2014-11-25 13:38:42,057 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 47c1cb50ecad10991e33a3c834624e07 - family: Initiating minor compaction
2014-11-25 13:38:42,057 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user5499,1416889268210.47c1cb50ecad10991e33a3c834624e07.
2014-11-25 13:38:42,057 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user5499,1416889268210.47c1cb50ecad10991e33a3c834624e07. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/.tmp, totalSize=169.3 M
2014-11-25 13:38:42,057 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/family/aacaccf49fdc40a5871f2cd62037e373, keycount=37167, bloomtype=ROW, size=55.4 M, encoding=NONE, seqNum=30998
2014-11-25 13:38:42,057 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/family/4fbddfe0bf524755979862106b30123f, keycount=39370, bloomtype=ROW, size=58.7 M, encoding=NONE, seqNum=31771
2014-11-25 13:38:42,057 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/family/cac61c8436ff483db6541fbd4c284749, keycount=37025, bloomtype=ROW, size=55.2 M, encoding=NONE, seqNum=32503
2014-11-25 13:38:44,701 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/.tmp/03faa68481154588bf72a4505761b58a as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/family/03faa68481154588bf72a4505761b58a
2014-11-25 13:38:44,706 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:44,711 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/family/aacaccf49fdc40a5871f2cd62037e373, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/family/aacaccf49fdc40a5871f2cd62037e373
2014-11-25 13:38:44,713 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/family/4fbddfe0bf524755979862106b30123f, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/family/4fbddfe0bf524755979862106b30123f
2014-11-25 13:38:44,715 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/family/cac61c8436ff483db6541fbd4c284749, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/47c1cb50ecad10991e33a3c834624e07/family/cac61c8436ff483db6541fbd4c284749
2014-11-25 13:38:44,715 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user5499,1416889268210.47c1cb50ecad10991e33a3c834624e07. into 03faa68481154588bf72a4505761b58a(size=168.2 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 2sec to execute.
2014-11-25 13:38:44,715 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user5499,1416889268210.47c1cb50ecad10991e33a3c834624e07., storeName=family, fileCount=3, fileSize=169.3 M, priority=-4, time=5780546279494431; duration=2sec
2014-11-25 13:38:44,715 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:44,715 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:44,715 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:44,715 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 256966581 starting at candidate #2 after considering 228 permutations with 184 in ratio
2014-11-25 13:38:44,715 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: a6d76b3d9a5a10e578fccc6098a8444b - family: Initiating minor compaction
2014-11-25 13:38:44,715 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user2169,1416889268210.a6d76b3d9a5a10e578fccc6098a8444b.
2014-11-25 13:38:44,716 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user2169,1416889268210.a6d76b3d9a5a10e578fccc6098a8444b. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/.tmp, totalSize=245.1 M
2014-11-25 13:38:44,716 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/271b6d45b67b40fa9e080f99095563d1, keycount=42924, bloomtype=ROW, size=64.0 M, encoding=NONE, seqNum=3649
2014-11-25 13:38:44,716 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/aedf8449b3e944af9dc5669f3249ebf5, keycount=40333, bloomtype=ROW, size=60.1 M, encoding=NONE, seqNum=4441
2014-11-25 13:38:44,716 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/11e6f94cd4b3422582536cefe431b946, keycount=43414, bloomtype=ROW, size=64.7 M, encoding=NONE, seqNum=5295
2014-11-25 13:38:44,716 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/648b782bd445492eb0e1b25f44fb61cf, keycount=37721, bloomtype=ROW, size=56.2 M, encoding=NONE, seqNum=6037
2014-11-25 13:38:49,667 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/.tmp/59e4833a0f314814a1d22afaad514df9 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/59e4833a0f314814a1d22afaad514df9
2014-11-25 13:38:49,672 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:49,678 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/271b6d45b67b40fa9e080f99095563d1, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/271b6d45b67b40fa9e080f99095563d1
2014-11-25 13:38:49,680 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/aedf8449b3e944af9dc5669f3249ebf5, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/aedf8449b3e944af9dc5669f3249ebf5
2014-11-25 13:38:49,681 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/11e6f94cd4b3422582536cefe431b946, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/11e6f94cd4b3422582536cefe431b946
2014-11-25 13:38:49,683 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/648b782bd445492eb0e1b25f44fb61cf, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a6d76b3d9a5a10e578fccc6098a8444b/family/648b782bd445492eb0e1b25f44fb61cf
2014-11-25 13:38:49,683 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user2169,1416889268210.a6d76b3d9a5a10e578fccc6098a8444b. into 59e4833a0f314814a1d22afaad514df9(size=243.5 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:38:49,683 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user2169,1416889268210.a6d76b3d9a5a10e578fccc6098a8444b., storeName=family, fileCount=4, fileSize=245.1 M, priority=-4, time=5780548938257576; duration=4sec
2014-11-25 13:38:49,683 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:49,683 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:49,684 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:49,684 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 187355483 starting at candidate #4 after considering 228 permutations with 202 in ratio
2014-11-25 13:38:49,684 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 69aa6c4f5cb560b28b2bbcd7aeef43cd - family: Initiating minor compaction
2014-11-25 13:38:49,684 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd.
2014-11-25 13:38:49,684 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/.tmp, totalSize=178.7 M
2014-11-25 13:38:49,684 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/137e0fb1a30a4041ad8348163dd8cde5, keycount=39972, bloomtype=ROW, size=59.6 M, encoding=NONE, seqNum=12990
2014-11-25 13:38:49,684 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/861a40b1f2ae47f08609e3b50e935df8, keycount=37172, bloomtype=ROW, size=55.4 M, encoding=NONE, seqNum=13721
2014-11-25 13:38:49,684 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/ec31038cbd824a4fb309db86b57cfcd4, keycount=42712, bloomtype=ROW, size=63.7 M, encoding=NONE, seqNum=14556
2014-11-25 13:38:54,010 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/.tmp/e469e5add79141ee80e008aa6b04c63e as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/e469e5add79141ee80e008aa6b04c63e
2014-11-25 13:38:54,016 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:54,021 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/137e0fb1a30a4041ad8348163dd8cde5, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/137e0fb1a30a4041ad8348163dd8cde5
2014-11-25 13:38:54,023 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/861a40b1f2ae47f08609e3b50e935df8, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/861a40b1f2ae47f08609e3b50e935df8
2014-11-25 13:38:54,025 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/ec31038cbd824a4fb309db86b57cfcd4, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69aa6c4f5cb560b28b2bbcd7aeef43cd/family/ec31038cbd824a4fb309db86b57cfcd4
2014-11-25 13:38:54,025 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd. into e469e5add79141ee80e008aa6b04c63e(size=177.5 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:38:54,025 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user7479,1416889268210.69aa6c4f5cb560b28b2bbcd7aeef43cd., storeName=family, fileCount=3, fileSize=178.7 M, priority=-4, time=5780553906674238; duration=4sec
2014-11-25 13:38:54,025 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:54,025 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:54,025 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:54,025 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 180395729 starting at candidate #7 after considering 228 permutations with 168 in ratio
2014-11-25 13:38:54,025 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: d0745af13f4e085f5d9be212fde5cee9 - family: Initiating minor compaction
2014-11-25 13:38:54,025 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9.
2014-11-25 13:38:54,026 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/.tmp, totalSize=172.0 M
2014-11-25 13:38:54,026 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/fc25f4526dc648579cfc388c8aced04c, keycount=39015, bloomtype=ROW, size=58.2 M, encoding=NONE, seqNum=15327
2014-11-25 13:38:54,026 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/875a21081dfa4a58900ecb11ea5074a6, keycount=40298, bloomtype=ROW, size=60.1 M, encoding=NONE, seqNum=16119
2014-11-25 13:38:54,026 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/6f3c856dd88d491b9825a621028339a0, keycount=36085, bloomtype=ROW, size=53.8 M, encoding=NONE, seqNum=16831
2014-11-25 13:38:57,258 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/.tmp/affc43ca7ec04c83aa6382a08bc7dd77 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/affc43ca7ec04c83aa6382a08bc7dd77
2014-11-25 13:38:57,264 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:57,271 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/fc25f4526dc648579cfc388c8aced04c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/fc25f4526dc648579cfc388c8aced04c
2014-11-25 13:38:57,273 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/875a21081dfa4a58900ecb11ea5074a6, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/875a21081dfa4a58900ecb11ea5074a6
2014-11-25 13:38:57,275 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/6f3c856dd88d491b9825a621028339a0, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/d0745af13f4e085f5d9be212fde5cee9/family/6f3c856dd88d491b9825a621028339a0
2014-11-25 13:38:57,275 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9. into affc43ca7ec04c83aa6382a08bc7dd77(size=170.9 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:38:57,275 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user6759,1416889268210.d0745af13f4e085f5d9be212fde5cee9., storeName=family, fileCount=3, fileSize=172.0 M, priority=-4, time=5780558248294577; duration=3sec
2014-11-25 13:38:57,275 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:57,275 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:57,275 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:57,275 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 171842557 starting at candidate #17 after considering 228 permutations with 206 in ratio
2014-11-25 13:38:57,275 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 80d2ffdd997af333255373f6d88089b7 - family: Initiating minor compaction
2014-11-25 13:38:57,275 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user7749,1416889268210.80d2ffdd997af333255373f6d88089b7.
2014-11-25 13:38:57,275 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user7749,1416889268210.80d2ffdd997af333255373f6d88089b7. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/.tmp, totalSize=163.9 M
2014-11-25 13:38:57,275 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/family/f90a0618a77d4b4abe743f84f2cebe9a, keycount=35306, bloomtype=ROW, size=52.6 M, encoding=NONE, seqNum=28722
2014-11-25 13:38:57,275 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/family/70d64d00672d458bbac7eb6221a6ee5d, keycount=39921, bloomtype=ROW, size=59.5 M, encoding=NONE, seqNum=29508
2014-11-25 13:38:57,276 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/family/1cf0bc779aab4773a1f0a5b90938b3b0, keycount=34694, bloomtype=ROW, size=51.7 M, encoding=NONE, seqNum=30190
2014-11-25 13:38:59,773 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/.tmp/386f2fb62eca4922972b85876f9841e5 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/family/386f2fb62eca4922972b85876f9841e5
2014-11-25 13:38:59,778 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:38:59,784 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/family/f90a0618a77d4b4abe743f84f2cebe9a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/family/f90a0618a77d4b4abe743f84f2cebe9a
2014-11-25 13:38:59,785 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/family/70d64d00672d458bbac7eb6221a6ee5d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/family/70d64d00672d458bbac7eb6221a6ee5d
2014-11-25 13:38:59,787 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/family/1cf0bc779aab4773a1f0a5b90938b3b0, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/80d2ffdd997af333255373f6d88089b7/family/1cf0bc779aab4773a1f0a5b90938b3b0
2014-11-25 13:38:59,787 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user7749,1416889268210.80d2ffdd997af333255373f6d88089b7. into 386f2fb62eca4922972b85876f9841e5(size=162.8 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 2sec to execute.
2014-11-25 13:38:59,787 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user7749,1416889268210.80d2ffdd997af333255373f6d88089b7., storeName=family, fileCount=3, fileSize=163.9 M, priority=-4, time=5780561498066243; duration=2sec
2014-11-25 13:38:59,787 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:59,787 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:38:59,787 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:38:59,788 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 247677610 starting at candidate #11 after considering 228 permutations with 172 in ratio
2014-11-25 13:38:59,788 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: a1bdaf5ad20e2ea54e0e5a2e45d102e5 - family: Initiating minor compaction
2014-11-25 13:38:59,788 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user4059,1416889268210.a1bdaf5ad20e2ea54e0e5a2e45d102e5.
2014-11-25 13:38:59,788 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user4059,1416889268210.a1bdaf5ad20e2ea54e0e5a2e45d102e5. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/.tmp, totalSize=236.2 M
2014-11-25 13:38:59,788 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/bf93ab60a56944c085c69a750fac8477, keycount=42492, bloomtype=ROW, size=63.3 M, encoding=NONE, seqNum=18644
2014-11-25 13:38:59,788 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/fb86b6e2146545f082a3b160e7ef9745, keycount=39587, bloomtype=ROW, size=59.0 M, encoding=NONE, seqNum=19422
2014-11-25 13:38:59,788 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/312284b2d7094059a54d81683a19c327, keycount=38546, bloomtype=ROW, size=57.5 M, encoding=NONE, seqNum=20182
2014-11-25 13:38:59,788 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/7b251696c3b04c4a925f5e9cd0bfc292, keycount=37818, bloomtype=ROW, size=56.4 M, encoding=NONE, seqNum=20927
2014-11-25 13:39:05,944 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/.tmp/9f4a4171e3694382afe65f1fb7a8d7a3 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/9f4a4171e3694382afe65f1fb7a8d7a3
2014-11-25 13:39:05,950 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:05,956 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/bf93ab60a56944c085c69a750fac8477, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/bf93ab60a56944c085c69a750fac8477
2014-11-25 13:39:05,957 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/fb86b6e2146545f082a3b160e7ef9745, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/fb86b6e2146545f082a3b160e7ef9745
2014-11-25 13:39:05,959 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/312284b2d7094059a54d81683a19c327, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/312284b2d7094059a54d81683a19c327
2014-11-25 13:39:05,961 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/7b251696c3b04c4a925f5e9cd0bfc292, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a1bdaf5ad20e2ea54e0e5a2e45d102e5/family/7b251696c3b04c4a925f5e9cd0bfc292
2014-11-25 13:39:05,961 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user4059,1416889268210.a1bdaf5ad20e2ea54e0e5a2e45d102e5. into 9f4a4171e3694382afe65f1fb7a8d7a3(size=234.6 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 6sec to execute.
2014-11-25 13:39:05,961 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user4059,1416889268210.a1bdaf5ad20e2ea54e0e5a2e45d102e5., storeName=family, fileCount=4, fileSize=236.2 M, priority=-4, time=5780564010562813; duration=6sec
2014-11-25 13:39:05,961 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:39:05,961 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:39:05,961 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:05,961 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 184395622 starting at candidate #16 after considering 228 permutations with 201 in ratio
2014-11-25 13:39:05,961 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 4fa6c789550f08f213befa07da277397 - family: Initiating minor compaction
2014-11-25 13:39:05,961 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user4419,1416889268210.4fa6c789550f08f213befa07da277397.
2014-11-25 13:39:05,961 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user4419,1416889268210.4fa6c789550f08f213befa07da277397. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/.tmp, totalSize=175.9 M
2014-11-25 13:39:05,961 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/family/8c76fda386314048b9ef812c0811c6bd, keycount=40268, bloomtype=ROW, size=60.0 M, encoding=NONE, seqNum=25119
2014-11-25 13:39:05,961 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/family/0a088411a5e44630895d78cc332dcf7e, keycount=41181, bloomtype=ROW, size=61.4 M, encoding=NONE, seqNum=25928
2014-11-25 13:39:05,962 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/family/4872e73098b84c5f8078926d1b5aef77, keycount=36511, bloomtype=ROW, size=54.4 M, encoding=NONE, seqNum=26648
2014-11-25 13:39:08,959 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/.tmp/1604a44fd40f4a9999e42f6670485abf as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/family/1604a44fd40f4a9999e42f6670485abf
2014-11-25 13:39:08,969 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:08,974 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/family/8c76fda386314048b9ef812c0811c6bd, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/4fa6c789550f08f213befa07da277397/family/8c76fda386314048b9ef812c0811c6bd
2014-11-25 13:39:08,975 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/family/0a088411a5e44630895d78cc332dcf7e, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/4fa6c789550f08f213befa07da277397/family/0a088411a5e44630895d78cc332dcf7e
2014-11-25 13:39:08,977 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4fa6c789550f08f213befa07da277397/family/4872e73098b84c5f8078926d1b5aef77, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/4fa6c789550f08f213befa07da277397/family/4872e73098b84c5f8078926d1b5aef77
2014-11-25 13:39:08,977 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user4419,1416889268210.4fa6c789550f08f213befa07da277397. into 1604a44fd40f4a9999e42f6670485abf(size=174.7 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:39:08,977 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user4419,1416889268210.4fa6c789550f08f213befa07da277397., storeName=family, fileCount=3, fileSize=175.9 M, priority=-4, time=5780570184125110; duration=3sec
2014-11-25 13:39:08,977 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:39:08,977 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:39:08,977 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:08,977 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 5 files of size 316160144 starting at candidate #8 after considering 228 permutations with 190 in ratio
2014-11-25 13:39:08,977 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 8bde118a62f612929db8d58958ecb297 - family: Initiating minor compaction
2014-11-25 13:39:08,978 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297.
2014-11-25 13:39:08,978 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 5 file(s) in family of usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/.tmp, totalSize=301.5 M
2014-11-25 13:39:08,978 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/659b666eae734de39b147bea275ab783, keycount=44398, bloomtype=ROW, size=66.2 M, encoding=NONE, seqNum=17895
2014-11-25 13:39:08,978 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/4c9028a0afa944158c72fa7d41086f31, keycount=41211, bloomtype=ROW, size=61.4 M, encoding=NONE, seqNum=18703
2014-11-25 13:39:08,978 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/42a66a7cb664443b996acb93ed56f412, keycount=40408, bloomtype=ROW, size=60.2 M, encoding=NONE, seqNum=19500
2014-11-25 13:39:08,978 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/a765763dbcc24639bfb52bcdb7eb281a, keycount=37531, bloomtype=ROW, size=56.0 M, encoding=NONE, seqNum=20240
2014-11-25 13:39:08,978 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/f02b331b8ca74546abff9f624fe4781d, keycount=38709, bloomtype=ROW, size=57.7 M, encoding=NONE, seqNum=21000
2014-11-25 13:39:13,017 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/.tmp/99b3dd9c17ab405f873b82bb008739a4 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/99b3dd9c17ab405f873b82bb008739a4
2014-11-25 13:39:13,023 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:13,029 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/659b666eae734de39b147bea275ab783, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/659b666eae734de39b147bea275ab783
2014-11-25 13:39:13,031 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/4c9028a0afa944158c72fa7d41086f31, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/4c9028a0afa944158c72fa7d41086f31
2014-11-25 13:39:13,032 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/42a66a7cb664443b996acb93ed56f412, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/42a66a7cb664443b996acb93ed56f412
2014-11-25 13:39:13,034 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/a765763dbcc24639bfb52bcdb7eb281a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/a765763dbcc24639bfb52bcdb7eb281a
2014-11-25 13:39:13,036 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/f02b331b8ca74546abff9f624fe4781d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/8bde118a62f612929db8d58958ecb297/family/f02b331b8ca74546abff9f624fe4781d
2014-11-25 13:39:13,036 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 5 file(s) in family of usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297. into 99b3dd9c17ab405f873b82bb008739a4(size=299.5 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:39:13,036 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user3249,1416889268210.8bde118a62f612929db8d58958ecb297., storeName=family, fileCount=5, fileSize=301.5 M, priority=-4, time=5780573200410804; duration=4sec
2014-11-25 13:39:13,036 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:39:13,036 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:39:13,036 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:13,036 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 5 files of size 305310755 starting at candidate #7 after considering 228 permutations with 216 in ratio
2014-11-25 13:39:13,037 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 419a973c54b8df54b6b65c8939f875da - family: Initiating minor compaction
2014-11-25 13:39:13,037 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da.
2014-11-25 13:39:13,037 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 5 file(s) in family of usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/.tmp, totalSize=291.2 M
2014-11-25 13:39:13,037 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/f8a1e23b6e034f61808cc72687002757, keycount=41610, bloomtype=ROW, size=62.0 M, encoding=NONE, seqNum=18517
2014-11-25 13:39:13,037 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/7c6f24db84e34c2b97b58d7995a1b6e6, keycount=38232, bloomtype=ROW, size=57.0 M, encoding=NONE, seqNum=19268
2014-11-25 13:39:13,037 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/45731b68ee7d4aa7ab21c3cd9edc5385, keycount=41034, bloomtype=ROW, size=61.2 M, encoding=NONE, seqNum=20075
2014-11-25 13:39:13,037 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/2c5b65626bf047ed873e87edf543b321, keycount=38305, bloomtype=ROW, size=57.1 M, encoding=NONE, seqNum=20827
2014-11-25 13:39:13,037 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/dedac3e6384a4dcd8fe7eb2ff19bcf96, keycount=36128, bloomtype=ROW, size=53.9 M, encoding=NONE, seqNum=21539
2014-11-25 13:39:17,731 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/.tmp/bfae4e76b50e41819bcdd6b774e06728 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/bfae4e76b50e41819bcdd6b774e06728
2014-11-25 13:39:17,736 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:17,742 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/f8a1e23b6e034f61808cc72687002757, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/f8a1e23b6e034f61808cc72687002757
2014-11-25 13:39:17,744 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/7c6f24db84e34c2b97b58d7995a1b6e6, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/7c6f24db84e34c2b97b58d7995a1b6e6
2014-11-25 13:39:17,745 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/45731b68ee7d4aa7ab21c3cd9edc5385, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/45731b68ee7d4aa7ab21c3cd9edc5385
2014-11-25 13:39:17,747 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/2c5b65626bf047ed873e87edf543b321, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/2c5b65626bf047ed873e87edf543b321
2014-11-25 13:39:17,749 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/dedac3e6384a4dcd8fe7eb2ff19bcf96, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/419a973c54b8df54b6b65c8939f875da/family/dedac3e6384a4dcd8fe7eb2ff19bcf96
2014-11-25 13:39:17,749 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 5 file(s) in family of usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da. into bfae4e76b50e41819bcdd6b774e06728(size=289.2 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:39:17,749 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user7839,1416889268210.419a973c54b8df54b6b65c8939f875da., storeName=family, fileCount=5, fileSize=291.2 M, priority=-4, time=5780577259489041; duration=4sec
2014-11-25 13:39:17,749 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:39:17,749 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:39:17,749 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:17,749 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 185715203 starting at candidate #5 after considering 228 permutations with 207 in ratio
2014-11-25 13:39:17,749 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: a9599695281fb69b67e424ae93f80ac0 - family: Initiating minor compaction
2014-11-25 13:39:17,749 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0.
2014-11-25 13:39:17,750 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/.tmp, totalSize=177.1 M
2014-11-25 13:39:17,750 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/c43b4c8b53e24b01af81c1b7a2722ab0, keycount=36992, bloomtype=ROW, size=55.2 M, encoding=NONE, seqNum=13720
2014-11-25 13:39:17,750 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/c927a358082a427f9b9d9f05aa5c4f88, keycount=42449, bloomtype=ROW, size=63.3 M, encoding=NONE, seqNum=14555
2014-11-25 13:39:17,750 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/3b156d5f35e544e7bb28c0ab4df79099, keycount=39364, bloomtype=ROW, size=58.7 M, encoding=NONE, seqNum=15327
2014-11-25 13:39:20,727 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/.tmp/61f9158180b7467282576f35da8eeaf3 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/61f9158180b7467282576f35da8eeaf3
2014-11-25 13:39:20,733 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:20,738 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/c43b4c8b53e24b01af81c1b7a2722ab0, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/c43b4c8b53e24b01af81c1b7a2722ab0
2014-11-25 13:39:20,740 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/c927a358082a427f9b9d9f05aa5c4f88, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/c927a358082a427f9b9d9f05aa5c4f88
2014-11-25 13:39:20,741 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/3b156d5f35e544e7bb28c0ab4df79099, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/a9599695281fb69b67e424ae93f80ac0/family/3b156d5f35e544e7bb28c0ab4df79099
2014-11-25 13:39:20,742 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0. into 61f9158180b7467282576f35da8eeaf3(size=175.9 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 2sec to execute.
2014-11-25 13:39:20,742 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user8019,1416889268210.a9599695281fb69b67e424ae93f80ac0., storeName=family, fileCount=3, fileSize=177.1 M, priority=-4, time=5780581972279774; duration=2sec
2014-11-25 13:39:20,742 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:39:20,742 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:39:20,742 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:20,742 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 188660582 starting at candidate #12 after considering 228 permutations with 187 in ratio
2014-11-25 13:39:20,742 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 431916fdd38260d48075cd85c007564d - family: Initiating minor compaction
2014-11-25 13:39:20,742 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d.
2014-11-25 13:39:20,742 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/.tmp, totalSize=179.9 M
2014-11-25 13:39:20,742 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/d39c6b9978a44c5bbb8e24d19a1507d0, keycount=42209, bloomtype=ROW, size=62.9 M, encoding=NONE, seqNum=18739
2014-11-25 13:39:20,742 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/11a654a10ad54c7fa5c57ae4fcdfca5e, keycount=40078, bloomtype=ROW, size=59.7 M, encoding=NONE, seqNum=19526
2014-11-25 13:39:20,742 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/c903812764a848c1ad73bf1f637e2354, keycount=38404, bloomtype=ROW, size=57.3 M, encoding=NONE, seqNum=20284
2014-11-25 13:39:23,777 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/.tmp/46d5dcb19540405c8818779b94dcd22a as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/46d5dcb19540405c8818779b94dcd22a
2014-11-25 13:39:23,783 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:23,789 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/d39c6b9978a44c5bbb8e24d19a1507d0, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/d39c6b9978a44c5bbb8e24d19a1507d0
2014-11-25 13:39:23,791 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/11a654a10ad54c7fa5c57ae4fcdfca5e, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/11a654a10ad54c7fa5c57ae4fcdfca5e
2014-11-25 13:39:23,792 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/c903812764a848c1ad73bf1f637e2354, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/431916fdd38260d48075cd85c007564d/family/c903812764a848c1ad73bf1f637e2354
2014-11-25 13:39:23,792 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d. into 46d5dcb19540405c8818779b94dcd22a(size=178.7 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:39:23,792 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user6489,1416889268210.431916fdd38260d48075cd85c007564d., storeName=family, fileCount=3, fileSize=179.9 M, priority=-4, time=5780584964964929; duration=3sec
2014-11-25 13:39:23,792 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:39:23,792 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5322), split_queue=0, merge_queue=0
2014-11-25 13:39:23,793 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:23,793 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 8 files of size 494990102 starting at candidate #7 after considering 228 permutations with 189 in ratio
2014-11-25 13:39:23,793 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 44276931450f87557d509a6420f58f5c - family: Initiating minor compaction
2014-11-25 13:39:23,793 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user2889,1416889268210.44276931450f87557d509a6420f58f5c.
2014-11-25 13:39:23,793 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 8 file(s) in family of usertable2,user2889,1416889268210.44276931450f87557d509a6420f58f5c. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/.tmp, totalSize=472.1 M
2014-11-25 13:39:23,793 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/1cdb8dde10894ee884c8c1bdfe91fd10, keycount=40327, bloomtype=ROW, size=60.1 M, encoding=NONE, seqNum=16123
2014-11-25 13:39:23,793 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/2728d91c7d4f407e8ff42d6dd90e2b3b, keycount=36332, bloomtype=ROW, size=54.2 M, encoding=NONE, seqNum=16838
2014-11-25 13:39:23,793 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/5b6ab036cbbd4b4ab4d533ddd1c4a217, keycount=43908, bloomtype=ROW, size=65.4 M, encoding=NONE, seqNum=17700
2014-11-25 13:39:23,793 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/b3100eec72b54847bfd355b8fdf8fc6d, keycount=42320, bloomtype=ROW, size=63.1 M, encoding=NONE, seqNum=18531
2014-11-25 13:39:23,793 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/d2b6b71f49df4ef0838d04ce7acf772c, keycount=37712, bloomtype=ROW, size=56.2 M, encoding=NONE, seqNum=19273
2014-11-25 13:39:23,793 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/0020915f662e475abd171baa25620f40, keycount=41745, bloomtype=ROW, size=62.2 M, encoding=NONE, seqNum=20094
2014-11-25 13:39:23,793 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/408b7b8b94dc47cd91c9673874894344, keycount=37716, bloomtype=ROW, size=56.2 M, encoding=NONE, seqNum=20832
2014-11-25 13:39:23,793 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/2843decb1c1e4da6b951692f8680c638, keycount=36593, bloomtype=ROW, size=54.6 M, encoding=NONE, seqNum=21557
2014-11-25 13:39:29,678 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/.tmp/6e901e11076f49fa9bf3fdd028ef7ccf as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/6e901e11076f49fa9bf3fdd028ef7ccf
2014-11-25 13:39:29,684 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:29,692 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/1cdb8dde10894ee884c8c1bdfe91fd10, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/1cdb8dde10894ee884c8c1bdfe91fd10
2014-11-25 13:39:29,694 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/2728d91c7d4f407e8ff42d6dd90e2b3b, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/2728d91c7d4f407e8ff42d6dd90e2b3b
2014-11-25 13:39:29,696 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/5b6ab036cbbd4b4ab4d533ddd1c4a217, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/5b6ab036cbbd4b4ab4d533ddd1c4a217
2014-11-25 13:39:29,698 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/b3100eec72b54847bfd355b8fdf8fc6d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/b3100eec72b54847bfd355b8fdf8fc6d
2014-11-25 13:39:29,699 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/d2b6b71f49df4ef0838d04ce7acf772c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/d2b6b71f49df4ef0838d04ce7acf772c
2014-11-25 13:39:29,701 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/0020915f662e475abd171baa25620f40, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/0020915f662e475abd171baa25620f40
2014-11-25 13:39:29,703 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/408b7b8b94dc47cd91c9673874894344, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/408b7b8b94dc47cd91c9673874894344
2014-11-25 13:39:29,705 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/2843decb1c1e4da6b951692f8680c638, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/44276931450f87557d509a6420f58f5c/family/2843decb1c1e4da6b951692f8680c638
2014-11-25 13:39:29,705 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 8 file(s) in family of usertable2,user2889,1416889268210.44276931450f87557d509a6420f58f5c. into 6e901e11076f49fa9bf3fdd028ef7ccf(size=468.9 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 5sec to execute.
2014-11-25 13:39:29,705 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user2889,1416889268210.44276931450f87557d509a6420f58f5c., storeName=family, fileCount=8, fileSize=472.1 M, priority=-4, time=5780588015600463; duration=5sec
2014-11-25 13:39:29,705 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:29,705 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:29,705 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 175189942 starting at candidate #21 after considering 228 permutations with 194 in ratio
2014-11-25 13:39:29,706 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 10fbbcf2b6f1389e433a4a5211bf2642 - family: Initiating minor compaction
2014-11-25 13:39:29,706 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user8739,1416889268210.10fbbcf2b6f1389e433a4a5211bf2642.
2014-11-25 13:39:29,706 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user8739,1416889268210.10fbbcf2b6f1389e433a4a5211bf2642. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/.tmp, totalSize=167.1 M
2014-11-25 13:39:29,706 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/family/3843fb2cac814a9a9af32213d1da3a46, keycount=36440, bloomtype=ROW, size=54.3 M, encoding=NONE, seqNum=30714
2014-11-25 13:39:29,706 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/family/a0f3f45e7284447ab55ec6613551a707, keycount=38484, bloomtype=ROW, size=57.4 M, encoding=NONE, seqNum=31470
2014-11-25 13:39:29,706 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/family/f41aa6ec89154a8e814f782174a9ee9c, keycount=37141, bloomtype=ROW, size=55.4 M, encoding=NONE, seqNum=32201
2014-11-25 13:39:34,530 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/.tmp/7016e3315ab4437aa6b7d174f2b1b2cd as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/family/7016e3315ab4437aa6b7d174f2b1b2cd
2014-11-25 13:39:34,536 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:34,542 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/family/3843fb2cac814a9a9af32213d1da3a46, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/family/3843fb2cac814a9a9af32213d1da3a46
2014-11-25 13:39:34,543 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/family/a0f3f45e7284447ab55ec6613551a707, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/family/a0f3f45e7284447ab55ec6613551a707
2014-11-25 13:39:34,545 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/family/f41aa6ec89154a8e814f782174a9ee9c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/10fbbcf2b6f1389e433a4a5211bf2642/family/f41aa6ec89154a8e814f782174a9ee9c
2014-11-25 13:39:34,545 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user8739,1416889268210.10fbbcf2b6f1389e433a4a5211bf2642. into 7016e3315ab4437aa6b7d174f2b1b2cd(size=166.0 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:39:34,546 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user8739,1416889268210.10fbbcf2b6f1389e433a4a5211bf2642., storeName=family, fileCount=3, fileSize=167.1 M, priority=-4, time=5780593928488919; duration=4sec
2014-11-25 13:39:34,546 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:34,546 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:34,546 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:34,546 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 185692139 starting at candidate #5 after considering 228 permutations with 206 in ratio
2014-11-25 13:39:34,546 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: fa362bc0b2fed482214114394bfa26f3 - family: Initiating minor compaction
2014-11-25 13:39:34,546 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user7209,1416889268210.fa362bc0b2fed482214114394bfa26f3.
2014-11-25 13:39:34,546 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user7209,1416889268210.fa362bc0b2fed482214114394bfa26f3. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/.tmp, totalSize=177.1 M
2014-11-25 13:39:34,546 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/family/a4009932a83a4f22935ea74f02ce4f55, keycount=37136, bloomtype=ROW, size=55.4 M, encoding=NONE, seqNum=13721
2014-11-25 13:39:34,546 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/family/a27587dd4ffd413e92237ae82938aff5, keycount=42586, bloomtype=ROW, size=63.5 M, encoding=NONE, seqNum=14558
2014-11-25 13:39:34,546 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/family/fbcbf661dacc461db61b663a4e0d30b5, keycount=39068, bloomtype=ROW, size=58.2 M, encoding=NONE, seqNum=15327
2014-11-25 13:39:38,202 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/.tmp/91905a789ccb4d4aad4bc82715c4d257 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/family/91905a789ccb4d4aad4bc82715c4d257
2014-11-25 13:39:38,207 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:38,213 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/family/a4009932a83a4f22935ea74f02ce4f55, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/family/a4009932a83a4f22935ea74f02ce4f55
2014-11-25 13:39:38,214 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/family/a27587dd4ffd413e92237ae82938aff5, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/family/a27587dd4ffd413e92237ae82938aff5
2014-11-25 13:39:38,216 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/family/fbcbf661dacc461db61b663a4e0d30b5, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/fa362bc0b2fed482214114394bfa26f3/family/fbcbf661dacc461db61b663a4e0d30b5
2014-11-25 13:39:38,216 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user7209,1416889268210.fa362bc0b2fed482214114394bfa26f3. into 91905a789ccb4d4aad4bc82715c4d257(size=175.9 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:39:38,216 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user7209,1416889268210.fa362bc0b2fed482214114394bfa26f3., storeName=family, fileCount=3, fileSize=177.1 M, priority=-4, time=5780598768815502; duration=3sec
2014-11-25 13:39:38,216 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:38,216 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:38,216 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:38,216 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 258499157 starting at candidate #2 after considering 228 permutations with 183 in ratio
2014-11-25 13:39:38,216 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 653390cc13d30804b9445ebffd69a81d - family: Initiating minor compaction
2014-11-25 13:39:38,217 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user5859,1416889268210.653390cc13d30804b9445ebffd69a81d.
2014-11-25 13:39:38,217 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user5859,1416889268210.653390cc13d30804b9445ebffd69a81d. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/.tmp, totalSize=246.5 M
2014-11-25 13:39:38,217 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/17d08ae4aacd4f789b20a4413e8453d7, keycount=43457, bloomtype=ROW, size=64.8 M, encoding=NONE, seqNum=3633
2014-11-25 13:39:38,217 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/6b2dcf51282a41e4a2b02849ed16b665, keycount=40780, bloomtype=ROW, size=60.8 M, encoding=NONE, seqNum=4436
2014-11-25 13:39:38,217 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/f5fcee981f9d4a258723c8888230f009, keycount=43411, bloomtype=ROW, size=64.7 M, encoding=NONE, seqNum=5290
2014-11-25 13:39:38,217 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/4c86eb79851547d8bbfe02faa173d880, keycount=37725, bloomtype=ROW, size=56.2 M, encoding=NONE, seqNum=6031
2014-11-25 13:39:41,500 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/.tmp/6dbbe6b124244a33bceee1cbce88c423 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/6dbbe6b124244a33bceee1cbce88c423
2014-11-25 13:39:41,506 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:41,512 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/17d08ae4aacd4f789b20a4413e8453d7, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/17d08ae4aacd4f789b20a4413e8453d7
2014-11-25 13:39:41,514 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/6b2dcf51282a41e4a2b02849ed16b665, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/6b2dcf51282a41e4a2b02849ed16b665
2014-11-25 13:39:41,516 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/f5fcee981f9d4a258723c8888230f009, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/f5fcee981f9d4a258723c8888230f009
2014-11-25 13:39:41,517 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/4c86eb79851547d8bbfe02faa173d880, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/653390cc13d30804b9445ebffd69a81d/family/4c86eb79851547d8bbfe02faa173d880
2014-11-25 13:39:41,518 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user5859,1416889268210.653390cc13d30804b9445ebffd69a81d. into 6dbbe6b124244a33bceee1cbce88c423(size=245.0 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:39:41,518 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user5859,1416889268210.653390cc13d30804b9445ebffd69a81d., storeName=family, fileCount=4, fileSize=246.5 M, priority=-4, time=5780602439378823; duration=3sec
2014-11-25 13:39:41,518 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:41,518 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:41,518 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:41,518 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 186828181 starting at candidate #8 after considering 228 permutations with 186 in ratio
2014-11-25 13:39:41,518 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: eb335d2faee6fcc254e5fef1453c282b - family: Initiating minor compaction
2014-11-25 13:39:41,518 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user2979,1416889268210.eb335d2faee6fcc254e5fef1453c282b.
2014-11-25 13:39:41,518 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user2979,1416889268210.eb335d2faee6fcc254e5fef1453c282b. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/.tmp, totalSize=178.2 M
2014-11-25 13:39:41,518 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/family/16fac7707dc74028883d2f2e9e3e6ff6, keycount=40447, bloomtype=ROW, size=60.3 M, encoding=NONE, seqNum=16252
2014-11-25 13:39:41,518 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/family/f774aefce8be4493860d9b8bc45f7a4d, keycount=35702, bloomtype=ROW, size=53.2 M, encoding=NONE, seqNum=16955
2014-11-25 13:39:41,518 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/family/7d027b9846094016853cea4317b037b1, keycount=43368, bloomtype=ROW, size=64.6 M, encoding=NONE, seqNum=17809
2014-11-25 13:39:44,988 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/.tmp/3f55e4c16b81450b90791703d6a74799 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/family/3f55e4c16b81450b90791703d6a74799
2014-11-25 13:39:44,993 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:44,998 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/family/16fac7707dc74028883d2f2e9e3e6ff6, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/family/16fac7707dc74028883d2f2e9e3e6ff6
2014-11-25 13:39:44,999 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/family/f774aefce8be4493860d9b8bc45f7a4d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/family/f774aefce8be4493860d9b8bc45f7a4d
2014-11-25 13:39:45,001 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/family/7d027b9846094016853cea4317b037b1, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/eb335d2faee6fcc254e5fef1453c282b/family/7d027b9846094016853cea4317b037b1
2014-11-25 13:39:45,001 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user2979,1416889268210.eb335d2faee6fcc254e5fef1453c282b. into 3f55e4c16b81450b90791703d6a74799(size=177.0 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:39:45,001 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user2979,1416889268210.eb335d2faee6fcc254e5fef1453c282b., storeName=family, fileCount=3, fileSize=178.2 M, priority=-4, time=5780605740892809; duration=3sec
2014-11-25 13:39:45,001 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:45,001 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:45,001 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:45,001 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 5 files of size 301494413 starting at candidate #14 after considering 228 permutations with 193 in ratio
2014-11-25 13:39:45,001 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 69b21767691ba0925d8af892eb4aa4c5 - family: Initiating minor compaction
2014-11-25 13:39:45,001 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5.
2014-11-25 13:39:45,001 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 5 file(s) in family of usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/.tmp, totalSize=287.5 M
2014-11-25 13:39:45,002 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/b5db409dc2db4a31a03b7d723d2d9442, keycount=39203, bloomtype=ROW, size=58.4 M, encoding=NONE, seqNum=24781
2014-11-25 13:39:45,002 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/7f424227155143da884feef22e054270, keycount=42682, bloomtype=ROW, size=63.6 M, encoding=NONE, seqNum=25620
2014-11-25 13:39:45,002 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/fdd1930af25a4526839b5a935dc3999b, keycount=36900, bloomtype=ROW, size=55.0 M, encoding=NONE, seqNum=26348
2014-11-25 13:39:45,002 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/10a95d7d29f9414da4a5e720ff539501, keycount=37094, bloomtype=ROW, size=55.3 M, encoding=NONE, seqNum=27078
2014-11-25 13:39:45,002 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/d4354467a33d4888b9a9c93311a9cc46, keycount=36986, bloomtype=ROW, size=55.1 M, encoding=NONE, seqNum=27802
2014-11-25 13:39:49,254 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/.tmp/38dadd4f555c415caef7e025fbb69dbe as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/38dadd4f555c415caef7e025fbb69dbe
2014-11-25 13:39:49,259 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:49,267 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/b5db409dc2db4a31a03b7d723d2d9442, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/b5db409dc2db4a31a03b7d723d2d9442
2014-11-25 13:39:49,269 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/7f424227155143da884feef22e054270, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/7f424227155143da884feef22e054270
2014-11-25 13:39:49,280 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/fdd1930af25a4526839b5a935dc3999b, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/fdd1930af25a4526839b5a935dc3999b
2014-11-25 13:39:49,281 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/10a95d7d29f9414da4a5e720ff539501, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/10a95d7d29f9414da4a5e720ff539501
2014-11-25 13:39:49,283 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/d4354467a33d4888b9a9c93311a9cc46, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/69b21767691ba0925d8af892eb4aa4c5/family/d4354467a33d4888b9a9c93311a9cc46
2014-11-25 13:39:49,283 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 5 file(s) in family of usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5. into 38dadd4f555c415caef7e025fbb69dbe(size=285.6 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:39:49,283 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user8379,1416889268210.69b21767691ba0925d8af892eb4aa4c5., storeName=family, fileCount=5, fileSize=287.5 M, priority=-4, time=5780609224237087; duration=4sec
2014-11-25 13:39:49,283 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:49,283 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:49,283 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:49,283 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 180807285 starting at candidate #7 after considering 228 permutations with 168 in ratio
2014-11-25 13:39:49,283 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 5693462910d31e0fd44c368a162a3159 - family: Initiating minor compaction
2014-11-25 13:39:49,283 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159.
2014-11-25 13:39:49,283 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/.tmp, totalSize=172.4 M
2014-11-25 13:39:49,284 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/a802df5f0551428482decfee7518026f, keycount=39073, bloomtype=ROW, size=58.3 M, encoding=NONE, seqNum=15328
2014-11-25 13:39:49,284 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/09ff96c3993049dca862b5f269a59c58, keycount=40342, bloomtype=ROW, size=60.1 M, encoding=NONE, seqNum=16120
2014-11-25 13:39:49,284 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/5dc3361cd159434d9a28b606e86bce14, keycount=36247, bloomtype=ROW, size=54.0 M, encoding=NONE, seqNum=16833
2014-11-25 13:39:53,124 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/.tmp/623f5200d6a143d099d0ad19e6173a2e as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/623f5200d6a143d099d0ad19e6173a2e
2014-11-25 13:39:53,131 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:53,136 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/a802df5f0551428482decfee7518026f, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/a802df5f0551428482decfee7518026f
2014-11-25 13:39:53,138 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/09ff96c3993049dca862b5f269a59c58, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/09ff96c3993049dca862b5f269a59c58
2014-11-25 13:39:53,139 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/5dc3361cd159434d9a28b606e86bce14, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/5693462910d31e0fd44c368a162a3159/family/5dc3361cd159434d9a28b606e86bce14
2014-11-25 13:39:53,139 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159. into 623f5200d6a143d099d0ad19e6173a2e(size=171.3 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:39:53,140 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user5409,1416889268210.5693462910d31e0fd44c368a162a3159., storeName=family, fileCount=3, fileSize=172.4 M, priority=-4, time=5780613506188859; duration=3sec
2014-11-25 13:39:53,140 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:53,140 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:53,140 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:53,140 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 186836142 starting at candidate #4 after considering 228 permutations with 202 in ratio
2014-11-25 13:39:53,140 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 775f28e1bbbfca269f5e02c6cf4f5952 - family: Initiating minor compaction
2014-11-25 13:39:53,140 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952.
2014-11-25 13:39:53,140 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/.tmp, totalSize=178.2 M
2014-11-25 13:39:53,140 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/ee6d008f0bdd4157b65bf788294d96ec, keycount=39876, bloomtype=ROW, size=59.4 M, encoding=NONE, seqNum=12991
2014-11-25 13:39:53,140 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/e1c695657cf545ca93504eea37f102a9, keycount=37170, bloomtype=ROW, size=55.4 M, encoding=NONE, seqNum=13723
2014-11-25 13:39:53,140 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/110d88d0dc18471898b2ec805a27542a, keycount=42477, bloomtype=ROW, size=63.3 M, encoding=NONE, seqNum=14560
2014-11-25 13:39:56,656 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/.tmp/b22a414621f74e52ad5638824c08e962 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/b22a414621f74e52ad5638824c08e962
2014-11-25 13:39:56,662 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:56,668 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/ee6d008f0bdd4157b65bf788294d96ec, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/ee6d008f0bdd4157b65bf788294d96ec
2014-11-25 13:39:56,671 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/e1c695657cf545ca93504eea37f102a9, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/e1c695657cf545ca93504eea37f102a9
2014-11-25 13:39:56,673 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/110d88d0dc18471898b2ec805a27542a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/775f28e1bbbfca269f5e02c6cf4f5952/family/110d88d0dc18471898b2ec805a27542a
2014-11-25 13:39:56,673 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952. into b22a414621f74e52ad5638824c08e962(size=177.0 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:39:56,673 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user5949,1416889268210.775f28e1bbbfca269f5e02c6cf4f5952., storeName=family, fileCount=3, fileSize=178.2 M, priority=-4, time=5780617362802705; duration=3sec
2014-11-25 13:39:56,673 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:56,673 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:56,674 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:56,674 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 172297648 starting at candidate #15 after considering 228 permutations with 213 in ratio
2014-11-25 13:39:56,674 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 89889f2dded6096cf9f3f21f17f99f8b - family: Initiating minor compaction
2014-11-25 13:39:56,674 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b.
2014-11-25 13:39:56,674 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/.tmp, totalSize=164.3 M
2014-11-25 13:39:56,674 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/5fc29984bf0d4a08976dbc89672d2272, keycount=36182, bloomtype=ROW, size=53.9 M, encoding=NONE, seqNum=28741
2014-11-25 13:39:56,674 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/5e4fd942d1c14386b2e98f8cb491e241, keycount=39339, bloomtype=ROW, size=58.6 M, encoding=NONE, seqNum=29512
2014-11-25 13:39:56,674 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/0a0dd2a1f8da461aaa6f144cb1832f85, keycount=34691, bloomtype=ROW, size=51.7 M, encoding=NONE, seqNum=30195
2014-11-25 13:39:59,785 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/.tmp/054637985cc744f99d7b957a3d335196 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/054637985cc744f99d7b957a3d335196
2014-11-25 13:39:59,790 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:39:59,795 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/5fc29984bf0d4a08976dbc89672d2272, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/5fc29984bf0d4a08976dbc89672d2272
2014-11-25 13:39:59,797 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/5e4fd942d1c14386b2e98f8cb491e241, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/5e4fd942d1c14386b2e98f8cb491e241
2014-11-25 13:39:59,799 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/0a0dd2a1f8da461aaa6f144cb1832f85, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/89889f2dded6096cf9f3f21f17f99f8b/family/0a0dd2a1f8da461aaa6f144cb1832f85
2014-11-25 13:39:59,799 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b. into 054637985cc744f99d7b957a3d335196(size=163.2 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:39:59,799 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user2619,1416889268210.89889f2dded6096cf9f3f21f17f99f8b., storeName=family, fileCount=3, fileSize=164.3 M, priority=-4, time=5780620896667402; duration=3sec
2014-11-25 13:39:59,799 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:59,799 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:39:59,799 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:39:59,799 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 177162261 starting at candidate #21 after considering 228 permutations with 212 in ratio
2014-11-25 13:39:59,799 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: f6b6e25b89562f389a05d71d6ba3decb - family: Initiating minor compaction
2014-11-25 13:39:59,799 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb.
2014-11-25 13:39:59,799 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/.tmp, totalSize=169.0 M
2014-11-25 13:39:59,799 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/4c135e95ac554035954051d2afd029de, keycount=36698, bloomtype=ROW, size=54.7 M, encoding=NONE, seqNum=30910
2014-11-25 13:39:59,799 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/d56315aebb874ed694ac2b5907f5fa3f, keycount=40017, bloomtype=ROW, size=59.7 M, encoding=NONE, seqNum=31696
2014-11-25 13:39:59,799 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/99850c15f4984093a2d9eef246aea6e3, keycount=36613, bloomtype=ROW, size=54.6 M, encoding=NONE, seqNum=32417
2014-11-25 13:40:02,710 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/.tmp/cbb16de88e38436481e5be218fac6923 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/cbb16de88e38436481e5be218fac6923
2014-11-25 13:40:02,715 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:40:02,723 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/4c135e95ac554035954051d2afd029de, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/4c135e95ac554035954051d2afd029de
2014-11-25 13:40:02,727 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/d56315aebb874ed694ac2b5907f5fa3f, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/d56315aebb874ed694ac2b5907f5fa3f
2014-11-25 13:40:02,732 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/99850c15f4984093a2d9eef246aea6e3, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/f6b6e25b89562f389a05d71d6ba3decb/family/99850c15f4984093a2d9eef246aea6e3
2014-11-25 13:40:02,732 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb. into cbb16de88e38436481e5be218fac6923(size=167.8 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 2sec to execute.
2014-11-25 13:40:02,732 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user7119,1416889268210.f6b6e25b89562f389a05d71d6ba3decb., storeName=family, fileCount=3, fileSize=169.0 M, priority=-4, time=5780624022055575; duration=2sec
2014-11-25 13:40:02,732 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:40:02,732 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5321), split_queue=0, merge_queue=0
2014-11-25 13:40:02,732 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:40:02,732 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 7 files of size 435479970 starting at candidate #8 after considering 228 permutations with 182 in ratio
2014-11-25 13:40:02,732 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: fc6c0c446a315daf2015d57ba81babe0 - family: Initiating minor compaction
2014-11-25 13:40:02,732 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user3519,1416889268210.fc6c0c446a315daf2015d57ba81babe0.
2014-11-25 13:40:02,732 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 7 file(s) in family of usertable2,user3519,1416889268210.fc6c0c446a315daf2015d57ba81babe0. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/.tmp, totalSize=415.3 M
2014-11-25 13:40:02,732 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/cb700daacb7348009a9c0eb9d8e842c0, keycount=40681, bloomtype=ROW, size=60.6 M, encoding=NONE, seqNum=16251
2014-11-25 13:40:02,733 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/7fc3baac65c74f1c8e41a21fcfe54848, keycount=35567, bloomtype=ROW, size=53.0 M, encoding=NONE, seqNum=16955
2014-11-25 13:40:02,733 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/4bae264c74d44c05bc21553cadb37464, keycount=43544, bloomtype=ROW, size=64.9 M, encoding=NONE, seqNum=17809
2014-11-25 13:40:02,733 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/1b4fb6e4f2fd4bc9bc6573cd35e896ed, keycount=42295, bloomtype=ROW, size=63.0 M, encoding=NONE, seqNum=18643
2014-11-25 13:40:02,733 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/3da7ad30089d4b258e106005e7081564, keycount=39690, bloomtype=ROW, size=59.2 M, encoding=NONE, seqNum=19422
2014-11-25 13:40:02,733 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/14fe08319109439190c9a2a7d725822a, keycount=38771, bloomtype=ROW, size=57.8 M, encoding=NONE, seqNum=20181
2014-11-25 13:40:02,733 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/84d19c9cbefa4d819ff346351aa1eb67, keycount=38037, bloomtype=ROW, size=56.7 M, encoding=NONE, seqNum=20927
2014-11-25 13:40:08,049 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/.tmp/e7e021d412cf4337a1e81446953697e9 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/e7e021d412cf4337a1e81446953697e9
2014-11-25 13:40:08,055 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:40:08,063 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/cb700daacb7348009a9c0eb9d8e842c0, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/cb700daacb7348009a9c0eb9d8e842c0
2014-11-25 13:40:08,065 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/7fc3baac65c74f1c8e41a21fcfe54848, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/7fc3baac65c74f1c8e41a21fcfe54848
2014-11-25 13:40:08,066 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/4bae264c74d44c05bc21553cadb37464, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/4bae264c74d44c05bc21553cadb37464
2014-11-25 13:40:08,068 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/1b4fb6e4f2fd4bc9bc6573cd35e896ed, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/1b4fb6e4f2fd4bc9bc6573cd35e896ed
2014-11-25 13:40:08,070 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/3da7ad30089d4b258e106005e7081564, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/3da7ad30089d4b258e106005e7081564
2014-11-25 13:40:08,071 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/14fe08319109439190c9a2a7d725822a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/14fe08319109439190c9a2a7d725822a
2014-11-25 13:40:08,073 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/84d19c9cbefa4d819ff346351aa1eb67, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/fc6c0c446a315daf2015d57ba81babe0/family/84d19c9cbefa4d819ff346351aa1eb67
2014-11-25 13:40:08,073 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 7 file(s) in family of usertable2,user3519,1416889268210.fc6c0c446a315daf2015d57ba81babe0. into e7e021d412cf4337a1e81446953697e9(size=412.6 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 5sec to execute.
2014-11-25 13:40:08,073 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user3519,1416889268210.fc6c0c446a315daf2015d57ba81babe0., storeName=family, fileCount=7, fileSize=415.3 M, priority=-4, time=5780626955131283; duration=5sec
2014-11-25 13:40:08,073 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5320), split_queue=0, merge_queue=0
2014-11-25 13:40:08,073 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:40:08,073 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 181139083 starting at candidate #6 after considering 228 permutations with 216 in ratio
2014-11-25 13:40:08,074 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 9481a850e6c49524a7e44af7702d77b4 - family: Initiating minor compaction
2014-11-25 13:40:08,074 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4.
2014-11-25 13:40:08,074 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/.tmp, totalSize=172.7 M
2014-11-25 13:40:08,074 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/852b19b0bff34fe19ef0a0c592b89b11, keycount=41602, bloomtype=ROW, size=62.0 M, encoding=NONE, seqNum=20090
2014-11-25 13:40:08,074 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/de94d31c9f3e44358880d98bed42d317, keycount=37597, bloomtype=ROW, size=56.1 M, encoding=NONE, seqNum=20831
2014-11-25 13:40:08,074 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/13cbb098e5c5490986359ebfe34f9015, keycount=36675, bloomtype=ROW, size=54.7 M, encoding=NONE, seqNum=21551
2014-11-25 13:40:11,907 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/.tmp/d8bac31319f443989f76cc9a5f151c29 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/d8bac31319f443989f76cc9a5f151c29
2014-11-25 13:40:11,914 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:40:11,919 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/852b19b0bff34fe19ef0a0c592b89b11, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/852b19b0bff34fe19ef0a0c592b89b11
2014-11-25 13:40:11,921 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/de94d31c9f3e44358880d98bed42d317, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/de94d31c9f3e44358880d98bed42d317
2014-11-25 13:40:11,923 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/13cbb098e5c5490986359ebfe34f9015, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/9481a850e6c49524a7e44af7702d77b4/family/13cbb098e5c5490986359ebfe34f9015
2014-11-25 13:40:11,923 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4. into d8bac31319f443989f76cc9a5f151c29(size=171.6 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:40:11,923 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user4329,1416889268210.9481a850e6c49524a7e44af7702d77b4., storeName=family, fileCount=3, fileSize=172.7 M, priority=-4, time=5780632296474038; duration=3sec
2014-11-25 13:40:11,923 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5320), split_queue=0, merge_queue=0
2014-11-25 13:40:11,923 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5320), split_queue=0, merge_queue=0
2014-11-25 13:40:11,923 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:40:11,923 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 257238910 starting at candidate #2 after considering 228 permutations with 188 in ratio
2014-11-25 13:40:11,923 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 4cbd9216f88e34160a388d0cd31c622c - family: Initiating minor compaction
2014-11-25 13:40:11,923 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user3789,1416889268210.4cbd9216f88e34160a388d0cd31c622c.
2014-11-25 13:40:11,923 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user3789,1416889268210.4cbd9216f88e34160a388d0cd31c622c. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/.tmp, totalSize=245.3 M
2014-11-25 13:40:11,923 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/f25f5b10ff2240e5b74318123a501a62, keycount=42743, bloomtype=ROW, size=63.7 M, encoding=NONE, seqNum=3643
2014-11-25 13:40:11,923 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/8ee40f2f9a7d49f1807149b1674aeb32, keycount=40543, bloomtype=ROW, size=60.4 M, encoding=NONE, seqNum=4440
2014-11-25 13:40:11,924 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/254d772394fe46a4a258da4e4bc9c2fe, keycount=43506, bloomtype=ROW, size=64.9 M, encoding=NONE, seqNum=5294
2014-11-25 13:40:11,924 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/98e55216e5cf4d829ea5d2f42178fb5d, keycount=37775, bloomtype=ROW, size=56.3 M, encoding=NONE, seqNum=6036
2014-11-25 13:40:15,635 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/.tmp/c806ce37f6c64bca98565d19b002c469 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/c806ce37f6c64bca98565d19b002c469
2014-11-25 13:40:15,641 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:40:15,647 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/f25f5b10ff2240e5b74318123a501a62, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/f25f5b10ff2240e5b74318123a501a62
2014-11-25 13:40:15,649 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/8ee40f2f9a7d49f1807149b1674aeb32, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/8ee40f2f9a7d49f1807149b1674aeb32
2014-11-25 13:40:15,650 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/254d772394fe46a4a258da4e4bc9c2fe, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/254d772394fe46a4a258da4e4bc9c2fe
2014-11-25 13:40:15,652 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/98e55216e5cf4d829ea5d2f42178fb5d, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/4cbd9216f88e34160a388d0cd31c622c/family/98e55216e5cf4d829ea5d2f42178fb5d
2014-11-25 13:40:15,652 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user3789,1416889268210.4cbd9216f88e34160a388d0cd31c622c. into c806ce37f6c64bca98565d19b002c469(size=243.8 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:40:15,652 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user3789,1416889268210.4cbd9216f88e34160a388d0cd31c622c., storeName=family, fileCount=4, fileSize=245.3 M, priority=-4, time=5780636146101787; duration=3sec
2014-11-25 13:40:15,652 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5320), split_queue=0, merge_queue=0
2014-11-25 13:40:15,652 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5320), split_queue=0, merge_queue=0
2014-11-25 13:40:15,652 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:40:15,653 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 4 files of size 256805160 starting at candidate #2 after considering 228 permutations with 184 in ratio
2014-11-25 13:40:15,653 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: b451134c60b1dc7cf526e81f6db2c433 - family: Initiating minor compaction
2014-11-25 13:40:15,653 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user2529,1416889268210.b451134c60b1dc7cf526e81f6db2c433.
2014-11-25 13:40:15,653 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 4 file(s) in family of usertable2,user2529,1416889268210.b451134c60b1dc7cf526e81f6db2c433. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/.tmp, totalSize=244.9 M
2014-11-25 13:40:15,653 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/74b46623d4b74212b0818f609c64b229, keycount=42970, bloomtype=ROW, size=64.1 M, encoding=NONE, seqNum=3649
2014-11-25 13:40:15,653 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/cfe54fb495f04655a7e357f8d88b6120, keycount=40208, bloomtype=ROW, size=59.9 M, encoding=NONE, seqNum=4441
2014-11-25 13:40:15,653 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/f3e7b362d4524572bad05a0874eebb6a, keycount=43304, bloomtype=ROW, size=64.6 M, encoding=NONE, seqNum=5294
2014-11-25 13:40:15,653 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/dea9d4e044454c39acab08bf020ab1d8, keycount=37807, bloomtype=ROW, size=56.4 M, encoding=NONE, seqNum=6037
2014-11-25 13:40:19,922 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/.tmp/08c2bfd27dbc4de89875758e849e8f45 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/08c2bfd27dbc4de89875758e849e8f45
2014-11-25 13:40:19,928 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:40:19,934 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/74b46623d4b74212b0818f609c64b229, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/74b46623d4b74212b0818f609c64b229
2014-11-25 13:40:19,936 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/cfe54fb495f04655a7e357f8d88b6120, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/cfe54fb495f04655a7e357f8d88b6120
2014-11-25 13:40:19,938 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/f3e7b362d4524572bad05a0874eebb6a, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/f3e7b362d4524572bad05a0874eebb6a
2014-11-25 13:40:19,939 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/dea9d4e044454c39acab08bf020ab1d8, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/b451134c60b1dc7cf526e81f6db2c433/family/dea9d4e044454c39acab08bf020ab1d8
2014-11-25 13:40:19,940 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 4 file(s) in family of usertable2,user2529,1416889268210.b451134c60b1dc7cf526e81f6db2c433. into 08c2bfd27dbc4de89875758e849e8f45(size=243.3 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 4sec to execute.
2014-11-25 13:40:19,940 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user2529,1416889268210.b451134c60b1dc7cf526e81f6db2c433., storeName=family, fileCount=4, fileSize=244.9 M, priority=-4, time=5780639875515543; duration=4sec
2014-11-25 13:40:19,940 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5320), split_queue=0, merge_queue=0
2014-11-25 13:40:19,940 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5320), split_queue=0, merge_queue=0
2014-11-25 13:40:19,940 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 34 store files, 0 compacting, 34 eligible, 30 blocking
2014-11-25 13:40:19,940 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 5 files of size 316937200 starting at candidate #8 after considering 228 permutations with 191 in ratio
2014-11-25 13:40:19,940 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 68e213930bf7032812a6e5212205b568 - family: Initiating minor compaction
2014-11-25 13:40:19,940 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568.
2014-11-25 13:40:19,940 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 5 file(s) in family of usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/.tmp, totalSize=302.3 M
2014-11-25 13:40:19,940 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/3e4445d996ae48a9ac5fa739cab592fc, keycount=44983, bloomtype=ROW, size=67.1 M, encoding=NONE, seqNum=17892
2014-11-25 13:40:19,940 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/da90cc6beaad4be0a472990198e9f592, keycount=40967, bloomtype=ROW, size=61.1 M, encoding=NONE, seqNum=18702
2014-11-25 13:40:19,940 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/621530d98e18458895a8471005473046, keycount=40681, bloomtype=ROW, size=60.6 M, encoding=NONE, seqNum=19500
2014-11-25 13:40:19,940 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/7bbfddbfb3a744628fafddc3b13bba71, keycount=37645, bloomtype=ROW, size=56.1 M, encoding=NONE, seqNum=20239
2014-11-25 13:40:19,941 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/731f7839a981490d855ac615405f54f4, keycount=38479, bloomtype=ROW, size=57.4 M, encoding=NONE, seqNum=20999
2014-11-25 13:40:22,770 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/.tmp/d0ecdc61a05049e9ae6c3e0f4470eada as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/d0ecdc61a05049e9ae6c3e0f4470eada
2014-11-25 13:40:22,776 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:40:22,782 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/3e4445d996ae48a9ac5fa739cab592fc, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/3e4445d996ae48a9ac5fa739cab592fc
2014-11-25 13:40:22,784 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/da90cc6beaad4be0a472990198e9f592, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/da90cc6beaad4be0a472990198e9f592
2014-11-25 13:40:22,786 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/621530d98e18458895a8471005473046, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/621530d98e18458895a8471005473046
2014-11-25 13:40:22,787 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/7bbfddbfb3a744628fafddc3b13bba71, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/7bbfddbfb3a744628fafddc3b13bba71
2014-11-25 13:40:22,789 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/731f7839a981490d855ac615405f54f4, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/68e213930bf7032812a6e5212205b568/family/731f7839a981490d855ac615405f54f4
2014-11-25 13:40:22,789 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 5 file(s) in family of usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568. into d0ecdc61a05049e9ae6c3e0f4470eada(size=300.3 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 2sec to execute.
2014-11-25 13:40:22,789 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user3609,1416889268210.68e213930bf7032812a6e5212205b568., storeName=family, fileCount=5, fileSize=302.3 M, priority=-4, time=5780644162950652; duration=2sec
2014-11-25 13:40:22,789 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5320), split_queue=0, merge_queue=0
2014-11-25 13:40:22,789 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5320), split_queue=0, merge_queue=0
2014-11-25 13:40:22,789 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 33 store files, 0 compacting, 33 eligible, 30 blocking
2014-11-25 13:40:22,789 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 5 files of size 317957099 starting at candidate #7 after considering 220 permutations with 184 in ratio
2014-11-25 13:40:22,789 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 251b8abbd56330bf749080625b3bed49 - family: Initiating minor compaction
2014-11-25 13:40:22,790 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49.
2014-11-25 13:40:22,790 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 5 file(s) in family of usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/.tmp, totalSize=303.2 M
2014-11-25 13:40:22,790 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/d0821edae1c64437a9bc9542994154f5, keycount=45240, bloomtype=ROW, size=67.4 M, encoding=NONE, seqNum=17891
2014-11-25 13:40:22,790 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/8ec6849eebae4434a816dd28cafe69ea, keycount=41162, bloomtype=ROW, size=61.4 M, encoding=NONE, seqNum=18700
2014-11-25 13:40:22,790 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/a6502a4bba574cc9aaa5a9daba974b61, keycount=39730, bloomtype=ROW, size=59.2 M, encoding=NONE, seqNum=19484
2014-11-25 13:40:22,790 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/788ef7fadd6c46a19d1338408dd91de4, keycount=38512, bloomtype=ROW, size=57.4 M, encoding=NONE, seqNum=20237
2014-11-25 13:40:22,790 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/988030204b8e449a8ffe2a3f86ced25c, keycount=38765, bloomtype=ROW, size=57.8 M, encoding=NONE, seqNum=20997
2014-11-25 13:40:28,082 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/.tmp/559d1fe242dc4961afb3df487db6c156 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/559d1fe242dc4961afb3df487db6c156
2014-11-25 13:40:28,088 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:40:28,095 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/d0821edae1c64437a9bc9542994154f5, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/d0821edae1c64437a9bc9542994154f5
2014-11-25 13:40:28,097 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/8ec6849eebae4434a816dd28cafe69ea, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/8ec6849eebae4434a816dd28cafe69ea
2014-11-25 13:40:28,099 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/a6502a4bba574cc9aaa5a9daba974b61, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/a6502a4bba574cc9aaa5a9daba974b61
2014-11-25 13:40:28,101 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/788ef7fadd6c46a19d1338408dd91de4, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/788ef7fadd6c46a19d1338408dd91de4
2014-11-25 13:40:28,103 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/988030204b8e449a8ffe2a3f86ced25c, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/251b8abbd56330bf749080625b3bed49/family/988030204b8e449a8ffe2a3f86ced25c
2014-11-25 13:40:28,103 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 5 file(s) in family of usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49. into 559d1fe242dc4961afb3df487db6c156(size=301.2 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 5sec to execute.
2014-11-25 13:40:28,103 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user5229,1416889268210.251b8abbd56330bf749080625b3bed49., storeName=family, fileCount=5, fileSize=303.2 M, priority=-3, time=5780647012426737; duration=5sec
2014-11-25 13:40:28,103 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5319), split_queue=0, merge_queue=0
2014-11-25 13:40:28,103 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 33 store files, 0 compacting, 33 eligible, 30 blocking
2014-11-25 13:40:28,103 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 177729825 starting at candidate #20 after considering 220 permutations with 189 in ratio
2014-11-25 13:40:28,103 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: b1d10532684e17b8d5ab026af3486dc5 - family: Initiating minor compaction
2014-11-25 13:40:28,104 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5.
2014-11-25 13:40:28,104 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Starting compaction of 3 file(s) in family of usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5. into tmpdir=hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/.tmp, totalSize=169.5 M
2014-11-25 13:40:28,104 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/eeeef9a064bc4530a0d810bdeea1d738, keycount=37138, bloomtype=ROW, size=55.4 M, encoding=NONE, seqNum=30995
2014-11-25 13:40:28,104 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/3128f2e98edf4fada680a31953f343f3, keycount=39358, bloomtype=ROW, size=58.7 M, encoding=NONE, seqNum=31769
2014-11-25 13:40:28,104 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.Compactor: Compacting hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/eab92e40851d4b709297585700df781e, keycount=37195, bloomtype=ROW, size=55.5 M, encoding=NONE, seqNum=32502
2014-11-25 13:40:31,927 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HRegionFileSystem: Committing store file hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/.tmp/b4964b5d78b0485597a350f17a006e21 as hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/b4964b5d78b0485597a350f17a006e21
2014-11-25 13:40:31,933 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Removing store files after compaction...
2014-11-25 13:40:31,938 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/eeeef9a064bc4530a0d810bdeea1d738, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/eeeef9a064bc4530a0d810bdeea1d738
2014-11-25 13:40:31,939 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/3128f2e98edf4fada680a31953f343f3, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/3128f2e98edf4fada680a31953f343f3
2014-11-25 13:40:31,941 DEBUG [regionserver60020-smallCompactions-1416889406578] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://mycluster:8020/hbase/test_bucketcache/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/eab92e40851d4b709297585700df781e, to hdfs://mycluster:8020/hbase/test_bucketcache/archive/data/default/usertable2/b1d10532684e17b8d5ab026af3486dc5/family/eab92e40851d4b709297585700df781e
2014-11-25 13:40:31,941 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: Completed compaction of 3 file(s) in family of usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5. into b4964b5d78b0485597a350f17a006e21(size=168.4 M), total size for store is 3.7 G. This selection was in queue for 0sec, and took 3sec to execute.
2014-11-25 13:40:31,941 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Completed compaction: Request = regionName=usertable2,user6129,1416889268210.b1d10532684e17b8d5ab026af3486dc5., storeName=family, fileCount=3, fileSize=169.5 M, priority=-3, time=5780652326384896; duration=3sec
2014-11-25 13:40:31,941 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: Small Compaction requested: system; Because: Recursive enqueue; compaction_queue=(0:5319), split_queue=0, merge_queue=0
2014-11-25 13:40:31,941 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:5319), split_queue=0, merge_queue=0
2014-11-25 13:40:31,941 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.RatioBasedCompactionPolicy: Selecting compaction from 33 store files, 0 compacting, 33 eligible, 30 blocking
2014-11-25 13:40:31,942 DEBUG [regionserver60020-smallCompactions-1416889406578] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 175125526 starting at candidate #22 after considering 220 permutations with 180 in ratio
2014-11-25 13:40:31,942 DEBUG [regionserver60020-smallCompactions-1416889406578] regionserver.HStore: 7e8fd83bb34b155bd0385aa63124a875 - family: Initiating minor compaction
2014-11-25 13:40:31,942 INFO  [regionserver60020-smallCompactions-1416889406578] regionserver.HRegion: Starting compaction on family in region usertable2,user8289,1416889268210.7e8fd83bb34b155bd0385aa63124a875.

