[
https://issues.apache.org/jira/browse/HBASE-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13688552#comment-13688552
]
Sergey Shelukhin commented on HBASE-8669:
-----------------------------------------
Here's an example. Compacting 98Mb files would be better, at the very least
given the circumstances...
{quote}
2013-06-18 19:23:05,826 DEBUG
[regionserver60020-largeCompactions-1371554482275]
compactions.RatioBasedCompactionPolicy: Selecting compaction from 11 store
files, 0 compacting, 11 eligible, 10 blocking
...
2013-06-18 19:23:05,827 DEBUG
[regionserver60020-largeCompactions-1371554482275]
compactions.ExploringCompactionPolicy: Exploring compaction algorithm has
selected 10 files of size 10583972212 starting at candidate #0 after
considering 44 permutations with 27 in ratio
...
2013-06-18 19:23:05,827 DEBUG
[regionserver60020-largeCompactions-1371554482275] compactions.Compactor:
Compacting
hdfs://ip-10-139-7-189/hbase/usertable/e7504e033565376b45faeea0e5b8bed3/family/afcc343a450b46139d96244b995f0411,
keycount=3535697, bloomtype=ROW, size=5,1g, encoding=NONE, seqNum=138441
2013-06-18 19:23:05,828 DEBUG
[regionserver60020-largeCompactions-1371554482275] compactions.Compactor:
Compacting
hdfs://ip-10-139-7-189/hbase/usertable/e7504e033565376b45faeea0e5b8bed3/family/a80ca770e18244618b6dc6df00b73456,
keycount=2026354, bloomtype=ROW, size=2,9g, encoding=NONE, seqNum=238661
2013-06-18 19:23:05,828 DEBUG
[regionserver60020-largeCompactions-1371554482275] compactions.Compactor:
Compacting
hdfs://ip-10-139-7-189/hbase/usertable/e7504e033565376b45faeea0e5b8bed3/family/422cff09df34491d97457de7f6291b5a,
keycount=789986, bloomtype=ROW, size=1,1g, encoding=NONE, seqNum=281615
2013-06-18 19:23:05,828 DEBUG
[regionserver60020-largeCompactions-1371554482275] compactions.Compactor:
Compacting
hdfs://ip-10-139-7-189/hbase/usertable/e7504e033565376b45faeea0e5b8bed3/family/0ba61215a6944dd5a3dc31b20ef42886,
keycount=65881, bloomtype=ROW, size=98,2m, encoding=NONE, seqNum=286268
2013-06-18 19:23:05,828 DEBUG
[regionserver60020-largeCompactions-1371554482275] compactions.Compactor:
Compacting
hdfs://ip-10-139-7-189/hbase/usertable/e7504e033565376b45faeea0e5b8bed3/family/e1ae1a138a8742a5b1181c34f248f671,
keycount=65817, bloomtype=ROW, size=98,1m, encoding=NONE, seqNum=290906
2013-06-18 19:23:05,828 DEBUG
[regionserver60020-largeCompactions-1371554482275] compactions.Compactor:
Compacting
hdfs://ip-10-139-7-189/hbase/usertable/e7504e033565376b45faeea0e5b8bed3/family/1f640902596c44b28ffe5670e12f4bf2,
keycount=65850, bloomtype=ROW, size=98,2m, encoding=NONE, seqNum=295558
2013-06-18 19:23:05,828 DEBUG
[regionserver60020-largeCompactions-1371554482275] compactions.Compactor:
Compacting
hdfs://ip-10-139-7-189/hbase/usertable/e7504e033565376b45faeea0e5b8bed3/family/cc0e383f390e4cd0ab53870804d3be0a,
keycount=65771, bloomtype=ROW, size=98,1m, encoding=NONE, seqNum=300209
2013-06-18 19:23:05,828 DEBUG
[regionserver60020-largeCompactions-1371554482275] compactions.Compactor:
Compacting
hdfs://ip-10-139-7-189/hbase/usertable/e7504e033565376b45faeea0e5b8bed3/family/176e7af3bf024f5496b7f645d5d7cbee,
keycount=65787, bloomtype=ROW, size=98,1m, encoding=NONE, seqNum=304851
2013-06-18 19:23:05,828 DEBUG
[regionserver60020-largeCompactions-1371554482275] compactions.Compactor:
Compacting
hdfs://ip-10-139-7-189/hbase/usertable/e7504e033565376b45faeea0e5b8bed3/family/41ee1a2b690e4ca78605e5f6556f8f22,
keycount=65864, bloomtype=ROW, size=98,2m, encoding=NONE, seqNum=309499
2013-06-18 19:23:05,828 DEBUG
[regionserver60020-largeCompactions-1371554482275] compactions.Compactor:
Compacting
hdfs://ip-10-139-7-189/hbase/usertable/e7504e033565376b45faeea0e5b8bed3/family/465a7c53b2654caaadba39f07e816f12,
keycount=65803, bloomtype=ROW, size=98,1m, encoding=NONE, seqNum=314140
{code}
> change exploring compaction policy to prefer smaller compactions on blocked
> stores
> ----------------------------------------------------------------------------------
>
> Key: HBASE-8669
> URL: https://issues.apache.org/jira/browse/HBASE-8669
> Project: HBase
> Issue Type: Improvement
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Priority: Minor
> Attachments: HBASE-8669-v0.patch
>
>
> Side-note from HBASE-8665 discussion. When we compact a blocked store, we
> might want to use a different heuristic to choose between the options.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
