[ 
https://issues.apache.org/jira/browse/HBASE-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857905#action_12857905
 ] 

stack commented on HBASE-2457:
------------------------------

Thanks Todd.  I like your cut at a better algorithm.  As per Jon, it may be the 
case that the contiguous-only no longer applies after yesterdays commit that 
leaves deletes in files until major compaction.  Also, anything that improves 
our i/o profile is ++ultra super important.

So, I suggest that we move the compaction review out of this issue into a new 
blocker against 0.20.5.  This new issue would be about trying your suggestion 
and breaking out compaction so it standalone/testable.  You're interested in 
this one Jon?

For this issue, for 0.20.4, I suggest we apply the band-aid.  For the super 
pathological case you turned up above, the band-aid will mean we only do two 
files at a time compressing -- way sub-optimal but at least we wouldn't be 
stuck.

> RS gets stuck compacting region ad infinitum
> --------------------------------------------
>
>                 Key: HBASE-2457
>                 URL: https://issues.apache.org/jira/browse/HBASE-2457
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.20.4
>            Reporter: Todd Lipcon
>            Priority: Critical
>         Attachments: log.gz, stack
>
>
> Testing 0.20_pre_durabil...@934643, I ended up in a state where one region 
> server got stuck compacting a single region over and over again forever. This 
> was with a special config with very low flush threshold in order to stress 
> test flush/compact code.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: 
https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to