[
https://issues.apache.org/jira/browse/HBASE-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262407#comment-13262407
]
ramkrishna.s.vasudevan edited comment on HBASE-5161 at 4/26/12 6:36 AM:
------------------------------------------------------------------------
@Stack and @J-D
We seem to end up in the same problem. We had some 32 reference files created
out of which one was never selected in further compaction cycles.
We even tried to stop the writes for 2 to 3 hours but still the compaction did
not pick up the reference file.
The region grew upto 400G.
{code}
./hbase-root-regionserver-HOST-192-168-47-205.log:2012-04-26 09:44:15,835 DEBUG
org.apache.hadoop.hbase.regionserver.Store:
hdfs://10.18.40.217:9000/hbase/ufdr/ce5c144a1714df08db1132238a749116/value/cde90029ecb74ef791500ccd3a1e8908.755d1cf6b960c02cc72c1dd83551df82-hdfs://10.18.40.217:9000/hbase/ufdr/755d1cf6b960c02cc72c1dd83551df82/value/cde90029ecb74ef791500ccd3a1e8908-top
is not splittable
{code}
We get the above logs for almost 2 to 3 hours. The pair of this reference file
(its bottom) is also not compacted.
Will dig in more to find any other reason for not getting picked up.
was (Author: ram_krish):
@Stack and @J-D
We seem to end up in the same problem. We had some 32 reference files created
out of which one was never selected in further compaction cycles.
We even tried to stop the writes for 2 to 3 hours but still the compaction did
not pick up the reference file. Will dig in more into this.
> Compaction algorithm should prioritize reference files
> ------------------------------------------------------
>
> Key: HBASE-5161
> URL: https://issues.apache.org/jira/browse/HBASE-5161
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.0
> Reporter: Jean-Daniel Cryans
> Priority: Critical
> Fix For: 0.92.1, 0.94.0
>
>
> I got myself into a state where my table was un-splittable as long as the
> insert load was coming in. Emergency flushes because of the low memory
> barrier don't check the number of store files so it never blocks, to a point
> where I had in one case 45 store files and the compactions were almost never
> done on the reference files (had 15 of them, went down by one in 20 minutes).
> Since you can't split regions with reference files, that region couldn't
> split and was doomed to just get more store files until the load stopped.
> Marking this as a minor issue, what we really need is a better pushback
> mechanism but not prioritizing reference files seems wrong.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
