We always compact if 2 files, regardless of the compaction threshold setting
----------------------------------------------------------------------------
Key: HBASE-618
URL: https://issues.apache.org/jira/browse/HBASE-618
Project: Hadoop HBase
Issue Type: Bug
Affects Versions: 0.2.0, 0.1.2
Reporter: stack
Priority: Blocker
Fix For: 0.2.0, 0.1.2
We will always compact if there are two files in a store. Here is an
illustration from a loading run against 0.1.2 candidate:
{code}
2008-05-06 18:25:42,255 INFO org.apache.hadoop.hbase.HRegion: starting
compaction on region category_rule_pricebin_statistics,,1210116131965
2008-05-06 18:25:42,259 DEBUG org.apache.hadoop.hbase.HStore: started
compaction of 2 files [329657396/confidence_interval/1251369679869294899,
329657396/confidence_interval/5238351815319958452] into
/hbase/category_rule_pricebin_statistics/compaction.dir/329657396/confidence_interval/mapfiles/6688946093979715350
2008-05-06 18:25:46,223 DEBUG org.apache.hadoop.hbase.HStore: moving
/hbase/category_rule_pricebin_statistics/compaction.dir/329657396/confidence_interval/mapfiles/6688946093979715350
to
/hbase/category_rule_pricebin_statistics/329657396/confidence_interval/mapfiles/6019580165435904305
2008-05-06 18:25:46,329 DEBUG org.apache.hadoop.hbase.HStore: started
compaction of 2 files [329657396/rule_id/4877828519309794708,
329657396/rule_id/3736239181369788409] into
/hbase/category_rule_pricebin_statistics/compaction.dir/329657396/rule_id/mapfiles/6451418039787481756
2008-05-06 18:25:50,273 DEBUG org.apache.hadoop.hbase.HStore: moving
/hbase/category_rule_pricebin_statistics/compaction.dir/329657396/rule_id/mapfiles/6451418039787481756
to
/hbase/category_rule_pricebin_statistics/329657396/rule_id/mapfiles/1365174520347083269
2008-05-06 18:25:50,338 DEBUG org.apache.hadoop.hbase.HStore: started
compaction of 2 files [329657396/hidden_variable/7348598912095388790,
329657396/hidden_variable/1402264537929464657] into
/hbase/category_rule_pricebin_statistics/compaction.dir/329657396/hidden_variable/mapfiles/7895992615693344978
2008-05-06 18:25:54,103 DEBUG org.apache.hadoop.hbase.HStore: moving
/hbase/category_rule_pricebin_statistics/compaction.dir/329657396/hidden_variable/mapfiles/7895992615693344978
to
/hbase/category_rule_pricebin_statistics/329657396/hidden_variable/mapfiles/4450886729060218942
2008-05-06 18:25:54,155 DEBUG org.apache.hadoop.hbase.HStore: started
compaction of 2 files [329657396/category_id/6976628214412388959,
329657396/category_id/8426537623290869905] into
/hbase/category_rule_pricebin_statistics/compaction.dir/329657396/category_id/mapfiles/4017716533879305176
2008-05-06 18:25:57,698 DEBUG org.apache.hadoop.hbase.HStore: moving
/hbase/category_rule_pricebin_statistics/compaction.dir/329657396/category_id/mapfiles/4017716533879305176
to
/hbase/category_rule_pricebin_statistics/329657396/category_id/mapfiles/657561173732096591
2008-05-06 18:25:57,747 DEBUG org.apache.hadoop.hbase.HStore: started
compaction of 2 files [329657396/price_bin_id/165701488423589566,
329657396/price_bin_id/5537046322320665760] into
/hbase/category_rule_pricebin_statistics/compaction.dir/329657396/price_bin_id/mapfiles/3214618236668106036
2008-05-06 18:26:01,135 DEBUG org.apache.hadoop.hbase.HStore: moving
/hbase/category_rule_pricebin_statistics/compaction.dir/329657396/price_bin_id/mapfiles/3214618236668106036
to
/hbase/category_rule_pricebin_statistics/329657396/price_bin_id/mapfiles/8727588456978537416
2008-05-06 18:26:01,181 INFO org.apache.hadoop.hbase.HRegion: compaction
completed on region category_rule_pricebin_statistics,,1210116131965 in 18sec
{code}
In the above, the region has 6 families, each of which is being loaded fairly
evenly. Every time through we'll compact a store if two files, which just so
happens to be most of the time in this case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
