[
https://issues.apache.org/jira/browse/HBASE-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13157000#comment-13157000
]
Lars Hofhansl commented on HBASE-4838:
--------------------------------------
I pinpointed the difference to the compactions of the daughters (again with
just 2 keys):
in 0.92 (with this patch) I see this for the 1st daughter region (which is
compacted last):
{noformat}
2011-11-24 22:08:51,324 INFO
[RegionServer:2;localhost,42385,1322201325234-smallCompactions-1322201331230]
regionserver.HRegion(1012): Starting compaction on testFamily in region
testFilterAcrossMutlipleRegions,,1322201330936.0db66f8aabdf138dbbcf6c04f857c284.
2011-11-24 22:08:51,332 INFO
[RegionServer:2;localhost,42385,1322201325234-smallCompactions-1322201331230]
regionserver.Store(725): Starting compaction of 1 file(s) in testFamily of
testFilterAcrossMutlipleRegions,,1322201330936.0db66f8aabdf138dbbcf6c04f857c284.
into
tmpdir=hdfs://localhost:52206/user/lars/testFilterAcrossMutlipleRegions/0db66f8aabdf138dbbcf6c04f857c284/.tmp,
seqid=3, totalSize=662.0
2011-11-24 22:08:51,333 DEBUG
[RegionServer:2;localhost,42385,1322201325234-smallCompactions-1322201331230]
regionserver.Store(1174): Compacting
hdfs://localhost:52206/user/lars/testFilterAcrossMutlipleRegions/0db66f8aabdf138dbbcf6c04f857c284/testFamily/85a0a11b15a248c69e09e44e0e9e052e.4e293f99103a49243c16eb104996554b-hdfs://localhost:52206/user/lars/testFilterAcrossMutlipleRegions/4e293f99103a49243c16eb104996554b/testFamily/85a0a11b15a248c69e09e44e0e9e052e-bottom,
keycount=2, bloomtype=NONE, size=662.0
2011-11-24 22:08:51,388 INFO
[RegionServer:2;localhost,42385,1322201325234-smallCompactions-1322201331230]
regionserver.Store(1322): Renaming compacted file at
hdfs://localhost:52206/user/lars/testFilterAcrossMutlipleRegions/0db66f8aabdf138dbbcf6c04f857c284/.tmp/7e7f4acb121e4696bd3c7d64e26a66b9
to
hdfs://localhost:52206/user/lars/testFilterAcrossMutlipleRegions/0db66f8aabdf138dbbcf6c04f857c284/testFamily/7e7f4acb121e4696bd3c7d64e26a66b9
2011-11-24 22:08:51,402 INFO
[RegionServer:2;localhost,42385,1322201325234-smallCompactions-1322201331230]
regionserver.Store(746): Completed major compaction of 1 file(s) in testFamily
of
testFilterAcrossMutlipleRegions,,1322201330936.0db66f8aabdf138dbbcf6c04f857c284.
into 7e7f4acb121e4696bd3c7d64e26a66b9, size=662.0; total size for store is
662.0
{noformat}
in trunk I see this for the 1st daughter region:
{noformat}
2011-11-24 22:15:18,205 INFO
[RegionServer:0;localhost,46427,1322201712357-smallCompactions-1322201718071]
regionserver.HRegion(1097): Starting compaction on testFamily in region
testFilterAcrossMutlipleRegions,,1322201717807.2bdeac6934712efdd694ec44ae48d1b2.
2011-11-24 22:15:18,206 INFO
[RegionServer:0;localhost,46427,1322201712357-smallCompactions-1322201718071]
regionserver.Store(797): Starting compaction of 1 file(s) in testFamily of
testFilterAcrossMutlipleRegions,,1322201717807.2bdeac6934712efdd694ec44ae48d1b2.
into
tmpdir=hdfs://localhost:37213/user/lars/testFilterAcrossMutlipleRegions/2bdeac6934712efdd694ec44ae48d1b2/.tmp,
seqid=3, totalSize=718.0
2011-11-24 22:15:18,206 DEBUG
[RegionServer:0;localhost,46427,1322201712357-smallCompactions-1322201718071]
regionserver.Store(1255): Compacting
hdfs://localhost:37213/user/lars/testFilterAcrossMutlipleRegions/2bdeac6934712efdd694ec44ae48d1b2/testFamily/64908313825b4c0599b86c26b33797e3.215be88f57f1ca63b6ead035b39c4d2e-hdfs://localhost:37213/user/lars/testFilterAcrossMutlipleRegions/215be88f57f1ca63b6ead035b39c4d2e/testFamily/64908313825b4c0599b86c26b33797e3-bottom,
keycount=2, bloomtype=NONE, size=718.0
2011-11-24 22:15:18,211 INFO
[RegionServer:0;localhost,46427,1322201712357-smallCompactions-1322201718071]
regionserver.Store(818): Completed major compaction of 1 file(s) in testFamily
of
testFilterAcrossMutlipleRegions,,1322201717807.2bdeac6934712efdd694ec44ae48d1b2.
into none, size=none; total size for store is 0.0
{noformat}
The keys in both cases are aaa and aab and the split key is aaa, so the 1st
region (''-'aaa') should indeed be empty after compaction. In trunk it is
correctly compacted to an empty file.
In 0.92 it somehow wrote out the entire file again (so the keys are found in
the store files for both regions).
> Port 2856 (TestAcidGuarantee is failing) to 0.92
> ------------------------------------------------
>
> Key: HBASE-4838
> URL: https://issues.apache.org/jira/browse/HBASE-4838
> Project: HBase
> Issue Type: Sub-task
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.92.0
>
> Attachments: 4838-v1.txt
>
>
> Moving back port into a separate issue (as suggested by JonH), because this
> not trivial.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
