[
https://issues.apache.org/jira/browse/HBASE-22330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16836034#comment-16836034
]
Hudson commented on HBASE-22330:
--------------------------------
SUCCESS: Integrated in Jenkins build HBase-1.3-IT #552 (See
[https://builds.apache.org/job/HBase-1.3-IT/552/])
HBASE-22330 Backport HBASE-20724 (Sometimes some compacted storefiles
(abhishek.chouhan:
[https://github.com/apache/hbase/commit/074ebb856675d8bdd389e62774e2572e84d835a3])
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/AbstractMultiFileWriter.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/DateTieredCompactor.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCleanupCompactedFileOnRegionClose.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/compactions/TestCompactor.java
* (edit)
hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/HFileProtos.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/StripeCompactor.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
* (edit)
hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
* (edit) hbase-protocol/src/main/protobuf/HFile.proto
* (add)
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCleanupCompactedFileAfterFailover.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/DefaultCompactor.java
> Backport HBASE-20724 (Sometimes some compacted storefiles are still opened
> after region failover) to branch-1
> -------------------------------------------------------------------------------------------------------------
>
> Key: HBASE-22330
> URL: https://issues.apache.org/jira/browse/HBASE-22330
> Project: HBase
> Issue Type: Sub-task
> Components: Compaction, regionserver
> Affects Versions: 1.5.0, 1.4.9, 1.3.4
> Reporter: Andrew Purtell
> Assignee: Abhishek Singh Chouhan
> Priority: Major
> Fix For: 1.5.0, 1.3.5, 1.4.11
>
> Attachments: HBASE-22330.branch-1.001.patch,
> HBASE-22330.branch-1.002.patch, HBASE-22330.branch-1.3.001.patch
>
>
> There appears to be a race condition between close and split which when
> combined with a side effect of HBASE-20704, leads to the parent region store
> files getting archived and cleared while daughter regions still have
> references to those parent region store files.
> Here is the timeline of events observed for an affected region:
> # RS1 faces ZooKeeper connectivity issue for master node and starts shutting
> itself down. As part of this it starts to close the store and clean up the
> compacted files (File A)
> # Master starts bulk assigning regions and assign parent region to RS2
> # Region opens on RS2 and ends up opening compacted store file(s) (suspect
> this is due to HBASE-20724)
> # Now split happens and daughter regions open on RS2 and try to run a
> compaction as part of post open
> # Split request at this point is complete. However now archiving proceeds on
> RS1 and ends up archiving the store file that is referenced by the daughter.
> Compaction fails due to FileNotFoundException and all subsequent attempts to
> open the region will fail until manual resolution.
> We think having HBASE-20724 would help in such situations since we won't end
> up loading compacted store files in the first place.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
