[ https://issues.apache.org/jira/browse/HBASE-22075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877429#comment-16877429 ]
Vladimir Rodionov edited comment on HBASE-22075 at 7/3/19 2:16 AM: ------------------------------------------------------------------- I think, *hbase.bulkload.retries.number* in a master branch is equals to # of regions in a table + 1. This should work in any case? The original (first one) patch to this ticket handles bulkload failures due to insufficient # of retries, but can not handle race conditions created during *ReproMOBDataLoss.java* run. This can be not a MOB issue at all, my guess. Something not MOB related is different in CDH 5? May be general compaction code? was (Author: vrodionov): I think, *hbase.bulkload.retries.number* in a master branch is equals to # of regions in a table + 1. This should work in any case? The original (first one) patch to this ticket handles bulkhead failures due to insufficient # of retries, but can not handle race conditions created during *ReproMOBDataLoss.java* run. This can be not a MOB issue at all, my guess. Something not MOB related is different in CDH 5? May be general compaction code? > Potential data loss when MOB compaction fails > --------------------------------------------- > > Key: HBASE-22075 > URL: https://issues.apache.org/jira/browse/HBASE-22075 > Project: HBase > Issue Type: Bug > Components: mob > Affects Versions: 2.1.0, 2.0.0, 2.0.1, 2.1.1, 2.0.2, 2.0.3, 2.1.2, 2.0.4, > 2.1.3 > Reporter: Vladimir Rodionov > Assignee: Vladimir Rodionov > Priority: Critical > Labels: compaction, mob > Fix For: 2.0.6, 2.2.1, 2.1.6 > > Attachments: HBASE-22075-v1.patch, HBASE-22075-v2.patch, > HBASE-22075.test-only.0.patch, HBASE-22075.test-only.1.patch, > HBASE-22075.test-only.2.patch, ReproMOBDataLoss.java > > > When MOB compaction fails during last step (bulk load of a newly created > reference file) there is a high chance of a data loss due to partially loaded > reference file, cells of which refer to (now) non-existent MOB file. The > newly created MOB file is deleted automatically in case of a MOB compaction > failure, but some cells with the references to this file might be loaded to > HBase. -- This message was sent by Atlassian JIRA (v7.6.3#76005)