[ 
https://issues.apache.org/jira/browse/HBASE-21745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-21745:
--------------------------
    Release Note: 
This issue adds via its subtasks:

 * An 'HBCK Report' page to the Master UI added by 
HBASE-22527+HBASE-22709+HBASE-22723+ (since 2.1.6, 2.2.1, 2.3.0). Lists 
consistency or anomalies found via new hbase:meta consistency checking 
extensions added to CatalogJanitor (holes, overlaps, bad servers) and by a new 
'HBCK chore' that runs at a lesser periodicity that will note filesystem 
orphans and overlaps as well as the following conditions:
 ** Master thought this region opened, but no regionserver reported it. 
 ** Master thought this region opened on Server1, but regionserver reported 
Server2 
 ** More than one regionservers reported opened this region
 Both chores can be triggered from the shell to regenerate ‘new’ reports.
 * Means of scheduling a ServerCrashProcedure (HBASE-21393).
 * An ‘offline’ hbase:meta rebuild (HBASE-22680).
 * Offline replace of hbase.version and hbase.id
 * Documentation on how to use completebulkload tool to ‘adopt’ orphaned data 
found by new HBCK2 ‘filesystem’ check (see below) and ‘HBCK chore’ (HBASE-22859)
 * A ‘holes’ and ‘overlaps’ fix that runs in the master that uses new 
bulk-merge facility to collapse many overlaps in the one go.
 * hbase-operator-tools HBCK2 client tool got a bunch of additions:
 ** A specialized 'fix' for the case where operators ran old hbck 'offlinemeta' 
repair and destroyed their hbase:meta; it ties together holes in meta with 
orphaned data in the fs (HBASE-22567)
 ** A ‘filesystem’ command that reports on orphan data as well as bad 
references and hlinks with a ‘fix’ for the latter two options (based on hbck1 
facility updated).
 ** Adds back the ‘replication’ fix facility from hbck1 (HBASE-22717)

  was:
This issue adds via its subtasks:

 * An 'HBCK Report' page to the Master UI added by 
HBASE-22527+HBASE-22709+HBASE-22723+ (since 2.1.6, 2.2.1, 2.3.0). Lists 
consistency or anomalies found via new hbase:meta consistency checking 
extensions added to CatalogJanitor (holes, overlaps, bad servers) and by a new 
'HBCK chore' that runs at a lesser periodicity that will note filesystem 
orphans and overlaps as well as the following conditions:

 ** Master thought this region opened, but no regionserver reported it. 
  ** Master thought this region opened on Server1, but regionserver reported 
Server2 
  ** More than one regionservers reported opened this region

 Both chores can be triggered from the shell to regenerate ‘new’ reports.

 * Means of scheduling a ServerCrashProcedure (HBASE-21393).
 * An ‘offline’ hbase:meta rebuild (HBASE-22680).
 * Offline replace of hbase.version and hbase.id
 * Documentation on how to use completebulkload tool to ‘adopt’ orphaned data 
found by new HBCK2 ‘filesystem’ check (see below) and ‘HBCK chore’ (HBASE-22859)
 * A ‘holes’ and ‘overlaps’ fix that runs in the master that uses new 
bulk-merge facility to collapse many overlaps in the one go.
 * hbase-operator-tools HBCK2 client tool got a bunch of additions:
 ** A specialized 'fix' for the case where operators ran old hbck 'offlinemeta' 
repair and destroyed their hbase:meta; it ties together holes in meta with 
orphaned data in the fs (HBASE-22567)
 ** A ‘filesystem’ command that reports on orphan data as well as bad 
references and hlinks with a ‘fix’ for the latter two options (based on hbck1 
facility updated).
 ** Adds back the ‘replication’ fix facility from hbck1 (HBASE-22717)


> Make HBCK2 be able to fix issues other than region assignment
> -------------------------------------------------------------
>
>                 Key: HBASE-21745
>                 URL: https://issues.apache.org/jira/browse/HBASE-21745
>             Project: HBase
>          Issue Type: Umbrella
>          Components: hbase-operator-tools, hbck2
>            Reporter: Duo Zhang
>            Assignee: stack
>            Priority: Critical
>
> This is what [~apurtell] posted on mailing-list, HBCK2 should support
>  * -Rebuild meta from region metadata in the filesystem, aka offline meta 
> rebuild.-
>  * -Fix assignment errors (undeployed regions, double assignments (yes, 
> should not be possible), etc)- (See 
> https://issues.apache.org/jira/browse/HBASE-21745?focusedCommentId=16888302&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16888302)
>  * -Fix region holes, overlaps, and other errors in the region chain- (See 
> HBASE-22796 and HBASE-22771 -- adds hole and overlap fixing to master; hbck2 
> client can as for a fixMeta).
>  * -Fix failed split and merge transactions that have failed to roll back due 
> to some bug (related to previous)- (Previous items 'overlaps' will take care 
> of these).
>  *  -Enumerate store files to determine file level corruption and sideline 
> corrupt files-
>  * -Fix hfile link problems (dangling / broken)-



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to