[jira] [Updated] (HBASE-14141) HBase Backup/Restore Phase 3: Filter WALs on backup to include only edits from backed up tables

2017-04-05 Thread Vladimir Rodionov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-14141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Rodionov updated HBASE-14141:
--
Resolution: Fixed
Status: Resolved  (was: Patch Available)

> HBase Backup/Restore Phase 3: Filter WALs on backup to include only edits 
> from backed up tables
> ---
>
> Key: HBASE-14141
> URL: https://issues.apache.org/jira/browse/HBASE-14141
> Project: HBase
>  Issue Type: New Feature
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
>Priority: Blocker
>  Labels: backup
> Fix For: 2.0.0
>
> Attachments: HBASE-14141.HBASE-14123.v1.patch, HBASE-14141.v1.patch, 
> HBASE-14141.v2.patch, HBASE-14141.v4.patch, HBASE-14141.v5.patch, 
> HBASE-14141.v6.patch
>
>
> h2. High level design overview
> * When incremental backup request comes for tables {t} we select all the 
> tables already registered in a backup system  - {T} and union them with {t}, 
> which results in a new table set - U(t, T)
> * For every table K from U(t,T) we perform the following:
> ** Convert new WAL files into HFile applying table filter K (only edits for 
> table T will pass the filter)
> ** Move these HFile(s) to backup destination
> During restore (incremental):
> * We run full restore first
> * Then collect all HFiles from intermediate incremental images and run them 
> through HFileSplitterJob, which splits files into a current tables region 
> boundaries
> * Load these files using LoadIncrementalHFiles tool
>   



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (HBASE-14141) HBase Backup/Restore Phase 3: Filter WALs on backup to include only edits from backed up tables

2017-04-04 Thread Ted Yu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-14141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Yu updated HBASE-14141:
---
Summary: HBase Backup/Restore Phase 3: Filter WALs on backup to include 
only edits from backed up tables  (was: HBase Backup/Restore Phase 3: Filter 
WALs on backup to include only edits from backup tables)

> HBase Backup/Restore Phase 3: Filter WALs on backup to include only edits 
> from backed up tables
> ---
>
> Key: HBASE-14141
> URL: https://issues.apache.org/jira/browse/HBASE-14141
> Project: HBase
>  Issue Type: New Feature
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
>Priority: Blocker
>  Labels: backup
> Fix For: 2.0.0
>
> Attachments: HBASE-14141.HBASE-14123.v1.patch, HBASE-14141.v1.patch, 
> HBASE-14141.v2.patch, HBASE-14141.v4.patch, HBASE-14141.v5.patch, 
> HBASE-14141.v6.patch
>
>
> h2. High level design overview
> * When incremental backup request comes for tables {t} we select all the 
> tables already registered in a backup system  - {T} and union them with {t}, 
> which results in a new table set - U(t, T)
> * For every table K from U(t,T) we perform the following:
> ** Convert new WAL files into HFile applying table filter K (only edits for 
> table T will pass the filter)
> ** Move these HFile(s) to backup destination
> During restore (incremental):
> * We run full restore first
> * Then collect all HFiles from intermediate incremental images and run them 
> through HFileSplitterJob, which splits files into a current tables region 
> boundaries
> * Load these files using LoadIncrementalHFiles tool
>   



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)