Ted Yu updated HBASE-14417:
    Attachment: 14417.v1.txt

Patch v1 shows basic flow of bulk loaded hfiles support.

To be added:
cleanup of BulkLoadDescriptor at the completion of full backup
BackupHFileCleaner which guards bulk loaded hfiles which are referenced by 

> Incremental backup and bulk loading
> -----------------------------------
>                 Key: HBASE-14417
>                 URL: https://issues.apache.org/jira/browse/HBASE-14417
>             Project: HBase
>          Issue Type: New Feature
>    Affects Versions: 2.0.0
>            Reporter: Vladimir Rodionov
>            Assignee: Ted Yu
>            Priority: Critical
>              Labels: backup
>             Fix For: 2.0.0
>         Attachments: 14417.v1.txt
> Currently, incremental backup is based on WAL files. Bulk data loading 
> bypasses WALs for obvious reasons, breaking incremental backups. The only way 
> to continue backups after bulk loading is to create new full backup of a 
> table. This may not be feasible for customers who do bulk loading regularly 
> (say, every day).
> Google doc for design:
> https://docs.google.com/document/d/1ACCLsecHDvzVSasORgqqRNrloGx4mNYIbvAU7lq5lJE

This message was sent by Atlassian JIRA

Reply via email to