[jira] [Updated] (HBASE-18843) Add DistCp support to incremental backup with bulk loading

2017-10-13 Thread Ted Yu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Yu updated HBASE-18843:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Thanks for the patch, Vlad.

Thanks for the review, Josh.

> Add DistCp support to incremental backup with bulk loading
> --
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
>  Issue Type: Improvement
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-18843-v1.patch, HBASE-18843-v2.patch, 
> HBASE-18843-v4.patch, HBASE-18843-v5.patch, HBASE-18843-v6.patch, 
> HBASE-18843-v7.patch, HBASE-18843-v8.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side 
> (where backup create runs). This has to be replaced with DistCp copying.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18843) Add DistCp support to incremental backup with bulk loading

2017-10-13 Thread Vladimir Rodionov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Rodionov updated HBASE-18843:
--
Attachment: HBASE-18843-v8.patch

v8. still not compatible with hadoop3. will open separate JIRA. 
[~te...@apache.org], [~elserj] can we commit this one?

> Add DistCp support to incremental backup with bulk loading
> --
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
>  Issue Type: Improvement
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-18843-v1.patch, HBASE-18843-v2.patch, 
> HBASE-18843-v4.patch, HBASE-18843-v5.patch, HBASE-18843-v6.patch, 
> HBASE-18843-v7.patch, HBASE-18843-v8.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side 
> (where backup create runs). This has to be replaced with DistCp copying.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18843) Add DistCp support to incremental backup with bulk loading

2017-10-04 Thread Vladimir Rodionov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Rodionov updated HBASE-18843:
--
Attachment: HBASE-18843-v7.patch

v7 (small fixes, findbugs etc)

> Add DistCp support to incremental backup with bulk loading
> --
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
>  Issue Type: Improvement
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-18843-v1.patch, HBASE-18843-v2.patch, 
> HBASE-18843-v4.patch, HBASE-18843-v5.patch, HBASE-18843-v6.patch, 
> HBASE-18843-v7.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side 
> (where backup create runs). This has to be replaced with DistCp copying.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18843) Add DistCp support to incremental backup with bulk loading

2017-10-03 Thread Ted Yu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Yu updated HBASE-18843:
---
Status: Patch Available  (was: Reopened)

> Add DistCp support to incremental backup with bulk loading
> --
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
>  Issue Type: Improvement
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-18843-v1.patch, HBASE-18843-v2.patch, 
> HBASE-18843-v4.patch, HBASE-18843-v5.patch, HBASE-18843-v6.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side 
> (where backup create runs). This has to be replaced with DistCp copying.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18843) Add DistCp support to incremental backup with bulk loading

2017-10-03 Thread Vladimir Rodionov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Rodionov updated HBASE-18843:
--
Attachment: HBASE-18843-v6.patch

v6. Compiles under Hadoop 3.0, but does not work (actually, all backup tests 
fail under 3.0 - totally separate issue). Works fine under 2.7+

> Add DistCp support to incremental backup with bulk loading
> --
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
>  Issue Type: Improvement
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-18843-v1.patch, HBASE-18843-v2.patch, 
> HBASE-18843-v4.patch, HBASE-18843-v5.patch, HBASE-18843-v6.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side 
> (where backup create runs). This has to be replaced with DistCp copying.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18843) Add DistCp support to incremental backup with bulk loading

2017-09-28 Thread stack (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-18843:
--
Fix Version/s: (was: 2.0.0-alpha-4)
   2.0.0-beta-1

> Add DistCp support to incremental backup with bulk loading
> --
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
>  Issue Type: Improvement
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0-beta-1
>
> Attachments: HBASE-18843-v1.patch, HBASE-18843-v2.patch, 
> HBASE-18843-v4.patch, HBASE-18843-v5.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side 
> (where backup create runs). This has to be replaced with DistCp copying.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18843) Add DistCp support to incremental backup with bulk loading

2017-09-26 Thread Ted Yu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Yu updated HBASE-18843:
---
   Resolution: Fixed
 Hadoop Flags: Reviewed
Fix Version/s: 2.0.0-alpha-4
   Status: Resolved  (was: Patch Available)

Thanks for the patch, Vlad.

> Add DistCp support to incremental backup with bulk loading
> --
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
>  Issue Type: Improvement
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Fix For: 2.0.0-alpha-4
>
> Attachments: HBASE-18843-v1.patch, HBASE-18843-v2.patch, 
> HBASE-18843-v4.patch, HBASE-18843-v5.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side 
> (where backup create runs). This has to be replaced with DistCp copying.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18843) Add DistCp support to incremental backup with bulk loading

2017-09-26 Thread Vladimir Rodionov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Rodionov updated HBASE-18843:
--
Attachment: HBASE-18843-v5.patch

v5 adds annotation to the new class

> Add DistCp support to incremental backup with bulk loading
> --
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
>  Issue Type: Improvement
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Attachments: HBASE-18843-v1.patch, HBASE-18843-v2.patch, 
> HBASE-18843-v4.patch, HBASE-18843-v5.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side 
> (where backup create runs). This has to be replaced with DistCp copying.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18843) Add DistCp support to incremental backup with bulk loading

2017-09-26 Thread Ted Yu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Yu updated HBASE-18843:
---
Status: Patch Available  (was: Open)

> Add DistCp support to incremental backup with bulk loading
> --
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
>  Issue Type: Improvement
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Attachments: HBASE-18843-v1.patch, HBASE-18843-v2.patch, 
> HBASE-18843-v4.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side 
> (where backup create runs). This has to be replaced with DistCp copying.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18843) Add DistCp support to incremental backup with bulk loading

2017-09-26 Thread Vladimir Rodionov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Rodionov updated HBASE-18843:
--
Attachment: HBASE-18843-v4.patch

Patch v4. cc : [~te...@apache.org]

> Add DistCp support to incremental backup with bulk loading
> --
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
>  Issue Type: Improvement
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Attachments: HBASE-18843-v1.patch, HBASE-18843-v2.patch, 
> HBASE-18843-v4.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side 
> (where backup create runs). This has to be replaced with DistCp copying.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18843) Add DistCp support to incremental backup with bulk loading

2017-09-21 Thread Vladimir Rodionov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Rodionov updated HBASE-18843:
--
Attachment: HBASE-18843-v2.patch

v2 (added interface annotation to the new class)

> Add DistCp support to incremental backup with bulk loading
> --
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
>  Issue Type: Improvement
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Attachments: HBASE-18843-v1.patch, HBASE-18843-v2.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side 
> (where backup create runs). This has to be replaced with DistCp copying.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18843) Add DistCp support to incremental backup with bulk loading

2017-09-21 Thread Vladimir Rodionov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Rodionov updated HBASE-18843:
--
Description: Currently, we copy bulk loaded files to backup one-by-one on a 
client side (where backup create runs). This has to be replaced with DistCp 
copying.

> Add DistCp support to incremental backup with bulk loading
> --
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
>  Issue Type: Improvement
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Attachments: HBASE-18843-v1.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side 
> (where backup create runs). This has to be replaced with DistCp copying.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HBASE-18843) Add DistCp support to incremental backup with bulk loading

2017-09-21 Thread Vladimir Rodionov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Rodionov updated HBASE-18843:
--
Attachment: HBASE-18843-v1.patch

Patch v1

> Add DistCp support to incremental backup with bulk loading
> --
>
> Key: HBASE-18843
> URL: https://issues.apache.org/jira/browse/HBASE-18843
> Project: HBase
>  Issue Type: Improvement
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Attachments: HBASE-18843-v1.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)