[
https://issues.apache.org/jira/browse/HBASE-14450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15423524#comment-15423524
]
Ted Yu commented on HBASE-14450:
--------------------------------
Gone through one test output from today looking for WALs involved with
incremental restore:
{code}
2016-08-16 10:13:35,907 INFO [ProcedureExecutor-13]
master.IncrementalTableBackupProcedure(176): Incremental copy from
hdfs://localhost:55522/user/hbase/test-data/03056445-e200-43be-b5b9-
a64f6466dd12/WALs/cn012.l42scl.hortonworks.com,39243,1471367526761/cn012.l42scl.hortonworks.com%2C39243%2C1471367526761.regiongroup-1.1471367533183,hdfs://localhost:55522/user/hbase/test-data/03056445-e200-43be-b5b9-a64f6466dd12/WALs/cn012.l42scl.hortonworks.com,39243,1471367526761/cn012.l42scl.hortonworks.com%2C39243%2C1471367526761.regiongroup-1.1471367567459,hdfs://localhost:
55522/user/hbase/test-data/03056445-e200-43be-b5b9-a64f6466dd12/WALs/cn012.l42scl.hortonworks.com,39243,1471367526761/cn012.l42scl.hortonworks.com%2C39243%2C1471367526761.regiongroup-2.
1471367567039,hdfs://localhost:55522/user/hbase/test-data/03056445-e200-43be-b5b9-a64f6466dd12/WALs/cn012.l42scl.hortonworks.com,43196,1471367526436/cn012.l42scl.hortonworks.
com%2C43196%2C1471367526436.regiongroup-1.1471367530064,hdfs://localhost:55522/user/hbase/test-data/03056445-e200-43be-b5b9-a64f6466dd12/oldWALs/cn012.l42scl.hortonworks.
com%2C39243%2C1471367526761.regiongroup-0.1471367567893,hdfs://localhost:55522/user/hbase/test-data/03056445-e200-43be-b5b9-a64f6466dd12/oldWALs/cn012.l42scl.hortonworks.
com%2C39243%2C1471367526761.regiongroup-2.1471367558565,hdfs://localhost:55522/user/hbase/test-data/03056445-e200-43be-b5b9-a64f6466dd12/oldWALs/cn012.l42scl.hortonworks.
com%2C39243%2C1471367526761.regiongroup-3.1471367561067,hdfs://localhost:55522/user/hbase/test-data/03056445-e200-43be-b5b9-a64f6466dd12/oldWALs/cn012.l42scl.hortonworks.
com%2C43196%2C1471367526436.regiongroup-0.1471367567459,hdfs://localhost:55522/user/hbase/test-data/03056445-e200-43be-b5b9-a64f6466dd12/oldWALs/cn012.l42scl.hortonworks.
com%2C43196%2C1471367526436.regiongroup-1.1471367567039
to hdfs://localhost:55522/backupUT/backup_1471367605362/WALs finished.
...
2016-08-16 10:13:58,053 INFO [main] impl.RestoreClientImpl(284): Restoring
'ns1:test-1471367554256' to 'ns1:table1_restore' from log dirs:
hdfs://localhost:55522/backupUT/ backup_1471367605362/WALs
...
2016-08-16 10:14:08,310 DEBUG [main] mapreduce.WALInputFormat(263): Scanning
hdfs://localhost:55522/backupUT/backup_1471367605362/WALs for WAL files
2016-08-16 10:14:08,311 WARN [main] mapreduce.WALInputFormat(286): File
hdfs://localhost:55522/backupUT/backup_1471367605362/WALs/.backup.manifest does
not appear to be an WAL file. Skipping...
2016-08-16 10:14:08,311 INFO [main] mapreduce.WALInputFormat(278): Found:
hdfs://localhost:55522/backupUT/backup_1471367605362/WALs/cn012.l42scl.hortonworks.com%2C39243%2C1471367526761.
regiongroup-0.1471367567893
2016-08-16 10:14:08,311 INFO [main] mapreduce.WALInputFormat(278): Found:
hdfs://localhost:55522/backupUT/backup_1471367605362/WALs/cn012.l42scl.hortonworks.com%2C39243%2C1471367526761.
regiongroup-1.1471367533183
2016-08-16 10:14:08,311 INFO [main] mapreduce.WALInputFormat(278): Found:
hdfs://localhost:55522/backupUT/backup_1471367605362/WALs/cn012.l42scl.hortonworks.com%2C39243%2C1471367526761.
regiongroup-1.1471367567459
2016-08-16 10:14:08,312 INFO [main] mapreduce.WALInputFormat(278): Found:
hdfs://localhost:55522/backupUT/backup_1471367605362/WALs/cn012.l42scl.hortonworks.com%2C39243%2C1471367526761.
regiongroup-2.1471367558565
2016-08-16 10:14:08,312 INFO [main] mapreduce.WALInputFormat(278): Found:
hdfs://localhost:55522/backupUT/backup_1471367605362/WALs/cn012.l42scl.hortonworks.com%2C39243%2C1471367526761.
regiongroup-2.1471367567039
2016-08-16 10:14:08,312 INFO [main] mapreduce.WALInputFormat(278): Found:
hdfs://localhost:55522/backupUT/backup_1471367605362/WALs/cn012.l42scl.hortonworks.com%2C39243%2C1471367526761.
regiongroup-3.1471367561067
2016-08-16 10:14:08,312 INFO [main] mapreduce.WALInputFormat(278): Found:
hdfs://localhost:55522/backupUT/backup_1471367605362/WALs/cn012.l42scl.hortonworks.com%2C43196%2C1471367526436.
regiongroup-0.1471367567459
2016-08-16 10:14:08,312 INFO [main] mapreduce.WALInputFormat(278): Found:
hdfs://localhost:55522/backupUT/backup_1471367605362/WALs/cn012.l42scl.hortonworks.com%2C43196%2C1471367526436.
regiongroup-1.1471367530064
2016-08-16 10:14:08,312 INFO [main] mapreduce.WALInputFormat(278): Found:
hdfs://localhost:55522/backupUT/backup_1471367605362/WALs/cn012.l42scl.hortonworks.com%2C43196%2C1471367526436.
regiongroup-1.1471367567039
...
2016-08-16 10:14:35,380 INFO [main] impl.RestoreClientImpl(220): Restore
includes the following image(s):
2016-08-16 10:14:35,380 INFO [main] impl.RestoreClientImpl(222): Backup:
backup_1471367566797
hdfs://localhost:55522/backupUT/backup_1471367566797/ns1/test-1471367554256/
2016-08-16 10:14:35,380 INFO [main] impl.RestoreClientImpl(222): Backup:
backup_1471367605362
hdfs://localhost:55522/backupUT/backup_1471367605362/ns1/test-1471367554256/
2016-08-16 10:14:35,380 DEBUG [main] impl.RestoreClientImpl(215): need to clear
merged Image. to be implemented in future jira
...
2016-08-16 10:14:39,330 INFO [main] impl.RestoreClientImpl(284): Restoring
'ns2:test-14713675542561' to 'ns2:table2_restore' from log dirs:
hdfs://localhost:55522/backupUT/ backup_1471367605362/WALs
{code}
Looks like WALInputFormat was able to find related WAL files.
> HBase Backup/Restore Phase 3: Multiwal support
> ----------------------------------------------
>
> Key: HBASE-14450
> URL: https://issues.apache.org/jira/browse/HBASE-14450
> Project: HBase
> Issue Type: Task
> Affects Versions: 2.0.0
> Reporter: Vladimir Rodionov
> Assignee: Ted Yu
> Labels: backup
> Fix For: 2.0.0
>
> Attachments: 14450.roll-wait.txt, 14450.v2.txt,
> org.apache.hadoop.hbase.backup.TestIncrementalBackup-output.txt,
> testIncrementalBackup-8-15.txt
>
>
> We need to support multiwal configurations.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
