This is an automated email from the ASF dual-hosted git repository.
anmolnar pushed a change to branch HBASE-28957_rebased
in repository https://gitbox.apache.org/repos/asf/hbase.git
discard 7b8d840f35b Unit test fixes
discard d714a516723 Remove testFailOnEmptyWALFilesWhenNotIgnored test
discard 13e6fe32dcc Include offset persistence from ReplicationSourceShipper
discard a12ed49c2c4 HBASE-28957. Build fixes
discard 45ff1abbd38 HBASE-29891: Multi-table continuous incremental backup is
failing bec… (#7891)
discard a698741df78 HBASE-28957. Unit test upgrade junit 4 -> 5
discard e5e6470eff5 HBASE-28957. Spotless apply
discard f367ca88b97 HBASE-28957. Resolve build errors
discard 947ae38c42b HBASE-29825: Incremental backup is failing due to
incorrect timezone (#7683)
discard aa0c56112cf HBASE-29826: Backup merge is failing because
.backup.manifest cannot be found (#7664)
discard bfa956affc5 HBASE-28957. Build + spotless fix
discard 816ebef2592 HBASE-29656 Scan WALs to identify bulkload operations for
incremental backup (#7400)
discard 9bc7ef5246c HBASE-29521: Update Restore Command to Handle Bulkloaded
Files (#7300)
discard d8398cc619e Revert "HBASE-29310 Handle Bulk Load Operations in
Continuous Backup (#7150)" (#7290)
discard 4e9b2eaf06e [HBASE-29520] Utilize Backed-up Bulkloaded Files in
Incremental Backup (#7246)
discard e76d8512983 HBASE-29524 Handle bulk-loaded HFiles in delete and
cleanup process (#7239)
discard 29f804f1e2a HBASE-29519 Copy Bulkloaded Files in Continuous Backup
(#7222)
discard d6175331653 HBASE-29375 Add Unit Tests for BackupAdminImpl and Improve
Test Granularity (#7171)
discard df06be82493 HBASE-28957 spotless apply after rebase
discard 98151bb8136 HBASE-29310 Handle Bulk Load Operations in Continuous
Backup (#7150)
discard de4b1665313 HBASE-29459 Capture bulkload files only till
IncrCommittedWalTs during Incremental Backup (#7166)
discard 44f0370f54f HBASE-29441 ReplicationSourceShipper should delegate the
empty wal entries handling to ReplicationEndpoint (#7145)
discard 29e9d4d2407 HBASE-29445 Add Option to Specify Custom Backup Location
in PITR (#7153)
discard 93f224e3b30 HBASE-29449 Update backup describe command for continuous
backup (#7045)
discard bd8c8b14d89 HBASE-29406: Skip Copying Bulkloaded Files to Backup
Location in Continuous Backup (#7119)
discard 872c532569d HBASE-29219 Ignore Empty WAL Files While Consuming
Backed-Up WAL Files (#7106)
discard 2f49447184a HBASE-29350: Ensure Cleanup of Continuous Backup WALs
After Last Backup is Force Deleted (#7090)
discard c5244593576 HBASE-28990 Modify Incremental Backup for Continuous
Backup (#6788)
discard bf56071ca50 HBASE-29255: Integrate backup WAL cleanup logic with the
delete command (#7007)
discard e588d52e5d7 HBASE-29133: Implement "pitr" Command for Point-in-Time
Restore (#6717)
discard 21185f100ee HBASE-29261: Investigate flaw in backup deletion
validation of PITR-critical backups and propose correct approach (#6922)
discard e1f10bd3f15 HBASE-29210: Introduce Validation for PITR-Critical Backup
Deletion (#6848)
discard f07b298315f HBASE-29025: Enhance the full backup command to support
Continuous Backup (#6710)
discard 5cdf7296ca9 HBASE-28996: Implement Custom ReplicationEndpoint to
Enable WAL Backup to External Storage (#6633)
add 59fc59ca7c1 HBASE-27691 Prevent filters from seeing synthetic scan
start cells (#8485)
add 14b1c19280c HBASE-30325 Bump gitpython from 3.1.57 to 3.1.58 in
/dev-support/flaky-tests (#8544)
add 227ac481983 HBASE-30326 Bump gitpython in
/dev-support/git-jira-release-audit (#8543)
add c3602c95e96 HBASE-30324 Uploading hbase-src.tar.gz is broken in
integration test (#8545)
add 96922fc01c5 HBASE-29984 Support separate old WAL directories in backup
(#8512)
add f9437f44fcc HBASE-30320 TestMemStoreLAB#testLABChunkQueue OOM on fast
hardware due to unbounded off-pool chunk allocation (#8533)
add cb16834dd12 HBASE-30322: Persist all fields of BackupInfo (#8542)
add 77ec3c1010c HBASE-30316 Add Docker build modes and user-friendly
tooling (#8530)
add 5fd36d83692 HBASE-28996: Implement Custom ReplicationEndpoint to
Enable WAL Backup to External Storage (#6633)
add d978ebb4239 HBASE-29025: Enhance the full backup command to support
Continuous Backup (#6710)
add 8cd4692164b HBASE-29210: Introduce Validation for PITR-Critical Backup
Deletion (#6848)
add 4fcd55a540d HBASE-29261: Investigate flaw in backup deletion
validation of PITR-critical backups and propose correct approach (#6922)
add b46d7ea121a HBASE-29133: Implement "pitr" Command for Point-in-Time
Restore (#6717)
add 823417be81f HBASE-29255: Integrate backup WAL cleanup logic with the
delete command (#7007)
add adc813a2369 HBASE-28990 Modify Incremental Backup for Continuous
Backup (#6788)
add 46eadcfd875 HBASE-29350: Ensure Cleanup of Continuous Backup WALs
After Last Backup is Force Deleted (#7090)
add 00f2cbd796b HBASE-29219 Ignore Empty WAL Files While Consuming
Backed-Up WAL Files (#7106)
add 416c5650a4d HBASE-29406: Skip Copying Bulkloaded Files to Backup
Location in Continuous Backup (#7119)
add a8315656abc HBASE-29449 Update backup describe command for continuous
backup (#7045)
add 5abdd8d0ff9 HBASE-29445 Add Option to Specify Custom Backup Location
in PITR (#7153)
add 8a97dc74a59 HBASE-29441 ReplicationSourceShipper should delegate the
empty wal entries handling to ReplicationEndpoint (#7145)
add 3a4b616bace HBASE-29459 Capture bulkload files only till
IncrCommittedWalTs during Incremental Backup (#7166)
add d428cf58310 HBASE-29310 Handle Bulk Load Operations in Continuous
Backup (#7150)
add 5a6c7eb92ea HBASE-28957 spotless apply after rebase
add 832a73b3e08 HBASE-29375 Add Unit Tests for BackupAdminImpl and Improve
Test Granularity (#7171)
add 570a01b8338 HBASE-29519 Copy Bulkloaded Files in Continuous Backup
(#7222)
add b47d8abb83d HBASE-29524 Handle bulk-loaded HFiles in delete and
cleanup process (#7239)
add 779990c7ac8 [HBASE-29520] Utilize Backed-up Bulkloaded Files in
Incremental Backup (#7246)
add 2b040368f2f Revert "HBASE-29310 Handle Bulk Load Operations in
Continuous Backup (#7150)" (#7290)
add a473bbea7f2 HBASE-29521: Update Restore Command to Handle Bulkloaded
Files (#7300)
add 97d4fdfce33 HBASE-29656 Scan WALs to identify bulkload operations for
incremental backup (#7400)
add 4e586063bf5 HBASE-28957. Build + spotless fix
add 616d358f5ca HBASE-29826: Backup merge is failing because
.backup.manifest cannot be found (#7664)
add 3d23ed21869 HBASE-29825: Incremental backup is failing due to
incorrect timezone (#7683)
add c74154f61dc HBASE-28957. Resolve build errors
add 5a56abecfdb HBASE-28957. Spotless apply
add d829352fe10 HBASE-28957. Unit test upgrade junit 4 -> 5
add 654267f0fb3 HBASE-29891: Multi-table continuous incremental backup is
failing bec… (#7891)
add a4ce25eab39 HBASE-28957. Build fixes
add 1c3a517d5b7 Include offset persistence from ReplicationSourceShipper
add 67fee795369 Remove testFailOnEmptyWALFilesWhenNotIgnored test
add 77ed232a3b5 Unit test fixes
add 0106b884e60 Rebase fix
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (7b8d840f35b)
\
N -- N -- N refs/heads/HBASE-28957_rebased (0106b884e60)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
dev-support/flaky-tests/python-requirements.txt | 2 +-
.../git-jira-release-audit/requirements.txt | 2 +-
dev-support/hbase_docker/.dockerignore | 13 +
dev-support/hbase_docker/Dockerfile | 40 +-
dev-support/hbase_docker/README.md | 425 +++++++++++++++++++--
dev-support/hbase_docker/build-hbase.sh | 400 +++++++++++++++++++
dev-support/hbase_docker/m1/.dockerignore | 11 +
dev-support/hbase_docker/m1/Dockerfile | 40 +-
.../integration-test/integration-test.Jenkinsfile | 5 +-
.../org/apache/hadoop/hbase/backup/BackupInfo.java | 20 +
.../backup/impl/IncrementalBackupManager.java | 8 +-
.../hadoop/hbase/backup/util/BackupUtils.java | 4 +
.../hbase/backup/TestBackupInfoSerialization.java | 166 ++++++++
.../hadoop/hbase/backup/TestBackupUtils.java | 5 +
.../hbase/backup/TestIncrementalBackupManager.java | 104 +++++
.../src/main/protobuf/Backup.proto | 8 +-
.../hadoop/hbase/regionserver/StoreScanner.java | 7 +-
.../hadoop/hbase/regionserver/TestMemStoreLAB.java | 7 +
.../hadoop/hbase/regionserver/TestScanner.java | 189 +++++++++
.../hbase/regionserver/TestSeekOptimizations.java | 63 ++-
20 files changed, 1462 insertions(+), 57 deletions(-)
create mode 100644 dev-support/hbase_docker/.dockerignore
create mode 100755 dev-support/hbase_docker/build-hbase.sh
create mode 100644 dev-support/hbase_docker/m1/.dockerignore
create mode 100644
hbase-backup/src/test/java/org/apache/hadoop/hbase/backup/TestBackupInfoSerialization.java
create mode 100644
hbase-backup/src/test/java/org/apache/hadoop/hbase/backup/TestIncrementalBackupManager.java
