apurtell opened a new pull request #4241: URL: https://github.com/apache/hbase/pull/4241
In a discussion on dev@ the idea was floated that StoreFileTracker could be backported into branch-2.5 to be released as part of 2.5.0 as an experimental feature. This issue considers the backport. There are sixteen subtasks on [HBASE-26067](https://issues.apache.org/jira/browse/HBASE-26067) and several other tangential commits. Cherry pick the list in sequence, fixing up as necessary. These appear to be the core commits: - commit 6aaef8978 [HBASE-26064](https://issues.apache.org/jira/browse/HBASE-26064) Introduce a StoreFileTracker to abstract the store file tracking logic - commit 43b40e937 [HBASE-25988](https://issues.apache.org/jira/browse/HBASE-25988) Store the store file list by a file (#3578) - commit 6e053765e [HBASE-26079](https://issues.apache.org/jira/browse/HBASE-26079) Use StoreFileTracker when splitting and merging (#3617) - commit 090b2fecf [HBASE-26224](https://issues.apache.org/jira/browse/HBASE-26224) Introduce a MigrationStoreFileTracker to support migrating from different store file tracker implementations (#3656) - commit 0ee168933 [HBASE-26246](https://issues.apache.org/jira/browse/HBASE-26246) Persist the StoreFileTracker configurations to TableDescriptor when creating table (#3666) - commit 2052e80e5 [HBASE-26248](https://issues.apache.org/jira/browse/HBASE-26248) Should find a suitable way to let users specify the store file tracker implementation (#3665) - commit 5ff0f98a5 [HBASE-26264](https://issues.apache.org/jira/browse/HBASE-26264) Add more checks to prevent misconfiguration on store file tracker (#3681) - commit fc4f6d10e [HBASE-26280](https://issues.apache.org/jira/browse/HBASE-26280) Use store file tracker when snapshoting (#3685) - commit 06db852aa [HBASE-26326](https://issues.apache.org/jira/browse/HBASE-26326) CreateTableProcedure fails when FileBasedStoreFileTracker… (#3721) - commit e4e7cf80b [HBASE-26386](https://issues.apache.org/jira/browse/HBASE-26386) Refactor StoreFileTracker implementations to expose the set method (#3774) - commit 08d117197 [HBASE-26328](https://issues.apache.org/jira/browse/HBASE-26328) Clone snapshot doesn't load reference files into FILE SFT impl (#3749) - commit 8bec26ea9 [HBASE-26263](https://issues.apache.org/jira/browse/HBASE-26263) [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables (#3700) - commit a288365f9 [HBASE-26271](https://issues.apache.org/jira/browse/HBASE-26271) Cleanup the broken store files under data directory (#3786) - commit d00b5faad [HBASE-26454](https://issues.apache.org/jira/browse/HBASE-26454) CreateTableProcedure still relies on temp dir and renames… (#3845) - commit 771e552cf [HBASE-26286](https://issues.apache.org/jira/browse/HBASE-26286): Add support for specifying store file tracker when restoring or cloning snapshot - commit f16b7b1bf [HBASE-26265](https://issues.apache.org/jira/browse/HBASE-26265) Update ref guide to mention the new store file tracker im… (#3942) And from [HBASE-26584](https://issues.apache.org/jira/browse/HBASE-26584) and beyond: - commit 755b3b4cb [HBASE-26585](https://issues.apache.org/jira/browse/HBASE-26585) Add SFT configuration to META table descriptor when creating META (#3998) - commit 39c42c7dc [HBASE-26639](https://issues.apache.org/jira/browse/HBASE-26639) The implementation of TestMergesSplitsAddToTracker is problematic (#4010) - commit 6e1f5b7fe [HBASE-26586](https://issues.apache.org/jira/browse/HBASE-26586) Should not rely on the global config when setting SFT implementation for a table while upgrading (#4006) - commit f1dd865c3 [HBASE-26654](https://issues.apache.org/jira/browse/HBASE-26654) ModifyTableDescriptorProcedure shoud load TableDescriptor while executing (#4034) - commit 8fbc9a260 [HBASE-26674](https://issues.apache.org/jira/browse/HBASE-26674) Should modify filesCompacting under storeWriteLock (#4040) - commit 5aa0fd265 [HBASE-26675](https://issues.apache.org/jira/browse/HBASE-26675) Data race on Compactor.writer (#4035) - commit 3021c5851 [HBASE-26700](https://issues.apache.org/jira/browse/HBASE-26700) The way we bypass broken track file is not enough in StoreFileListFile (#4055) - commit a8b68c9b8 [HBASE-26690](https://issues.apache.org/jira/browse/HBASE-26690) Modify FSTableDescriptors to not rely on renaming when writing TableDescriptor (#4054) - commit dffeb8e63 [HBASE-26587](https://issues.apache.org/jira/browse/HBASE-26587) Introduce a new Admin API to change SFT implementation (#4030) (#4080) - commit b265fe55b [HBASE-26673](https://issues.apache.org/jira/browse/HBASE-26673) Implement a shell command for change SFT implementation (#4113) - commit 4cdb380cc [HBASE-26640](https://issues.apache.org/jira/browse/HBASE-26640) Reimplement master local region initialization to better work with SFT (#4111) - commit 77bb153a2 [HBASE-26707](https://issues.apache.org/jira/browse/HBASE-26707): Reduce number of renames during bulkload (#4066) (#4122) - commit a4b192e33 [HBASE-26611](https://issues.apache.org/jira/browse/HBASE-26611) Changing SFT implementation on disabled table is dangerous (#4082) - commit d3629bbf1 [HBASE-26837](https://issues.apache.org/jira/browse/HBASE-26837) Set SFT config when creating TableDescriptor in TestCloneSnapshotProcedure (#4226) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
