bvaradar opened a new pull request #1459: [WIP] [HUDI-418] [HUDI-421] Bootstrap Index using HFile and File System View Changes with unit-test URL: https://github.com/apache/incubator-hudi/pull/1459 ## What is the purpose of the pull request This is part of code changes needed to support RFC-12 to support efficient bootstrap of legacy tables. This PR contains 2 commits * HUDI-418 - Bootstrap Index using HFile with APIs to create and lookup. Note that this implementation is different from what was initially proposed in RFC-12. This implementation uses existing HFile layout as this layout works well for our usecase and the implementation is battle tested and stable. There are 2 HFiles maintained - one for storing all bootstrap mappings at partition level (for all file-system view calls) and another at per file-id level (for compaction lookups) * HUDI-421 Core Changes in File System View to integrate with Bootstrap Index. With this change the upper layers which uses FileSystem View can easily identify and handle external base-files. ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit - [ ] Commit message is descriptive of the change - [ ] CI is green - [ ] Necessary doc changes done or have another open PR - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
