nsivabalan opened a new pull request #3947:
URL: https://github.com/apache/hudi/pull/3947
## What is the purpose of the pull request
- Lets say there is a partially failed commit which added a new partition
(which is not present in table prior to this commit). next write, will rollback
this failed commit. When fetching partition list we check against
TableFileSystemView which will hit metadata table which may not return the new
partition, but just older partitions. listing files is directly done using fs
and so is not an issue.
- Have put up a quick fix with a test case that fails if not for the fix.
## Brief change log
- fixed listing of partitions in List based rollback helper to use file
system based listing instead of metadata based listing.
## Verify this pull request
This change added tests and can be verified as follows:
-
TestHoodieBackedMetadata#testRollbackOfPartiallyFailedCommitWithNewPartitions
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
