prashantwason opened a new pull request #2594:
URL: https://github.com/apache/hudi/pull/2594
## What is the purpose of the pull request
The marker directory is created after a commit instance enters the inflight
stage. If the process dies before the marker directory can be created, the next
commit will encounter a .inflight instance and hence try to rollback. This
rollback will try to list the marker directory to find the marker files. Since
the marker directory was not created in the failed commit, the listing fails
and leads to a FileSystem exception for FileNotFound.
Simple fix is to ensure marker directory exists before trying to list it.
## Brief change log
Simple check for marker directory existence.
## Verify this pull request
An existing unit test has been enhanced.
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
