ajantha-bhat opened a new pull request #3994:
URL: https://github.com/apache/carbondata/pull/3994
### Why is this PR needed?
For compaction, we don't register in-progress segment. so, when unable to
get a table status lock. compaction can fail. That time compaction partial
segment needs to be cleaned. If the partial segment is failed to clean up due
to unable to get lock or IO issues. When the user retries the compaction.
carbon uses the same segment id. so while writing the segment file for new
compaction. list only the files mapping to the current compaction, not all the
files which contain stale files.
### What changes were proposed in this PR?
While writing the segment file, consider index files belongs to the current
load only in the segment folder.
### Does this PR introduce any user interface change?
- No
### Is any new testcase added?
- No [As it happens in concurrent scenario randomly, manually verified]
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
