GitHub user dhatchayani opened a pull request:
https://github.com/apache/carbondata/pull/1535
[CARBONDATA-1771] While segment_index compaction, .carbonindex files of
invalid segments are also getting merged
**Scenario:**
Disable feature, do loads, execute MINOR compaction
Execute SEGMENT_INDEX compaction
SEGMENT_INDEX compaction merges .carbonindex files of compacted invalid
segments also
**Solution:**
Merge index files of valid segments only
- [ ] Any interfaces changed?
- [ ] Any backward compatibility impacted?
- [ ] Document update required?
- [X] Testing done
UT Added
- [ ] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dhatchayani/incubator-carbondata
index_compaction
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/1535.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1535
----
commit 9462791bb5ef5eb9dbc9f7c3a8c97ef3e6ad7dfb
Author: dhatchayani <[email protected]>
Date: 2017-11-19T15:23:50Z
[CARBONDATA-1771] While segment_index compaction, .carbonindex files of
invalid segments are also getting merged
----
---
