Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2310#discussion_r188847798
--- Diff:
core/src/main/java/org/apache/carbondata/core/datamap/DistributableDataMapFormat.java
---
@@ -103,10 +111,23 @@ private static FilterResolverIntf
getFilterExp(Configuration configuration) thro
@Override public void initialize(InputSplit inputSplit,
TaskAttemptContext taskAttemptContext)
throws IOException, InterruptedException {
- DataMapDistributableWrapper distributable =
(DataMapDistributableWrapper) inputSplit;
- TableDataMap dataMap = DataMapStoreManager.getInstance()
+ distributable = (DataMapDistributableWrapper) inputSplit;
+ // clear the segmentMap and from cache in executor when there are
invalid segments
+ SegmentStatusManager ssm = new
SegmentStatusManager(table.getAbsoluteTableIdentifier());
--- End diff --
Don't read table statusfile in executor, pass the invalid segments from
driver
---
