Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2869#discussion_r229247445
--- Diff:
hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonFileInputFormat.java
---
@@ -145,9 +158,33 @@ public CarbonTable
getOrCreateCarbonTable(Configuration configuration) throws IO
externalTableSegments.add(seg);
}
}
- // do block filtering and get split
- List<InputSplit> splits =
- getSplits(job, filter, externalTableSegments, null,
partitionInfo, null);
+ List<InputSplit> splits = new ArrayList<>();
+ if (isSDK) {
+ for (CarbonFile carbonFile :
getAllCarbonDataFiles(carbonTable.getTablePath())) {
--- End diff --
move it to method getAllFileSplits(), and called it from
CarbonReaderBuilder.build() as discussed above
---
