xubo245 commented on a change in pull request #3196: [CARBONDATA-3366] Support
SDK reader to read blocklet level split
URL: https://github.com/apache/carbondata/pull/3196#discussion_r281081334
##########
File path:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReaderBuilder.java
##########
@@ -228,4 +228,118 @@ public CarbonReaderBuilder withRowRecordReader() {
}
}
+ /**
+ * gets an array of blocklet level CarbonInputSplits
+ * @return
+ * @throws IOException
+ */
+ public InputSplit[] getSplits() throws IOException {
+ if (hadoopConf == null) {
+ hadoopConf = FileFactory.getConfiguration();
+ }
+ CarbonTable table;
+ table = CarbonTable.buildTable(tablePath, tableName, hadoopConf);
+ final CarbonFileInputFormat format = new CarbonFileInputFormat();
+ final Job job = new Job(hadoopConf);
+ // set cache level to blockletlevel
Review comment:
blocklet level
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
