Github user jackylk commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1669#discussion_r157356369
--- Diff:
integration/spark-common/src/main/scala/org/apache/carbondata/spark/load/DataLoadProcessBuilderOnSpark.scala
---
@@ -160,4 +162,112 @@ object DataLoadProcessBuilderOnSpark {
Array((uniqueLoadStatusId, (loadMetadataDetails, executionErrors)))
}
}
+
+ /**
+ * use FileScanRDD to read input csv files
--- End diff --
change comment to mention this function creates a RDD that does reading of
multiple CSV files
---