Github user jackylk commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1855#discussion_r164649308
--- Diff:
integration/spark-common/src/main/scala/org/apache/spark/util/SparkUtil.scala
---
@@ -52,12 +54,14 @@ object SparkUtil {
// set folder or file
hadoopConfiguration.set(FileInputFormat.INPUT_DIR, filePath)
hadoopConfiguration.set(FileInputFormat.INPUT_DIR_RECURSIVE, "true")
+ val jobConf = new JobConf(hadoopConfiguration)
--- End diff --
Seems no one is using this function, please remove it
---