Github user jackylk commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1594#discussion_r155002317
--- Diff:
integration/spark-common/src/main/scala/org/apache/carbondata/spark/load/DataLoadProcessorStepOnSpark.scala
---
@@ -128,7 +128,7 @@ object DataLoadProcessorStepOnSpark {
val model: CarbonLoadModel =
modelBroadcast.value.getCopyWithTaskNo(index.toString)
val conf = DataLoadProcessBuilder.createConfiguration(model)
val sortParameters = SortParameters.createSortParameters(conf)
-
+ val sortStepRowUtil = new SortStepRowUtil(sortParameters)
--- End diff --
I think it is ok to create it for each partition
---
