Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1781#discussion_r163763834
--- Diff:
integration/spark2/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala
---
@@ -541,9 +543,11 @@ object CarbonDataRDDFactory {
carbonLoadModel,
loadStatus,
newEntryLoadStatus,
- overwriteTable)
+ overwriteTable,
+ uniqueTableStatusId)
+ PreAggregateUtil.commitDataMaps(carbonLoadModel,
uniqueTableStatusId)(sqlContext.sparkSession)
--- End diff --
Add a listener for postStatusUpdateEvent and commit in that listner
---