akashrn5 commented on a change in pull request #3734:
URL: https://github.com/apache/carbondata/pull/3734#discussion_r419344017
##########
File path:
integration/spark/src/main/scala/org/apache/spark/sql/secondaryindex/rdd/SecondaryIndexCreator.scala
##########
@@ -321,6 +323,18 @@ object SecondaryIndexCreator {
segmentLocks.foreach(segmentLock => {
segmentLock.unlock()
})
+ // if some segments are skipped, disable the SI table so that
+ // SILoadEventListenerForFailedSegments will take care to load to these
segments in next
+ // consecutive load to main table.
+ if (!skippedSegments.isEmpty) {
+ secondaryIndexModel.sqlContext.sparkSession.sql(
+ s"""ALTER TABLE ${
+ secondaryIndexModel
+ .carbonLoadModel
+ .getDatabaseName
+ }.${ secondaryIndexModel.secondaryIndex.indexName } SET
+ |SERDEPROPERTIES ('isSITableEnabled' =
'true')""".stripMargin).collect()
Review comment:
that was by mistake during code change, corrected it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
