[
https://issues.apache.org/jira/browse/CARBONDATA-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15499534#comment-15499534
]
ASF GitHub Bot commented on CARBONDATA-246:
-------------------------------------------
Github user ravikiran23 commented on a diff in the pull request:
https://github.com/apache/incubator-carbondata/pull/161#discussion_r79290299
--- Diff:
integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonMergerRDD.scala
---
@@ -259,6 +253,9 @@ class CarbonMergerRDD[K, V](
)
)
+ // keep on assigning till last one is reached.
+ blocksOfLastSegment = blocksOfOneSegment.asJava
--- End diff --
fixed
> compaction is wrong in case if last segment is not assigned to an executor.
> ----------------------------------------------------------------------------
>
> Key: CARBONDATA-246
> URL: https://issues.apache.org/jira/browse/CARBONDATA-246
> Project: CarbonData
> Issue Type: Bug
> Reporter: ravikiran
>
> if during compaction of 4 loads, for any executor if only first 3 loads task
> is assigned then the col cardinality calculation based on the last segment
> info will become wrong.
> in this case the cardinality will go wrong for that executor.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
