GitHub user ravikiran23 opened a pull request:

    https://github.com/apache/incubator-carbondata/pull/161

    [CARBONDATA-246] compaction is wrong in case if last segment is not 
assigned to an executor.

    PROBLEM:
    
    if during compaction of 4 loads, for any executor if only first 3 loads 
task is assigned then the col cardinality calculation based on the last segment 
info will become wrong.
    
    in this case the cardinality will go wrong for that executor.
    
    Solution : 
    
    Pass the segment properties info from the driver using the last segment. 


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/ravikiran23/incubator-carbondata 
blockDistributionProblem

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-carbondata/pull/161.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #161
    
----
commit 9a0dbc0df8ae091dff0d02133295ce2344cf6734
Author: ravikiran <ravikiran.sn...@gmail.com>
Date:   2016-09-16T19:16:24Z

    if during compaction of 4 loads, for any executor if only first 3 loads 
task is assigned then the col cardinality calculation based on the last segment 
info will become wrong.
    
    in this case the cardinality will go wrong for that executor.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Reply via email to