[ 
https://issues.apache.org/jira/browse/KYLIN-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16672628#comment-16672628
 ] 

liuzhixin commented on KYLIN-3388:
----------------------------------

[~Shaofengshi]

Step1: Create Intermediate Flat Hive Table
Step2: Redistribute intermediate table
#
Perhaps, Kylin can insert one rand column in the intermediate hive table for 
the next shard, (as default).
At the same time,  Kylin should support the custom column for shard. (has 
provided)
#

> Data may become not correct if mappers fail during the redistribute step, 
> "distribute by rand()"
> ------------------------------------------------------------------------------------------------
>
>                 Key: KYLIN-3388
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3388
>             Project: Kylin
>          Issue Type: Bug
>          Components: Job Engine
>            Reporter: Zhong Yanghong
>            Assignee: Chao Long
>            Priority: Critical
>             Fix For: v2.4.0, v2.3.2
>
>         Attachments: Hive Issue - distribute by rand().png
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to