[jira] [Commented] (KYLIN-3278) Kylin should not distribute hive table by random at Step1
[ https://issues.apache.org/jira/browse/KYLIN-3278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407401#comment-16407401 ] ASF subversion and git services commented on KYLIN-3278: Commit 0029d8a77a4588e613f766f3218595cf33e1fb2e in kylin's branch refs/heads/master from shaofengshi [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=0029d8a ] KYLIN-3278 Revert "KYLIN-3084, fix issue by using distribute by" This reverts commit 849faec7d63b59af58eadc331f00c96343f18cc8. Remove unnecessary UT > Kylin should not distribute hive table by random at Step1 > - > > Key: KYLIN-3278 > URL: https://issues.apache.org/jira/browse/KYLIN-3278 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Affects Versions: v2.3.0 >Reporter: Chuqian Yu >Assignee: Wang Cheng >Priority: Major > Fix For: v2.3.1 > > > Hi,Kylin team. > When I upgrade from 2.2.0 to 2.3.0 ,I found that the step.1 "Create > Intermediate Flat Hive Table" of cube build was much slower than before, > because Kylin distribute hive table by random when created it in version > 2.3.0 . I wander is it necessary? Because > kylin.source.hive.redistribute-flat-table was set to true by default, so we > will do the distribution job at Step.2 "Redistribute Flat Hive Table". > Best regards, > Chuqian Yu -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3278) Kylin should not distribute hive table by random at Step1
[ https://issues.apache.org/jira/browse/KYLIN-3278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407390#comment-16407390 ] ASF subversion and git services commented on KYLIN-3278: Commit aa2f8e796f387c1227c8fa216b9af69d0ee9de42 in kylin's branch refs/heads/2.3.x from shaofengshi [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=aa2f8e7 ] KYLIN-3278 Revert "KYLIN-3084, fix issue by using distribute by" This reverts commit 849faec7d63b59af58eadc331f00c96343f18cc8. Remove unnecessary UT > Kylin should not distribute hive table by random at Step1 > - > > Key: KYLIN-3278 > URL: https://issues.apache.org/jira/browse/KYLIN-3278 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Affects Versions: v2.3.0 >Reporter: Chuqian Yu >Assignee: Wang Cheng >Priority: Major > Fix For: v2.3.1 > > > Hi,Kylin team. > When I upgrade from 2.2.0 to 2.3.0 ,I found that the step.1 "Create > Intermediate Flat Hive Table" of cube build was much slower than before, > because Kylin distribute hive table by random when created it in version > 2.3.0 . I wander is it necessary? Because > kylin.source.hive.redistribute-flat-table was set to true by default, so we > will do the distribution job at Step.2 "Redistribute Flat Hive Table". > Best regards, > Chuqian Yu -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3278) Kylin should not distribute hive table by random at Step1
[ https://issues.apache.org/jira/browse/KYLIN-3278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390686#comment-16390686 ] Wang Cheng commented on KYLIN-3278: --- I will revert the relevant commits of KYLIN-3084, and use "set hive.merge.tezfiles to true" to workaround the TEZ UNION ALL issue. > Kylin should not distribute hive table by random at Step1 > - > > Key: KYLIN-3278 > URL: https://issues.apache.org/jira/browse/KYLIN-3278 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Affects Versions: v2.3.0 >Reporter: Chuqian Yu >Assignee: Wang Cheng >Priority: Major > > Hi,Kylin team. > When I upgrade from 2.2.0 to 2.3.0 ,I found that the step.1 "Create > Intermediate Flat Hive Table" of cube build was much slower than before, > because Kylin distribute hive table by random when created it in version > 2.3.0 . I wander is it necessary? Because > kylin.source.hive.redistribute-flat-table was set to true by default, so we > will do the distribution job at Step.2 "Redistribute Flat Hive Table". > Best regards, > Chuqian Yu -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3278) Kylin should not distribute hive table by random at Step1
[ https://issues.apache.org/jira/browse/KYLIN-3278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389569#comment-16389569 ] Shaofeng SHI commented on KYLIN-3278: - Thanks for the reporting, this change was introduced in KYLIN-3084 [~blue20080] could you please check this? > Kylin should not distribute hive table by random at Step1 > - > > Key: KYLIN-3278 > URL: https://issues.apache.org/jira/browse/KYLIN-3278 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Reporter: Chuqian Yu >Priority: Major > > Hi,Kylin team. > When I upgrade from 2.2.0 to 2.3.0 ,I found that the step.1 "Create > Intermediate Flat Hive Table" of cube build was much slower than before, > because Kylin distribute hive table by random when created it in version > 2.3.0 . I wander is it necessary? Because > kylin.source.hive.redistribute-flat-table was set to true by default, so we > will do the distribution job at Step.2 "Redistribute Flat Hive Table". > Best regards, > Chuqian Yu -- This message was sent by Atlassian JIRA (v7.6.3#76005)
