[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612069#comment-16612069 ] Shaofeng SHI commented on KYLIN-2565: - We cut off two branches for the new version: * master-hadoop3.1: Kylin master code base with Hadoop 3.1 and HBase 2.0 API * 2.5.x-hadoop3.1: Kylin 2.5.x code base with Hadoop 3.1 and HBase 2.0 API > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > Fix For: v2.5.0 > > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610071#comment-16610071 ] ASF subversion and git services commented on KYLIN-2565: Commit a220ff6d289796bd5ec4800cecd5f5eb7d05b527 in kylin's branch refs/heads/2.5.x-hadoop3.1 from shaofengshi [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=a220ff6 ] KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610070#comment-16610070 ] ASF subversion and git services commented on KYLIN-2565: Commit 2cf62401ae7e2d48e9d8bb086558dadf7d63fa56 in kylin's branch refs/heads/2.5.x-hadoop3.1 from [~blue20080] [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=2cf6240 ] KYLIN-2565, upgrade to Hadoop3.0 > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609980#comment-16609980 ] ASF subversion and git services commented on KYLIN-2565: Commit a83133ad565a98cf90ce8d2cf603ecbf8e96a3b0 in kylin's branch refs/heads/master-hadoop3.1-2.5.0 from shaofengshi [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=a83133a ] KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609959#comment-16609959 ] ASF subversion and git services commented on KYLIN-2565: Commit 616bb38b41880136f3b649730ba910fa74a64216 in kylin's branch refs/heads/master-hadoop3.1 from [~blue20080] [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=616bb38 ] KYLIN-2565, upgrade to Hadoop3.0 > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609960#comment-16609960 ] ASF subversion and git services commented on KYLIN-2565: Commit a09485037906d8105cc38d28b898c85d3c4b7920 in kylin's branch refs/heads/master-hadoop3.1 from shaofengshi [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=a094850 ] KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609963#comment-16609963 ] ASF subversion and git services commented on KYLIN-2565: Commit 766a472bc294e06ac2f13c5437bda349ff3aa480 in kylin's branch refs/heads/master-hadoop3.1 from shaofengshi [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=766a472 ] KYLIN-2565 Resolve conflict > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591400#comment-16591400 ] ASF subversion and git services commented on KYLIN-2565: Commit 9f0227e642abba0f366b97ddafbec9180fb5f7fb in kylin's branch refs/heads/master-hadoop3.1-2.5.0 from [~blue20080] [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=9f0227e ] KYLIN-2565, upgrade to Hadoop3.0 > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591401#comment-16591401 ] ASF subversion and git services commented on KYLIN-2565: Commit a83133ad565a98cf90ce8d2cf603ecbf8e96a3b0 in kylin's branch refs/heads/master-hadoop3.1-2.5.0 from shaofengshi [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=a83133a ] KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature >Reporter: Wang Cheng >Assignee: Shaofeng SHI >Priority: Major > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406449#comment-16406449 ] ASF subversion and git services commented on KYLIN-2565: Commit 0099b61e9d330b36227cd5afef1165b23d78162e in kylin's branch refs/heads/master-hadoop3.0-3 from [~wormholer] [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=0099b61 ] KYLIN-2565, upgrade to Hadoop3.0 > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature >Reporter: Wang Cheng >Priority: Major > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406450#comment-16406450 ] ASF subversion and git services commented on KYLIN-2565: Commit 8cecbf09ce671b304180afda1bc1a015745f4a64 in kylin's branch refs/heads/master-hadoop3.0-3 from shaofengshi [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=8cecbf0 ] KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature >Reporter: Wang Cheng >Priority: Major > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16405894#comment-16405894 ] ASF subversion and git services commented on KYLIN-2565: Commit 8c00c8e66fcbe883fc33eeaaa0d78b718b01f53c in kylin's branch refs/heads/master-hadoop3.0-2 from shaofengshi [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=8c00c8e ] KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature >Reporter: Wang Cheng >Priority: Major > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16405893#comment-16405893 ] ASF subversion and git services commented on KYLIN-2565: Commit b5b422802322ad08156bc8598fb93cfdcaf98751 in kylin's branch refs/heads/master-hadoop3.0-2 from [~wormholer] [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=b5b4228 ] KYLIN-2565, upgrade to Hadoop3.0 > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature >Reporter: Wang Cheng >Priority: Major > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214568#comment-16214568 ] Wang Cheng commented on KYLIN-2565: --- [~Sammi], Kylin on Hadoop3.0-alpha is ready to test when this issue is created. I would know if this patch is helpful for you? > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature >Reporter: Wang Cheng > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (KYLIN-2565) Upgrade Kylin to Hadoop3.0
[ https://issues.apache.org/jira/browse/KYLIN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205440#comment-16205440 ] SammiChen commented on KYLIN-2565: -- Thanks Cheng for reporting the issue to track the support of Hadoop 3.0 & EC for Apache Kylin. Hadoop 3.0-beta1 was recently released. 3.0 GA will be the next milestone and happen soon. With Hadoop 3.0 new feature HDFS-EC, massive storage space(for example 50%) can be saved using this new technology. Apache Kylin consumes large volume of HDFS data and could generate 20% more data onto HDFS after cube computing in some cases, therefore HDFS EC should have good opportunities to optimize the storage cost and even performance. Discussed with Luke, we’d like to collaborate with his team working on this support. Here is the rough plan: 1) Verify Apahce Kylin stack works with Hadoop 3.0 and EC Build and run functional tests. The Kylin related issues will be reported to Kylin community and all Hadoop EC related issues will go to Hadoop community; 2) Benchmark and report Given the functional tests passed, we’ll benchmark Kylin over Hadoop 3.0. Which Kylin workloads to use could be discussed here, and we’d also like to share the results. Any comments? Thanks for your thoughts! > Upgrade Kylin to Hadoop3.0 > -- > > Key: KYLIN-2565 > URL: https://issues.apache.org/jira/browse/KYLIN-2565 > Project: Kylin > Issue Type: New Feature >Reporter: Wang Cheng > > Hadoop3.0-alpha is released, Kylin should also keep compatible with it. Below > is the Hadoop3.0 components requirements: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release -- This message was sent by Atlassian JIRA (v6.4.14#64029)
