[jira] [Commented] (KYLIN-3811) Support the standalone HBase cluster using HDFS HA

2019-02-27 Thread Chao Long (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780192#comment-16780192
 ] 

Chao Long commented on KYLIN-3811:
--

Hi Wei, after applying the patch,  I found this file KylinLoadIncrementalHFiles 
make mvn test fail, can you check it? Thank you.

Btw, Is it a bug of Hbase? 

If yes, can we fix it in Hbase? 

> Support the standalone HBase cluster using HDFS HA
> --
>
> Key: KYLIN-3811
> URL: https://issues.apache.org/jira/browse/KYLIN-3811
> Project: Kylin
>  Issue Type: Improvement
>  Components: Storage - HBase
>Affects Versions: v2.3.1
>Reporter: zhangwei
>Assignee: zhangwei
>Priority: Minor
> Attachments: hdfs_ha.patch, hdfs_ha_2.patch, screenshot-1.png
>
>
> 独立hbase 集群的 hdfs namenode主备切换导致Kylin无法正常工作的问题
> 痛点:
> ylin.hbase.cluster.fs=hdfs://namenode:54310,在hbase的hdfs namenode切换之后会,和hbase 
> hdfs相关的步骤会出现失败
> 我们的方案:(所有的修改都基于kylin的代码,不需要hbase 做修改) 
> kylin.properties 
> kylin.hbase.cluster.fs=hdfs://nshbase
> kylin.storage.hbase.cluster-hdfs-config-file=hbase-hdfs-site.xml
> hbase-hdfs-site.xml配置 hbase hdfs的HA连接方式,其中dfs.nameservices= nshbase



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3811) Support the standalone HBase cluster using HDFS HA

2019-02-25 Thread zhangwei (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777689#comment-16777689
 ] 

zhangwei commented on KYLIN-3811:
-

because LoadIncrementalHfile is hbase class and we don't want to change class 
of hbase so we hack this class in kylin side

this is main change left is kylinloadincrementalHFile right is 
LoadIncrementalHfile

 !screenshot-1.png! 

> Support the standalone HBase cluster using HDFS HA
> --
>
> Key: KYLIN-3811
> URL: https://issues.apache.org/jira/browse/KYLIN-3811
> Project: Kylin
>  Issue Type: Improvement
>  Components: Storage - HBase
>Affects Versions: v2.3.1
>Reporter: zhangwei
>Assignee: zhangwei
>Priority: Minor
> Attachments: hdfs_ha.patch, hdfs_ha_2.patch, screenshot-1.png
>
>
> 独立hbase 集群的 hdfs namenode主备切换导致Kylin无法正常工作的问题
> 痛点:
> ylin.hbase.cluster.fs=hdfs://namenode:54310,在hbase的hdfs namenode切换之后会,和hbase 
> hdfs相关的步骤会出现失败
> 我们的方案:(所有的修改都基于kylin的代码,不需要hbase 做修改) 
> kylin.properties 
> kylin.hbase.cluster.fs=hdfs://nshbase
> kylin.storage.hbase.cluster-hdfs-config-file=hbase-hdfs-site.xml
> hbase-hdfs-site.xml配置 hbase hdfs的HA连接方式,其中dfs.nameservices= nshbase



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3811) Support the standalone HBase cluster using HDFS HA

2019-02-23 Thread Shaofeng SHI (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776086#comment-16776086
 ] 

Shaofeng SHI commented on KYLIN-3811:
-

Hi Wei, I see the main change is using KylinLoadIncrementalHFiles to replace 
HBase's "LoadIncrementalHFiles", what's the behavior change there? Is it a 
limitation of HBase "LoadIncrementalHFiles"? Thank you!

> Support the standalone HBase cluster using HDFS HA
> --
>
> Key: KYLIN-3811
> URL: https://issues.apache.org/jira/browse/KYLIN-3811
> Project: Kylin
>  Issue Type: Improvement
>  Components: Storage - HBase
>Affects Versions: v2.3.1
>Reporter: zhangwei
>Assignee: zhangwei
>Priority: Minor
> Attachments: hdfs_ha.patch, hdfs_ha_2.patch
>
>
> 独立hbase 集群的 hdfs namenode主备切换导致Kylin无法正常工作的问题
> 痛点:
> ylin.hbase.cluster.fs=hdfs://namenode:54310,在hbase的hdfs namenode切换之后会,和hbase 
> hdfs相关的步骤会出现失败
> 我们的方案:(所有的修改都基于kylin的代码,不需要hbase 做修改) 
> kylin.properties 
> kylin.hbase.cluster.fs=hdfs://nshbase
> kylin.storage.hbase.cluster-hdfs-config-file=hbase-hdfs-site.xml
> hbase-hdfs-site.xml配置 hbase hdfs的HA连接方式,其中dfs.nameservices= nshbase



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)