Re: Proposal for updating master branch to use HBase 1.x

[nichunen]

+1

Hbase 1.x is more commonly used in our clients. 


  George/倪春恩

Mobile:+86-13501723787| WeChat:nceecn

北京明略软件系统有限公司（MiningLamp.COM
）





上海市浦东新区晨晖路258号G座iDream张江科创中心C125




Room C125#,Intelligent Industrial Park Building G,258#Chenhui Road, Pudong 
District,Shanghai,201203




> On Jan 23, 2017, at 11:16 AM, ShaoFeng Shi  wrote:
> 
> 
> +1 We need keep pace with the community; As more and more users are using
> HBase 1.x, it is the time for us to switch our main dev and testing
> platform to it.
> 
> 
> 2017-01-23 11:04 GMT+08:00 Dong Li :
>> 
>> 
>> +1, thanks Kaige!
>> 
>> 
>> 
>> 
>> 
>> Thanks,
>> Dong Li
>> 
>> 
>> 2017-01-23 10:46 GMT+08:00 Luke Han :
>>> 
>>> 
>>> +1, hope all hbase 0.9x users will upgrade to 1.x soon:)
>>> 
>>> 
>>> Thanks.
>>> 
>>> 
>>> 
>>> 
>>> 
>>> Best Regards!
>>> -
>>> 
>>> 
>>> Luke Han
>>> 
>>> 
>>> On Sun, Jan 22, 2017 at 12:06 PM, Kaige Liu 
>>> wrote:
 
 
 Hi Folks,
 
 
 Currently our master branch is based on HBase 0.98. As per discussion
 
>>> 
>>> here<
 
 
 http://apache-kylin.74782.x6.nabble.com/DISCUSS-
 Call-the-next-release-v2-0-td6684.html#a6750>, I think it’s the time
 
>> 
>> to
 
 
 change master branch to use HBase 1.x now.
 Below changes should be made:
 
 
 1. Delete master-hbase1.x branch and use master branch instead.
 
 
 2. merge master-cdh5.7 to master branch(KYLIN-2413), master-cdh5.7 should be
 deleted.
 
 
 3. new branch master-hbase0.98 will be created to continue
 supporting HBase 0.98.
 
 
 Users and developers will be impacted and should choose correct branch
 according to corresponding Hadoop distros.
 
 
 1. HBase 0.98 users should use master-hbase0.98 branch
 
 
 2. Others please use master branch
 
 
 Developers may need to upgrade your dev environments.
 
 
 Best regards,
 
 
 Kaige Liu(刘凯歌)
 Mail: kaige@kyligence.io
 Shanghai Kyligence Information Technology Co., Ltd
 上海市浦东新区亮秀路112号Y1座405室
 
 
 "Do small things with great love."
 
 
 
 
>>> 
>>> 
>>> 
>> 
>> 
>> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> -- 
> Best regards,
> 
> 
> Shaofeng Shi 史少锋
> 

答复: Proposal for updating master branch to use HBase 1.x

[Fan Xie]

+1


发件人: ShaoFeng Shi 
发送时间: 2017年1月23日 11:16:54
收件人: dev
主题: Re: Proposal for updating master branch to use HBase 1.x

+1 We need keep pace with the community; As more and more users are using
HBase 1.x, it is the time for us to switch our main dev and testing
platform to it.

2017-01-23 11:04 GMT+08:00 Dong Li :

> +1, thanks Kaige!
>
>
> Thanks,
> Dong Li
>
> 2017-01-23 10:46 GMT+08:00 Luke Han :
>
> > +1, hope all hbase 0.9x users will upgrade to 1.x soon:)
> >
> > Thanks.
> >
> >
> > Best Regards!
> > -
> >
> > Luke Han
> >
> > On Sun, Jan 22, 2017 at 12:06 PM, Kaige Liu 
> > wrote:
> >
> > > Hi Folks,
> > >
> > > Currently our master branch is based on HBase 0.98. As per discussion
> > here<
> > > http://apache-kylin.74782.x6.nabble.com/DISCUSS-
> > > Call-the-next-release-v2-0-td6684.html#a6750>, I think it’s the time
> to
> > > change master branch to use HBase 1.x now.
> > > Below changes should be made:
> > >
> > > 1.   Delete master-hbase1.x branch and use master branch instead.
> > >
> > > 2.   merge master-cdh5.7 to master branch(KYLIN-2413 > > issues.apache.org/jira/browse/KYLIN-2413>), master-cdh5.7 should be
> > > deleted.
> > >
> > > 3.   new branch master-hbase0.98 will be created to continue
> > > supporting HBase 0.98.
> > >
> > > Users and developers will be impacted and should choose correct branch
> > > according to corresponding Hadoop distros.
> > >
> > > 1.   HBase 0.98 users should use master-hbase0.98 branch
> > >
> > > 2.   Others please use master branch
> > >
> > > Developers may need to upgrade your dev environments.
> > >
> > > Best regards,
> > >
> > > Kaige Liu(刘凯歌)
> > > Mail: kaige@kyligence.io
> > > Shanghai Kyligence Information Technology Co., Ltd
> > > 上海市浦东新区亮秀路112号Y1座405室
> > >
> > > "Do small things with great love."
> > >
> > >
> >
>



--
Best regards,

Shaofeng Shi 史少锋

Re: kylin cube migrating

[ShaoFeng Shi]

Hi chao,

This utility class is doing migration from one Kylin to another (for
example, Kylin QA to Kylin Production) within the same Hadoop Cluster. It
doesn't support across Hadoop cluster.

在 2017年1月22日 下午3:32，yangchao 写道：

> 如果两个集群分别有kerberos+ranger权限管理的话， 如何同步呢？
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/kylin-cube-migrating-tp6000p7014.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
Best regards,

Shaofeng Shi 史少锋

Re: Proposal for updating master branch to use HBase 1.x

[ShaoFeng Shi]

+1 We need keep pace with the community; As more and more users are using
HBase 1.x, it is the time for us to switch our main dev and testing
platform to it.

2017-01-23 11:04 GMT+08:00 Dong Li :

> +1, thanks Kaige!
>
>
> Thanks,
> Dong Li
>
> 2017-01-23 10:46 GMT+08:00 Luke Han :
>
> > +1, hope all hbase 0.9x users will upgrade to 1.x soon:)
> >
> > Thanks.
> >
> >
> > Best Regards!
> > -
> >
> > Luke Han
> >
> > On Sun, Jan 22, 2017 at 12:06 PM, Kaige Liu 
> > wrote:
> >
> > > Hi Folks,
> > >
> > > Currently our master branch is based on HBase 0.98. As per discussion
> > here<
> > > http://apache-kylin.74782.x6.nabble.com/DISCUSS-
> > > Call-the-next-release-v2-0-td6684.html#a6750>, I think it’s the time
> to
> > > change master branch to use HBase 1.x now.
> > > Below changes should be made:
> > >
> > > 1.   Delete master-hbase1.x branch and use master branch instead.
> > >
> > > 2.   merge master-cdh5.7 to master branch(KYLIN-2413 > > issues.apache.org/jira/browse/KYLIN-2413>), master-cdh5.7 should be
> > > deleted.
> > >
> > > 3.   new branch master-hbase0.98 will be created to continue
> > > supporting HBase 0.98.
> > >
> > > Users and developers will be impacted and should choose correct branch
> > > according to corresponding Hadoop distros.
> > >
> > > 1.   HBase 0.98 users should use master-hbase0.98 branch
> > >
> > > 2.   Others please use master branch
> > >
> > > Developers may need to upgrade your dev environments.
> > >
> > > Best regards,
> > >
> > > Kaige Liu(刘凯歌)
> > > Mail: kaige@kyligence.io
> > > Shanghai Kyligence Information Technology Co., Ltd
> > > 上海市浦东新区亮秀路112号Y1座405室
> > >
> > > "Do small things with great love."
> > >
> > >
> >
>



-- 
Best regards,

Shaofeng Shi 史少锋

答复: Proposal for updating master branch to use HBase 1.x

[roger shi]

+1, thanks Kaige.


发件人: Kaige Liu 
发送时间: 2017年1月22日 12:06
收件人: dev@kylin.apache.org
主题: Proposal for updating master branch to use HBase 1.x

Hi Folks,

Currently our master branch is based on HBase 0.98. As per discussion 
here,
 I think it’s the time to change master branch to use HBase 1.x now.
Below changes should be made:

1.   Delete master-hbase1.x branch and use master branch instead.

2.   merge master-cdh5.7 to master 
branch(KYLIN-2413), 
master-cdh5.7 should be deleted.

3.   new branch master-hbase0.98 will be created to continue supporting 
HBase 0.98.

Users and developers will be impacted and should choose correct branch 
according to corresponding Hadoop distros.

1.   HBase 0.98 users should use master-hbase0.98 branch

2.   Others please use master branch

Developers may need to upgrade your dev environments.

Best regards,

Kaige Liu(刘凯歌)
Mail: kaige@kyligence.io
Shanghai Kyligence Information Technology Co., Ltd
上海市浦东新区亮秀路112号Y1座405室

"Do small things with great love."

Re: Proposal for updating master branch to use HBase 1.x

[Dong Li]

+1, thanks Kaige!


Thanks,
Dong Li

2017-01-23 10:46 GMT+08:00 Luke Han :

> +1, hope all hbase 0.9x users will upgrade to 1.x soon:)
>
> Thanks.
>
>
> Best Regards!
> -
>
> Luke Han
>
> On Sun, Jan 22, 2017 at 12:06 PM, Kaige Liu 
> wrote:
>
> > Hi Folks,
> >
> > Currently our master branch is based on HBase 0.98. As per discussion
> here<
> > http://apache-kylin.74782.x6.nabble.com/DISCUSS-
> > Call-the-next-release-v2-0-td6684.html#a6750>, I think it’s the time to
> > change master branch to use HBase 1.x now.
> > Below changes should be made:
> >
> > 1.   Delete master-hbase1.x branch and use master branch instead.
> >
> > 2.   merge master-cdh5.7 to master branch(KYLIN-2413 > issues.apache.org/jira/browse/KYLIN-2413>), master-cdh5.7 should be
> > deleted.
> >
> > 3.   new branch master-hbase0.98 will be created to continue
> > supporting HBase 0.98.
> >
> > Users and developers will be impacted and should choose correct branch
> > according to corresponding Hadoop distros.
> >
> > 1.   HBase 0.98 users should use master-hbase0.98 branch
> >
> > 2.   Others please use master branch
> >
> > Developers may need to upgrade your dev environments.
> >
> > Best regards,
> >
> > Kaige Liu(刘凯歌)
> > Mail: kaige@kyligence.io
> > Shanghai Kyligence Information Technology Co., Ltd
> > 上海市浦东新区亮秀路112号Y1座405室
> >
> > "Do small things with great love."
> >
> >
>

Re: Proposal for updating master branch to use HBase 1.x

[hongbin ma]

+1

With more and more prod env upgrading to hbase 1.x, Kaige's proposal can
help kylin developer to upgrade their development environment( sandbox, qa
cluster, etc), so that the gap between dev env and prod env can be minimal.

A key message here is we're not stopping support for hbase 0.98. we're
merely changing the "default" hbase version. ​


On Sun, Jan 22, 2017 at 12:06 PM, Kaige Liu  wrote:

> Hi Folks,
>
> Currently our master branch is based on HBase 0.98. As per discussion here<
> http://apache-kylin.74782.x6.nabble.com/DISCUSS-
> Call-the-next-release-v2-0-td6684.html#a6750>, I think it’s the time to
> change master branch to use HBase 1.x now.
> Below changes should be made:
>
> 1.   Delete master-hbase1.x branch and use master branch instead.
>
> 2.   merge master-cdh5.7 to master branch(KYLIN-2413 issues.apache.org/jira/browse/KYLIN-2413>), master-cdh5.7 should be
> deleted.
>
> 3.   new branch master-hbase0.98 will be created to continue
> supporting HBase 0.98.
>
> Users and developers will be impacted and should choose correct branch
> according to corresponding Hadoop distros.
>
> 1.   HBase 0.98 users should use master-hbase0.98 branch
>
> 2.   Others please use master branch
>
> Developers may need to upgrade your dev environments.
>
> Best regards,
>
> Kaige Liu(刘凯歌)
> Mail: kaige@kyligence.io
> Shanghai Kyligence Information Technology Co., Ltd
> 上海市浦东新区亮秀路112号Y1座405室
>
> "Do small things with great love."
>
>


-- 
Regards,

*Bin Mahone | 马洪宾*

Re: Proposal for updating master branch to use HBase 1.x

[Luke Han]

+1, hope all hbase 0.9x users will upgrade to 1.x soon:)

Thanks.


Best Regards!
-

Luke Han

On Sun, Jan 22, 2017 at 12:06 PM, Kaige Liu  wrote:

> Hi Folks,
>
> Currently our master branch is based on HBase 0.98. As per discussion here<
> http://apache-kylin.74782.x6.nabble.com/DISCUSS-
> Call-the-next-release-v2-0-td6684.html#a6750>, I think it’s the time to
> change master branch to use HBase 1.x now.
> Below changes should be made:
>
> 1.   Delete master-hbase1.x branch and use master branch instead.
>
> 2.   merge master-cdh5.7 to master branch(KYLIN-2413 issues.apache.org/jira/browse/KYLIN-2413>), master-cdh5.7 should be
> deleted.
>
> 3.   new branch master-hbase0.98 will be created to continue
> supporting HBase 0.98.
>
> Users and developers will be impacted and should choose correct branch
> according to corresponding Hadoop distros.
>
> 1.   HBase 0.98 users should use master-hbase0.98 branch
>
> 2.   Others please use master branch
>
> Developers may need to upgrade your dev environments.
>
> Best regards,
>
> Kaige Liu(刘凯歌)
> Mail: kaige@kyligence.io
> Shanghai Kyligence Information Technology Co., Ltd
> 上海市浦东新区亮秀路112号Y1座405室
>
> "Do small things with great love."
>
>

Re: kylin cube migrating

[yangchao]

如果两个集群分别有kerberos+ranger权限管理的话， 如何同步呢？

--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/kylin-cube-migrating-tp6000p7014.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

cube migration meet error

[yangchao]

./bin/kylin.sh org.apache.kylin.storage.hbase.util.CubeMigrationCLI
thd-2-pdd-sh.prod.yiran.com:7070 olap-1-pdd-sh.prod.yiran.com:7070
ares_order_cube ares true false false true


2017-01-22 15:45:30,739 INFO  [main CubeManager:908]: Loaded 3 cubes, fail
on 0 cubes
2017-01-22 15:45:30,739 INFO  [main CubeMigrationCLI:121]: cube to be moved
is : ares_order_cube
Exception in thread "main" java.lang.NullPointerException
at
org.apache.kylin.storage.hbase.util.CubeMigrationCLI.moveCube(CubeMigrationCLI.java:123)
at
org.apache.kylin.storage.hbase.util.CubeMigrationCLI.moveCube(CubeMigrationCLI.java:164)
at
org.apache.kylin.storage.hbase.util.CubeMigrationCLI.main(CubeMigrationCLI.java:103)

 ...

PS: thd-2-pdd-sh.prod.yiran.com:7070 and olap-1-pdd-sh.prod.yiran.com:7070 
have kerberos and ranger authentication

--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/cube-migration-meet-error-tp7015.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

query double column in fact table

[xiaofan]

hi all 
 i have a double type column price in the fact table,when i query  'select *
' get data price=8.0,so i must query sql like 'select price form product
where price=8.0',both price=8 and price=8.00 can get nothing,so is there
some method to adapt this scene?thanks


--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/query-double-column-in-fact-table-tp7009.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

?????? build kylin code exception

[????????????]

A: thank you very much for your reply. I will try do it. May be I was wrong.
--  --
??: "Billy Liu";;
: 2017??1??21??(??) 5:47
??: "dev"; 

: Re: build kylin code exception



Please run the build command at kylin root path. If you want to build some
submdoule, please run something like 'mvn compile -pl jdbc'.

2017-01-21 17:39 GMT+08:00 ShaoFeng Shi :

> Please check this doc to see whether it helps:
> https://kylin.apache.org/development/dev_env.html
>
>
> 2017-01-21 8:40 GMT+08:00  :
>
> > Very thank you for your reply. this is my executing command.
> > clean install -D skipTests -X .
> > My Eclipse version is Neon.1a Release (4.6.1), JRE jdk1.8.0_45.
> >
> >
> >
> > --  --
> > *??:* "ShaoFeng Shi";;
> > *:* 2017??1??20??(??) 11:20
> > *??:* "dev";
> > *:* Re: build kylin code exception
> >
> > Hi, could you please provide the command that you are executing?
> >
> > 2017-01-20 16:11 GMT+08:00  :
> >
> > > hi, I try to build kylin code occured exception. My environment is
> > > Window10, kylin-1.6.0-cdh5.7. The exception as follow
> > >
> > >
> > > [DEBUG] URLResourceLoader: Exception when looking for
> > > 'dev-support/checkstyle-suppressions.xml' at ''
> > > java.net.MalformedURLException: no protocol: dev-support/checkstyle-
> > > suppressions.xml
> > > at java.net.URL.(URL.java:586)
> > > at java.net.URL.(URL.java:483)
> > > at java.net.URL.(URL.java:432)
> > > at org.codehaus.plexus.resource.loader.URLResourceLoader.
> > > getResource(URLResourceLoader.java:71)
> > > at org.codehaus.plexus.resource.DefaultResourceManager.
> > > getResource(DefaultResourceManager.java:159)
> > > at org.codehaus.plexus.resource.DefaultResourceManager.
> > > getResourceAsFile(DefaultResourceManager.java:91)
> > > at org.apache.maven.plugin.checkstyle.exec.
> > > DefaultCheckstyleExecutor.getSuppressionsFilePath(
> > > DefaultCheckstyleExecutor.java:797)
> > > at org.apache.maven.plugin.checkstyle.exec.
> > > DefaultCheckstyleExecutor.executeCheckstyle(DefaultCheckstyleExecutor.
> > > java:117)
> > > at org.apache.maven.plugin.checkstyle.
> > > CheckstyleViolationCheckMojo.execute(CheckstyleViolationCheckMojo.
> > > java:538)
> > > at org.apache.maven.plugin.DefaultBuildPluginManager.
> > executeMojo(
> > > DefaultBuildPluginManager.java:132)
> > > at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> > > MojoExecutor.java:208)
> > > at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> > > MojoExecutor.java:153)
> > > at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> > > MojoExecutor.java:145)
> > > at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
> > > buildProject(LifecycleModuleBuilder.java:116)
> > > at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
> > > buildProject(LifecycleModuleBuilder.java:80)
> > > at org.apache.maven.lifecycle.internal.builder.singlethreaded.
> > > SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> > > at org.apache.maven.lifecycle.internal.LifecycleStarter.
> > > execute(LifecycleStarter.java:120)
> > > at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:
> > 347)
> > > at org.apache.maven.DefaultMaven.
> execute(DefaultMaven.java:154)
> > > at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
> > > at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
> > > at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
> > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > > at sun.reflect.NativeMethodAccessorImpl.invoke(
> > > NativeMethodAccessorImpl.java:62)
> > > at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> > > DelegatingMethodAccessorImpl.java:43)
> > > at java.lang.reflect.Method.invoke(Method.java:497)
> > > at org.codehaus.plexus.classworlds.launcher.Launcher.
> > > launchEnhanced(Launcher.java:289)
> > > at org.codehaus.plexus.classworlds.launcher.Launcher.
> > > launch(Launcher.java:229)
> > > at org.codehaus.plexus.classworlds.launcher.Launcher.
> > > mainWithExitCode(Launcher.java:415)
> > > at org.codehaus.plexus.classworlds.launcher.Launcher.
> > > main(Launcher.java:356)
> > > [DEBUG] URLResourceLoader: Exception when looking for
> > > 'dev-support/checkstyle-suppressions.xml
> > > java.net.MalformedURLException: no protocol: dev-support/checkstyle-
> > > suppressions.xml
> > > at java.net.URL.(URL.java:586)
> > > at java.net.URL.(URL.java:483)
> > > at java.net.URL.(URL.java:432)
> > >

Re: A question about cube build

[163]

did you set the partition column?

发自我的 iPhone

> 在 2017年1月17日，下午4:22，"simba...@71360.com"  写道：
> 
> When I make an incremental cube build. there should be a pop-up window which 
> I can select END TIME.
> But such a case is encountered, there is no window that I can select END 
> TIME. A window pops up like this.
>