Re: [VOTE] Release apache-kylin-3.0.0-alpha2 (RC1)

[Cheng wang]

+1

Regards,
Cheng

On 7/25/19, 10:46 PM, "ShaoFeng Shi"  wrote:

Hi all,



I have created a build for Apache Kylin 3.0.0-alpha2, release candidate 1.



Changes highlights:

[KYLIN-3942] - Rea-time OLAP supports multi-level json event

[KYLIN-4086] - Support connect Kylin with Tableau by JDBC

[KYLIN-3841] - Build Global Dict by MR/Hive

[KYLIN-4017] - Fix building engine failed to get zk lock and leads to the
building engine doesn't work

[KYLIN-3843] - List kylin instances with their server mode on web

[KYLIN-3997] - Add a health check job of Kylin

[KYLIN-4028] - Speed up startup progress using cached dependency

[KYLIN-4035] - Calculate column cardinality by using spark engine



Thanks to everyone who has contributed to this release.

Here’s the release notes:


https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12345840



The commit to being voted upon:




https://github.com/apache/kylin/commit/06f441cd04a98a988197f7b1d750608d6ee51cd8



Its hash is 06f441cd04a98a988197f7b1d750608d6ee51cd8.



The artifacts to be voted on, including the source package and two 
pre-compiled
binary packages, are located here:

https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-3.0.0-alpha2-rc1/



The hash of the artifacts are as follows:

apache-kylin-3.0.0-alpha2-source-release.zip.sha256

dc206ab0527703271e4cc435368a4f0980247465947a199396567dfc776bf7f8

apache-kylin-3.0.0-alpha2-bin-hbase1x.tar.gz.sha256

406f2d7ea318df230d1e65600f4ffccb22accfeee47a7e2f85ee4f70bbc6bbdc

apache-kylin-3.0.0-alpha2-bin-cdh57.tar.gz.sha256

1dadf9910d07ed5af233477a92013a8b6090ae18b3f8d9b48c7ee915acbafe25

apache-kylin-3.0.0-alpha2-bin-hadoop3.tar.gz.sha256

f0d075b0e2bc3c0953bf17c7220ddae03ae611fae03456fad215b36f9393eb28

apache-kylin-3.0.0-alpha2-bin-cdh60.tar.gz.sha256

47faa1810f21fa8c4c109b82af9eb09d44c2f0d14d245a94655aaf783780a143





A staged Maven repository is available for review at:

https://repository.apache.org/content/repositories/orgapachekylin-1065/



Release artifacts are signed with the following key:

https://people.apache.org/keys/committer/shaofengshi.asc



Please vote on releasing this package as Apache Kylin 3.0.0-alpha2.



The vote is open for the next 72 hours and passes if a majority of

at least three +1 PMC votes are cast.



[ ] +1 Release this package as Apache Kylin 3.0.0-alpha2

[ ]  0 I don't feel strongly about it, but I'm okay with the release

[ ] -1 Do not release this package because...





Here is my vote:



+1 (binding)


Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofeng...@apache.org

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscr...@kylin.apache.org
Join Kylin dev mail group: dev-subscr...@kylin.apache.org

Re: [VOTE] Release apache-kylin-2.6.3 (RC1)

[Cheng wang]

＋1(binding)

Best regards,
Cheng Wang


On 7/1/19, 9:27 AM, "ShaoFeng Shi"  wrote:

Hi all,

I have created a build for Apache Kylin 2.6.3, release candidate 1.

Changes highlights:
- [KYLIN-4024] - Support pushdown to Presto
- [KYLIN-3977] - Avoid mistaken deleting dicts by storage cleanup while
building jobs are running
- [KYLIN-4015] – Fix build cube error at the "Build UHC Dictionary" step
- [KYLIN-4022] - Error with message "Unrecognized column type:
DECIMAL(xx,xx)" happens when doing query pushdown

Thanks to everyone who has contributed to this release.
Here’s release notes:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12345582

The commit to being voted upon:


https://github.com/apache/kylin/commit/0d5f85b0a40c301134122de927204a0d17ad65fa

Its hash is 0d5f85b0a40c301134122de927204a0d17ad65fa.

The artifacts to be voted on are located here:
https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.6.3-rc1/

The hash of the artifact is as follows:
apache-kylin-2.6.3-source-release.zip.sha256
50d1cad423f1a15a5e25f1c3c68748c7ce10e0116fd67fa9e38c1470a11d389c

A staged Maven repository is available for review at:
https://repository.apache.org/content/repositories/orgapachekylin-1063/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/shaofengshi.asc

Please vote on releasing this package as Apache Kylin 2.6.3.

The vote is open for the next 72 hours and passes if a majority of
at least three +1 PMC votes are cast.

[ ] +1 Release this package as Apache Kylin 2.6.3
[ ]  0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...


Here is my vote:

+1 (binding)

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofeng...@apache.org

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscr...@kylin.apache.org
Join Kylin dev mail group: dev-subscr...@kylin.apache.org

Re: Plan to host the first "Kylin Data Summit" event

[Cheng wang]

+1,
It would be a meaningful event, which provides a great opportunity for KYLIN 
uses to share ideas and technologies, hoping it will move KYLIN to next level.

Best regards
Cheng

From: ShaoFeng Shi 
Reply-To: "u...@kylin.apache.org" 
Date: Thursday, May 30, 2019 at 2:30 PM
To: dev , user 
Subject: Plan to host the first "Kylin Data Summit" event

Hello Kylin developers and users,

We (Kyligence Inc) planned to host the first "Kylin Data Summit" event at 
Shanghai, China. This event is going to provide a place to share, discuss the 
technology and trends in Big Data domain. The presentors and target audiences 
are big data engineers, data analysts and others who are interested in the data 
analysis domain. I’m writing to the community for the approval of using Apache 
Kylin trademark on such an event. After getting Kylin PMC approval, we will 
submit the request to the VP of ASF band management. The process is from 
https://www.apache.org/foundation/marks/events.html#approval

The information about this event is as follows:

  *   What is the topic focus of the event
Big Data, OLAP, Apache Kylin and other big data technologies like Apache 
Hadoop, Apache Spark, etc.

  *   Who is organising the event
Kyligence Inc. and InfoQ China

  *   When is the event
12th, July.

  *   How many attendees are expected
500 expected attendees.

  *   How much PMC involvement is there already
Some Apache Kylin’s PMC members are involved in the organization of Kylin Data 
Summit, such as Billy Liu, Yang Li, Shaofeng Shi. Several PMC will give speech 
on this event: Luke, Yanghong Zhong.


  *   Which marks are requested
The name and logo of Apache Kylin, the Apache feather logo.

  *   How would you propose that the ASF will be listed as a community partner?

Community Partner

  *   How will the event selection work?

We have a selection group for this event, formed by the PMCs that will attend 
the event. We will invite the community users to prepare proposal, and then 
make a vote in the selection group

Is this for profit or non-profit?
Profit, with some free tickets to community contributors.

  *   The event’s related site and marketing materials
They are still under construction.

Please share your comment or suggestions, thank you!

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofeng...@apache.org

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: 
user-subscr...@kylin.apache.org
Join Kylin dev mail group: 
dev-subscr...@kylin.apache.org

Re: [VOTE] Release apache-kylin-2.5.1 (RC1)

[Cheng Wang]

+1 (binding)




Best Regards,
Cheng

On 11/2/18, 2:09 PM, "ShaoFeng Shi"  wrote:

>Hi all,
>
>I have created a build for Apache Kylin 2.5.1, release candidate 1.
>
>Changes highlights:
>
>[KYLIN-3531] - Login failed with case-insensitive username
>[KYLIN-3604] - Can't build cube with spark in HBase standalone mode
>[KYLIN-3613] - Kylin with Standalone HBase Cluster could not find the main
>cluster namespace at "Create HTable" step
>[KYLIN-3634] - When the filter column has null value may cause incorrect
>query result
>[KYLIN-3635] - Percentile calculation on Spark engine is wrong
>[KYLIN-3644] - NumberFormatExcetion on null values when building cube with
>Spark
>[KYLIN-3599] - Bulk Add Measures
>
>Thanks to everyone who has contributed to this release.
>Here’s release notes:
>https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12344108
>
>The commit to be voted upon:
>
>https://github.com/apache/kylin/commit/24e2452309a450ec4ef62339b003343eabe23016
>
>Its hash is 24e2452309a450ec4ef62339b003343eabe23016.
>
>The artifacts to be voted on are located here:
>https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.5.1-rc1/
>
>The hashe of the artifact is as follows:
>apache-kylin-2.5.1-source-release.zip.sha256
>21db5dab4d3900a49237b9083b5d270c8471d1882a5427cddf1cc74873df42f2
>
>A staged Maven repository is available for review at:
>https://repository.apache.org/content/repositories/orgapachekylin-1056/
>
>Release artifacts are signed with the following key:
>https://people.apache.org/keys/committer/shaofengshi.asc
>
>Please vote on releasing this package as Apache Kylin 2.5.1.
>
>The vote is open for the next 72 hours and passes if a majority of
>at least three +1 PPMC votes are cast.
>
>[ ] +1 Release this package as Apache Kylin 2.5.1
>[ ]  0 I don't feel strongly about it, but I'm okay with the release
>[ ] -1 Do not release this package because...
>
>
>Here is my vote:
>
>+1 (binding)
>
>-- 
>Best regards,
>
>Shaofeng Shi 史少锋

Re: [VOTE] Migrate to gitbox

[Cheng Wang]

+1.
It should approve the DEV procedure a lot!


Best regards,
--
Wang Cheng | 王成
 









On 2/1/18, 10:37 AM, "Billy Liu"  wrote:

>Hi all,
>
>I'm starting this vote to migrate Apache Kylin repository from git-wip
>to gitbox. Gitbox allows deeper integration with Github, enables
>committers to merge, close or edit pull request in Github directly.
>
>More features:
>- Easier for code review compared to the Review Board
>- JIRA linking, which will automatically link a PR with its corresponding JIRA
>- Leverage Github ecosystem, such as web hooks for PR monitor, Code
>Static Analytics, Coverage Report.
>
>For Kylin committers, you need to do link your Github account with ASF
>account through https://gitbox.apache.org/
>
>[ ] +1, Migrate Kylin repository to gitbox
>[ ]  -1,  Keep the current git-wip no change
>
>
>Regards,
>Billy Liu

Re: [Announce] New Apache Kylin committer Cheng Wang

[Cheng Wang]

Thanks!



On 10/17/17, 11:17 AM, "Chen, Sammi" <sammi.c...@intel.com> wrote:

>Congratulations to Cheng!
>
>-Original Message-
>From: Luke Han [mailto:luke...@apache.org] 
>Sent: Monday, October 16, 2017 6:33 PM
>To: dev <dev@kylin.apache.org>; user <u...@kylin.apache.org>; Apache Kylin PMC 
><priv...@kylin.apache.org>
>Subject: [Announce] New Apache Kylin committer Cheng Wang
>
>On behalf of the Apache Kylin PMC, I am very pleased to announce that Cheng 
>Wang has accepted the PMC's invitation to become a committer on the project.
>
>We appreciate all of Cheng's generous contributions about many bug fixes, 
>patches, helped many users. We are so glad to have him to be our new committer 
>and looking forward to his continued involvement.
>
>Congratulations and Welcome, Cheng!

Re: KYLIN 2.1 #7 Step Name: Build Cube with Spark FAIL

[Cheng Wang]

It seems some problems in spark, but no clues from the given spark log.
Please follow the doc: http://kylin.apache.org/docs21/tutorial/cube_spark.html 
and get the spark cubing configurations correctly.

BTW, make sure there are sufficient resources(memory/cores) in Yarn.




On 8/31/17, 5:09 PM, "kylin_liu"  wrote:

>here is kylin.log 
>
>kylin.log   
>
>--
>Sent from: http://apache-kylin.74782.x6.nabble.com/

Re: KYLIN 2.1 #7 Step Name: Build Cube with Spark FAIL

[Cheng Wang]

Are there any exceptions in kylin.log?



On 8/31/17, 4:52 PM, "kylin_liu"  wrote:

>eventLogs-application_1504081250597_0061-2.zip
>
>  
>
>This is spark the history logs downloaded the log file
>
>--
>Sent from: http://apache-kylin.74782.x6.nabble.com/

Re: Can't edit cube

[Cheng Wang]

Sometimes it happens because one Kylin instance is used by multi-users. Please 
make sure there are no others using the Kylin at the same time.




On 8/31/17, 3:19 PM, "apache_...@163.com"  wrote:

>Hi,
>
>When edit the exist cube,can't save.Please help see what's the problem?
>
>Error message:
>
>
>2017-08-31 15:20:08,022 ERROR [http-bio-7070-exec-28] 
>controller.CubeController:516 : Failed to deal with the request:Overwriting 
>conflict /cube_desc/cube_0830.json, expect old TS 1504057946524, but it is 
>1504163743354
>java.lang.IllegalStateException: Overwriting conflict 
>/cube_desc/cube_0830.json, expect old TS 1504057946524, but it is 1504163743354
>at 
> org.apache.kylin.storage.hbase.HBaseResourceStore.checkAndPutResourceImpl(HBaseResourceStore.java:315)
>at 
> org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceCheckpoint(ResourceStore.java:294)
>at 
> org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:280)
>at 
> org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:260)
>at 
> org.apache.kylin.cube.CubeDescManager.updateCubeDesc(CubeDescManager.java:380)
>at 
> org.apache.kylin.rest.service.CubeService.updateCubeAndDesc(CubeService.java:255)
>at 
> org.apache.kylin.rest.service.CubeService$$FastClassBySpringCGLIB$$17a07c0e.invoke()
>at 
> org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
>at 
> org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:720)
>at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
>at 
> org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:68)
>at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
>at 
> org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:655)
>at 
> org.apache.kylin.rest.service.CubeService$$EnhancerBySpringCGLIB$$a843c409.updateCubeAndDesc()
>at 
> org.apache.kylin.rest.controller.CubeController.updateCubeDesc(CubeController.java:511)
>at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>at java.lang.reflect.Method.invoke(Method.java:498)
>
>
>
>apache_...@163.com

Re: [VOTE] Release apache-kylin-2.1.0 (RC2)

[Cheng Wang]

+1 (Upgrade Spark to 2.1 should bring more capability to accelerate cubing.)





On 8/13/17, 2:45 PM, "ShaoFeng Shi"  wrote:

>Hi all,
>
>I have created a build for Apache Kylin 2.1.0, release candidate 2.
>
>Changes highlights:
>KYLIN-2506 - Refactor global dictionary
>KYLIN-2515 - Route unsupported query back to query its source directly
>KYLIN-2579 KYLIN-2580  - Improvement on subqueries
>KYLIN-2633 - Upgrade Spark to 2.1
>KYLIN-2646 - Project level query authorization
>
>And more than 100 bug fixes and enhancements.
>
>Thanks to everyone who has contributed to this release. Here’s release
>notes:
>https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12340443
>
>The commit to be voted upon:
>
>https://github.com/apache/kylin/commit/562dd173aaf6b398be8e053f896755b3afe8137f
>
>Its hash is 562dd173aaf6b398be8e053f896755b3afe8137f.
>
>The artifacts to be voted on are located here:
>https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.1.0-rc2/
>
>The hashes of the artifacts are as follows:
>apache-kylin-2.1.0-src.tar.gz.md5 44cab3240772dd1b2e717b48105b416c
>apache-kylin-2.1.0-src.tar.gz.sha1 a3470589523cfa9046d70123d78059b913f31b9f
>
>(The binary packages for HBase 1.x and CDH 5.7are also provided for testing)
>
>A staged Maven repository is available for review at:
>https://repository.apache.org/content/repositories/orgapachekylin-1043/
>
>Release artifacts are signed with the following key:
>https://people.apache.org/keys/committer/shaofengshi.asc
>
>Please vote on releasing this package as Apache Kylin 2.1.0.
>
>The vote is open for the next 72 hours and passes if a majority of
>at least three +1 PPMC votes are cast.
>
>[ ] +1 Release this package as Apache Kylin 2.1.0
>[ ]  0 I don't feel strongly about it, but I'm okay with the release
>[ ] -1 Do not release this package because...
>
>Here is my vote:
>
>+1 (binding)
>
>
>-- 
>Best regards,
>
>Shaofeng Shi 史少锋

Re: #3 Step Name: Extract Fact Table Distinct Error

[Cheng Wang]

It looks like hive configuration is incorrect, can you please provide your 
cluster environment info?

发自我的 iPhone

> 在 2017年1月7日，下午6:18，Sivakumar Venkataraman  写道：
> 
> We are new to kylin. We are trying to build a sample cube.
> While in Step 3, the following exception is thrown.
> 
> 
> java.lang.RuntimeException: java.io.IOException:
> org.apache.thrift.transport.TTransportException
>at
> org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(HiveMRInput.java:94)
>at
> org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:123)
>at
> org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:103)
>at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:88)
>at
> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
>at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
>at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
>at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
>at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
>at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>at java.lang.Thread.run(Thread.java:745)
> Caused by: java.io.IOException:
> org.apache.thrift.transport.TTransportException
>at
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:97)
>at
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:51)
>at
> org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(HiveMRInput.java:89)
>... 11 more
> Caused by: org.apache.thrift.transport.TTransportException
>at
> org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
>at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
>at
> org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
>at
> org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
>at
> org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
>at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
>at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_table(ThriftHiveMetastore.java:1260)
>at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table(ThriftHiveMetastore.java:1246)
>at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1349)
>at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>at java.lang.reflect.Method.invoke(Method.java:498)
>at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:152)
>at com.sun.proxy.$Proxy45.getTable(Unknown Source)
>at org.apache.hive.hcatalog.common.HCatUtil.getTable(HCatUtil.java:180)
>at
> org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:105)
>at
> org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86)
>at
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95)
>... 13 more
> 
> result code:2
> 
> 
> Any help is appreciated !
> 
> --
> View this message in context: 
> http://apache-kylin.74782.x6.nabble.com/3-Step-Name-Extract-Fact-Table-Distinct-Error-tp6864.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: can not get hive table

[Cheng Wang]

在hive客户端看一下表是不是在default数据库，还是其他数据库。

On 12/22/16, 10:04 AM, "35925138" <35925...@qq.com> wrote:

我用hive客户端可以看到main_stu_action表，数据也都正常，使用hcatalog，客户端运行命令也能够查找到这个表，可在kylin中要添加表的时候，就是失败，查看日志，报如下错误，请帮忙看看，我是哪里错误了。


Caused by: NoSuchObjectException(message:default.main_stu_action table not 
found)
at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_core(HiveMetaStore.java:1808)
at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1778)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)
at com.sun.proxy.$Proxy48.get_table(Unknown Source)
at 
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1208)
at 
org.apache.kylin.source.hive.CLIHiveClient.getHiveTableMeta(CLIHiveClient.java:79)
at 
org.apache.kylin.source.hive.HiveSourceTableLoader.extractHiveTables(HiveSourceTableLoader.java:93)

Re: cube query problem with kylin-1.5.3

[Cheng Wang]

Region.execService(HRegion.java:6154)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1692)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1674)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:31447)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031)
... 4 more

at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1206)
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:213)
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:287)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.execService(ClientProtos.java:32675)
at
org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1615)
... 13 more
2016-08-04 12:02:05,665 INFO  [http-bio-7070-exec-5]
service.QueryService:253 :
==[QUERY]===
SQL: select * from   KYLIN_SALES
User: ADMIN
Success: false
Duration: 0.0
Project: learn_kylin
Realization Names: [kylin_sales_cube_desc_clone_clone]
Cuboid Ids: [99]
Total scan count: 0
Result row count: 0
Accept Partial: true
Is Partial Result: false
Hit Exception Cache: false
Storage cache used: false
Message: Error while executing SQL "select * from   KYLIN_SALES LIMIT
5": Error in coprocessor
==[QUERY]===





===

I really have no idea ... thanks for your help
===



2016-08-04 11:56 GMT+08:00 Cheng Wang <cheng.w...@kyligence.io>:

> OK, then please provide more exception information.
>
> On 8/4/16, 11:49 AM, "王峰" <wangfengfight...@gmail.com> wrote:
>
> sorry I am not describe rightly , my kylin version is
> apache-kylin-1.5.3-HBase1.x-bin.
> I did not use apache-kylin-1.5.3-bin.tar.gz ...
>
> 2016-08-04 11:37 GMT+08:00 Cheng Wang <cheng.w...@kyligence.io>:
>
> > I meant that you need to check your Kylin version. According to your
> > environment, try this version:
> >
> http://www.apache.org/dyn/closer.cgi/kylin/apache-kylin-1.5.3/apache-kylin-1.5.3-HBase1.x-bin.tar.gz
> >
> > On 8/4/16, 11:03 AM, "wangfeng" <wangfengfight...@gmail.com> wrote:
> >
> > as you say, I check the details logs of kylin-1.5.3,and found those info:
> > ==[QUERY]===
> > SQL: select * from KYLIN_SALES
> > User: ADMIN
> > Success: false
> > Duration: 0.0
> > Project: learn_kylin
> > Realization Names: [kylin_sales_cube_desc_clone_clone]
> > Cuboid Ids: [99]
> > Total scan count: 0
> > Result row count: 0
> > Accept Partial: true
> > Is Partial Result: false
> > Hit Exception Cache: false
> > Storage cache used: false
> > Message: Error while executing SQL "select * from KYLIN_SALES LIMIT
> 5":
> > Error in coprocessor
> > ==[QUERY]===
> >
> > 2016-08-04 10:53:11,819 ERROR [http-bio-7070-exec-10]
> > controller.BasicController:44 :
> > org.apache.kylin.rest.exception.InternalErrorException: Error while
> > executing SQL "select * from KYLIN_SALES LIMIT 5": Error in
> coprocessor
> > at
> >
> >
> org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224)
> > at
> >
> >
> org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:498)
> > at
> >
> >
> org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
> > at
> >
> >
> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
> > at
> >
> >
> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
> > at
> >
> >
> org.springframework.web.servlet.mvc.method.annotation.R

Re: cube query problem with kylin-1.5.3

[Cheng Wang]

I meant that you need to check your Kylin version. According to your 
environment, try this version: 
http://www.apache.org/dyn/closer.cgi/kylin/apache-kylin-1.5.3/apache-kylin-1.5.3-HBase1.x-bin.tar.gz

On 8/4/16, 11:03 AM, "wangfeng"  wrote:

as you say, I check the details logs of kylin-1.5.3,and found those info: 
==[QUERY]=== 
SQL: select * from KYLIN_SALES 
User: ADMIN 
Success: false 
Duration: 0.0 
Project: learn_kylin 
Realization Names: [kylin_sales_cube_desc_clone_clone] 
Cuboid Ids: [99] 
Total scan count: 0 
Result row count: 0 
Accept Partial: true 
Is Partial Result: false 
Hit Exception Cache: false 
Storage cache used: false 
Message: Error while executing SQL "select * from KYLIN_SALES LIMIT 5":
Error in coprocessor 
==[QUERY]=== 

2016-08-04 10:53:11,819 ERROR [http-bio-7070-exec-10]
controller.BasicController:44 : 
org.apache.kylin.rest.exception.InternalErrorException: Error while
executing SQL "select * from KYLIN_SALES LIMIT 5": Error in coprocessor 
at
org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224)
 
at
org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) 
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 
at java.lang.reflect.Method.invoke(Method.java:498) 
at
org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
 
at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
 
at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
 
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617)
 
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578)
 
at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
 
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
 
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
 
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
 
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789)
 
--
 

if hbase version 0.98 works well , can I compile the
kylin-coprocessor-1.5.3-0.jar to meet the 0.98. 
btw, I used to set coprocessor to
kylin-1.5---kylin-coprocessor-1.5.0-SNAPSHOT-0.jar  but did not work. 

--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/cube-query-problem-with-kylin-1-5-3-tp5484p5490.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: Error in coprocessor

[Cheng Wang]

看起来是cdh5.5版本太低，要升级到cdh5.7

On 8/2/16, 4:42 PM, "Q" <35305...@qq.com> wrote:

环境是cdh5.5，kylin用的apache-kylin-1.5.3-cdh5.7-bin.tar.gz
启动kylin后，运行sample.sh，然后重启kylin。
在WEB UI中build cude成功。
在运行SQL示例程序的时候报错如下：
Error while executing SQL "select part_dt, sum(price) as total_selled, 
count(distinct seller_id) as sellers from KYLIN_SALES group by part_dt order by 
part_dt LIMIT 10": Error in coprocessor。
查看日志文件报错如下：
2016-08-02 16:39:07,880 WARN  [kylin-coproc--pool2-t1] 
ipc.CoprocessorRpcChannel:58 : Call failed on IOException
org.apache.hadoop.hbase.DoNotRetryIOException: 
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.NoSuchMethodError: 
org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment.getRegion()Lorg/apache/hadoop/hbase/regionserver/Region;
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2065)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
at 
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoSuchMethodError: 
org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment.getRegion()Lorg/apache/hadoop/hbase/regionserver/Region;
at 
org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:180)
at 
org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:4353)
at 
org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7234)
at 
org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
at 
org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
at 
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
... 4 more


at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at 
org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
at 
org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
at 
org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:328)
at 
org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1625)
at 
org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:92)
at 
org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:89)
at 
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126)
at 
org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:95)
at 
org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callMethod(CoprocessorRpcChannel.java:56)
at 
org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService$Stub.visitCube(CubeVisitProtos.java:4400)
at 
org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$1$1.call(CubeHBaseEndpointRPC.java:374)
at 
org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$1$1.call(CubeHBaseEndpointRPC.java:370)
at org.apache.hadoop.hbase.client.HTable$16.call(HTable.java:1797)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: 
org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
 org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.NoSuchMethodError: 
org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment.getRegion()Lorg/apache/hadoop/hbase/regionserver/Region;
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2065)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
at 
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoSuchMethodError: