date:20160520

[jira] [Created] (KYLIN-1715) User cannot go back to an executing query if clicked other links by mistake

2016-05-20 Thread Dong Li (JIRA)

Dong Li created KYLIN-1715:
--

 Summary: User cannot go back to an executing query if clicked 
other links by mistake
 Key: KYLIN-1715
 URL: https://issues.apache.org/jira/browse/KYLIN-1715
 Project: Kylin
  Issue Type: Bug
  Components: Web 
Affects Versions: v1.5.1
Reporter: Dong Li
Assignee: Zhong,Jason
Priority: Minor


1. In insight page, input a sql and submit it.
2. During its execution, click Monitor page
3. Got a warning alert, "You're executing query in current page, are you sure 
to leave the page? No matter click Yes or Cancel, I can never go back to the 
query.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-1714) Make job/source/storage engines configurable from kylin.properties

2016-05-20 Thread liyang (JIRA)

liyang created KYLIN-1714:
-

 Summary: Make job/source/storage engines configurable from 
kylin.properties
 Key: KYLIN-1714
 URL: https://issues.apache.org/jira/browse/KYLIN-1714
 Project: Kylin
  Issue Type: Improvement
Reporter: liyang






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-1716) leave executing query page action stop bug

2016-05-20 Thread Zhong,Jason (JIRA)

Zhong,Jason created KYLIN-1716:
--

 Summary: leave executing query page action stop bug
 Key: KYLIN-1716
 URL: https://issues.apache.org/jira/browse/KYLIN-1716
 Project: Kylin
  Issue Type: Bug
  Components: Web 
Reporter: Zhong,Jason
Assignee: Zhong,Jason
 Fix For: v1.5.3


at 'Insight' page, when executing query, if you click to other page like 
'Model', will prompt 'You've executing query in current page, are you sure to 
leave this page?' ,if you click cancel, you still leave query page successfully.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-1717) Make job engine scheduler configurable

2016-05-20 Thread Shaofeng SHI (JIRA)

Shaofeng SHI created KYLIN-1717:
---

 Summary: Make job engine scheduler configurable
 Key: KYLIN-1717
 URL: https://issues.apache.org/jira/browse/KYLIN-1717
 Project: Kylin
  Issue Type: Improvement
  Components: Job Engine
Reporter: Shaofeng SHI
Assignee: Shaofeng SHI


Today the job engine scheduler is a simple implementation; need abstract it to 
decouple the implementation



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: RE: RE: RE: kylin question

2016-05-20 Thread ??????????

I use CDH , when I build cubes, execute job I get this exception


INSERT OVERWRITE TABLE 
kylin_intermediate_kylin_sales_cube_desc_2012010100_2016052000 SELECT
KYLIN_SALES.PART_DT
,KYLIN_SALES.LEAF_CATEG_ID
,KYLIN_SALES.LSTG_SITE_ID
,KYLIN_CATEGORY_GROUPINGS.META_CATEG_NAME
,KYLIN_CATEGORY_GROUPINGS.CATEG_LVL2_NAME
,KYLIN_CATEGORY_GROUPINGS.CATEG_LVL3_NAME
,KYLIN_SALES.LSTG_FORMAT_NAME
,KYLIN_SALES.PRICE
,KYLIN_SALES.SELLER_ID
  OM DEFAULT.KYLIN_SALES as KYLIN_SALES 
INNER JOIN DEFAULT.KYLIN_CAL_DT as KYLIN_CAL_DT
ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
INNER JOIN DEFAULT.KYLIN_CATEGORY_GROUPINGS as KYLIN_CATEGORY_GROUPINGS
ON KYLIN_SALES.LEAF_CATEG_ID = KYLIN_CATEGORY_GROUPINGS.LEAF_CATEG_ID AND 
KYLIN_SALES.LSTG_SITE_ID = KYLIN_CATEGORY_GROUPINGS.SITE_ID
WHERE (KYLIN_SALES.PART_DT >= '2012-01-01' AND KYLIN_SALES.PART_DT < 
'2016-05-20')
;


"





2016-05-20 16:57:41,711 ERROR [pool-5-thread-2] 
execution.AbstractExecutable:116 : error running Executable
java.lang.NoSuchMethodError: 
org.codehaus.jackson.map.ObjectMapper.setSerializationInclusion(Lorg/codehaus/jackson/map/annotate/JsonSerialize$Inclusion;)Lorg/codehaus/jackson/map/ObjectMapper;
at 
org.apache.hadoop.yarn.webapp.YarnJacksonJaxbJsonProvider.configObjectMapper(YarnJacksonJaxbJsonProvider.java:59)
at 
org.apache.hadoop.yarn.util.timeline.TimelineUtils.(TimelineUtils.java:47)
at 
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.serviceInit(YarnClientImpl.java:151)
at 
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at 
org.apache.hadoop.mapred.ResourceMgrDelegate.serviceInit(ResourceMgrDelegate.java:94)
at 
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at 
org.apache.hadoop.mapred.ResourceMgrDelegate.(ResourceMgrDelegate.java:88)
at org.apache.hadoop.mapred.YARNRunner.(YARNRunner.java:111)
at 
org.apache.hadoop.mapred.YarnClientProtocolProvider.create(YarnClientProtocolProvider.java:34)
at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:95)
at org.apache.hadoop.mapreduce.Cluster.(Cluster.java:82)
at org.apache.hadoop.mapreduce.Cluster.(Cluster.java:75)
at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1255)
at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1251)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.mapreduce.Job.connect(Job.java:1250)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1279)
at 
org.apache.kylin.engine.mr.common.AbstractHadoopJob.waitForCompletion(AbstractHadoopJob.java:147)
at 
org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:96)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at 
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:118)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-05-20 16:57:41,721 DEBUG [pool-5-thread-2] hbase.HBaseResourceStore:260 : 
Update row /execute_output/7264bedc-fef8-4a72-91c5-e5dac0fd47a0-01 from oldTs: 
1463734658316, to newTs: 1463734661718, operation result: true
2016-05-20 16:57:41,727 DEBUG [pool-5-thread-2] hbase.HBaseResourceStore:260 : 
Update row /execute_output/7264bedc-fef8-4a72-91c5-e5dac0fd47a0-01 from oldTs: 
1463734661718, to newTs: 1463734661724, operation result: true
2016-05-20 16:57:41,727 INFO  [pool-5-thread-2] manager.ExecutableManager:274 : 
job id:7264bedc-fef8-4a72-91c5-e5dac0fd47a0-01 from RUNNING to ERROR
2016-05-20 16:57:41,727 ERROR [pool-5-thread-2] 
execution.AbstractExecutable:116 : error running Executable
org.apache.kylin.job.exception.ExecuteException: java.lang.NoSuchMethodError: 
org.codehaus.jackson.map.ObjectMapper.setSerializationInclusion(Lorg/codehaus/jackson/map/annotate/JsonSerialize$Inclusion;)Lorg/codehaus/jackson/map/ObjectMapper;
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at

[jira] [Created] (KYLIN-1720) Apache Kylin:- Measures is not seen anywhere

2016-05-20 Thread Rahul Choubey (JIRA)

Rahul Choubey created KYLIN-1720:


 Summary: Apache Kylin:- Measures is not seen anywhere
 Key: KYLIN-1720
 URL: https://issues.apache.org/jira/browse/KYLIN-1720
 Project: Kylin
  Issue Type: Bug
Affects Versions: v1.5.1
Reporter: Rahul Choubey
Priority: Blocker


We have created measures in cube that we have created through Kylin.

But the question is where this measures will get stored and how can I use them 
when I query the cubes. I want to use these measures in my select statement 
while querying the cube for e.g.:-

SELECT KYLIN_CATEGORY_GROUPINGS.BSNS_VRTCL_NAME,KYLIN_CAL_DT.YEAR_BEG_DT, 
MAX_PRICE FROM KYLIN_SALES
INNER JOIN KYLIN_CATEGORY_GROUPINGS
ON KYLIN_SALES.LEAF_CATEG_ID = KYLIN_CATEGORY_GROUPINGS.LEAF_CATEG_ID AND 
KYLIN_SALES.LSTG_SITE_ID = KYLIN_CATEGORY_GROUPINGS.SITE_ID
INNER JOIN KYLIN_CAL_DT
ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
GROUP BY KYLIN_CATEGORY_GROUPINGS.BSNS_VRTCL_NAME,KYLIN_CAL_DT.YEAR_BEG_DT

Currently if I am using above using query, it will give me error saying that 
MAX_PRICE is not a column present in tables.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [VOTE] Release apache-kylin-1.5.2 (release candidate 1)

2016-05-20 Thread Xiaoyu Wang


+1 (binding)
mvn test passed
signature verified

在 2016年05月20日 18:08, Li Yang 写道:

+1

mvn test pass

java version "1.7.0_79"
OpenJDK Runtime Environment (rhel-2.5.5.1.el6_6-x86_64 u79-b14)
OpenJDK 64-Bit Server VM (build 24.79-b02, mixed mode)


On Fri, May 20, 2016 at 5:37 PM, Dong Li  wrote:


Hi all,

I have created a build for Apache Kylin 1.5.2, release candidate 1.

Changes highlights:
[KYLIN-1077] - Support Hive View as Lookup Table
[KYLIN-1515] - Make Kylin run on MapR
[KYLIN-1600] - Download diagnosis zip from GUI
[KYLIN-1672] - support kylin on cdh 5.7

Thanks to everyone who has contributed to this release.
Here’s release notes:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12335528

The commit to be voted upon:

https://github.com/apache/kylin/commit/349c004861d0f0a9ae5d8c4646b55e39ebfde282

Its hash is 349c004861d0f0a9ae5d8c4646b55e39ebfde282

The artifacts to be voted on are located here:
https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.2-rc1/

The hashes of the artifacts are as follows:
apache-kylin-1.5.2-src.tar.gz.mdfde5f5676116beb1693d803a3eb6c277
apache-kylin-1.5.2-src.tar.gz.sha1
  0a8e2cd465825047bf35f078595560605c511f15

A staged Maven repository is available for review at:
https://repository.apache.org/content/repositories/orgapachekylin-1026/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/lidong.asc

Please vote on releasing this package as Apache Kylin 1.5.2.

The vote is open for the next 72 hours and passes if a majority of
at least three +1 PPMC votes are cast.

[ ] +1 Release this package as Apache Kylin 1.5.2
[ ] 0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...

Here is my vote:
+1 (binding)

Thanks,
Dong Li

Thanks,
Dong Li

2016-05-20 17:24 GMT+08:00 lidong :


Hi all,
I have created a build for Apache Kylin 1.5.2, release candidate 1.
Changes highlights:
[KYLIN-1077] - Support Hive View as Lookup Table[KYLIN-1515] - Make Kylin
run on MapR[KYLIN-1600] - Download diagnosis zip from GUI[KYLIN-1672] -
support kylin on cdh 5.7
Thanks to everyone who has contributed to this release. Here’s release
notes:


https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121version=12335528

The commit to be voted upon:


https://github.com/apache/kylin/commit/349c004861d0f0a9ae5d8c4646b55e39ebfde282

Its hash is 349c004861d0f0a9ae5d8c4646b55e39ebfde282
  The artifacts to be voted on are located here:
https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.2-rc1/ The
hashes of the artifacts are as follows: apache-kylin-1.5.2-src.tar.gz.md
fde5f5676116beb1693d803a3eb6c277 apache-kylin-1.5.2-src.tar.gz.sha1
0a8e2cd465825047bf35f078595560605c511f15 A staged Maven repository is
available for review at:
https://repository.apache.org/content/repositories/orgapachekylin-1026/
Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/lidong.asc Please vote on
releasing this package as Apache Kylin 1.5.2. The vote is open for the

next

72 hours and passes if a majority of at least three +1 PPMC votes are

cast.

[ ] +1 Release this package as Apache Kylin 1.5.2 [ ] 0 I don't feel
strongly about it, but I'm okay with the release [ ] -1 Do not release

this

package because... Here is my vote: +1 (binding) Thanks, Dong Li

Re: RE: kylin question

2016-05-20 Thread ??????????

I put the Hadoop-yarn* jars to $KYLIN_HOME/lib ,resolved the exception,but I 
have other exception like this
java.lang.NoSuchMethodError: 
org.codehaus.jackson.map.ObjectMapper.setSerializationInclusion(Lorg/codehaus/jackson/map/annotate/JsonSerialize$Inclusion;)Lorg/codehaus/jackson/map/ObjectMapper;
at 
org.apache.hadoop.yarn.webapp.YarnJacksonJaxbJsonProvider.configObjectMapper(YarnJacksonJaxbJsonProvider.java:59)
at 
org.apache.hadoop.yarn.util.timeline.TimelineUtils.(TimelineUtils.java:47)
at 
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.serviceInit(YarnClientImpl.java:151)
at 
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at 
org.apache.hadoop.mapred.ResourceMgrDelegate.serviceInit(ResourceMgrDelegate.java:94)
at 
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at 
org.apache.hadoop.mapred.ResourceMgrDelegate.(ResourceMgrDelegate.java:88)
at org.apache.hadoop.mapred.YARNRunner.(YARNRunner.java:111)
at 
org.apache.hadoop.mapred.YarnClientProtocolProvider.create(YarnClientProtocolProvider.java:34)
at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:95)
at org.apache.hadoop.mapreduce.Cluster.(Cluster.java:82)
at org.apache.hadoop.mapreduce.Cluster.(Cluster.java:75)
at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1255)
at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1251)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.mapreduce.Job.connect(Job.java:1250)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1279)
at 
org.apache.kylin.engine.mr.common.AbstractHadoopJob.waitForCompletion(AbstractHadoopJob.java:147)
at 
org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:96)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at 
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:118)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)



and I put jackson-* 1.9.13 jars to $KYLIN_HOME/bin,still have exception




Thanks!


-- Original --
From:  "Yapu Jia";;
Date:  Fri, May 20, 2016 02:56 PM
To:  "dev@kylin.apache.org"; 

Subject:  RE: kylin question



I think this issue maybe caused by that your mapred classpath not have 
Hadoop-yarn* jars.

Thanks.

-Original Message-
From: ?? [mailto:549066...@qq.com] 
Sent: Friday, May 20, 2016 2:28 PM
To: dev 
Subject: kylin question

Hi:
   When I Quick play with a sample cube get some exception like this


org.apache.kylin.job.exception.ExecuteException: 
org.apache.kylin.job.exception.ExecuteException: 
java.lang.NoClassDefFoundError: Could not initialize class 
org.apache.hadoop.yarn.util.timeline.TimelineUtils
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.kylin.job.exception.ExecuteException: 
java.lang.NoClassDefFoundError: Could not initialize class 
org.apache.hadoop.yarn.util.timeline.TimelineUtils
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
... 4 more
Caused by: java.lang.NoClassDefFoundError: Could not initialize class 
org.apache.hadoop.yarn.util.timeline.TimelineUtils
at 
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.serviceInit(YarnClientImpl.java:151)
at

Re: Timeout visiting cube!

2016-05-20 Thread hongbin ma

kylin query server can't wait for hbase coprosessors to return forever. By
default kylin uses hbase's "hbase.rpc.timeout" as the rpc call's timeout.
You can increase the kylin side timeout by increasing
the kylin.query.cube.visit.timeout.times to larger multiplier than
one(default). However it may still suffer from hbase rpc timeout

need to be 1.5.1 or above

On Fri, May 20, 2016 at 10:16 AM, 耳东 <775620...@qq.com> wrote:

> hi all
>
>   When I query the cube, most of the sql can return results. However
> the more dimension included in the sql, the more times it takes to return
> the results. And when I add almost all the dimension in the sql , it
> returns Timeout visiting cube.
>
>
>
>
>
>
> 2016-05-20 10:12:41,492 ERROR [pool-12-thread-126]
> v2.CubeHBaseEndpointRPC:98 : Execution exception when running task in
> pool-12-thread-126
> 2016-05-20 10:12:41,492 ERROR [pool-12-thread-126]
> v2.CubeHBaseEndpointRPC:108 : Caught exception in thread pool-12-thread-126:
> java.lang.RuntimeException: Error when visiting cubes by endpoint:
> at
> org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$1.run(CubeHBaseEndpointRPC.java:323)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
> Caused by: java.net.SocketTimeoutException: callTimeout=6,
> callDuration=69040: row '' on table 'KYLIN_Z7VH6H8XII' at
> region=KYLIN_Z7VH6H8XII,,1463638140445.af341476d4df7a5e2ae9cf23a31afccf.,
> hostname=test11,60020,1463636501632, seqNum=5
> at
> org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:159)
> at
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:95)
> at
> org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callMethod(CoprocessorRpcChannel.java:56)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService$Stub.visitCube(CubeVisitProtos.java:3861)
> at
> org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$2.call(CubeHBaseEndpointRPC.java:361)
> at
> org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$2.call(CubeHBaseEndpointRPC.java:357)
> at org.apache.hadoop.hbase.client.HTable$16.call(HTable.java:1783)
> ... 4 more
> Caused by: java.io.IOException: Call to test11/10.142.20.96:60020 failed
> on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call
> id=237083, waitTime=60001, operationTimeout=6 expired.
> at
> org.apache.hadoop.hbase.ipc.RpcClientImpl.wrapException(RpcClientImpl.java:1236)
> at
> org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1204)
> at
> org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:216)
> at
> org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:300)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.execService(ClientProtos.java:31775)
> at
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1618)
> at
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:92)
> at
> org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:89)
> at
> org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126)
> ... 10 more
> Caused by: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call
> id=237083, waitTime=60001, operationTimeout=6 expired.
> at
> org.apache.hadoop.hbase.ipc.Call.checkAndSetTimeout(Call.java:70)
> at
> org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1178)
> ... 17 more
> 2016-05-20 10:12:41,492 ERROR [pool-12-thread-125]
> v2.CubeHBaseEndpointRPC:108 : Caught exception in thread pool-12-thread-125:
> java.lang.RuntimeException: Error when visiting cubes by endpoint:
> at
> org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$1.run(CubeHBaseEndpointRPC.java:323)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)




-- 
Regards,

*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github:

?????? too little reduce

2016-05-20 Thread ????

I set kylin.hbase.hfile.size.gb in kylin.properties to 1 and rebuild the cube. 
however in the Kylin_HFile_Generator_http_service_cube_Step, it still submitted 
3260 map with 3 reduce.

--  --
??: "nichunen";;
: 2016??5??19??(??) 10:17
??: "dev"; 
: "dev"; 
: Re: too little reduce

Hi,

Try set kylin.hbase.hfile.size.gb in kylin.properties to smaller size, the job 
will have more reducers and will be faster then.  

  George/??

Mobile:+86-13501723787| WeChat:nceecn

??MiningLamp.COM
??

258??G??iDreamC125

Room C125#,Intelligent Industrial Park Building G,258#Chenhui Road, Pudong 
District,Shanghai,201203

> On May 19, 2016, at 9:39 PM,  <775620...@qq.com> wrote:
> 
> 
> HI all:
> 
> 
> 
> 
> 
> When I build the cube, in the Convert Cuboid Data to HFile step, the mr job 
> Kylin_HFile_Generator_http_service_cube_Step submitted 3260 map with 3 
> reduce. The map job completed in three minutes and the reduce job have been 
> runing for 3 hours.
> How can I increase the reduce number?
>

RE: RE: kylin question

2016-05-20 Thread Yapu Jia

Hi, 

You can check your jackson version. I think that if your jackson version not 
match your Hadoop verison, it would cause this exception.

Thanks.
-Original Message-
From: 水。。。海 [mailto:549066...@qq.com] 
Sent: Friday, May 20, 2016 4:29 PM
To: dev 
Subject: Re: RE: kylin question

I put the Hadoop-yarn* jars to $KYLIN_HOME/lib ,resolved the exception,but I 
have other exception like this
java.lang.NoSuchMethodError: 
org.codehaus.jackson.map.ObjectMapper.setSerializationInclusion(Lorg/codehaus/jackson/map/annotate/JsonSerialize$Inclusion;)Lorg/codehaus/jackson/map/ObjectMapper;
at 
org.apache.hadoop.yarn.webapp.YarnJacksonJaxbJsonProvider.configObjectMapper(YarnJacksonJaxbJsonProvider.java:59)
at 
org.apache.hadoop.yarn.util.timeline.TimelineUtils.(TimelineUtils.java:47)
at 
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.serviceInit(YarnClientImpl.java:151)
at 
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at 
org.apache.hadoop.mapred.ResourceMgrDelegate.serviceInit(ResourceMgrDelegate.java:94)
at 
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at 
org.apache.hadoop.mapred.ResourceMgrDelegate.(ResourceMgrDelegate.java:88)
at org.apache.hadoop.mapred.YARNRunner.(YARNRunner.java:111)
at 
org.apache.hadoop.mapred.YarnClientProtocolProvider.create(YarnClientProtocolProvider.java:34)
at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:95)
at org.apache.hadoop.mapreduce.Cluster.(Cluster.java:82)
at org.apache.hadoop.mapreduce.Cluster.(Cluster.java:75)
at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1255)
at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1251)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.mapreduce.Job.connect(Job.java:1250)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1279)
at 
org.apache.kylin.engine.mr.common.AbstractHadoopJob.waitForCompletion(AbstractHadoopJob.java:147)
at 
org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:96)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at 
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:118)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)



and I put jackson-* 1.9.13 jars to $KYLIN_HOME/bin,still have exception




Thanks!


-- Original --
From:  "Yapu Jia";;
Date:  Fri, May 20, 2016 02:56 PM
To:  "dev@kylin.apache.org"; 

Subject:  RE: kylin question



I think this issue maybe caused by that your mapred classpath not have 
Hadoop-yarn* jars.

Thanks.

-Original Message-
From: 水。。。海 [mailto:549066...@qq.com] 
Sent: Friday, May 20, 2016 2:28 PM
To: dev 
Subject: kylin question

Hi:
   When I Quick play with a sample cube get some exception like this


org.apache.kylin.job.exception.ExecuteException: 
org.apache.kylin.job.exception.ExecuteException: 
java.lang.NoClassDefFoundError: Could not initialize class 
org.apache.hadoop.yarn.util.timeline.TimelineUtils
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.kylin.job.exception.ExecuteException: 
java.lang.NoClassDefFoundError: Could not initialize class 
org.apache.hadoop.yarn.util.timeline.TimelineUtils
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at

[jira] [Created] (KYLIN-1718) Grow ByteBuffer Dynamically in Cube Building and Query

2016-05-20 Thread Yerui Sun (JIRA)

Yerui Sun created KYLIN-1718:


 Summary: Grow ByteBuffer Dynamically in Cube Building and Query
 Key: KYLIN-1718
 URL: https://issues.apache.org/jira/browse/KYLIN-1718
 Project: Kylin
  Issue Type: Improvement
  Components: Job Engine, Query Engine
Affects Versions: v1.5.1, v1.5.2
Reporter: Yerui Sun
Assignee: Yerui Sun
 Fix For: v1.5.3


In Cube Building Mapper/Reducer and CubeVisitService, we use an allocated 
ByteBuffer to store encoded metrics value, with a constant size 
RowConstants.ROWVALUE_BUFFER_SIZE, which is 1MB by default.
If the metrics value is larger than 1MB, such as high cardinality bitmap,  
BufferOverflowException will be threw. We need grow the ByteBuffer if the 
exception occured.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-1719) Add config in scan request to control compress the query result or not

2016-05-20 Thread Yerui Sun (JIRA)

Yerui Sun created KYLIN-1719:


 Summary: Add config in scan request to control compress the query 
result or not
 Key: KYLIN-1719
 URL: https://issues.apache.org/jira/browse/KYLIN-1719
 Project: Kylin
  Issue Type: Improvement
  Components: Query Engine
Affects Versions: v1.5.1, v1.5.2
Reporter: Yerui Sun
Assignee: Yerui Sun
 Fix For: v1.5.3


The query result in CubeVisitService will be compressed before sending back to 
client, given about 10% size benefit. However, if the result size is large, 
such as over 100MB, the compress processing will be very slow, takes 60s or 
longer. 
We should add a config in scan request, to control whether compress the result 
or not.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

RE: RE: RE: kylin question

2016-05-20 Thread Yapu Jia

Which step you get this exception? Can you get more details information?
And, I recommend use Ambari HDP to deploy your environment. 

Thanks.

-Original Message-
From: 水。。。海 [mailto:549066...@qq.com] 
Sent: Friday, May 20, 2016 4:48 PM
To: dev 
Subject: Re: RE: RE: kylin question

jackson version in hadoop is 1.8.8, I try 1.8.8 and 1.9.13 ,all have problems




-- Original --
From:  "Yapu Jia";;
Date:  Fri, May 20, 2016 04:41 PM
To:  "dev@kylin.apache.org"; 

Subject:  RE: RE: kylin question



Hi, 

You can check your jackson version. I think that if your jackson version not 
match your Hadoop verison, it would cause this exception.

Thanks.
-Original Message-
From: 水。。。海 [mailto:549066...@qq.com] 
Sent: Friday, May 20, 2016 4:29 PM
To: dev 
Subject: Re: RE: kylin question

I put the Hadoop-yarn* jars to $KYLIN_HOME/lib ,resolved the exception,but I 
have other exception like this
java.lang.NoSuchMethodError: 
org.codehaus.jackson.map.ObjectMapper.setSerializationInclusion(Lorg/codehaus/jackson/map/annotate/JsonSerialize$Inclusion;)Lorg/codehaus/jackson/map/ObjectMapper;
at 
org.apache.hadoop.yarn.webapp.YarnJacksonJaxbJsonProvider.configObjectMapper(YarnJacksonJaxbJsonProvider.java:59)
at 
org.apache.hadoop.yarn.util.timeline.TimelineUtils.(TimelineUtils.java:47)
at 
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.serviceInit(YarnClientImpl.java:151)
at 
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at 
org.apache.hadoop.mapred.ResourceMgrDelegate.serviceInit(ResourceMgrDelegate.java:94)
at 
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at 
org.apache.hadoop.mapred.ResourceMgrDelegate.(ResourceMgrDelegate.java:88)
at org.apache.hadoop.mapred.YARNRunner.(YARNRunner.java:111)
at 
org.apache.hadoop.mapred.YarnClientProtocolProvider.create(YarnClientProtocolProvider.java:34)
at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:95)
at org.apache.hadoop.mapreduce.Cluster.(Cluster.java:82)
at org.apache.hadoop.mapreduce.Cluster.(Cluster.java:75)
at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1255)
at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1251)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.mapreduce.Job.connect(Job.java:1250)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1279)
at 
org.apache.kylin.engine.mr.common.AbstractHadoopJob.waitForCompletion(AbstractHadoopJob.java:147)
at 
org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:96)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at 
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:118)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)



and I put jackson-* 1.9.13 jars to $KYLIN_HOME/bin,still have exception




Thanks!


-- Original --
From:  "Yapu Jia";;
Date:  Fri, May 20, 2016 02:56 PM
To:  "dev@kylin.apache.org"; 

Subject:  RE: kylin question



I think this issue maybe caused by that your mapred classpath not have 
Hadoop-yarn* jars.

Thanks.

-Original Message-
From: 水。。。海 [mailto:549066...@qq.com] 
Sent: Friday, May 20, 2016 2:28 PM
To: dev 
Subject: kylin question

Hi:
   When I Quick play with a sample cube get some exception like this


org.apache.kylin.job.exception.ExecuteException: 
org.apache.kylin.job.exception.ExecuteException: 
java.lang.NoClassDefFoundError: Could not initialize class 
org.apache.hadoop.yarn.util.timeline.TimelineUtils
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
at

Re: [VOTE] Release apache-kylin-1.5.2 (release candidate 1)

2016-05-20 Thread Li Yang

+1

mvn test pass

java version "1.7.0_79"
OpenJDK Runtime Environment (rhel-2.5.5.1.el6_6-x86_64 u79-b14)
OpenJDK 64-Bit Server VM (build 24.79-b02, mixed mode)


On Fri, May 20, 2016 at 5:37 PM, Dong Li  wrote:

> Hi all,
>
> I have created a build for Apache Kylin 1.5.2, release candidate 1.
>
> Changes highlights:
> [KYLIN-1077] - Support Hive View as Lookup Table
> [KYLIN-1515] - Make Kylin run on MapR
> [KYLIN-1600] - Download diagnosis zip from GUI
> [KYLIN-1672] - support kylin on cdh 5.7
>
> Thanks to everyone who has contributed to this release.
> Here’s release notes:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12335528
>
> The commit to be voted upon:
>
> https://github.com/apache/kylin/commit/349c004861d0f0a9ae5d8c4646b55e39ebfde282
>
> Its hash is 349c004861d0f0a9ae5d8c4646b55e39ebfde282
>
> The artifacts to be voted on are located here:
> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.2-rc1/
>
> The hashes of the artifacts are as follows:
> apache-kylin-1.5.2-src.tar.gz.mdfde5f5676116beb1693d803a3eb6c277
> apache-kylin-1.5.2-src.tar.gz.sha1
>  0a8e2cd465825047bf35f078595560605c511f15
>
> A staged Maven repository is available for review at:
> https://repository.apache.org/content/repositories/orgapachekylin-1026/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/lidong.asc
>
> Please vote on releasing this package as Apache Kylin 1.5.2.
>
> The vote is open for the next 72 hours and passes if a majority of
> at least three +1 PPMC votes are cast.
>
> [ ] +1 Release this package as Apache Kylin 1.5.2
> [ ] 0 I don't feel strongly about it, but I'm okay with the release
> [ ] -1 Do not release this package because...
>
> Here is my vote:
> +1 (binding)
>
> Thanks,
> Dong Li
>
> Thanks,
> Dong Li
>
> 2016-05-20 17:24 GMT+08:00 lidong :
>
> > Hi all,
> > I have created a build for Apache Kylin 1.5.2, release candidate 1.
> > Changes highlights:
> > [KYLIN-1077] - Support Hive View as Lookup Table[KYLIN-1515] - Make Kylin
> > run on MapR[KYLIN-1600] - Download diagnosis zip from GUI[KYLIN-1672] -
> > support kylin on cdh 5.7
> > Thanks to everyone who has contributed to this release. Here’s release
> > notes:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121version=12335528
> > The commit to be voted upon:
> >
> https://github.com/apache/kylin/commit/349c004861d0f0a9ae5d8c4646b55e39ebfde282
> > Its hash is 349c004861d0f0a9ae5d8c4646b55e39ebfde282
> >  The artifacts to be voted on are located here:
> > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.2-rc1/ The
> > hashes of the artifacts are as follows: apache-kylin-1.5.2-src.tar.gz.md
> > fde5f5676116beb1693d803a3eb6c277 apache-kylin-1.5.2-src.tar.gz.sha1
> > 0a8e2cd465825047bf35f078595560605c511f15 A staged Maven repository is
> > available for review at:
> > https://repository.apache.org/content/repositories/orgapachekylin-1026/
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/lidong.asc Please vote on
> > releasing this package as Apache Kylin 1.5.2. The vote is open for the
> next
> > 72 hours and passes if a majority of at least three +1 PPMC votes are
> cast.
> > [ ] +1 Release this package as Apache Kylin 1.5.2 [ ] 0 I don't feel
> > strongly about it, but I'm okay with the release [ ] -1 Do not release
> this
> > package because... Here is my vote: +1 (binding) Thanks, Dong Li
>

[jira] [Created] (KYLIN-1715) User cannot go back to an executing query if clicked other links by mistake

[jira] [Created] (KYLIN-1714) Make job/source/storage engines configurable from kylin.properties

[jira] [Created] (KYLIN-1716) leave executing query page action stop bug

[jira] [Created] (KYLIN-1717) Make job engine scheduler configurable

Re: RE: RE: RE: kylin question

[jira] [Created] (KYLIN-1720) Apache Kylin:- Measures is not seen anywhere

Re: [VOTE] Release apache-kylin-1.5.2 (release candidate 1)

Re: RE: kylin question

Re: Timeout visiting cube!

?????? too little reduce

RE: RE: kylin question

[jira] [Created] (KYLIN-1718) Grow ByteBuffer Dynamically in Cube Building and Query

[jira] [Created] (KYLIN-1719) Add config in scan request to control compress the query result or not

RE: RE: RE: kylin question

Re: [VOTE] Release apache-kylin-1.5.2 (release candidate 1)

15 matches

Site Navigation

Mail list logo

Footer information