[jira] [Created] (KYLIN-3320) CubeStatsReader cannot print stats properly for some cube

2018-03-26 Thread Ma Gang (JIRA) 
Ma Gang created KYLIN-3320:
--

 Summary: CubeStatsReader cannot print stats properly for some cube 
 Key: KYLIN-3320
 URL: https://issues.apache.org/jira/browse/KYLIN-3320
 Project: Kylin
  Issue Type: Improvement
  Components: Tools, Build and Test
Reporter: Ma Gang
Assignee: Ma Gang


For the cubes that have cuboid_bytes set in the CubeInstance, the cuboid stats 
cannot print properly using tool CubeStatsReader



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Re: long time sql can't work in kylin

2018-03-26 Thread Wangdp 
Hi,
 
  There is no error message in the kylin log,kylin server run normal.

  it look like jdbc Exception(AvaticaStatement.executeQuery),Are there any 
parameters for this setting?



apache_...@163.com
 
From: Billy Liu
Date: 2018-03-27 09:34
To: dev
Subject: Re: long time sql can't work in kylin
From the stack trace, it's not Kylin exception. For the long query,
Kylin has timeout configuration. Could you check the kylin.log?
 
With Warm regards
 
Billy Liu
 
 
2018-03-26 16:39 GMT+08:00 Wangdp :
> Hi:
>
>  hdp2.5.3   kylin2.2
>
>   when a run a long time(More than 4 minutes) sql,it not work.
>
>  This is error info.
>
> : org.apache.http.NoHttpResponseException: The target server failed to respond
> at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
> at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
> at 
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)
> at 
> org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
> at 
> com.ddd.metric.component.indpack.IndicDataZip.Query2File(IndicDataZip.java:335)
> at 
> com.ddd.metric.component.indpack.IndicDataZip.run(IndicDataZip.java:248)
> at com.ddd.metric.component.jobrun.JobRun.run(JobRun.java:227)
> at com.ddd.metric.rest.job.JobImpl.run(JobImpl.java:40)
> at 
> com.alibaba.dubbo.common.bytecode.Wrapper3.invokeMethod(Wrapper3.java)
> at 
> com.alibaba.dubbo.rpc.proxy.javassist.JavassistProxyFactory$1.doInvoke(JavassistProxyFactory.java:46)
> at 
> com.alibaba.dubbo.rpc.proxy.AbstractProxyInvoker.invoke(AbstractProxyInvoker.java:72)
> at 
> com.alibaba.dubbo.rpc.protocol.InvokerWrapper.invoke(InvokerWrapper.java:53)
> at 
> com.alibaba.dubbo.rpc.filter.ExceptionFilter.invoke(ExceptionFilter.java:64)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at 
> com.alibaba.dubbo.monitor.support.MonitorFilter.invoke(MonitorFilter.java:75)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at 
> com.alibaba.dubbo.rpc.filter.TimeoutFilter.invoke(TimeoutFilter.java:42)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at 
> com.alibaba.dubbo.rpc.protocol.dubbo.filter.TraceFilter.invoke(TraceFilter.java:78)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at 
> com.alibaba.dubbo.rpc.filter.ContextFilter.invoke(ContextFilter.java:70)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at 
> com.alibaba.dubbo.rpc.filter.GenericFilter.invoke(GenericFilter.java:132)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at 
> com.alibaba.dubbo.rpc.filter.ClassLoaderFilter.invoke(ClassLoaderFilter.java:38)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at com.alibaba.dubbo.rpc.filter.EchoFilter.invoke(EchoFilter.java:38)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at 
> com.alibaba.dubbo.rpc.proxy.InvokerInvocationHandler.invoke(InvokerInvocationHandler.java:52)
> at com.alibaba.dubbo.common.bytecode.proxy1.run(proxy1.java)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at 
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:140)
> at 
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:294)
> at 
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:248)
> at 
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:235)
> at 
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402)
> at 
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209)
> at 
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
> at 
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
> at 
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
> at 
>

[jira] [Created] (KYLIN-3319) exceeds threshold 5000000 while executing SQL

2018-03-26 Thread cc (JIRA) 
cc created KYLIN-3319:
-

 Summary: exceeds threshold 500 while executing SQL
 Key: KYLIN-3319
 URL: https://issues.apache.org/jira/browse/KYLIN-3319
 Project: Kylin
  Issue Type: Bug
  Components: Query Engine
Affects Versions: v2.3.0
Reporter: cc
 Attachments: image.png

{color:#d04437}hello,what is the reason of the errors?{color}

{color:#d04437}Query returned 5008662 rows exceeds threshold 500 while 
executing SQL: "select * from USER_FREQ_DAY_TEST LIMIT 5"{color}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Upgrade Kylin version to 2.3.0 with some trouble that throws UncheckedExecutionException of HiveClientCache

2018-03-26 Thread 凡梦星尘 
Hi Billy:

Thanks for your suggest, I will try it. Hope can response good news.

2018-03-27 9:11 GMT+08:00 Billy Liu :

> For the first question, it seems some classpath conflict issue
> existing there "NoSuchMethodError", try google "HiveMetaStoreClient
> NoSuchMethodError"
>
> For the second question, to enable the dashboard, please follow the
> http://kylin.apache.org/docs23/howto/howto_setup_systemcube.html
> first.
>
> With Warm regards
>
> Billy Liu
>
>
> 2018-03-26 17:59 GMT+08:00 凡梦星尘 :
> > Hi guys:
> >
> > Congratulation  to Kylin release 2.3.0 with so many features.
> >
> > The last weekend I had try to upgrade this newest version to test ENV.
> All
> > things going is good and run well sample cube under MR mode. But when I
> try
> > to switch Spark mode not success. After fixed some problems that meet a
> > hard trouble not fixed. The error log see below:
> >
> > java.lang.RuntimeException: java.io.IOException:
> > com.google.common.util.concurrent.UncheckedExecutionException:
> > java.lang.RuntimeException: Unable to instantiate
> > org.apache.hive.hcatalog.common.HiveClientCache$
> CacheableHiveMetaStoreClient
> > at org.apache.kylin.source.hive.HiveMRInput$
> HiveTableInputFormat.configureJob(HiveMRInput.java:116)
> > at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> setupMapper(FactDistinctColumnsJob.java:121)
> > at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> run(FactDistinctColumnsJob.java:99)
> > at org.apache.kylin.engine.mr.common.MapReduceExecutable.
> doWork(MapReduceExecutable.java:130)
> > at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:162)
> > at org.apache.kylin.job.execution.DefaultChainedExecutable.
> doWork(DefaultChainedExecutable.java:67)
> > at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:162)
> > at org.apache.kylin.job.impl.threadpool.DefaultScheduler$
> JobRunner.run(DefaultScheduler.java:300)
> > at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
> > at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
> > at java.lang.Thread.run(Thread.java:748)
> > Caused by: java.io.IOException:
> > com.google.common.util.concurrent.UncheckedExecutionException:
> > java.lang.RuntimeException: Unable to instantiate
> > org.apache.hive.hcatalog.common.HiveClientCache$
> CacheableHiveMetaStoreClient
> > at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.
> setInput(HCatInputFormat.java:97)
> > at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.
> setInput(HCatInputFormat.java:51)
> > at org.apache.kylin.source.hive.HiveMRInput$
> HiveTableInputFormat.configureJob(HiveMRInput.java:113)
> > ... 10 more
> > Caused by: com.google.common.util.concurrent.
> UncheckedExecutionException:
> > java.lang.RuntimeException: Unable to instantiate
> > org.apache.hive.hcatalog.common.HiveClientCache$
> CacheableHiveMetaStoreClient
> > at com.google.common.cache.LocalCache$Segment.get(
> LocalCache.java:2256)
> > at com.google.common.cache.LocalCache.get(LocalCache.java:3985)
> > at com.google.common.cache.LocalCache$LocalManualCache.
> get(LocalCache.java:4788)
> > at org.apache.hive.hcatalog.common.HiveClientCache.
> getOrCreate(HiveClientCache.java:292)
> > at org.apache.hive.hcatalog.common.HiveClientCache.get(
> HiveClientCache.java:267)
> > at org.apache.hive.hcatalog.common.HCatUtil.
> getHiveMetastoreClient(HCatUtil.java:558)
> > at org.apache.hive.hcatalog.mapreduce.InitializeInput.
> getInputJobInfo(InitializeInput.java:104)
> > at org.apache.hive.hcatalog.mapreduce.InitializeInput.
> setInput(InitializeInput.java:88)
> > at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.
> setInput(HCatInputFormat.java:95)
> > ... 12 more
> > Caused by: java.lang.RuntimeException: Unable to instantiate
> > org.apache.hive.hcatalog.common.HiveClientCache$
> CacheableHiveMetaStoreClient
> > at org.apache.hadoop.hive.metastore.MetaStoreUtils.
> newInstance(MetaStoreUtils.java:1566)
> > at org.apache.hadoop.hive.metastore.
> RetryingMetaStoreClient.(RetryingMetaStoreClient.java:92)
> > at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.
> getProxy(RetryingMetaStoreClient.java:138)
> > at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.
> getProxy(RetryingMetaStoreClient.java:124)
> > at org.apache.hive.hcatalog.common.HiveClientCache$5.call(
> HiveClientCache.java:297)
> > at org.apache.hive.hcatalog.common.HiveClientCache$5.call(
> HiveClientCache.java:292)
> > at com.google.common.cache.LocalCache$LocalManualCache$1.
> load(LocalCache.java:4791)
> > at com.google.common.cache.LocalCache$LoadingValueReference.
>

Re: long time sql can't work in kylin

2018-03-26 Thread Billy Liu 
>From the stack trace, it's not Kylin exception. For the long query,
Kylin has timeout configuration. Could you check the kylin.log?

With Warm regards

Billy Liu


2018-03-26 16:39 GMT+08:00 Wangdp :
> Hi:
>
>  hdp2.5.3   kylin2.2
>
>   when a run a long time(More than 4 minutes) sql,it not work.
>
>  This is error info.
>
> : org.apache.http.NoHttpResponseException: The target server failed to respond
> at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
> at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
> at 
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)
> at 
> org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
> at 
> com.adtec.metric.component.indpack.IndicDataZip.Query2File(IndicDataZip.java:335)
> at 
> com.adtec.metric.component.indpack.IndicDataZip.run(IndicDataZip.java:248)
> at com.adtec.metric.component.jobrun.JobRun.run(JobRun.java:227)
> at com.adtec.metric.rest.job.JobImpl.run(JobImpl.java:40)
> at 
> com.alibaba.dubbo.common.bytecode.Wrapper3.invokeMethod(Wrapper3.java)
> at 
> com.alibaba.dubbo.rpc.proxy.javassist.JavassistProxyFactory$1.doInvoke(JavassistProxyFactory.java:46)
> at 
> com.alibaba.dubbo.rpc.proxy.AbstractProxyInvoker.invoke(AbstractProxyInvoker.java:72)
> at 
> com.alibaba.dubbo.rpc.protocol.InvokerWrapper.invoke(InvokerWrapper.java:53)
> at 
> com.alibaba.dubbo.rpc.filter.ExceptionFilter.invoke(ExceptionFilter.java:64)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at 
> com.alibaba.dubbo.monitor.support.MonitorFilter.invoke(MonitorFilter.java:75)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at 
> com.alibaba.dubbo.rpc.filter.TimeoutFilter.invoke(TimeoutFilter.java:42)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at 
> com.alibaba.dubbo.rpc.protocol.dubbo.filter.TraceFilter.invoke(TraceFilter.java:78)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at 
> com.alibaba.dubbo.rpc.filter.ContextFilter.invoke(ContextFilter.java:70)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at 
> com.alibaba.dubbo.rpc.filter.GenericFilter.invoke(GenericFilter.java:132)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at 
> com.alibaba.dubbo.rpc.filter.ClassLoaderFilter.invoke(ClassLoaderFilter.java:38)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at com.alibaba.dubbo.rpc.filter.EchoFilter.invoke(EchoFilter.java:38)
> at 
> com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
> at 
> com.alibaba.dubbo.rpc.proxy.InvokerInvocationHandler.invoke(InvokerInvocationHandler.java:52)
> at com.alibaba.dubbo.common.bytecode.proxy1.run(proxy1.java)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at 
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:140)
> at 
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:294)
> at 
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:248)
> at 
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:235)
> at 
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402)
> at 
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209)
> at 
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
> at 
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
> at 
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
> at 
> com.alibaba.dubbo.rpc.protocol.rest.DubboHttpServer$RestHandler.handle(DubboHttpServer.java:86)
> at 
> com.alibaba.dubbo.remoting.http.servlet.DispatcherServlet.service(DispatcherServlet.java:64)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
> at 
>

[GitHub] yiming187 closed pull request #45: i think it must be a error

2018-03-26 Thread GitBox 
yiming187 closed pull request #45: i think it must be a error
URL: https://github.com/apache/kylin/pull/45
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git 
a/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/util/ZookeeperJobLock.java
 
b/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/util/ZookeeperJobLock.java
index 7bf7498139..0b1232c85c 100644
--- 
a/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/util/ZookeeperJobLock.java
+++ 
b/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/util/ZookeeperJobLock.java
@@ -81,7 +81,7 @@ public boolean lock() {
 logger.warn("error acquire lock", e);
 }
 if (!hasLock) {
-logger.warn("fail to acquire lock, scheduler has not been started; 
maybe another kylin process is still running?");
+logger.error("fail to acquire lock, scheduler has not been 
started; maybe another kylin process is still running?");
 try {
 for (String node : sharedLock.getParticipantNodes()) {
 logger.warn("lock holder info: {}", new 
String(zkClient.getData().forPath(node)));


 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] yiming187 commented on issue #121: KYLIN-3305 Fix typos `kylin.job.run.as.remote.cmd`

2018-03-26 Thread GitBox 
yiming187 commented on issue #121: KYLIN-3305 Fix typos 
`kylin.job.run.as.remote.cmd`
URL: https://github.com/apache/kylin/pull/121#issuecomment-376361033
 
 
   +1


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] yiming187 closed pull request #121: KYLIN-3305 Fix typos `kylin.job.run.as.remote.cmd`

2018-03-26 Thread GitBox 
yiming187 closed pull request #121: KYLIN-3305 Fix typos 
`kylin.job.run.as.remote.cmd`
URL: https://github.com/apache/kylin/pull/121
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/website/_dev/dev_env.md b/website/_dev/dev_env.md
index c16330a364..388582f058 100644
--- a/website/_dev/dev_env.md
+++ b/website/_dev/dev_env.md
@@ -87,7 +87,7 @@ Local configuration must be modified to point to your hadoop 
sandbox (or CLI) ma
 
 * In **examples/test_case_data/sandbox/kylin.properties**
* Find `sandbox` and replace with your hadoop hosts (if you're using HDP 
sandbox, this can be skipped)
-   * Find `kylin.job.run.as.remote.cmd` and change it to "true" (in code 
repository the default is false, which assume running it on hadoop CLI)
+   * Find `kylin.job.use-remote-cli` and change it to "true" (in code 
repository the default is false, which assume running it on hadoop CLI)
* Find `kylin.job.remote.cli.username` and `kylin.job.remote.cli.password`, 
fill in the user name and password used to login hadoop cluster for hadoop 
command execution; If you're using HDP sandbox, the default username is `root` 
and password is `hadoop`.
 
 * In **examples/test_case_data/sandbox**
diff --git a/website/_dev/howto_test.md b/website/_dev/howto_test.md
index 88b1649b3d..1d52ef2cf6 100644
--- a/website/_dev/howto_test.md
+++ b/website/_dev/howto_test.md
@@ -52,7 +52,7 @@ If your sandbox is already provisioned and your code change 
will not affect the
 
 ### Cube Provision
 
-Environment cube provision is indeed running kylin cubing jobs to prepare 
example cubes in the sandbox. These prepared cubes will be used by the ITs. 
Currently provision step is bound with the maven pre-integration-test phase, 
and it contains running BuildCubeWithEngine (HBase required), 
BuildCubeWithStream(Kafka required) and BuildIIWithStream(Kafka Required). You 
can run the mvn commands on you sandbox or your develop computer. For the 
latter case you need to set kylin.job.run.as.remote.cmd=true in 
__$KYLIN_HOME/examples/test_case_data/sandbox/kylin.properties__. 
+Environment cube provision is indeed running kylin cubing jobs to prepare 
example cubes in the sandbox. These prepared cubes will be used by the ITs. 
Currently provision step is bound with the maven pre-integration-test phase, 
and it contains running BuildCubeWithEngine (HBase required), 
BuildCubeWithStream(Kafka required) and BuildIIWithStream(Kafka Required). You 
can run the mvn commands on you sandbox or your develop computer. For the 
latter case you need to set kylin.job.use-remote-cli=true in 
__$KYLIN_HOME/examples/test_case_data/sandbox/kylin.properties__. 
 Try appending `-DfastBuildMode=true` to mvn verify command to speed up 
provision by skipping incremental cubing. 
 
 ## More on v1.3 Mini Cluster


 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[jira] [Created] (KYLIN-3317) Replace UUID.randomUUID with deterministic PRNG

2018-03-26 Thread Ted Yu (JIRA) 
Ted Yu created KYLIN-3317:
-

 Summary: Replace UUID.randomUUID with deterministic PRNG
 Key: KYLIN-3317
 URL: https://issues.apache.org/jira/browse/KYLIN-3317
 Project: Kylin
  Issue Type: Task
Reporter: Ted Yu


Currently UUID.randomUUID is called in various places in the code base.

* It is non-deterministic.
* It uses a single secure random for UUID generation. This uses a single JVM 
wide lock, and this can lead to lock contention and other performance problems.

We should move to something that is deterministic by using seeded PRNGs



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] lidongsjtu commented on issue #124: KYLIN-3314 refactor code for cube planner algorithm

2018-03-26 Thread GitBox 
lidongsjtu commented on issue #124: KYLIN-3314 refactor code for cube planner 
algorithm
URL: https://github.com/apache/kylin/pull/124#issuecomment-376206373
 
 
   LGTM


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] kyotoYaho closed pull request #124: KYLIN-3314 refactor code for cube planner algorithm

2018-03-26 Thread GitBox 
kyotoYaho closed pull request #124: KYLIN-3314 refactor code for cube planner 
algorithm
URL: https://github.com/apache/kylin/pull/124
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git 
a/core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/AbstractRecommendAlgorithm.java
 
b/core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/AbstractRecommendAlgorithm.java
index b35c738645..094b960005 100755
--- 
a/core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/AbstractRecommendAlgorithm.java
+++ 
b/core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/AbstractRecommendAlgorithm.java
@@ -18,16 +18,17 @@
 
 package org.apache.kylin.cube.cuboid.algorithm;
 
-import java.util.concurrent.atomic.AtomicBoolean;
-
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
+import java.util.List;
+import java.util.concurrent.atomic.AtomicBoolean;
+
 public abstract class AbstractRecommendAlgorithm implements 
CuboidRecommendAlgorithm {
 private static final Logger logger = 
LoggerFactory.getLogger(AbstractRecommendAlgorithm.class);
 
-private CuboidStats cuboidStats;
-private BenefitPolicy benefitPolicy;
+protected final CuboidStats cuboidStats;
+protected final BenefitPolicy benefitPolicy;
 
 private AtomicBoolean cancelRequested = new AtomicBoolean(false);
 private AtomicBoolean canceled = new AtomicBoolean(false);
@@ -44,6 +45,12 @@ public AbstractRecommendAlgorithm(final long timeout, 
BenefitPolicy benefitPolic
 this.benefitPolicy = benefitPolicy;
 }
 
+@Override
+public List recommend(double expansionRate) {
+double spaceLimit = cuboidStats.getBaseCuboidSize() * expansionRate;
+return start(spaceLimit);
+}
+
 @Override
 public void cancel() {
 cancelRequested.set(true);
@@ -51,7 +58,6 @@ public void cancel() {
 
 /**
  * Checks whether the algorithm has been canceled or timed out.
- * 
  */
 protected boolean shouldCancel() {
 if (canceled.get()) {
@@ -71,12 +77,4 @@ protected boolean shouldCancel() {
 }
 return false;
 }
-
-public CuboidStats getCuboidStats() {
-return cuboidStats;
-}
-
-public BenefitPolicy getBenefitPolicy() {
-return benefitPolicy;
-}
 }
diff --git 
a/core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/BPUSCalculator.java
 
b/core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/BPUSCalculator.java
index 6d0b654f75..e29332585f 100755
--- 
a/core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/BPUSCalculator.java
+++ 
b/core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/BPUSCalculator.java
@@ -18,15 +18,14 @@
 
 package org.apache.kylin.cube.cuboid.algorithm;
 
-import java.util.List;
-import java.util.Map;
-import java.util.Set;
-
+import com.google.common.collect.ImmutableMap;
+import com.google.common.collect.Maps;
+import com.google.common.collect.Sets;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
-import com.google.common.collect.Maps;
-import com.google.common.collect.Sets;
+import java.util.Map;
+import java.util.Set;
 
 /**
  * Calculate the benefit based on Benefit Per Unit Space.
@@ -35,17 +34,24 @@
 
 private static Logger logger = 
LoggerFactory.getLogger(BPUSCalculator.class);
 
-protected CuboidStats cuboidStats;
-protected Map cuboidAggCostMap;
+protected final CuboidStats cuboidStats;
+protected final ImmutableMap initCuboidAggCostMap;
+protected final Map processCuboidAggCostMap;
 
 public BPUSCalculator(CuboidStats cuboidStats) {
 this.cuboidStats = cuboidStats;
-this.cuboidAggCostMap = Maps.newHashMap();
+this.initCuboidAggCostMap = 
ImmutableMap.copyOf(initCuboidAggCostMap());
+this.processCuboidAggCostMap = Maps.newHashMap(initCuboidAggCostMap);
 }
 
-@Override
-public void initBeforeStart() {
-cuboidAggCostMap.clear();
+protected BPUSCalculator(CuboidStats cuboidStats, ImmutableMap 
initCuboidAggCostMap) {
+this.cuboidStats = cuboidStats;
+this.initCuboidAggCostMap = initCuboidAggCostMap;
+this.processCuboidAggCostMap = Maps.newHashMap(initCuboidAggCostMap);
+}
+
+private Map initCuboidAggCostMap() {
+Map cuboidAggCostMap = Maps.newHashMap();
 //Initialize stats for mandatory cuboids
 for (Long cuboid : cuboidStats.getAllCuboidsForMandatory()) {
 if (getCuboidCost(cuboid) != null) {
@@ -66,6 +72,7 @@ public void initBeforeStart() {
 }
 cuboidAggCostMap.put(cuboid, leastCost);
 }
+return cuboidAggCostMap;
 }

Upgrade Kylin version to 2.3.0 with some trouble that throws UncheckedExecutionException of HiveClientCache

2018-03-26 Thread 凡梦星尘 
Hi guys:

Congratulation  to Kylin release 2.3.0 with so many features.

The last weekend I had try to upgrade this newest version to test ENV. All
things going is good and run well sample cube under MR mode. But when I try
to switch Spark mode not success. After fixed some problems that meet a
hard trouble not fixed. The error log see below:

java.lang.RuntimeException: java.io.IOException:
com.google.common.util.concurrent.UncheckedExecutionException:
java.lang.RuntimeException: Unable to instantiate
org.apache.hive.hcatalog.common.HiveClientCache$CacheableHiveMetaStoreClient
at 
org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(HiveMRInput.java:116)
at 
org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:121)
at 
org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:99)
at 
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:130)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:162)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:67)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:162)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException:
com.google.common.util.concurrent.UncheckedExecutionException:
java.lang.RuntimeException: Unable to instantiate
org.apache.hive.hcatalog.common.HiveClientCache$CacheableHiveMetaStoreClient
at 
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:97)
at 
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:51)
at 
org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(HiveMRInput.java:113)
... 10 more
Caused by: com.google.common.util.concurrent.UncheckedExecutionException:
java.lang.RuntimeException: Unable to instantiate
org.apache.hive.hcatalog.common.HiveClientCache$CacheableHiveMetaStoreClient
at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2256)
at com.google.common.cache.LocalCache.get(LocalCache.java:3985)
at 
com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4788)
at 
org.apache.hive.hcatalog.common.HiveClientCache.getOrCreate(HiveClientCache.java:292)
at 
org.apache.hive.hcatalog.common.HiveClientCache.get(HiveClientCache.java:267)
at 
org.apache.hive.hcatalog.common.HCatUtil.getHiveMetastoreClient(HCatUtil.java:558)
at 
org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:104)
at 
org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:88)
at 
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95)
... 12 more
Caused by: java.lang.RuntimeException: Unable to instantiate
org.apache.hive.hcatalog.common.HiveClientCache$CacheableHiveMetaStoreClient
at 
org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1566)
at 
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(RetryingMetaStoreClient.java:92)
at 
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:138)
at 
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:124)
at 
org.apache.hive.hcatalog.common.HiveClientCache$5.call(HiveClientCache.java:297)
at 
org.apache.hive.hcatalog.common.HiveClientCache$5.call(HiveClientCache.java:292)
at 
com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4791)
at 
com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3584)
at 
com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2372)
at 
com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2335)
at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2250)
... 20 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at

[jira] [Created] (KYLIN-3316) Reported NPE after build in KAP

2018-03-26 Thread TianZhiwei (JIRA) 
TianZhiwei created KYLIN-3316:
-

 Summary: Reported NPE after build in KAP
 Key: KYLIN-3316
 URL: https://issues.apache.org/jira/browse/KYLIN-3316
 Project: Kylin
  Issue Type: Bug
  Components: Job Engine
Affects Versions: v2.3.0
Reporter: TianZhiwei
 Fix For: v2.4.0


Does not affect the completion of the build task and any build task can be 
reproduced



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (KYLIN-3315) allow each project to set its own source in project level override configuration

2018-03-26 Thread Dong Li (JIRA) 
Dong Li created KYLIN-3315:
--

 Summary: allow each project to set its own source in project level 
override configuration
 Key: KYLIN-3315
 URL: https://issues.apache.org/jira/browse/KYLIN-3315
 Project: Kylin
  Issue Type: Improvement
  Components: Metadata
Reporter: Dong Li


Currently, all projects connect to the same source which is set in 
kylin.properties with kylin.source.default property.
It's better to allow each project to set its own source in project level 
override configuration.
As the result, we can have project A connects to JDBC, and project B connects 
to Hive.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

long time sql can't work in kylin

2018-03-26 Thread Wangdp 
Hi:

 hdp2.5.3   kylin2.2

  when a run a long time(More than 4 minutes) sql,it not work.

 This is error info.

: org.apache.http.NoHttpResponseException: The target server failed to respond
at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
at 
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)
at 
org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
at 
com.adtec.metric.component.indpack.IndicDataZip.Query2File(IndicDataZip.java:335)
at 
com.adtec.metric.component.indpack.IndicDataZip.run(IndicDataZip.java:248)
at com.adtec.metric.component.jobrun.JobRun.run(JobRun.java:227)
at com.adtec.metric.rest.job.JobImpl.run(JobImpl.java:40)
at 
com.alibaba.dubbo.common.bytecode.Wrapper3.invokeMethod(Wrapper3.java)
at 
com.alibaba.dubbo.rpc.proxy.javassist.JavassistProxyFactory$1.doInvoke(JavassistProxyFactory.java:46)
at 
com.alibaba.dubbo.rpc.proxy.AbstractProxyInvoker.invoke(AbstractProxyInvoker.java:72)
at 
com.alibaba.dubbo.rpc.protocol.InvokerWrapper.invoke(InvokerWrapper.java:53)
at 
com.alibaba.dubbo.rpc.filter.ExceptionFilter.invoke(ExceptionFilter.java:64)
at 
com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
at 
com.alibaba.dubbo.monitor.support.MonitorFilter.invoke(MonitorFilter.java:75)
at 
com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
at 
com.alibaba.dubbo.rpc.filter.TimeoutFilter.invoke(TimeoutFilter.java:42)
at 
com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
at 
com.alibaba.dubbo.rpc.protocol.dubbo.filter.TraceFilter.invoke(TraceFilter.java:78)
at 
com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
at 
com.alibaba.dubbo.rpc.filter.ContextFilter.invoke(ContextFilter.java:70)
at 
com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
at 
com.alibaba.dubbo.rpc.filter.GenericFilter.invoke(GenericFilter.java:132)
at 
com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
at 
com.alibaba.dubbo.rpc.filter.ClassLoaderFilter.invoke(ClassLoaderFilter.java:38)
at 
com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
at com.alibaba.dubbo.rpc.filter.EchoFilter.invoke(EchoFilter.java:38)
at 
com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper$1.invoke(ProtocolFilterWrapper.java:91)
at 
com.alibaba.dubbo.rpc.proxy.InvokerInvocationHandler.invoke(InvokerInvocationHandler.java:52)
at com.alibaba.dubbo.common.bytecode.proxy1.run(proxy1.java)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:140)
at 
org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:294)
at 
org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:248)
at 
org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:235)
at 
org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402)
at 
org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209)
at 
org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
at 
org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
at 
org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at 
com.alibaba.dubbo.rpc.protocol.rest.DubboHttpServer$RestHandler.handle(DubboHttpServer.java:86)
at 
com.alibaba.dubbo.remoting.http.servlet.DispatcherServlet.service(DispatcherServlet.java:64)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at 
org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at 
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
at 
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at 
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at

[GitHub] coveralls commented on issue #124: KYLIN-3314 refactor code for cube planner algorithm

2018-03-26 Thread GitBox 
coveralls commented on issue #124: KYLIN-3314 refactor code for cube planner 
algorithm
URL: https://github.com/apache/kylin/pull/124#issuecomment-376083546
 
 
   ## Pull Request Test Coverage Report for [Build 
3087](https://coveralls.io/builds/16173500)
   
   * **0** of **144**  **(0.0%)** changed or added relevant lines in **13** 
files are covered.
   * **18** unchanged lines in **6** files lost coverage.
   * Overall coverage increased (+**0.09%**) to **23.965%**
   
   ---
   
   |  Changes Missing Coverage | Covered Lines | Changed/Added Lines | % |
   | :-|--||---: |
   | 
[core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/generic/RouletteWheelSelection.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2Falgorithm%2Fgeneric%2FRouletteWheelSelection.java#L51)
 | 0 | 1 | 0.0%
   | 
[core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/AbstractRecommendAlgorithm.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2Falgorithm%2FAbstractRecommendAlgorithm.java#L50)
 | 0 | 2 | 0.0%
   | 
[core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/CuboidBenefitModel.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2Falgorithm%2FCuboidBenefitModel.java#L36)
 | 0 | 2 | 0.0%
   | 
[core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/SPBPUSCalculator.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2Falgorithm%2FSPBPUSCalculator.java#L33)
 | 0 | 3 | 0.0%
   | 
[core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/generic/BitsMutation.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2Falgorithm%2Fgeneric%2FBitsMutation.java#L45)
 | 0 | 4 | 0.0%
   | 
[core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/PBPUSCalculator.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2Falgorithm%2FPBPUSCalculator.java#L34)
 | 0 | 6 | 0.0%
   | 
[core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/generic/BitsOnePointCrossover.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2Falgorithm%2Fgeneric%2FBitsOnePointCrossover.java#L53)
 | 0 | 6 | 0.0%
   | 
[core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/CuboidStats.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2Falgorithm%2FCuboidStats.java#L127)
 | 0 | 8 | 0.0%
   | 
[core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/greedy/GreedyAlgorithm.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2Falgorithm%2Fgreedy%2FGreedyAlgorithm.java#L65)
 | 0 | 13 | 0.0%
   | 
[core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/generic/GeneticAlgorithm.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2Falgorithm%2Fgeneric%2FGeneticAlgorithm.java#L65)
 | 0 | 17 | 0.0%
   
   
   |  Files with Coverage Reduction | New Missed Lines | % |
   | :-|--|--: |
   | 
[core-cube/src/main/java/org/apache/kylin/cube/cuboid/TreeCuboidScheduler.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2FTreeCuboidScheduler.java#L129)
 | 1 | 68.5% |
   | 
[core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/greedy/GreedyAlgorithm.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2Falgorithm%2Fgreedy%2FGreedyAlgorithm.java#L63)
 | 1 | 0.0% |
   | 
[core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/generic/BitsChromosome.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2Falgorithm%2Fgeneric%2FBitsChromosome.java#L55)
 | 2 | 0.0% |
   | 
[core-cube/src/main/java/org/apache/kylin/cube/cuboid/algorithm/BPUSCalculator.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2Falgorithm%2FBPUSCalculator.java#L45)
 | 3 | 0.0% |
   | 
[core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/16173500/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L449)
 | 4 | 78.12% |
   |

[GitHub] kyotoYaho opened a new pull request #124: KYLIN-3314 refactor code for cube planner algorithm

2018-03-26 Thread GitBox 
kyotoYaho opened a new pull request #124: KYLIN-3314 refactor code for cube 
planner algorithm
URL: https://github.com/apache/kylin/pull/124
 
 
   Signed-off-by: Zhong 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Re: [VOTE] Release apache-kylin-2.3.1

2018-03-26 Thread zhenya Sun 
Agree to the proposal 

+1
> 在 2018年3月26日，下午2:50，Jianhua Peng  写道：
> 
> +1
> 
> On 2018/03/24 17:36:30, Billy Liu  wrote: 
>> Hi all,
>> 
>> I have created a build for Apache Kylin 2.3.1, release candidate 1.
>> This is a bug fix release for Kylin 2.3.0
>> 
>> Changes highlights:
>> [KYLIN-3270] Fix the blocking issue in cube optimizing jobs
>> [KYLIN-3276] Fix the query cache bug with dynamic parameters
>> [KYLIN-3287] When a shard by column is in dict encoding, dict building error.
>> [KYLIN-3288] "Sqoop To Flat Hive Table" step should specify
>> "mapreduce.queue.name"
>> [KYLIN-3278] Kylin should not distribute hive table by random at Step1
>> [KYLIN-3300] Upgrade jackson-databind for security issue
>> [KYLIN-3301] Upgrade opensaml for security issue
>> 
>> 12 issues are fixed in this release.
>> 
>> Thanks to everyone who has contributed to this release.
>> Here’s release notes:
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12342940
>> 
>> The commit to be voted upon:
>> 
>> https://github.com/apache/kylin/commit/928cc1628c546efe7ec348c467f5d26607c8d7e6
>> 
>> Its hash is 928cc1628c546efe7ec348c467f5d26607c8d7e6.
>> 
>> The artifacts to be voted on are located here:
>> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.3.1-rc1/
>> 
>> The hashes of the artifacts are as follows:
>> apache-kylin-2.3.1-src.tar.gz.md5 541d8dff9e5caaae349cf61ad394b0d6
>> apache-kylin-2.3.1-src.tar.gz.sha1 7ff10d1770d05a8324252547f95adde990bde9dc
>> 
>> A staged Maven repository is available for review at:
>> https://repository.apache.org/content/repositories/orgapachekylin-1049/
>> 
>> Release artifacts are signed with the following key:
>> https://people.apache.org/keys/committer/billyliu.asc
>> 
>> Please vote on releasing this package as Apache Kylin 2.3.1.
>> 
>> The vote is open for the next 72 hours and passes if a majority of
>> at least three +1 PPMC votes are cast.
>> 
>> [ ] +1 Release this package as Apache Kylin 2.3.1
>> [ ]  0 I don't feel strongly about it, but I'm okay with the release
>> [ ] -1 Do not release this package because...
>> 
>> 
>> Here is my vote:
>> 
>> +1 (binding)
>> 
>> 
>> With Warm regards
>> 
>> Billy Liu
>>

Re: [VOTE] Release apache-kylin-2.3.1

2018-03-26 Thread Jianhua Peng 
+1

On 2018/03/24 17:36:30, Billy Liu  wrote: 
> Hi all,
> 
> I have created a build for Apache Kylin 2.3.1, release candidate 1.
> This is a bug fix release for Kylin 2.3.0
> 
> Changes highlights:
>  [KYLIN-3270] Fix the blocking issue in cube optimizing jobs
>  [KYLIN-3276] Fix the query cache bug with dynamic parameters
>  [KYLIN-3287] When a shard by column is in dict encoding, dict building error.
>  [KYLIN-3288] "Sqoop To Flat Hive Table" step should specify
> "mapreduce.queue.name"
>  [KYLIN-3278] Kylin should not distribute hive table by random at Step1
>  [KYLIN-3300] Upgrade jackson-databind for security issue
>  [KYLIN-3301] Upgrade opensaml for security issue
> 
> 12 issues are fixed in this release.
> 
> Thanks to everyone who has contributed to this release.
> Here’s release notes:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12342940
> 
> The commit to be voted upon:
> 
> https://github.com/apache/kylin/commit/928cc1628c546efe7ec348c467f5d26607c8d7e6
> 
> Its hash is 928cc1628c546efe7ec348c467f5d26607c8d7e6.
> 
> The artifacts to be voted on are located here:
> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.3.1-rc1/
> 
> The hashes of the artifacts are as follows:
> apache-kylin-2.3.1-src.tar.gz.md5 541d8dff9e5caaae349cf61ad394b0d6
> apache-kylin-2.3.1-src.tar.gz.sha1 7ff10d1770d05a8324252547f95adde990bde9dc
> 
> A staged Maven repository is available for review at:
> https://repository.apache.org/content/repositories/orgapachekylin-1049/
> 
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/billyliu.asc
> 
> Please vote on releasing this package as Apache Kylin 2.3.1.
> 
> The vote is open for the next 72 hours and passes if a majority of
> at least three +1 PPMC votes are cast.
> 
> [ ] +1 Release this package as Apache Kylin 2.3.1
> [ ]  0 I don't feel strongly about it, but I'm okay with the release
> [ ] -1 Do not release this package because...
> 
> 
> Here is my vote:
> 
> +1 (binding)
> 
> 
> With Warm regards
> 
> Billy Liu
>

[jira] [Created] (KYLIN-3314) refactor code for cube planner algorithm

2018-03-26 Thread Zhong Yanghong (JIRA) 
Zhong Yanghong created KYLIN-3314:
-

 Summary: refactor code for cube planner algorithm
 Key: KYLIN-3314
 URL: https://issues.apache.org/jira/browse/KYLIN-3314
 Project: Kylin
  Issue Type: Improvement
  Components: Metadata
Reporter: Zhong Yanghong
Assignee: Wang Ken






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)