[jira] [Created] (KYLIN-3892) Set cubing job priority
Temple Zhou created KYLIN-3892: -- Summary: Set cubing job priority Key: KYLIN-3892 URL: https://issues.apache.org/jira/browse/KYLIN-3892 Project: Kylin Issue Type: New Feature Components: Job Engine Affects Versions: v2.6.0, v2.5.0, v2.4.0 Reporter: Temple Zhou Assignee: Temple Zhou The cubing job with high priority will be delayed when there are too many tasks running. So I want to set the job priority for the important cubing jobs. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3890) Add doc about usage of ./bin/metadata.sh
[ https://issues.apache.org/jira/browse/KYLIN-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795715#comment-16795715 ] Shaofeng SHI commented on KYLIN-3890: - Welcome to refine the doc, here is the basic version: https://kylin.apache.org/docs/howto/howto_backup_metadata.html > Add doc about usage of ./bin/metadata.sh > > > Key: KYLIN-3890 > URL: https://issues.apache.org/jira/browse/KYLIN-3890 > Project: Kylin > Issue Type: Improvement > Components: Documentation >Affects Versions: v2.5.2 >Reporter: Yuzhang QIU >Priority: Minor > > JIRA title descript the JIRA -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3891) Kylin jdbc throws NoHttpResponseException
[
https://issues.apache.org/jira/browse/KYLIN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhao jintao updated KYLIN-3891:
---
Remaining Estimate: 168h (was: 48h)
Original Estimate: 168h (was: 48h)
> Kylin jdbc throws NoHttpResponseException
> -
>
> Key: KYLIN-3891
> URL: https://issues.apache.org/jira/browse/KYLIN-3891
> Project: Kylin
> Issue Type: Bug
> Components: Driver - JDBC
>Affects Versions: v2.5.2
> Environment: Huawei FusionInsight
>Reporter: zhao jintao
>Priority: Major
> Labels: easyfix
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> Hi Team;
> When I use kylin jdbc, I find that jdbc throws NoHttpResponseException.
> Then I do jdbc test cases in "DriverTest.java", I use one jdbc connection
> query 20 times, each time first wait 20 minutes. Unfortunately， I also find
> that jdbc also throws NoHttpResponseException.
> This is my test code:
> try {
> for (int j = 0; j < 20; j++) {
> Thread.sleep(1000*20);
> Statement state = conn.createStatement();
> ResultSet resultSet = state.executeQuery("select count(*)
> from KYLIN_SALES ;");
> printResultSetMetaData(resultSet);
> printResultSet(resultSet);
> resultSet.close();
> }
> } catch (InterruptedException e){
> e.printStackTrace();
> }
> This is NoHttpResponseException:
> java.sql.SQLException: Error while executing SQL "select count(*) from
> KYLIN_SALES ;": java.sql.SQLException:
> org.apache.http.NoHttpResponseException: The target server failed to respond
> at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
> at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
> at org.apache.kylin.jdbc.DriverTest.testHttpClient(DriverTest.java:299)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
> at
> com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
> at
> com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:47)
> at
> com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:242)
> at
> com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70)
> Caused by: java.lang.RuntimeException: java.sql.SQLException:
> org.apache.http.NoHttpResponseException: The target server failed to respond
> at org.apache.kylin.jdbc.KylinMeta.prepareAndExecute(KylinMeta.java:115)
> at
> org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:638)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:149)
> ... 24 more
> Caused by: java.sql.SQLException: org.apache.http.NoHttpResponseException:
> The target server failed to respond
> at org.apache.kylin.jdbc.KylinResultSet.execute(KylinResultSet.java:71)
> at
> org.apache.calcite.avatica.AvaticaConnection$1.execute(AvaticaConnection.java:630)
> at org.apache.kylin.jdbc.KylinMeta.prepareAndExecute(KylinMeta.java:1
[jira] [Commented] (KYLIN-3891) Kylin jdbc throws NoHttpResponseException
[
https://issues.apache.org/jira/browse/KYLIN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795641#comment-16795641
]
zhao jintao commented on KYLIN-3891:
I search this exception use google,and I find that the httpclient of jdbc need
retry when face NoHttpResponseException.
[apache
stack|https://stackoverflow.com/questions/10570672/get-nohttpresponseexception-for-load-testing/10680629#10680629]
After I add retry configuation in KylinClient.java of httpClient, It work fine
in my jdbc test.
httpClient.setHttpRequestRetryHandler((exception, executionCount, context) -> {
if (executionCount > 3) {
logger.warn("Maximum tries reached for client http pool ");
return false;
}
if (exception instanceof NoHttpResponseException
//NoHttpResponseException 重试
//|| exception instanceof ConnectTimeoutException //连接超时重试
// || exception instanceof SocketTimeoutException
//响应超时不重试，避免造成业务数据不一致
) {
logger.warn("NoHttpResponseException on " + executionCount + "
call");
return true;
}
return false;
});
I use this jdbc client in FineReort system, jdbc client connect SLB,SLB connect
kylin.But I find that if I restart kylin, sometimes jdbc client response 502
httpcode from SLB。
I use this jdbc client in FineReort system, jdbc client connect SLB,SLB connect
kylin.But I find that if I restart kylin, sometimes jdbc client accept 502
response from SLB。
This is FineReport log:
at org.apache.kylin.jdbc.KylinConnection.(KylinConnection.java:69)
at
org.apache.kylin.jdbc.KylinJdbcFactory.newConnection(KylinJdbcFactory.java:77)
at
org.apache.kylin.jdbc.shaded.org.apache.calcite.avatica.UnregisteredDriver.connect(UnregisteredDriver.java:138)
at
com.fr.third.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1461)
at
com.fr.third.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1525)
at
com.fr.third.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2099)
Caused by: java.io.IOException: POST failed, error code 502 and response:
^M
Does any one meet this same problem?
> Kylin jdbc throws NoHttpResponseException
> -
>
> Key: KYLIN-3891
> URL: https://issues.apache.org/jira/browse/KYLIN-3891
> Project: Kylin
> Issue Type: Bug
> Components: Driver - JDBC
>Affects Versions: v2.5.2
> Environment: Huawei FusionInsight
>Reporter: zhao jintao
>Priority: Major
> Labels: easyfix
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> Hi Team;
> When I use kylin jdbc, I find that jdbc throws NoHttpResponseException.
> Then I do jdbc test cases in "DriverTest.java", I use one jdbc connection
> query 20 times, each time first wait 20 minutes. Unfortunately， I also find
> that jdbc also throws NoHttpResponseException.
> This is my test code:
> try {
> for (int j = 0; j < 20; j++) {
> Thread.sleep(1000*20);
> Statement state = conn.createStatement();
> ResultSet resultSet = state.executeQuery("select count(*)
> from KYLIN_SALES ;");
> printResultSetMetaData(resultSet);
> printResultSet(resultSet);
> resultSet.close();
> }
> } catch (InterruptedException e){
> e.printStackTrace();
> }
> This is NoHttpResponseException:
> java.sql.SQLException: Error while executing SQL "select count(*) from
> KYLIN_SALES ;": java.sql.SQLException:
> org.apache.http.NoHttpResponseException: The target server failed to respond
> at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
> at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
> at org.apache.kylin.jdbc.DriverTest.testHttpClient(DriverTest.java:299)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runn
[jira] [Created] (KYLIN-3891) Kylin jdbc throws NoHttpResponseException
zhao jintao created KYLIN-3891:
--
Summary: Kylin jdbc throws NoHttpResponseException
Key: KYLIN-3891
URL: https://issues.apache.org/jira/browse/KYLIN-3891
Project: Kylin
Issue Type: Bug
Components: Driver - JDBC
Affects Versions: v2.5.2
Environment: Huawei FusionInsight
Reporter: zhao jintao
Hi Team;
When I use kylin jdbc, I find that jdbc throws NoHttpResponseException.
Then I do jdbc test cases in "DriverTest.java", I use one jdbc connection
query 20 times, each time first wait 20 minutes. Unfortunately， I also find
that jdbc also throws NoHttpResponseException.
This is my test code:
try {
for (int j = 0; j < 20; j++) {
Thread.sleep(1000*20);
Statement state = conn.createStatement();
ResultSet resultSet = state.executeQuery("select count(*) from
KYLIN_SALES ;");
printResultSetMetaData(resultSet);
printResultSet(resultSet);
resultSet.close();
}
} catch (InterruptedException e){
e.printStackTrace();
}
This is NoHttpResponseException:
java.sql.SQLException: Error while executing SQL "select count(*) from
KYLIN_SALES ;": java.sql.SQLException: org.apache.http.NoHttpResponseException:
The target server failed to respond
at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
at
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)
at
org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
at org.apache.kylin.jdbc.DriverTest.testHttpClient(DriverTest.java:299)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at
com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
at
com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:47)
at
com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:242)
at
com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70)
Caused by: java.lang.RuntimeException: java.sql.SQLException:
org.apache.http.NoHttpResponseException: The target server failed to respond
at org.apache.kylin.jdbc.KylinMeta.prepareAndExecute(KylinMeta.java:115)
at
org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:638)
at
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:149)
... 24 more
Caused by: java.sql.SQLException: org.apache.http.NoHttpResponseException: The
target server failed to respond
at org.apache.kylin.jdbc.KylinResultSet.execute(KylinResultSet.java:71)
at
org.apache.calcite.avatica.AvaticaConnection$1.execute(AvaticaConnection.java:630)
at org.apache.kylin.jdbc.KylinMeta.prepareAndExecute(KylinMeta.java:111)
... 26 more
Caused by: org.apache.http.NoHttpResponseException: The target server failed to
respond
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:95)
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:62)
at
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
at
[GitHub] [kylin] coveralls commented on issue #533: kylin-3812 optimize the child CompareTupleFilter in a CompareTupleFilter
coveralls commented on issue #533: kylin-3812 optimize the child CompareTupleFilter in a CompareTupleFilter URL: https://github.com/apache/kylin/pull/533#issuecomment-474183735 ## Pull Request Test Coverage Report for [Build 4264](https://coveralls.io/builds/22259430) * **2** of **15** **(13.33%)** changed or added relevant lines in **3** files are covered. * **1** unchanged line in **1** file lost coverage. * Overall coverage decreased (**-0.003%**) to **26.891%** --- | Changes Missing Coverage | Covered Lines | Changed/Added Lines | % | | :-|--||---: | | [query/src/main/java/org/apache/kylin/query/relnode/OLAPAggregateRel.java](https://coveralls.io/builds/22259430/source?filename=query%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fquery%2Frelnode%2FOLAPAggregateRel.java#L281) | 0 | 1 | 0.0% | [core-metadata/src/main/java/org/apache/kylin/metadata/expression/CaseTupleExpression.java](https://coveralls.io/builds/22259430/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmetadata%2Fexpression%2FCaseTupleExpression.java#L50) | 0 | 2 | 0.0% | [core-metadata/src/main/java/org/apache/kylin/metadata/filter/CompareTupleFilter.java](https://coveralls.io/builds/22259430/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmetadata%2Ffilter%2FCompareTupleFilter.java#L81) | 2 | 12 | 16.67% | Files with Coverage Reduction | New Missed Lines | % | | :-|--|--: | | [core-metadata/src/main/java/org/apache/kylin/source/datagen/ColumnGenerator.java](https://coveralls.io/builds/22259430/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fsource%2Fdatagen%2FColumnGenerator.java#L319) | 1 | 81.08% | | Totals | [](https://coveralls.io/builds/22259430) | | :-- | --: | | Change from base [Build 4263](https://coveralls.io/builds/22259325): | -0.003% | | Covered Lines: | 18948 | | Relevant Lines: | 70462 | --- # 💛 - [Coveralls](https://coveralls.io) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] kyotoYaho opened a new pull request #533: kylin-3812 optimize the child CompareTupleFilter in a CompareTupleFilter
kyotoYaho opened a new pull request #533: kylin-3812 optimize the child CompareTupleFilter in a CompareTupleFilter URL: https://github.com/apache/kylin/pull/533 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #533: kylin-3812 optimize the child CompareTupleFilter in a CompareTupleFilter
asfgit commented on issue #533: kylin-3812 optimize the child CompareTupleFilter in a CompareTupleFilter URL: https://github.com/apache/kylin/pull/533#issuecomment-474179711 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #533: kylin-3812 optimize the child CompareTupleFilter in a CompareTupleFilter
asfgit commented on issue #533: kylin-3812 optimize the child CompareTupleFilter in a CompareTupleFilter URL: https://github.com/apache/kylin/pull/533#issuecomment-474179709 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3874) "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
[
https://issues.apache.org/jira/browse/KYLIN-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795568#comment-16795568
]
ASF subversion and git services commented on KYLIN-3874:
Commit 69591504fd44bfc02ea520c6bae3feeafd38915f in kylin's branch
refs/heads/2.6.x from Guangxu Cheng
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=6959150 ]
KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use
different HDFS clusters
> "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS
> clusters
> ---
>
> Key: KYLIN-3874
> URL: https://issues.apache.org/jira/browse/KYLIN-3874
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v2.6.2
>
>
> {panel:title=exception}
> 2019-03-14 16:33:45,113 INFO [main]
> org.apache.hadoop.service.AbstractService: Service
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state INITED; cause:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException:
> Couldn't create proxy provider class
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
> ...
> Caused by: java.lang.RuntimeException: Could not find any configured
> addresses for URI
> hdfs://{color:#ff}hbase-ns-test{color}/kylin/kylin_metadata/kylin-cd4db32e-42b6-44f2-7fa9-ef6c46334249/derived_meta_global/hfile
> at
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider.(ConfiguredFailoverProxyProvider.java:116)
> ... 31 more
> {panel}
> {color:#ff}hbase-ns-test{color} is the nameservice of HDFS which is used
> by HBase.
> In our kylin environment, HBase and MR/HIVE use different HDFS clusters.
> {code:java|title=CubeHFileJob.java|borderStyle=solid}
> // use current hbase configuration
> Configuration configuration = new
> Configuration(HBaseConnection.getCurrentHBaseConfiguration());
> merge(configuration, getConf());
> {code}
> "getConf()" contains only the HDFS configuration of MR, and "configuration"
> contains the HDFS configuration both HBase and MR. See:
> [HBaseConnection#addHBaseClusterNNHAConfiguration()|https://github.com/apache/kylin/blob/d23d2bddab3263d39059492b91f71d8091198057/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/HBaseConnection.java#L205]
> So "merge(configuration, getConf())" will lead to HBASE's HDFS configuration
> to be covered. Mainly parameter "dfs.nameservices"
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3882) kylin master build failed for pom issues
[
https://issues.apache.org/jira/browse/KYLIN-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795567#comment-16795567
]
ASF subversion and git services commented on KYLIN-3882:
Commit 9f3a8773d37263d8a521d15dde8a4449289e4e64 in kylin's branch
refs/heads/2.6.x from Liu Shaohui
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=9f3a8773 ]
KYLIN-3882: kylin master build failed for pom issues
> kylin master build failed for pom issues
>
>
> Key: KYLIN-3882
> URL: https://issues.apache.org/jira/browse/KYLIN-3882
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
>
> As title.
> 1, Kyligence repo id : nexus conflicts with local maven settings.xml
> {code:java}
> [ERROR] Failed to execute goal on project kylin-core-metadata: Could not
> resolve dependencies for project
> org.apache.kylin:kylin-core-metadata:jar:3.0.0-SNAPSHOT: Failure to find
> org.apache.calcite:calcite-core:jar:1.16.0-kylin-r2 in
> http://nexus.x./nexus/content/groups/public was cached in the local
> repository, resolution will not be reattempted until the update interval of
> nexus has elapsed or updates are forced -> [Help 1]
> {code}
>
> 2, maven.compiler.source/target is not set
> {code:java}
> [INFO] Compiling 2 Scala sources and 18 Java sources to
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/target/classes ...
> [WARNING] [Warn] : bootstrap class path not set in conjunction with -source
> 1.6
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkBatchCubingJobBuilder2.java:148:
> diamond operator is not supported in -source 1.6
> (use -source 7 or higher to enable diamond operator)
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkCubingByLayer.java:239:
> try-with-resources is not supported in -source 1.6
> (use -source 7 or higher to enable try-with-resources)
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkCubingByLayer.java:251:
> diamond operator is not supported in -source 1.6
> (use -source 7 or higher to enable diamond operator){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3880) DataType is incompatible in Kylin HBase coprocessor
[
https://issues.apache.org/jira/browse/KYLIN-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795569#comment-16795569
]
ASF subversion and git services commented on KYLIN-3880:
Commit 3be7ff0d0ec4553d2cdf977fdbac16528d4670ed in kylin's branch
refs/heads/2.6.x from Liu Shaohui
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3be7ff0 ]
KYLIN-3880: DataType is incompatible in Kylin HBase coprocessor
> DataType is incompatible in Kylin HBase coprocessor
> ---
>
> Key: KYLIN-3880
> URL: https://issues.apache.org/jira/browse/KYLIN-3880
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
> Fix For: v2.6.2
>
>
> During upgrade kylin from 2.4.1 to 2.5.2, the query will failed for the
> incompatible class in Kylin HBase coprocessor
> {code:java}
> 2019-03-12,17:48:11,530 INFO
> [FifoRWQ.default.readRpcServer.handler=197,queue=13,port=24600]
> org.apache.hadoop.hdfs.DFSClient: Access token was invalid when connecting to
> /10.152.33.45:22402 :
> org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got
> access token error for OP_READ_BLOCK, self=/10.152.33.44:55387,
> remote=/10.152.33.45:22402, for file
> /hbase/zjyprc-xiaomi/data/miui_sec/data/4b88a72f5bd37daca00efb842e676ca8/C/6593503eb213431998db117cf3dab3a6,
> for pool BP-792581576-10.152.48.22-1510572454905 block 1899006034_825272806
> 2019-03-12,17:48:12,135 INFO
> [FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600]
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService:
> start query dc0fadcf-3689-5508-9a45-559aaebfd4e0 in thread
> FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600
> 2019-03-12,17:48:12,135 ERROR
> [FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600]
> org.apache.hadoop.ipc.RpcServer: Unexpected throwable object
> java.lang.RuntimeException: java.io.InvalidClassException:
> org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream
> classdesc serialVersionUID = -8891652700267537109, local class
> serialVersionUID = -406124487097947
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem.readDimensionEncoding(TrimmedCubeCodeSystem.java:87)
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:122)
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:91)
> at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:346)
> at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:307)
> at
> org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:466)
> at
> org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:412)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:259)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:6625)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execServiceOnRegion(HRegionServer.java:4336)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execService(HRegionServer.java:4318)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34964)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2059)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:126)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:152)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:128)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.io.InvalidClassException:
> org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream
> classdesc serialVersionUID = -8891652700267537109, local class
> serialVersionUID = -406124487097947
> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:699)
> at
> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1885)
> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1751)
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2042)
> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)
> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)
> at
> java.io.ObjectInputStream.readOrdinaryOb
[jira] [Commented] (KYLIN-3888) TableNotDisabledException when running "Convert Lookup Table to HFile"
[
https://issues.apache.org/jira/browse/KYLIN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795570#comment-16795570
]
ASF subversion and git services commented on KYLIN-3888:
Commit 196faa052c1e9710eafa7879a28381255d03f986 in kylin's branch
refs/heads/2.6.x from Guangxu Cheng
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=196faa0 ]
KYLIN-3888 TableNotDisabledException when running "Convert Lookup Table to
HFile"
> TableNotDisabledException when running "Convert Lookup Table to HFile"
> --
>
> Key: KYLIN-3888
> URL: https://issues.apache.org/jira/browse/KYLIN-3888
> Project: Kylin
> Issue Type: Bug
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v2.6.2
>
>
> {code}
> org.apache.hadoop.hbase.TableNotDisabledException:
> KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at
> org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4756)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4714)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4647)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.deleteTable(HBaseAdmin.java:904)
> at
> org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.removeSnapshotIfExist(LookupTableToHFileJob.java:170)
> at
> org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.run(LookupTableToHFileJob.java:104)
> at
> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.impl.threadpool.DistributedScheduler$JobRunner.run(DistributedScheduler.java:110)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by:
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hbase.TableNotDisabledException):
> KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
> at
> org.apache.hadoop.hbase.master.HMaster.checkTableModifiable(HMaster.java:2266)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.prepareDelete(DeleteTableProcedure.java:253)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:102)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:59)
> at
> org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:119)
> at
> org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:498)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1147)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:942)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:895)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:77)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:497)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3839) Strorage clean up after refreshing and deleting segment
[ https://issues.apache.org/jira/browse/KYLIN-3839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795571#comment-16795571 ] ASF subversion and git services commented on KYLIN-3839: Commit 66ccb713f21ea1a7f1a69c725eabb60ce3629002 in kylin's branch refs/heads/2.6.x from chao long [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=66ccb71 ] KYLIN-3839 Strorage clean up after refreshing and deleting segment > Strorage clean up after refreshing and deleting segment > --- > > Key: KYLIN-3839 > URL: https://issues.apache.org/jira/browse/KYLIN-3839 > Project: Kylin > Issue Type: Improvement > Components: Others >Reporter: Chao Long >Assignee: Chao Long >Priority: Major > Fix For: v2.6.2 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3839) Strorage clean up after refreshing and deleting segment
[ https://issues.apache.org/jira/browse/KYLIN-3839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3839: Fix Version/s: v2.6.2 > Strorage clean up after refreshing and deleting segment > --- > > Key: KYLIN-3839 > URL: https://issues.apache.org/jira/browse/KYLIN-3839 > Project: Kylin > Issue Type: Improvement > Components: Others >Reporter: Chao Long >Assignee: Chao Long >Priority: Major > Fix For: v2.6.2 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3874) "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
[
https://issues.apache.org/jira/browse/KYLIN-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795550#comment-16795550
]
Guangxu Cheng commented on KYLIN-3874:
--
bq.If you want to use different HDFS clusters, you should modify your
hdfs-site.xml .
Kylin supports set HBase's HDFS configuration information in a separate file
which specified by parameter "kylin.storage.hbase.cluster-hdfs-config-file". In
this case, the exception mentioned in this issue will occur. Thanks
> "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS
> clusters
> ---
>
> Key: KYLIN-3874
> URL: https://issues.apache.org/jira/browse/KYLIN-3874
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v2.6.2
>
>
> {panel:title=exception}
> 2019-03-14 16:33:45,113 INFO [main]
> org.apache.hadoop.service.AbstractService: Service
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state INITED; cause:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException:
> Couldn't create proxy provider class
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
> ...
> Caused by: java.lang.RuntimeException: Could not find any configured
> addresses for URI
> hdfs://{color:#ff}hbase-ns-test{color}/kylin/kylin_metadata/kylin-cd4db32e-42b6-44f2-7fa9-ef6c46334249/derived_meta_global/hfile
> at
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider.(ConfiguredFailoverProxyProvider.java:116)
> ... 31 more
> {panel}
> {color:#ff}hbase-ns-test{color} is the nameservice of HDFS which is used
> by HBase.
> In our kylin environment, HBase and MR/HIVE use different HDFS clusters.
> {code:java|title=CubeHFileJob.java|borderStyle=solid}
> // use current hbase configuration
> Configuration configuration = new
> Configuration(HBaseConnection.getCurrentHBaseConfiguration());
> merge(configuration, getConf());
> {code}
> "getConf()" contains only the HDFS configuration of MR, and "configuration"
> contains the HDFS configuration both HBase and MR. See:
> [HBaseConnection#addHBaseClusterNNHAConfiguration()|https://github.com/apache/kylin/blob/d23d2bddab3263d39059492b91f71d8091198057/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/HBaseConnection.java#L205]
> So "merge(configuration, getConf())" will lead to HBASE's HDFS configuration
> to be covered. Mainly parameter "dfs.nameservices"
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3874) "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
[
https://issues.apache.org/jira/browse/KYLIN-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795543#comment-16795543
]
zhao jintao commented on KYLIN-3874:
If you want to use different HDFS clusters, you should modify your
hdfs-site.xml .
> "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS
> clusters
> ---
>
> Key: KYLIN-3874
> URL: https://issues.apache.org/jira/browse/KYLIN-3874
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v2.6.2
>
>
> {panel:title=exception}
> 2019-03-14 16:33:45,113 INFO [main]
> org.apache.hadoop.service.AbstractService: Service
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state INITED; cause:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException:
> Couldn't create proxy provider class
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
> ...
> Caused by: java.lang.RuntimeException: Could not find any configured
> addresses for URI
> hdfs://{color:#ff}hbase-ns-test{color}/kylin/kylin_metadata/kylin-cd4db32e-42b6-44f2-7fa9-ef6c46334249/derived_meta_global/hfile
> at
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider.(ConfiguredFailoverProxyProvider.java:116)
> ... 31 more
> {panel}
> {color:#ff}hbase-ns-test{color} is the nameservice of HDFS which is used
> by HBase.
> In our kylin environment, HBase and MR/HIVE use different HDFS clusters.
> {code:java|title=CubeHFileJob.java|borderStyle=solid}
> // use current hbase configuration
> Configuration configuration = new
> Configuration(HBaseConnection.getCurrentHBaseConfiguration());
> merge(configuration, getConf());
> {code}
> "getConf()" contains only the HDFS configuration of MR, and "configuration"
> contains the HDFS configuration both HBase and MR. See:
> [HBaseConnection#addHBaseClusterNNHAConfiguration()|https://github.com/apache/kylin/blob/d23d2bddab3263d39059492b91f71d8091198057/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/HBaseConnection.java#L205]
> So "merge(configuration, getConf())" will lead to HBASE's HDFS configuration
> to be covered. Mainly parameter "dfs.nameservices"
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3874) "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
[
https://issues.apache.org/jira/browse/KYLIN-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795539#comment-16795539
]
zhao jintao commented on KYLIN-3874:
Hi guangxuCheng:
In my Kylin envrioment， HBase and MR use different HDFS clusters; kylin works
fine. I use Kylin 2.5.2
> "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS
> clusters
> ---
>
> Key: KYLIN-3874
> URL: https://issues.apache.org/jira/browse/KYLIN-3874
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v2.6.2
>
>
> {panel:title=exception}
> 2019-03-14 16:33:45,113 INFO [main]
> org.apache.hadoop.service.AbstractService: Service
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state INITED; cause:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException:
> Couldn't create proxy provider class
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
> ...
> Caused by: java.lang.RuntimeException: Could not find any configured
> addresses for URI
> hdfs://{color:#ff}hbase-ns-test{color}/kylin/kylin_metadata/kylin-cd4db32e-42b6-44f2-7fa9-ef6c46334249/derived_meta_global/hfile
> at
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider.(ConfiguredFailoverProxyProvider.java:116)
> ... 31 more
> {panel}
> {color:#ff}hbase-ns-test{color} is the nameservice of HDFS which is used
> by HBase.
> In our kylin environment, HBase and MR/HIVE use different HDFS clusters.
> {code:java|title=CubeHFileJob.java|borderStyle=solid}
> // use current hbase configuration
> Configuration configuration = new
> Configuration(HBaseConnection.getCurrentHBaseConfiguration());
> merge(configuration, getConf());
> {code}
> "getConf()" contains only the HDFS configuration of MR, and "configuration"
> contains the HDFS configuration both HBase and MR. See:
> [HBaseConnection#addHBaseClusterNNHAConfiguration()|https://github.com/apache/kylin/blob/d23d2bddab3263d39059492b91f71d8091198057/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/HBaseConnection.java#L205]
> So "merge(configuration, getConf())" will lead to HBASE's HDFS configuration
> to be covered. Mainly parameter "dfs.nameservices"
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3872) Kylin web UI http 404 error
[
https://issues.apache.org/jira/browse/KYLIN-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795161#comment-16795161
]
Chao Long commented on KYLIN-3872:
--
Hi [~mimimiracle], I'm glad to hear your problem has been resolved. It seems a
spark package version issue.
Btw, the spark version of Kylin2.6.1 is 2.3.2 and use
$KYLIN_HOME/bin/download-spark.sh will download the spark binary of right
version.
> Kylin web UI http 404 error
>
>
> Key: KYLIN-3872
> URL: https://issues.apache.org/jira/browse/KYLIN-3872
> Project: Kylin
> Issue Type: Bug
>Affects Versions: v2.6.1
> Environment: CDH6.1
> Hadoop3.0.0+cdh6.1.0
> HDFS 3.0.0+cdh6.1.0
> YARN 3.0.0+cdh6.1.0
> HBase 2.1.0+cdh6.1.0
> Hive 2.1.1+cdh6.1.0
> spark 2.4.0+cdh6.1.0
> ZooKeeper 3.4.5+cdh6.1.0
>Reporter: mimimiracle
>Priority: Blocker
> Labels: Kylin, tomcat
> Fix For: v2.6.1
>
>
> kylin server is started but the web cannot be access
> {code:java}
> [root@server1 logs]# netstat -anp| grep 7070
> tcp 0 0 0.0.0.0:7070 0.0.0.0:* LISTEN 11487/java
> {code}
> below is some of log records
> {code:java}
> 2019-03-13 18:28:18,697 WARN [localhost-startStop-1]
> scan.StandardJarScanner:146 : Failed to scan
> [file:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/jars/derbyLocale_ja_JP.jar]
> from classloader hierarchy
> java.io.FileNotFoundException:
> /opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/jars/derbyLocale_ja_JP.jar
> (No such file or directory)
> at java.util.zip.ZipFile.open(Native Method)
> at java.util.zip.ZipFile.(ZipFile.java:225)
> at java.util.zip.ZipFile.(ZipFile.java:155)
> at java.util.jar.JarFile.(JarFile.java:166)
> at java.util.jar.JarFile.(JarFile.java:130)
> at
> org.apache.tomcat.util.compat.JreCompat.jarFileNewInstance(JreCompat.java:196)
> at
> org.apache.tomcat.util.scan.JarFileUrlJar.(JarFileUrlJar.java:65)
> at
> org.apache.tomcat.util.scan.JarFactory.newInstance(JarFactory.java:49)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.process(StandardJarScanner.java:374)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.processURLs(StandardJarScanner.java:309)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.doScanClassPath(StandardJarScanner.java:266)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.scan(StandardJarScanner.java:229)
> at
> org.apache.catalina.startup.ContextConfig.processJarsForWebFragments(ContextConfig.java:1888)
> at
> org.apache.catalina.startup.ContextConfig.webConfig(ContextConfig.java:1116)
> at
> org.apache.catalina.startup.ContextConfig.configureStart(ContextConfig.java:765)
> at
> org.apache.catalina.startup.ContextConfig.lifecycleEvent(ContextConfig.java:299)
> at
> org.apache.catalina.util.LifecycleBase.fireLifecycleEvent(LifecycleBase.java:94)
> at
> org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5154)
> at
> org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
> at
> org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:754)
> at
> org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:730)
> java.io.FileNotFoundException:
> /opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/jars/derbyLocale_pt_BR.jar
> (No such file or directory)
> at java.util.zip.ZipFile.open(Native Method)
> at java.util.zip.ZipFile.(ZipFile.java:225)
> at java.util.zip.ZipFile.(ZipFile.java:155)
> at java.util.jar.JarFile.(JarFile.java:166)
> at java.util.jar.JarFile.(JarFile.java:130)
> at
> org.apache.tomcat.util.compat.JreCompat.jarFileNewInstance(JreCompat.java:196)
> at
> org.apache.tomcat.util.scan.JarFileUrlJar.(JarFileUrlJar.java:65)
> at
> org.apache.tomcat.util.scan.JarFactory.newInstance(JarFactory.java:49)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.process(StandardJarScanner.java:374)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.processURLs(StandardJarScanner.java:309)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.doScanClassPath(StandardJarScanner.java:266)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
> at
> org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
>
[GitHub] [kylin] shaofengshi commented on issue #528: KYLIN-3883 Kylin supports column count aggregation
shaofengshi commented on issue #528: KYLIN-3883 Kylin supports column count aggregation URL: https://github.com/apache/kylin/pull/528#issuecomment-473929129 Hi @xbirbird, thank you for the patch! The change looks good, could you please add some test case for this? Or at least it can be covered by the integration test (BuildCubeWithEngine.java). Just let me know how you test and verify this feature, thx! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Created] (KYLIN-3890) Add doc about usage of ./bin/metadata.sh
Yuzhang QIU created KYLIN-3890: -- Summary: Add doc about usage of ./bin/metadata.sh Key: KYLIN-3890 URL: https://issues.apache.org/jira/browse/KYLIN-3890 Project: Kylin Issue Type: Improvement Components: Documentation Affects Versions: v2.5.2 Reporter: Yuzhang QIU JIRA title descript the JIRA -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (KYLIN-3884) loading hfile to HBase failed for temporary dir in output path
[
https://issues.apache.org/jira/browse/KYLIN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794908#comment-16794908
]
Liu Shaohui edited comment on KYLIN-3884 at 3/18/19 10:32 AM:
--
[~Shaofengshi] When running spark job with spark.speculation=true, there may
be two running task for same task id at a time.
If a running task left after the the job is committed, it will create a new
_temporary dir in the output path.
See:
[https://github.com/apache/hbase/blob/master/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java]
#196
Be default, fs mkdirs api will create the parent path if it not exist.
{code:java}
fs.mkdirs(writerPath);
configureStoragePolicy(conf, fs, tableAndFamily, writerPath);{code}
was (Author: liushaohui):
[~Shaofengshi] When running spark job with spark.speculation=true, there may
be too running task for same task id at a time.
If a running task left after the the job is committed, it will create a new
_temporary dir in the output path.
See:
[https://github.com/apache/hbase/blob/master/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java]
#196
Be default, fs mkdirs api will create the parent path if it not exist.
{code:java}
fs.mkdirs(writerPath);
configureStoragePolicy(conf, fs, tableAndFamily, writerPath);{code}
> loading hfile to HBase failed for temporary dir in output path
> ---
>
> Key: KYLIN-3884
> URL: https://issues.apache.org/jira/browse/KYLIN-3884
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Priority: Major
>
> {code:java}
> 2019-03-14 20:18:46,591 DEBUG [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] steps.BulkLoadJob:77 : Start to run
> LoadIncrementalHFiles
> 2019-03-14 20:18:46,642 WARN [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] mapreduce.LoadIncrementalHFiles:197
> : Skipping non-directory
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_SUCCESS
> 2019-03-14 20:18:46,650 ERROR [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] mapreduce.LoadIncrementalHFiles:352
> : -
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/4170d772384144848c1c10cba66152c3
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/50ec331ff3c648e3b6e4f54a7b1fe7e9
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/703ade3b535b4fedab39ee183e22aa7c
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/82019f8ca00a4f16b9d2b45356a55a3a
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/8cc8844bced24cb88fda52fecc7224d5
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/cbac78e0c6d74b5c96a7b64f99e0d0b3
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/e3844766a4d0486d89f287450034f378
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_temporary/0
> 2019-03-14 20:18:46,651 ERROR [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] common.HadoopShellExecutable:65 :
> error execute
> HadoopShellExecutable{id=e48de76a-6e16-309f-a3a5-191c04071072-08, name=Load
> HFile to HBase Table, state=RUNNING}
> java.io.FileNotFoundException: Path is not a file:
> /user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_temporary/0
> Caused by:
> org.apache.hadoop.ipc.RemoteException(java.io.FileNotFoundException): Path is
> not a file:
> /user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_tem
[jira] [Commented] (KYLIN-3884) loading hfile to HBase failed for temporary dir in output path
[
https://issues.apache.org/jira/browse/KYLIN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794908#comment-16794908
]
Liu Shaohui commented on KYLIN-3884:
[~Shaofengshi] When running spark job with spark.speculation=true, there may
be too running task for same task id at a time.
If a running task left after the the job is committed, it will create a new
_temporary dir in the output path.
See:
[https://github.com/apache/hbase/blob/master/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java]
#196
Be default, fs mkdirs api will create the parent path if it not exist.
{code:java}
fs.mkdirs(writerPath);
configureStoragePolicy(conf, fs, tableAndFamily, writerPath);{code}
> loading hfile to HBase failed for temporary dir in output path
> ---
>
> Key: KYLIN-3884
> URL: https://issues.apache.org/jira/browse/KYLIN-3884
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Priority: Major
>
> {code:java}
> 2019-03-14 20:18:46,591 DEBUG [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] steps.BulkLoadJob:77 : Start to run
> LoadIncrementalHFiles
> 2019-03-14 20:18:46,642 WARN [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] mapreduce.LoadIncrementalHFiles:197
> : Skipping non-directory
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_SUCCESS
> 2019-03-14 20:18:46,650 ERROR [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] mapreduce.LoadIncrementalHFiles:352
> : -
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/4170d772384144848c1c10cba66152c3
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/50ec331ff3c648e3b6e4f54a7b1fe7e9
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/703ade3b535b4fedab39ee183e22aa7c
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/82019f8ca00a4f16b9d2b45356a55a3a
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/8cc8844bced24cb88fda52fecc7224d5
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/cbac78e0c6d74b5c96a7b64f99e0d0b3
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/e3844766a4d0486d89f287450034f378
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_temporary/0
> 2019-03-14 20:18:46,651 ERROR [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] common.HadoopShellExecutable:65 :
> error execute
> HadoopShellExecutable{id=e48de76a-6e16-309f-a3a5-191c04071072-08, name=Load
> HFile to HBase Table, state=RUNNING}
> java.io.FileNotFoundException: Path is not a file:
> /user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_temporary/0
> Caused by:
> org.apache.hadoop.ipc.RemoteException(java.io.FileNotFoundException): Path is
> not a file:
> /user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_temporary/0{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3889) Measure of Count distinct bitmap disappeared when creating the cube
[ https://issues.apache.org/jira/browse/KYLIN-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenquan Ha updated KYLIN-3889: -- Summary: Measure of Count distinct bitmap disappeared when creating the cube (was: The column of Count distinct bitmap disappear when create a cube) > Measure of Count distinct bitmap disappeared when creating the cube > --- > > Key: KYLIN-3889 > URL: https://issues.apache.org/jira/browse/KYLIN-3889 > Project: Kylin > Issue Type: Bug > Components: Measure - Count Distinct >Affects Versions: v2.5.2 >Reporter: Wenquan Ha >Priority: Minor > > I have found that count distinct bitmap measure will disappear in cube, which > measure use the column of join key( which column connect the fact table and > lookup table with inner join or left join). > > *Reproduction step(version: apache-kylin-2.6.1-bin-hbase1)* > # create a model with one fact table and one lookup table through the A > column to connect both > # create a cube, A column will not be choosed as dimension column. And > create a count distinct bitmap measure use A column. > # Click Next button and you will find the measure which you just created > already disappeard on web gui. > > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3889) The column of Count distinct bitmap disappear when create a cube
Wenquan Ha created KYLIN-3889: - Summary: The column of Count distinct bitmap disappear when create a cube Key: KYLIN-3889 URL: https://issues.apache.org/jira/browse/KYLIN-3889 Project: Kylin Issue Type: Bug Components: Measure - Count Distinct Affects Versions: v2.5.2 Reporter: Wenquan Ha I have found that count distinct bitmap measure will disappear in cube, which measure use the column of join key( which column connect the fact table and lookup table with inner join or left join). *Reproduction step(version: apache-kylin-2.6.1-bin-hbase1)* # create a model with one fact table and one lookup table through the A column to connect both # create a cube, A column will not be choosed as dimension column. And create a count distinct bitmap measure use A column. # Click Next button and you will find the measure which you just created already disappeard on web gui. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3870) Kylin support count(column)
[ https://issues.apache.org/jira/browse/KYLIN-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794852#comment-16794852 ] jinguowei commented on KYLIN-3870: -- https://issues.apache.org/jira/browse/KYLIN-3883 > Kylin support count(column) > --- > > Key: KYLIN-3870 > URL: https://issues.apache.org/jira/browse/KYLIN-3870 > Project: Kylin > Issue Type: Improvement >Reporter: jinguowei >Assignee: xiaodongzhang >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (KYLIN-3870) Kylin support count(column)
[ https://issues.apache.org/jira/browse/KYLIN-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jinguowei closed KYLIN-3870. Resolution: Fixed > Kylin support count(column) > --- > > Key: KYLIN-3870 > URL: https://issues.apache.org/jira/browse/KYLIN-3870 > Project: Kylin > Issue Type: Improvement >Reporter: jinguowei >Assignee: xiaodongzhang >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3884) loading hfile to HBase failed for temporary dir in output path
[
https://issues.apache.org/jira/browse/KYLIN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794842#comment-16794842
]
Shaofeng SHI commented on KYLIN-3884:
-
Shaohui, in which case the temp folder will be kept there? Usually, it will be
automatically deleted after move the file to the parent folder. Want to hear
more from you.
> loading hfile to HBase failed for temporary dir in output path
> ---
>
> Key: KYLIN-3884
> URL: https://issues.apache.org/jira/browse/KYLIN-3884
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Priority: Major
>
> {code:java}
> 2019-03-14 20:18:46,591 DEBUG [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] steps.BulkLoadJob:77 : Start to run
> LoadIncrementalHFiles
> 2019-03-14 20:18:46,642 WARN [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] mapreduce.LoadIncrementalHFiles:197
> : Skipping non-directory
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_SUCCESS
> 2019-03-14 20:18:46,650 ERROR [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] mapreduce.LoadIncrementalHFiles:352
> : -
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/4170d772384144848c1c10cba66152c3
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/50ec331ff3c648e3b6e4f54a7b1fe7e9
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/703ade3b535b4fedab39ee183e22aa7c
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/82019f8ca00a4f16b9d2b45356a55a3a
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/8cc8844bced24cb88fda52fecc7224d5
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/cbac78e0c6d74b5c96a7b64f99e0d0b3
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/e3844766a4d0486d89f287450034f378
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_temporary/0
> 2019-03-14 20:18:46,651 ERROR [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] common.HadoopShellExecutable:65 :
> error execute
> HadoopShellExecutable{id=e48de76a-6e16-309f-a3a5-191c04071072-08, name=Load
> HFile to HBase Table, state=RUNNING}
> java.io.FileNotFoundException: Path is not a file:
> /user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_temporary/0
> Caused by:
> org.apache.hadoop.ipc.RemoteException(java.io.FileNotFoundException): Path is
> not a file:
> /user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_temporary/0{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3839) Strorage clean up after refreshing and deleting segment
[ https://issues.apache.org/jira/browse/KYLIN-3839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794845#comment-16794845 ] ASF GitHub Bot commented on KYLIN-3839: --- shaofengshi commented on pull request #502: KYLIN-3839 Strorage clean up after refreshing and deleting segment URL: https://github.com/apache/kylin/pull/502 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Strorage clean up after refreshing and deleting segment > --- > > Key: KYLIN-3839 > URL: https://issues.apache.org/jira/browse/KYLIN-3839 > Project: Kylin > Issue Type: Improvement > Components: Others >Reporter: Chao Long >Assignee: Chao Long >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3888) TableNotDisabledException when running "Convert Lookup Table to HFile"
[
https://issues.apache.org/jira/browse/KYLIN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794838#comment-16794838
]
ASF GitHub Bot commented on KYLIN-3888:
---
shaofengshi commented on pull request #531: KYLIN-3888
TableNotDisabledException when running "Convert Lookup Table to HFile"
URL: https://github.com/apache/kylin/pull/531
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> TableNotDisabledException when running "Convert Lookup Table to HFile"
> --
>
> Key: KYLIN-3888
> URL: https://issues.apache.org/jira/browse/KYLIN-3888
> Project: Kylin
> Issue Type: Bug
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
>
> {code}
> org.apache.hadoop.hbase.TableNotDisabledException:
> KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at
> org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4756)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4714)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4647)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.deleteTable(HBaseAdmin.java:904)
> at
> org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.removeSnapshotIfExist(LookupTableToHFileJob.java:170)
> at
> org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.run(LookupTableToHFileJob.java:104)
> at
> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.impl.threadpool.DistributedScheduler$JobRunner.run(DistributedScheduler.java:110)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by:
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hbase.TableNotDisabledException):
> KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
> at
> org.apache.hadoop.hbase.master.HMaster.checkTableModifiable(HMaster.java:2266)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.prepareDelete(DeleteTableProcedure.java:253)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:102)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:59)
> at
> org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:119)
> at
> org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:498)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1147)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:942)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:895)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:77)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:497)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3839) Strorage clean up after refreshing and deleting segment
[ https://issues.apache.org/jira/browse/KYLIN-3839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794846#comment-16794846 ] ASF subversion and git services commented on KYLIN-3839: Commit 62d5b0336b65013522e258499f640416f7e5ca82 in kylin's branch refs/heads/master from chao long [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=62d5b03 ] KYLIN-3839 Strorage clean up after refreshing and deleting segment > Strorage clean up after refreshing and deleting segment > --- > > Key: KYLIN-3839 > URL: https://issues.apache.org/jira/browse/KYLIN-3839 > Project: Kylin > Issue Type: Improvement > Components: Others >Reporter: Chao Long >Assignee: Chao Long >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] shaofengshi merged pull request #502: KYLIN-3839 Strorage clean up after refreshing and deleting segment
shaofengshi merged pull request #502: KYLIN-3839 Strorage clean up after refreshing and deleting segment URL: https://github.com/apache/kylin/pull/502 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Resolved] (KYLIN-3888) TableNotDisabledException when running "Convert Lookup Table to HFile"
[
https://issues.apache.org/jira/browse/KYLIN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shaofeng SHI resolved KYLIN-3888.
-
Resolution: Fixed
> TableNotDisabledException when running "Convert Lookup Table to HFile"
> --
>
> Key: KYLIN-3888
> URL: https://issues.apache.org/jira/browse/KYLIN-3888
> Project: Kylin
> Issue Type: Bug
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v2.6.2
>
>
> {code}
> org.apache.hadoop.hbase.TableNotDisabledException:
> KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at
> org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4756)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4714)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4647)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.deleteTable(HBaseAdmin.java:904)
> at
> org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.removeSnapshotIfExist(LookupTableToHFileJob.java:170)
> at
> org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.run(LookupTableToHFileJob.java:104)
> at
> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.impl.threadpool.DistributedScheduler$JobRunner.run(DistributedScheduler.java:110)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by:
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hbase.TableNotDisabledException):
> KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
> at
> org.apache.hadoop.hbase.master.HMaster.checkTableModifiable(HMaster.java:2266)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.prepareDelete(DeleteTableProcedure.java:253)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:102)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:59)
> at
> org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:119)
> at
> org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:498)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1147)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:942)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:895)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:77)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:497)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3888) TableNotDisabledException when running "Convert Lookup Table to HFile"
[
https://issues.apache.org/jira/browse/KYLIN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794839#comment-16794839
]
ASF subversion and git services commented on KYLIN-3888:
Commit 9c8d30b09b224dc173acd99ff4c62f51b2492e97 in kylin's branch
refs/heads/master from Guangxu Cheng
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=9c8d30b ]
KYLIN-3888 TableNotDisabledException when running "Convert Lookup Table to
HFile"
> TableNotDisabledException when running "Convert Lookup Table to HFile"
> --
>
> Key: KYLIN-3888
> URL: https://issues.apache.org/jira/browse/KYLIN-3888
> Project: Kylin
> Issue Type: Bug
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
>
> {code}
> org.apache.hadoop.hbase.TableNotDisabledException:
> KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at
> org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4756)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4714)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4647)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.deleteTable(HBaseAdmin.java:904)
> at
> org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.removeSnapshotIfExist(LookupTableToHFileJob.java:170)
> at
> org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.run(LookupTableToHFileJob.java:104)
> at
> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.impl.threadpool.DistributedScheduler$JobRunner.run(DistributedScheduler.java:110)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by:
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hbase.TableNotDisabledException):
> KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
> at
> org.apache.hadoop.hbase.master.HMaster.checkTableModifiable(HMaster.java:2266)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.prepareDelete(DeleteTableProcedure.java:253)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:102)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:59)
> at
> org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:119)
> at
> org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:498)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1147)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:942)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:895)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:77)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:497)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3888) TableNotDisabledException when running "Convert Lookup Table to HFile"
[
https://issues.apache.org/jira/browse/KYLIN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shaofeng SHI updated KYLIN-3888:
Fix Version/s: v2.6.2
> TableNotDisabledException when running "Convert Lookup Table to HFile"
> --
>
> Key: KYLIN-3888
> URL: https://issues.apache.org/jira/browse/KYLIN-3888
> Project: Kylin
> Issue Type: Bug
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v2.6.2
>
>
> {code}
> org.apache.hadoop.hbase.TableNotDisabledException:
> KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at
> org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4756)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4714)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4647)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.deleteTable(HBaseAdmin.java:904)
> at
> org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.removeSnapshotIfExist(LookupTableToHFileJob.java:170)
> at
> org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.run(LookupTableToHFileJob.java:104)
> at
> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.impl.threadpool.DistributedScheduler$JobRunner.run(DistributedScheduler.java:110)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by:
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hbase.TableNotDisabledException):
> KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
> at
> org.apache.hadoop.hbase.master.HMaster.checkTableModifiable(HMaster.java:2266)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.prepareDelete(DeleteTableProcedure.java:253)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:102)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:59)
> at
> org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:119)
> at
> org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:498)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1147)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:942)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:895)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:77)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:497)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3888) TableNotDisabledException when running "Convert Lookup Table to HFile"
[
https://issues.apache.org/jira/browse/KYLIN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794841#comment-16794841
]
Shaofeng SHI commented on KYLIN-3888:
-
Goot catch, thank you guangxu!
> TableNotDisabledException when running "Convert Lookup Table to HFile"
> --
>
> Key: KYLIN-3888
> URL: https://issues.apache.org/jira/browse/KYLIN-3888
> Project: Kylin
> Issue Type: Bug
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v2.6.2
>
>
> {code}
> org.apache.hadoop.hbase.TableNotDisabledException:
> KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at
> org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4756)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4714)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4647)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.deleteTable(HBaseAdmin.java:904)
> at
> org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.removeSnapshotIfExist(LookupTableToHFileJob.java:170)
> at
> org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.run(LookupTableToHFileJob.java:104)
> at
> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.impl.threadpool.DistributedScheduler$JobRunner.run(DistributedScheduler.java:110)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by:
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hbase.TableNotDisabledException):
> KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
> at
> org.apache.hadoop.hbase.master.HMaster.checkTableModifiable(HMaster.java:2266)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.prepareDelete(DeleteTableProcedure.java:253)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:102)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:59)
> at
> org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:119)
> at
> org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:498)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1147)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:942)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:895)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:77)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:497)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] [kylin] shaofengshi merged pull request #531: KYLIN-3888 TableNotDisabledException when running "Convert Lookup Table to HFile"
shaofengshi merged pull request #531: KYLIN-3888 TableNotDisabledException when running "Convert Lookup Table to HFile" URL: https://github.com/apache/kylin/pull/531 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] shaofengshi merged pull request #532: Update Superset Blog
shaofengshi merged pull request #532: Update Superset Blog URL: https://github.com/apache/kylin/pull/532 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #532: Update Superset Blog
asfgit commented on issue #532: Update Superset Blog URL: https://github.com/apache/kylin/pull/532#issuecomment-473805220 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3887) Query with decimal sum measure of double complied failed after KYLIN-3703
[
https://issues.apache.org/jira/browse/KYLIN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794799#comment-16794799
]
Liu Shaohui commented on KYLIN-3887:
[~temple.zhou] Will you help to look at this issue? Revert the commit of
KYLIN-3703, the compile problem will disappear.
> Query with decimal sum measure of double complied failed after KYLIN-3703
> -
>
> Key: KYLIN-3887
> URL: https://issues.apache.org/jira/browse/KYLIN-3887
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Priority: Major
>
> After KYLIN-3703, Query with decimal sum measure of double complied failed.
> {code:java}
> Caused by: org.codehaus.commons.compiler.CompileException:
> Line 112, Column 42: Cannot cast "java.math.BigDecimal" to
> "java.lang.Double"{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] [kylin] GinaZhai opened a new pull request #532: Update Superset Blog
GinaZhai opened a new pull request #532: Update Superset Blog URL: https://github.com/apache/kylin/pull/532 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #532: Update Superset Blog
asfgit commented on issue #532: Update Superset Blog URL: https://github.com/apache/kylin/pull/532#issuecomment-473805221 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] javalife0312 commented on issue #515: KYLIN-3841 Build Global Dict by MR/Hive
javalife0312 commented on issue #515: KYLIN-3841 Build Global Dict by MR/Hive URL: https://github.com/apache/kylin/pull/515#issuecomment-473803072 > Hi Guowei, can you use seperated PR for the changes of count(col)? Thank you! ok This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #531: KYLIN-3888 TableNotDisabledException when running "Convert Lookup Table to HFile"
asfgit commented on issue #531: KYLIN-3888 TableNotDisabledException when running "Convert Lookup Table to HFile" URL: https://github.com/apache/kylin/pull/531#issuecomment-473801025 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3888) TableNotDisabledException when running "Convert Lookup Table to HFile"
[
https://issues.apache.org/jira/browse/KYLIN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794809#comment-16794809
]
ASF GitHub Bot commented on KYLIN-3888:
---
guangxuCheng commented on pull request #531: KYLIN-3888
TableNotDisabledException when running "Convert Lookup Table to HFile"
URL: https://github.com/apache/kylin/pull/531
See: https://issues.apache.org/jira/browse/KYLIN-3888
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> TableNotDisabledException when running "Convert Lookup Table to HFile"
> --
>
> Key: KYLIN-3888
> URL: https://issues.apache.org/jira/browse/KYLIN-3888
> Project: Kylin
> Issue Type: Bug
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
>
> {code}
> org.apache.hadoop.hbase.TableNotDisabledException:
> KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
> at
> org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
> at
> org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4756)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4714)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4647)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.deleteTable(HBaseAdmin.java:904)
> at
> org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.removeSnapshotIfExist(LookupTableToHFileJob.java:170)
> at
> org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.run(LookupTableToHFileJob.java:104)
> at
> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.impl.threadpool.DistributedScheduler$JobRunner.run(DistributedScheduler.java:110)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by:
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hbase.TableNotDisabledException):
> KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
> at
> org.apache.hadoop.hbase.master.HMaster.checkTableModifiable(HMaster.java:2266)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.prepareDelete(DeleteTableProcedure.java:253)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:102)
> at
> org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:59)
> at
> org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:119)
> at
> org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:498)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1147)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:942)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:895)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:77)
> at
> org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:497)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] [kylin] asfgit commented on issue #531: KYLIN-3888 TableNotDisabledException when running "Convert Lookup Table to HFile"
asfgit commented on issue #531: KYLIN-3888 TableNotDisabledException when running "Convert Lookup Table to HFile" URL: https://github.com/apache/kylin/pull/531#issuecomment-473801032 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] guangxuCheng opened a new pull request #531: KYLIN-3888 TableNotDisabledException when running "Convert Lookup Table to HFile"
guangxuCheng opened a new pull request #531: KYLIN-3888 TableNotDisabledException when running "Convert Lookup Table to HFile" URL: https://github.com/apache/kylin/pull/531 See: https://issues.apache.org/jira/browse/KYLIN-3888 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Created] (KYLIN-3888) TableNotDisabledException when running "Convert Lookup Table to HFile"
Guangxu Cheng created KYLIN-3888:
Summary: TableNotDisabledException when running "Convert Lookup
Table to HFile"
Key: KYLIN-3888
URL: https://issues.apache.org/jira/browse/KYLIN-3888
Project: Kylin
Issue Type: Bug
Reporter: Guangxu Cheng
Assignee: Guangxu Cheng
{code}
org.apache.hadoop.hbase.TableNotDisabledException:
KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at
org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
at
org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
at
org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45)
at
org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4756)
at
org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4714)
at
org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4647)
at
org.apache.hadoop.hbase.client.HBaseAdmin.deleteTable(HBaseAdmin.java:904)
at
org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.removeSnapshotIfExist(LookupTableToHFileJob.java:170)
at
org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.run(LookupTableToHFileJob.java:104)
at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
at
org.apache.kylin.job.impl.threadpool.DistributedScheduler$JobRunner.run(DistributedScheduler.java:110)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by:
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hbase.TableNotDisabledException):
KYLIN_LOOKUP_DEFAULT.F_ADVERTISER_DIM_KYLIN_TEST_9WCVUDIXI5
at
org.apache.hadoop.hbase.master.HMaster.checkTableModifiable(HMaster.java:2266)
at
org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.prepareDelete(DeleteTableProcedure.java:253)
at
org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:102)
at
org.apache.hadoop.hbase.master.procedure.DeleteTableProcedure.executeFromState(DeleteTableProcedure.java:59)
at
org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:119)
at
org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:498)
at
org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1147)
at
org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:942)
at
org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:895)
at
org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:77)
at
org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:497)
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] [kylin] codecov-io commented on issue #529: KYLIN-3884: loading hfile to HBase failed for temporary dir in output path
codecov-io commented on issue #529: KYLIN-3884: loading hfile to HBase failed for temporary dir in output path URL: https://github.com/apache/kylin/pull/529#issuecomment-473798859 # [Codecov](https://codecov.io/gh/apache/kylin/pull/529?src=pr&el=h1) Report > :exclamation: No coverage uploaded for pull request base (`master@0431554`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `0%`. [](https://codecov.io/gh/apache/kylin/pull/529?src=pr&el=tree) ```diff @@Coverage Diff@@ ## master #529 +/- ## = Coverage ? 24.44% Complexity? 5025 = Files ? 1160 Lines ?70401 Branches ?10014 = Hits ?17209 Misses?51458 Partials ? 1734 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/529?src=pr&el=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [.../apache/kylin/storage/hbase/steps/BulkLoadJob.java](https://codecov.io/gh/apache/kylin/pull/529/diff?src=pr&el=tree#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS9zdGVwcy9CdWxrTG9hZEpvYi5qYXZh) | `0% <0%> (ø)` | `0 <0> (?)` | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/529?src=pr&el=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/529?src=pr&el=footer). Last update [0431554...0211fed](https://codecov.io/gh/apache/kylin/pull/529?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Created] (KYLIN-3887) Query with decimal sum measure of double complied failed after KYLIN-3703
Liu Shaohui created KYLIN-3887:
--
Summary: Query with decimal sum measure of double complied failed
after KYLIN-3703
Key: KYLIN-3887
URL: https://issues.apache.org/jira/browse/KYLIN-3887
Project: Kylin
Issue Type: Bug
Reporter: Liu Shaohui
After KYLIN-3703, Query with decimal sum measure of double complied failed.
{code:java}
Caused by: org.codehaus.commons.compiler.CompileException:
Line 112, Column 42: Cannot cast "java.math.BigDecimal" to
"java.lang.Double"{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3883) Kylin supports column count aggregation
[ https://issues.apache.org/jira/browse/KYLIN-3883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaodongzhang updated KYLIN-3883: - Component/s: (was: Job Engine) Query Engine > Kylin supports column count aggregation > --- > > Key: KYLIN-3883 > URL: https://issues.apache.org/jira/browse/KYLIN-3883 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: all >Reporter: xiaodongzhang >Assignee: xiaodongzhang >Priority: Major > > Kylin目前只支持对常量1进行count聚合预计算，即count(1)，count(col_1)的查询内部全部重写到对count(1)的查询，这样会导致一个问题：当col_1列中存在null值时，count(col_1)的查询结果并不准确。这样就导致Kylin的查询结果和Hive、Spark等不一致。该Patch中，提供了对count(col_1)的支持。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3884) loading hfile to HBase failed for temporary dir in output path
[
https://issues.apache.org/jira/browse/KYLIN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794782#comment-16794782
]
ASF GitHub Bot commented on KYLIN-3884:
---
lshmouse commented on pull request #529: KYLIN-3884: loading hfile to HBase
failed for temporary dir in output path
URL: https://github.com/apache/kylin/pull/529
See: https://issues.apache.org/jira/browse/KYLIN-3884
Delete the temporary dir before loading hfiles to HBase tables.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> loading hfile to HBase failed for temporary dir in output path
> ---
>
> Key: KYLIN-3884
> URL: https://issues.apache.org/jira/browse/KYLIN-3884
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Priority: Major
>
> {code:java}
> 2019-03-14 20:18:46,591 DEBUG [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] steps.BulkLoadJob:77 : Start to run
> LoadIncrementalHFiles
> 2019-03-14 20:18:46,642 WARN [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] mapreduce.LoadIncrementalHFiles:197
> : Skipping non-directory
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_SUCCESS
> 2019-03-14 20:18:46,650 ERROR [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] mapreduce.LoadIncrementalHFiles:352
> : -
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/4170d772384144848c1c10cba66152c3
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/50ec331ff3c648e3b6e4f54a7b1fe7e9
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/703ade3b535b4fedab39ee183e22aa7c
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/82019f8ca00a4f16b9d2b45356a55a3a
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/8cc8844bced24cb88fda52fecc7224d5
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/cbac78e0c6d74b5c96a7b64f99e0d0b3
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/e3844766a4d0486d89f287450034f378
>
> hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_temporary/0
> 2019-03-14 20:18:46,651 ERROR [Scheduler 2084224398 Job
> e48de76a-6e16-309f-a3a5-191c04071072-131] common.HadoopShellExecutable:65 :
> error execute
> HadoopShellExecutable{id=e48de76a-6e16-309f-a3a5-191c04071072-08, name=Load
> HFile to HBase Table, state=RUNNING}
> java.io.FileNotFoundException: Path is not a file:
> /user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_temporary/0
> Caused by:
> org.apache.hadoop.ipc.RemoteException(java.io.FileNotFoundException): Path is
> not a file:
> /user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_temporary/0{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3886) Missing argument for options for yarn command
[
https://issues.apache.org/jira/browse/KYLIN-3886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794785#comment-16794785
]
ASF GitHub Bot commented on KYLIN-3886:
---
lshmouse commented on pull request #530: KYLIN-3886: Missing argument for
options for yarn command
URL: https://github.com/apache/kylin/pull/530
See: https://issues.apache.org/jira/browse/KYLIN-3886
The app id may be empty which cause the yarn command failed for missing
argument.
Checking the app id before executing yarn command
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Missing argument for options for yarn command
> --
>
> Key: KYLIN-3886
> URL: https://issues.apache.org/jira/browse/KYLIN-3886
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Priority: Major
>
> The app id is empty which cause the yarn command failed for missing argument
>
> {code:java}
> 2019-03-13 11:48:08,604 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : Missing
> argument for options
> 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : usage:
> application
> 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
> -appStates Works with -list to filter applications
> 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : based on
> input comma-separated list of
> 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
> application states. The valid application
> 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : state
> can be one of the following:
> 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
> ALL,NEW,NEW_SAVING,SUBMITTED,ACCEPTED,RUN
> 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
> NING,FINISHED,FAILED,KILLED
> 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
> -appTypes Works with -list to filter applications
> 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : based on
> input comma-separated list of
> 2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
> application types.
> 2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -help
> Displays help for all commands.
> 2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -kill
> Kills the application.
> 2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -list
> List applications. Supports optional use
> 2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job
> f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : of
> -appTypes to filter applications based{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] [kylin] asfgit commented on issue #530: KYLIN-3886: Missing argument for options for yarn command
asfgit commented on issue #530: KYLIN-3886: Missing argument for options for yarn command URL: https://github.com/apache/kylin/pull/530#issuecomment-473792462 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #530: KYLIN-3886: Missing argument for options for yarn command
asfgit commented on issue #530: KYLIN-3886: Missing argument for options for yarn command URL: https://github.com/apache/kylin/pull/530#issuecomment-473792463 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] lshmouse opened a new pull request #530: KYLIN-3886: Missing argument for options for yarn command
lshmouse opened a new pull request #530: KYLIN-3886: Missing argument for options for yarn command URL: https://github.com/apache/kylin/pull/530 See: https://issues.apache.org/jira/browse/KYLIN-3886 The app id may be empty which cause the yarn command failed for missing argument. Checking the app id before executing yarn command This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
