[GitHub] [kylin] asfgit commented on issue #529: KYLIN-3884: loading hfile to HBase failed for temporary dir in output path
asfgit commented on issue #529: KYLIN-3884: loading hfile to HBase failed for temporary dir in output path URL: https://github.com/apache/kylin/pull/529#issuecomment-473791423 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] lshmouse opened a new pull request #529: KYLIN-3884: loading hfile to HBase failed for temporary dir in output path
lshmouse opened a new pull request #529: KYLIN-3884: loading hfile to HBase failed for temporary dir in output path URL: https://github.com/apache/kylin/pull/529 See: https://issues.apache.org/jira/browse/KYLIN-3884 Delete the temporary dir before loading hfiles to HBase tables. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #529: KYLIN-3884: loading hfile to HBase failed for temporary dir in output path
asfgit commented on issue #529: KYLIN-3884: loading hfile to HBase failed for temporary dir in output path URL: https://github.com/apache/kylin/pull/529#issuecomment-473791422 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (KYLIN-3883) Kylin supports column count aggregation
[ https://issues.apache.org/jira/browse/KYLIN-3883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaodongzhang updated KYLIN-3883: - Fix Version/s: (was: v3.0.0) > Kylin supports column count aggregation > --- > > Key: KYLIN-3883 > URL: https://issues.apache.org/jira/browse/KYLIN-3883 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Affects Versions: all >Reporter: xiaodongzhang >Assignee: xiaodongzhang >Priority: Major > > Kylin目前只支持对常量1进行count聚合预计算，即count(1)，count(col_1)的查询内部全部重写到对count(1)的查询，这样会导致一个问题：当col_1列中存在null值时，count(col_1)的查询结果并不准确。这样就导致Kylin的查询结果和Hive、Spark等不一致。该Patch中，提供了对count(col_1)的支持。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3886) Missing argument for options for yarn command
[
https://issues.apache.org/jira/browse/KYLIN-3886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liu Shaohui updated KYLIN-3886:
---
Description:
The app id is empty which cause the yarn command failed for missing argument
{code:java}
2019-03-13 11:48:08,604 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : Missing
argument for options
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : usage:
application
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -appStates
Works with -list to filter applications
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : based on
input comma-separated list of
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
application states. The valid application
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : state can
be one of the following:
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
ALL,NEW,NEW_SAVING,SUBMITTED,ACCEPTED,RUN
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
NING,FINISHED,FAILED,KILLED
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -appTypes
Works with -list to filter applications
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : based on
input comma-separated list of
2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
application types.
2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -help
Displays help for all commands.
2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -kill
Kills the application.
2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -list List
applications. Supports optional use
2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : of
-appTypes to filter applications based{code}
was:
2019-03-13 11:48:08,604 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : Missing
argument for options
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : usage:
application
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
-appStates Works with -list to filter applications
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
based on input comma-separated list of
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
application states. The valid application
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
state can be one of the following:
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
ALL,NEW,NEW_SAVING,SUBMITTED,ACCEPTED,RUN
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
NING,FINISHED,FAILED,KILLED
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -appTypes
Works with -list to filter applications
2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
based on input comma-separated list of
2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 :
application types.
2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job
f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -help
Displays help for all commands.
2019-03-13 11:48:08,607
[jira] [Created] (KYLIN-3886) Missing argument for options for yarn command
Liu Shaohui created KYLIN-3886: -- Summary: Missing argument for options for yarn command Key: KYLIN-3886 URL: https://issues.apache.org/jira/browse/KYLIN-3886 Project: Kylin Issue Type: Bug Reporter: Liu Shaohui 2019-03-13 11:48:08,604 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : Missing argument for options 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : usage: application 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -appStates Works with -list to filter applications 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : based on input comma-separated list of 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : application states. The valid application 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : state can be one of the following: 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : ALL,NEW,NEW_SAVING,SUBMITTED,ACCEPTED,RUN 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : NING,FINISHED,FAILED,KILLED 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -appTypes Works with -list to filter applications 2019-03-13 11:48:08,606 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : based on input comma-separated list of 2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : application types. 2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -help Displays help for all commands. 2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -kill Kills the application. 2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : -list List applications. Supports optional use 2019-03-13 11:48:08,607 INFO [Scheduler 542945608 Job f918877a-deb0-704c-ec6f-82f33f5e39a5-323] spark.SparkExecutable:38 : of -appTypes to filter applications based -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (KYLIN-3885) Build dimension dictionary job costs too long when using Spark fact distinct
[
https://issues.apache.org/jira/browse/KYLIN-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liu Shaohui reassigned KYLIN-3885:
--
Assignee: Liu Shaohui
> Build dimension dictionary job costs too long when using Spark fact distinct
>
>
> Key: KYLIN-3885
> URL: https://issues.apache.org/jira/browse/KYLIN-3885
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
>
> Build dimension dictionary job costs less than 20 minutes when using
> mapreduce fact distinct,but but it costs more than 3 hours when using spark
> fact distinct.
> {code:java}
> "Scheduler 542945608 Job 05c62aca-853f-396e-9653-f20c9ebd8ebc-329" #329
> prio=5 os_prio=0 tid=0x7f312109c800 nid=0x2dc0b in Object.wait()
> [0x7f30d8d24000]
>java.lang.Thread.State: WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> at java.lang.Object.wait(Object.java:502)
> at org.apache.hadoop.ipc.Client.call(Client.java:1482)
> - locked <0x0005c3110fc0> (a org.apache.hadoop.ipc.Client$Call)
> at org.apache.hadoop.ipc.Client.call(Client.java:1427)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
> at com.sun.proxy.$Proxy33.delete(Unknown Source)
> at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:573)
> at sun.reflect.GeneratedMethodAccessor193.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:249)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:107)
> at com.sun.proxy.$Proxy34.delete(Unknown Source)
> at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:2057)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$13.doCall(DistributedFileSystem.java:682)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$13.doCall(DistributedFileSystem.java:675)
> at
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:696)
> at
> org.apache.hadoop.fs.FilterFileSystem.delete(FilterFileSystem.java:232)
> at
> org.apache.hadoop.fs.viewfs.ChRootedFileSystem.delete(ChRootedFileSystem.java:198)
> at
> org.apache.hadoop.fs.viewfs.ViewFileSystem.delete(ViewFileSystem.java:334)
> at
> org.apache.hadoop.hdfs.FederatedDFSFileSystem.delete(FederatedDFSFileSystem.java:232)
> at
> org.apache.kylin.dict.global.GlobalDictHDFSStore.deleteSlice(GlobalDictHDFSStore.java:211)
> at
> org.apache.kylin.dict.global.AppendTrieDictionaryBuilder.flushCurrentNode(AppendTrieDictionaryBuilder.java:137)
> at
> org.apache.kylin.dict.global.AppendTrieDictionaryBuilder.addValue(AppendTrieDictionaryBuilder.java:97)
> at
> org.apache.kylin.dict.GlobalDictionaryBuilder.addValue(GlobalDictionaryBuilder.java:85)
> at
> org.apache.kylin.dict.DictionaryGenerator.buildDictionary(DictionaryGenerator.java:82)
> at
> org.apache.kylin.dict.DictionaryManager.buildDictFromReadableTable(DictionaryManager.java:303)
> at
> org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager.java:290)
> at
> org.apache.kylin.cube.CubeManager$DictionaryAssist.buildDictionary(CubeManager.java:1043)
> at
> org.apache.kylin.cube.CubeManager.buildDictionary(CubeManager.java:1012)
> at
> org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:72)
> at
> org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:50)
> at
> org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:73)
> at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92)
> at
> org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
> at
> java.util.concurrent.ThreadPoolExecuto
[jira] [Created] (KYLIN-3885) Build dimension dictionary job costs too long when using Spark fact distinct
Liu Shaohui created KYLIN-3885:
--
Summary: Build dimension dictionary job costs too long when using
Spark fact distinct
Key: KYLIN-3885
URL: https://issues.apache.org/jira/browse/KYLIN-3885
Project: Kylin
Issue Type: Bug
Reporter: Liu Shaohui
Build dimension dictionary job costs less than 20 minutes when using mapreduce
fact distinct,but but it costs more than 3 hours when using spark fact distinct.
{code:java}
"Scheduler 542945608 Job 05c62aca-853f-396e-9653-f20c9ebd8ebc-329" #329 prio=5
os_prio=0 tid=0x7f312109c800 nid=0x2dc0b in Object.wait()
[0x7f30d8d24000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.hadoop.ipc.Client.call(Client.java:1482)
- locked <0x0005c3110fc0> (a org.apache.hadoop.ipc.Client$Call)
at org.apache.hadoop.ipc.Client.call(Client.java:1427)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy33.delete(Unknown Source)
at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:573)
at sun.reflect.GeneratedMethodAccessor193.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:249)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:107)
at com.sun.proxy.$Proxy34.delete(Unknown Source)
at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:2057)
at
org.apache.hadoop.hdfs.DistributedFileSystem$13.doCall(DistributedFileSystem.java:682)
at
org.apache.hadoop.hdfs.DistributedFileSystem$13.doCall(DistributedFileSystem.java:675)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:696)
at
org.apache.hadoop.fs.FilterFileSystem.delete(FilterFileSystem.java:232)
at
org.apache.hadoop.fs.viewfs.ChRootedFileSystem.delete(ChRootedFileSystem.java:198)
at
org.apache.hadoop.fs.viewfs.ViewFileSystem.delete(ViewFileSystem.java:334)
at
org.apache.hadoop.hdfs.FederatedDFSFileSystem.delete(FederatedDFSFileSystem.java:232)
at
org.apache.kylin.dict.global.GlobalDictHDFSStore.deleteSlice(GlobalDictHDFSStore.java:211)
at
org.apache.kylin.dict.global.AppendTrieDictionaryBuilder.flushCurrentNode(AppendTrieDictionaryBuilder.java:137)
at
org.apache.kylin.dict.global.AppendTrieDictionaryBuilder.addValue(AppendTrieDictionaryBuilder.java:97)
at
org.apache.kylin.dict.GlobalDictionaryBuilder.addValue(GlobalDictionaryBuilder.java:85)
at
org.apache.kylin.dict.DictionaryGenerator.buildDictionary(DictionaryGenerator.java:82)
at
org.apache.kylin.dict.DictionaryManager.buildDictFromReadableTable(DictionaryManager.java:303)
at
org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager.java:290)
at
org.apache.kylin.cube.CubeManager$DictionaryAssist.buildDictionary(CubeManager.java:1043)
at
org.apache.kylin.cube.CubeManager.buildDictionary(CubeManager.java:1012)
at
org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:72)
at
org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:50)
at
org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:73)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92)
at
org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (KYLIN-3884) loading hfile to HBase failed for temporary dir in output path
Liu Shaohui created KYLIN-3884:
--
Summary: loading hfile to HBase failed for temporary dir in
output path
Key: KYLIN-3884
URL: https://issues.apache.org/jira/browse/KYLIN-3884
Project: Kylin
Issue Type: Bug
Reporter: Liu Shaohui
{code:java}
2019-03-14 20:18:46,591 DEBUG [Scheduler 2084224398 Job
e48de76a-6e16-309f-a3a5-191c04071072-131] steps.BulkLoadJob:77 : Start to run
LoadIncrementalHFiles
2019-03-14 20:18:46,642 WARN [Scheduler 2084224398 Job
e48de76a-6e16-309f-a3a5-191c04071072-131] mapreduce.LoadIncrementalHFiles:197 :
Skipping non-directory
hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_SUCCESS
2019-03-14 20:18:46,650 ERROR [Scheduler 2084224398 Job
e48de76a-6e16-309f-a3a5-191c04071072-131] mapreduce.LoadIncrementalHFiles:352 :
-
hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/4170d772384144848c1c10cba66152c3
hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/50ec331ff3c648e3b6e4f54a7b1fe7e9
hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/703ade3b535b4fedab39ee183e22aa7c
hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/82019f8ca00a4f16b9d2b45356a55a3a
hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/8cc8844bced24cb88fda52fecc7224d5
hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/cbac78e0c6d74b5c96a7b64f99e0d0b3
hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/F1/e3844766a4d0486d89f287450034f378
hdfs://zjyprc-xiaomi/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_temporary/0
2019-03-14 20:18:46,651 ERROR [Scheduler 2084224398 Job
e48de76a-6e16-309f-a3a5-191c04071072-131] common.HadoopShellExecutable:65 :
error execute HadoopShellExecutable{id=e48de76a-6e16-309f-a3a5-191c04071072-08,
name=Load HFile to HBase Table, state=RUNNING}
java.io.FileNotFoundException: Path is not a file:
/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_temporary/0
Caused by:
org.apache.hadoop.ipc.RemoteException(java.io.FileNotFoundException): Path is
not a file:
/user/s_kylin/kylin_zjyprc_bigdata_staging/kylin_zjyprc_bigdata_staging-kylin_metadata/kylin-e48de76a-6e16-309f-a3a5-191c04071072/total_user_cube/hfile/_temporary/0{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3880) DataType is incompatible in Kylin HBase coprocessor
[
https://issues.apache.org/jira/browse/KYLIN-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794745#comment-16794745
]
ASF GitHub Bot commented on KYLIN-3880:
---
shaofengshi commented on pull request #527: KYLIN-3880: DataType is
incompatible in Kylin HBase coprocessor
URL: https://github.com/apache/kylin/pull/527
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> DataType is incompatible in Kylin HBase coprocessor
> ---
>
> Key: KYLIN-3880
> URL: https://issues.apache.org/jira/browse/KYLIN-3880
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
> Fix For: v2.6.2
>
>
> During upgrade kylin from 2.4.1 to 2.5.2, the query will failed for the
> incompatible class in Kylin HBase coprocessor
> {code:java}
> 2019-03-12,17:48:11,530 INFO
> [FifoRWQ.default.readRpcServer.handler=197,queue=13,port=24600]
> org.apache.hadoop.hdfs.DFSClient: Access token was invalid when connecting to
> /10.152.33.45:22402 :
> org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got
> access token error for OP_READ_BLOCK, self=/10.152.33.44:55387,
> remote=/10.152.33.45:22402, for file
> /hbase/zjyprc-xiaomi/data/miui_sec/data/4b88a72f5bd37daca00efb842e676ca8/C/6593503eb213431998db117cf3dab3a6,
> for pool BP-792581576-10.152.48.22-1510572454905 block 1899006034_825272806
> 2019-03-12,17:48:12,135 INFO
> [FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600]
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService:
> start query dc0fadcf-3689-5508-9a45-559aaebfd4e0 in thread
> FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600
> 2019-03-12,17:48:12,135 ERROR
> [FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600]
> org.apache.hadoop.ipc.RpcServer: Unexpected throwable object
> java.lang.RuntimeException: java.io.InvalidClassException:
> org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream
> classdesc serialVersionUID = -8891652700267537109, local class
> serialVersionUID = -406124487097947
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem.readDimensionEncoding(TrimmedCubeCodeSystem.java:87)
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:122)
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:91)
> at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:346)
> at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:307)
> at
> org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:466)
> at
> org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:412)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:259)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:6625)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execServiceOnRegion(HRegionServer.java:4336)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execService(HRegionServer.java:4318)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34964)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2059)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:126)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:152)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:128)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.io.InvalidClassException:
> org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream
> classdesc serialVersionUID = -8891652700267537109, local class
> serialVersionUID = -406124487097947
> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:699)
> at
> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1885)
> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1751)
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2042)
> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
>
[jira] [Commented] (KYLIN-3883) Kylin supports column count aggregation
[ https://issues.apache.org/jira/browse/KYLIN-3883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794754#comment-16794754 ] ASF GitHub Bot commented on KYLIN-3883: --- xbirbird commented on pull request #528: KYLIN-3883 Kylin supports column count aggregation URL: https://github.com/apache/kylin/pull/528 Kylin目前只支持对常量1进行count聚合预计算，即count(1)，count(col_1)的查询内部全部重写到对count(1)的查询，这样会导致一个问题：当col_1列中存在null值时，count(col_1)的查询结果并不准确。这样就导致Kylin的查询结果和Hive、Spark等不一致。该Patch中，提供了对count(col_1)的支持。 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Kylin supports column count aggregation > --- > > Key: KYLIN-3883 > URL: https://issues.apache.org/jira/browse/KYLIN-3883 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Affects Versions: all >Reporter: xiaodongzhang >Assignee: xiaodongzhang >Priority: Major > Fix For: v3.0.0 > > > Kylin目前只支持对常量1进行count聚合预计算，即count(1)，count(col_1)的查询内部全部重写到对count(1)的查询，这样会导致一个问题：当col_1列中存在null值时，count(col_1)的查询结果并不准确。这样就导致Kylin的查询结果和Hive、Spark等不一致。该Patch中，提供了对count(col_1)的支持。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] asfgit commented on issue #528: KYLIN-3883 Kylin supports column count aggregation
asfgit commented on issue #528: KYLIN-3883 Kylin supports column count aggregation URL: https://github.com/apache/kylin/pull/528#issuecomment-473780022 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #528: KYLIN-3883 Kylin supports column count aggregation
asfgit commented on issue #528: KYLIN-3883 Kylin supports column count aggregation URL: https://github.com/apache/kylin/pull/528#issuecomment-473780026 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] xbirbird opened a new pull request #528: KYLIN-3883 Kylin supports column count aggregation
xbirbird opened a new pull request #528: KYLIN-3883 Kylin supports column count aggregation URL: https://github.com/apache/kylin/pull/528 Kylin目前只支持对常量1进行count聚合预计算，即count(1)，count(col_1)的查询内部全部重写到对count(1)的查询，这样会导致一个问题：当col_1列中存在null值时，count(col_1)的查询结果并不准确。这样就导致Kylin的查询结果和Hive、Spark等不一致。该Patch中，提供了对count(col_1)的支持。 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Created] (KYLIN-3883) Kylin supports column count aggregation
xiaodongzhang created KYLIN-3883: Summary: Kylin supports column count aggregation Key: KYLIN-3883 URL: https://issues.apache.org/jira/browse/KYLIN-3883 Project: Kylin Issue Type: New Feature Components: Job Engine Affects Versions: all Reporter: xiaodongzhang Assignee: xiaodongzhang Fix For: v3.0.0 Kylin目前只支持对常量1进行count聚合预计算，即count(1)，count(col_1)的查询内部全部重写到对count(1)的查询，这样会导致一个问题：当col_1列中存在null值时，count(col_1)的查询结果并不准确。这样就导致Kylin的查询结果和Hive、Spark等不一致。该Patch中，提供了对count(col_1)的支持。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] shaofengshi merged pull request #527: KYLIN-3880: DataType is incompatible in Kylin HBase coprocessor
shaofengshi merged pull request #527: KYLIN-3880: DataType is incompatible in Kylin HBase coprocessor URL: https://github.com/apache/kylin/pull/527 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3880) DataType is incompatible in Kylin HBase coprocessor
[
https://issues.apache.org/jira/browse/KYLIN-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794746#comment-16794746
]
ASF subversion and git services commented on KYLIN-3880:
Commit 0431554ecf2779d5d48cbb549881a3895e375cad in kylin's branch
refs/heads/master from Liu Shaohui
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=0431554 ]
KYLIN-3880: DataType is incompatible in Kylin HBase coprocessor
> DataType is incompatible in Kylin HBase coprocessor
> ---
>
> Key: KYLIN-3880
> URL: https://issues.apache.org/jira/browse/KYLIN-3880
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
> Fix For: v2.6.2
>
>
> During upgrade kylin from 2.4.1 to 2.5.2, the query will failed for the
> incompatible class in Kylin HBase coprocessor
> {code:java}
> 2019-03-12,17:48:11,530 INFO
> [FifoRWQ.default.readRpcServer.handler=197,queue=13,port=24600]
> org.apache.hadoop.hdfs.DFSClient: Access token was invalid when connecting to
> /10.152.33.45:22402 :
> org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got
> access token error for OP_READ_BLOCK, self=/10.152.33.44:55387,
> remote=/10.152.33.45:22402, for file
> /hbase/zjyprc-xiaomi/data/miui_sec/data/4b88a72f5bd37daca00efb842e676ca8/C/6593503eb213431998db117cf3dab3a6,
> for pool BP-792581576-10.152.48.22-1510572454905 block 1899006034_825272806
> 2019-03-12,17:48:12,135 INFO
> [FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600]
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService:
> start query dc0fadcf-3689-5508-9a45-559aaebfd4e0 in thread
> FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600
> 2019-03-12,17:48:12,135 ERROR
> [FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600]
> org.apache.hadoop.ipc.RpcServer: Unexpected throwable object
> java.lang.RuntimeException: java.io.InvalidClassException:
> org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream
> classdesc serialVersionUID = -8891652700267537109, local class
> serialVersionUID = -406124487097947
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem.readDimensionEncoding(TrimmedCubeCodeSystem.java:87)
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:122)
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:91)
> at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:346)
> at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:307)
> at
> org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:466)
> at
> org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:412)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:259)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:6625)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execServiceOnRegion(HRegionServer.java:4336)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execService(HRegionServer.java:4318)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34964)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2059)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:126)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:152)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:128)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.io.InvalidClassException:
> org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream
> classdesc serialVersionUID = -8891652700267537109, local class
> serialVersionUID = -406124487097947
> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:699)
> at
> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1885)
> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1751)
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2042)
> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)
> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)
> at
> java.io.ObjectInputStream.readOrdinaryO
[jira] [Commented] (KYLIN-3874) "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
[
https://issues.apache.org/jira/browse/KYLIN-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794737#comment-16794737
]
ASF subversion and git services commented on KYLIN-3874:
Commit 9f7ec94c9dee4f0f0946318bff52a8e186c0da87 in kylin's branch
refs/heads/master from Guangxu Cheng
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=9f7ec94 ]
KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use
different HDFS clusters
> "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS
> clusters
> ---
>
> Key: KYLIN-3874
> URL: https://issues.apache.org/jira/browse/KYLIN-3874
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v2.6.2
>
>
> {panel:title=exception}
> 2019-03-14 16:33:45,113 INFO [main]
> org.apache.hadoop.service.AbstractService: Service
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state INITED; cause:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException:
> Couldn't create proxy provider class
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
> ...
> Caused by: java.lang.RuntimeException: Could not find any configured
> addresses for URI
> hdfs://{color:#ff}hbase-ns-test{color}/kylin/kylin_metadata/kylin-cd4db32e-42b6-44f2-7fa9-ef6c46334249/derived_meta_global/hfile
> at
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider.(ConfiguredFailoverProxyProvider.java:116)
> ... 31 more
> {panel}
> {color:#ff}hbase-ns-test{color} is the nameservice of HDFS which is used
> by HBase.
> In our kylin environment, HBase and MR/HIVE use different HDFS clusters.
> {code:java|title=CubeHFileJob.java|borderStyle=solid}
> // use current hbase configuration
> Configuration configuration = new
> Configuration(HBaseConnection.getCurrentHBaseConfiguration());
> merge(configuration, getConf());
> {code}
> "getConf()" contains only the HDFS configuration of MR, and "configuration"
> contains the HDFS configuration both HBase and MR. See:
> [HBaseConnection#addHBaseClusterNNHAConfiguration()|https://github.com/apache/kylin/blob/d23d2bddab3263d39059492b91f71d8091198057/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/HBaseConnection.java#L205]
> So "merge(configuration, getConf())" will lead to HBASE's HDFS configuration
> to be covered. Mainly parameter "dfs.nameservices"
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3874) "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
[
https://issues.apache.org/jira/browse/KYLIN-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794736#comment-16794736
]
ASF GitHub Bot commented on KYLIN-3874:
---
shaofengshi commented on pull request #516: KYLIN-3874 "Convert Cuboid Data to
HFile" failed when HBase and MR use different HDFS clusters
URL: https://github.com/apache/kylin/pull/516
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS
> clusters
> ---
>
> Key: KYLIN-3874
> URL: https://issues.apache.org/jira/browse/KYLIN-3874
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v2.6.2
>
>
> {panel:title=exception}
> 2019-03-14 16:33:45,113 INFO [main]
> org.apache.hadoop.service.AbstractService: Service
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state INITED; cause:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException:
> Couldn't create proxy provider class
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
> ...
> Caused by: java.lang.RuntimeException: Could not find any configured
> addresses for URI
> hdfs://{color:#ff}hbase-ns-test{color}/kylin/kylin_metadata/kylin-cd4db32e-42b6-44f2-7fa9-ef6c46334249/derived_meta_global/hfile
> at
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider.(ConfiguredFailoverProxyProvider.java:116)
> ... 31 more
> {panel}
> {color:#ff}hbase-ns-test{color} is the nameservice of HDFS which is used
> by HBase.
> In our kylin environment, HBase and MR/HIVE use different HDFS clusters.
> {code:java|title=CubeHFileJob.java|borderStyle=solid}
> // use current hbase configuration
> Configuration configuration = new
> Configuration(HBaseConnection.getCurrentHBaseConfiguration());
> merge(configuration, getConf());
> {code}
> "getConf()" contains only the HDFS configuration of MR, and "configuration"
> contains the HDFS configuration both HBase and MR. See:
> [HBaseConnection#addHBaseClusterNNHAConfiguration()|https://github.com/apache/kylin/blob/d23d2bddab3263d39059492b91f71d8091198057/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/HBaseConnection.java#L205]
> So "merge(configuration, getConf())" will lead to HBASE's HDFS configuration
> to be covered. Mainly parameter "dfs.nameservices"
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] [kylin] shaofengshi merged pull request #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
shaofengshi merged pull request #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters URL: https://github.com/apache/kylin/pull/516 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Assigned] (KYLIN-3880) DataType is incompatible in Kylin HBase coprocessor
[
https://issues.apache.org/jira/browse/KYLIN-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shaofeng SHI reassigned KYLIN-3880:
---
Assignee: Liu Shaohui
> DataType is incompatible in Kylin HBase coprocessor
> ---
>
> Key: KYLIN-3880
> URL: https://issues.apache.org/jira/browse/KYLIN-3880
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
>
> During upgrade kylin from 2.4.1 to 2.5.2, the query will failed for the
> incompatible class in Kylin HBase coprocessor
> {code:java}
> 2019-03-12,17:48:11,530 INFO
> [FifoRWQ.default.readRpcServer.handler=197,queue=13,port=24600]
> org.apache.hadoop.hdfs.DFSClient: Access token was invalid when connecting to
> /10.152.33.45:22402 :
> org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got
> access token error for OP_READ_BLOCK, self=/10.152.33.44:55387,
> remote=/10.152.33.45:22402, for file
> /hbase/zjyprc-xiaomi/data/miui_sec/data/4b88a72f5bd37daca00efb842e676ca8/C/6593503eb213431998db117cf3dab3a6,
> for pool BP-792581576-10.152.48.22-1510572454905 block 1899006034_825272806
> 2019-03-12,17:48:12,135 INFO
> [FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600]
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService:
> start query dc0fadcf-3689-5508-9a45-559aaebfd4e0 in thread
> FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600
> 2019-03-12,17:48:12,135 ERROR
> [FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600]
> org.apache.hadoop.ipc.RpcServer: Unexpected throwable object
> java.lang.RuntimeException: java.io.InvalidClassException:
> org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream
> classdesc serialVersionUID = -8891652700267537109, local class
> serialVersionUID = -406124487097947
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem.readDimensionEncoding(TrimmedCubeCodeSystem.java:87)
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:122)
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:91)
> at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:346)
> at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:307)
> at
> org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:466)
> at
> org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:412)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:259)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:6625)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execServiceOnRegion(HRegionServer.java:4336)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execService(HRegionServer.java:4318)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34964)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2059)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:126)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:152)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:128)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.io.InvalidClassException:
> org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream
> classdesc serialVersionUID = -8891652700267537109, local class
> serialVersionUID = -406124487097947
> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:699)
> at
> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1885)
> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1751)
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2042)
> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)
> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)
> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431)
> at
> org.apache.kylin.dimension.AbstractDateDimEnc.readExternal(AbstractDateDimEnc.java:137)
> at
> java.io.ObjectInputS
[jira] [Updated] (KYLIN-3874) "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
[
https://issues.apache.org/jira/browse/KYLIN-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shaofeng SHI updated KYLIN-3874:
Fix Version/s: v2.6.2
> "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS
> clusters
> ---
>
> Key: KYLIN-3874
> URL: https://issues.apache.org/jira/browse/KYLIN-3874
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v2.6.2
>
>
> {panel:title=exception}
> 2019-03-14 16:33:45,113 INFO [main]
> org.apache.hadoop.service.AbstractService: Service
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state INITED; cause:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException:
> Couldn't create proxy provider class
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
> ...
> Caused by: java.lang.RuntimeException: Could not find any configured
> addresses for URI
> hdfs://{color:#ff}hbase-ns-test{color}/kylin/kylin_metadata/kylin-cd4db32e-42b6-44f2-7fa9-ef6c46334249/derived_meta_global/hfile
> at
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider.(ConfiguredFailoverProxyProvider.java:116)
> ... 31 more
> {panel}
> {color:#ff}hbase-ns-test{color} is the nameservice of HDFS which is used
> by HBase.
> In our kylin environment, HBase and MR/HIVE use different HDFS clusters.
> {code:java|title=CubeHFileJob.java|borderStyle=solid}
> // use current hbase configuration
> Configuration configuration = new
> Configuration(HBaseConnection.getCurrentHBaseConfiguration());
> merge(configuration, getConf());
> {code}
> "getConf()" contains only the HDFS configuration of MR, and "configuration"
> contains the HDFS configuration both HBase and MR. See:
> [HBaseConnection#addHBaseClusterNNHAConfiguration()|https://github.com/apache/kylin/blob/d23d2bddab3263d39059492b91f71d8091198057/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/HBaseConnection.java#L205]
> So "merge(configuration, getConf())" will lead to HBASE's HDFS configuration
> to be covered. Mainly parameter "dfs.nameservices"
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] [kylin] shaofengshi commented on a change in pull request #502: KYLIN-3839 Strorage clean up after refreshing and deleting segment
shaofengshi commented on a change in pull request #502: KYLIN-3839 Strorage
clean up after refreshing and deleting segment
URL: https://github.com/apache/kylin/pull/502#discussion_r266297943
##
File path:
server-base/src/main/java/org/apache/kylin/rest/service/CubeService.java
##
@@ -550,7 +558,30 @@ public CubeInstance deleteSegment(CubeInstance cube,
String segmentName) throws
logger.warn(String.format(Locale.ROOT,
msg.getDELETE_SEGMENT_CAUSE_GAPS(), cube.getName(), segmentName));
}
-return
CubeManager.getInstance(getConfig()).updateCubeDropSegments(cube, toDelete);
+CubeInstance cubeInstance =
CubeManager.getInstance(getConfig()).updateCubeDropSegments(cube, toDelete);
+
+cleanSegmentStorage(Collections.singletonList(toDelete));
+
+return cubeInstance;
+}
+
+// clean segment data in hbase and hdfs
+private void cleanSegmentStorage(List toRemoveSegs) throws
IOException {
+if (KylinConfig.getInstanceFromEnv().cleanStorageAfterDelOperation()) {
+if (toRemoveSegs != null) {
+List toDropHTables =
Lists.newArrayListWithCapacity(toRemoveSegs.size());
+List toDelHDFSPaths =
Lists.newArrayListWithCapacity(toRemoveSegs.size());
+for (CubeSegment seg : toRemoveSegs) {
+toDropHTables.add(seg.getStorageLocationIdentifier());
+
toDelHDFSPaths.add(JobBuilderSupport.getJobWorkingDir(seg.getConfig().getHdfsWorkingDirectory(),
seg.getLastBuildJobID()));
+}
+
+if (!toRemoveSegs.isEmpty()) {
Review comment:
Please combine this line with the previous " if (toRemoveSegs != null)"
check.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] [kylin] shaofengshi commented on a change in pull request #502: KYLIN-3839 Strorage clean up after refreshing and deleting segment
shaofengshi commented on a change in pull request #502: KYLIN-3839 Strorage
clean up after refreshing and deleting segment
URL: https://github.com/apache/kylin/pull/502#discussion_r266297875
##
File path:
server-base/src/main/java/org/apache/kylin/rest/service/CubeService.java
##
@@ -550,7 +558,30 @@ public CubeInstance deleteSegment(CubeInstance cube,
String segmentName) throws
logger.warn(String.format(Locale.ROOT,
msg.getDELETE_SEGMENT_CAUSE_GAPS(), cube.getName(), segmentName));
}
-return
CubeManager.getInstance(getConfig()).updateCubeDropSegments(cube, toDelete);
+CubeInstance cubeInstance =
CubeManager.getInstance(getConfig()).updateCubeDropSegments(cube, toDelete);
+
+cleanSegmentStorage(Collections.singletonList(toDelete));
+
+return cubeInstance;
+}
+
+// clean segment data in hbase and hdfs
+private void cleanSegmentStorage(List toRemoveSegs) throws
IOException {
+if (KylinConfig.getInstanceFromEnv().cleanStorageAfterDelOperation()) {
Review comment:
If not enabled, directly return, to make the code more clear (less embed
logic);
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[jira] [Updated] (KYLIN-3880) DataType is incompatible in Kylin HBase coprocessor
[
https://issues.apache.org/jira/browse/KYLIN-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shaofeng SHI updated KYLIN-3880:
Fix Version/s: v2.6.2
> DataType is incompatible in Kylin HBase coprocessor
> ---
>
> Key: KYLIN-3880
> URL: https://issues.apache.org/jira/browse/KYLIN-3880
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
> Fix For: v2.6.2
>
>
> During upgrade kylin from 2.4.1 to 2.5.2, the query will failed for the
> incompatible class in Kylin HBase coprocessor
> {code:java}
> 2019-03-12,17:48:11,530 INFO
> [FifoRWQ.default.readRpcServer.handler=197,queue=13,port=24600]
> org.apache.hadoop.hdfs.DFSClient: Access token was invalid when connecting to
> /10.152.33.45:22402 :
> org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got
> access token error for OP_READ_BLOCK, self=/10.152.33.44:55387,
> remote=/10.152.33.45:22402, for file
> /hbase/zjyprc-xiaomi/data/miui_sec/data/4b88a72f5bd37daca00efb842e676ca8/C/6593503eb213431998db117cf3dab3a6,
> for pool BP-792581576-10.152.48.22-1510572454905 block 1899006034_825272806
> 2019-03-12,17:48:12,135 INFO
> [FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600]
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService:
> start query dc0fadcf-3689-5508-9a45-559aaebfd4e0 in thread
> FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600
> 2019-03-12,17:48:12,135 ERROR
> [FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600]
> org.apache.hadoop.ipc.RpcServer: Unexpected throwable object
> java.lang.RuntimeException: java.io.InvalidClassException:
> org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream
> classdesc serialVersionUID = -8891652700267537109, local class
> serialVersionUID = -406124487097947
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem.readDimensionEncoding(TrimmedCubeCodeSystem.java:87)
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:122)
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:91)
> at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:346)
> at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:307)
> at
> org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:466)
> at
> org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:412)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:259)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:6625)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execServiceOnRegion(HRegionServer.java:4336)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execService(HRegionServer.java:4318)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34964)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2059)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:126)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:152)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:128)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.io.InvalidClassException:
> org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream
> classdesc serialVersionUID = -8891652700267537109, local class
> serialVersionUID = -406124487097947
> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:699)
> at
> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1885)
> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1751)
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2042)
> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)
> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)
> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431)
> at
> org.apache.kylin.dimension.AbstractDateDimEnc.readExternal(AbstractDateDimEnc.java:137)
> a
[jira] [Commented] (KYLIN-3817) Duration in Cube building is a negative number
[ https://issues.apache.org/jira/browse/KYLIN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794692#comment-16794692 ] ASF subversion and git services commented on KYLIN-3817: Commit 008ed65750db6747c6fe46ef51af9458057d830f in kylin's branch refs/heads/2.6.x from Shaohui Liu [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=008ed65 ] KYLIN-3817: Duration in Cube building is a negative number > Duration in Cube building is a negative number > -- > > Key: KYLIN-3817 > URL: https://issues.apache.org/jira/browse/KYLIN-3817 > Project: Kylin > Issue Type: Bug >Affects Versions: v2.6.0 >Reporter: Na Zhai >Assignee: Liu Shaohui >Priority: Major > Fix For: v2.6.2 > > Attachments: Duration error.png > > > After building the cube for a few minutes, click the Refresh button and the > duration of the job becomes negative. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3880) DataType is incompatible in Kylin HBase coprocessor
[
https://issues.apache.org/jira/browse/KYLIN-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794693#comment-16794693
]
ASF GitHub Bot commented on KYLIN-3880:
---
lshmouse commented on pull request #527: KYLIN-3880: DataType is incompatible
in Kylin HBase coprocessor
URL: https://github.com/apache/kylin/pull/527
See: https://issues.apache.org/jira/browse/KYLIN-3880
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> DataType is incompatible in Kylin HBase coprocessor
> ---
>
> Key: KYLIN-3880
> URL: https://issues.apache.org/jira/browse/KYLIN-3880
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Priority: Major
>
> During upgrade kylin from 2.4.1 to 2.5.2, the query will failed for the
> incompatible class in Kylin HBase coprocessor
> {code:java}
> 2019-03-12,17:48:11,530 INFO
> [FifoRWQ.default.readRpcServer.handler=197,queue=13,port=24600]
> org.apache.hadoop.hdfs.DFSClient: Access token was invalid when connecting to
> /10.152.33.45:22402 :
> org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got
> access token error for OP_READ_BLOCK, self=/10.152.33.44:55387,
> remote=/10.152.33.45:22402, for file
> /hbase/zjyprc-xiaomi/data/miui_sec/data/4b88a72f5bd37daca00efb842e676ca8/C/6593503eb213431998db117cf3dab3a6,
> for pool BP-792581576-10.152.48.22-1510572454905 block 1899006034_825272806
> 2019-03-12,17:48:12,135 INFO
> [FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600]
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService:
> start query dc0fadcf-3689-5508-9a45-559aaebfd4e0 in thread
> FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600
> 2019-03-12,17:48:12,135 ERROR
> [FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600]
> org.apache.hadoop.ipc.RpcServer: Unexpected throwable object
> java.lang.RuntimeException: java.io.InvalidClassException:
> org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream
> classdesc serialVersionUID = -8891652700267537109, local class
> serialVersionUID = -406124487097947
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem.readDimensionEncoding(TrimmedCubeCodeSystem.java:87)
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:122)
> at
> org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:91)
> at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:346)
> at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:307)
> at
> org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:466)
> at
> org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:412)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:259)
> at
> org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:6625)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execServiceOnRegion(HRegionServer.java:4336)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execService(HRegionServer.java:4318)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34964)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2059)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:126)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:152)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:128)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.io.InvalidClassException:
> org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream
> classdesc serialVersionUID = -8891652700267537109, local class
> serialVersionUID = -406124487097947
> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:699)
> at
> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1885)
> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1751)
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2042)
> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
> at
>
[jira] [Assigned] (KYLIN-3882) kylin master build failed for pom issues
[
https://issues.apache.org/jira/browse/KYLIN-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shaofeng SHI reassigned KYLIN-3882:
---
Assignee: Liu Shaohui
> kylin master build failed for pom issues
>
>
> Key: KYLIN-3882
> URL: https://issues.apache.org/jira/browse/KYLIN-3882
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
>
> As title.
> 1, Kyligence repo id : nexus conflicts with local maven settings.xml
> {code:java}
> [ERROR] Failed to execute goal on project kylin-core-metadata: Could not
> resolve dependencies for project
> org.apache.kylin:kylin-core-metadata:jar:3.0.0-SNAPSHOT: Failure to find
> org.apache.calcite:calcite-core:jar:1.16.0-kylin-r2 in
> http://nexus.x./nexus/content/groups/public was cached in the local
> repository, resolution will not be reattempted until the update interval of
> nexus has elapsed or updates are forced -> [Help 1]
> {code}
>
> 2, maven.compiler.source/target is not set
> {code:java}
> [INFO] Compiling 2 Scala sources and 18 Java sources to
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/target/classes ...
> [WARNING] [Warn] : bootstrap class path not set in conjunction with -source
> 1.6
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkBatchCubingJobBuilder2.java:148:
> diamond operator is not supported in -source 1.6
> (use -source 7 or higher to enable diamond operator)
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkCubingByLayer.java:239:
> try-with-resources is not supported in -source 1.6
> (use -source 7 or higher to enable try-with-resources)
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkCubingByLayer.java:251:
> diamond operator is not supported in -source 1.6
> (use -source 7 or higher to enable diamond operator){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3882) kylin master build failed for pom issues
[
https://issues.apache.org/jira/browse/KYLIN-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794707#comment-16794707
]
ASF subversion and git services commented on KYLIN-3882:
Commit e16d2cfae1615fa18306ff378487627858afe8fa in kylin's branch
refs/heads/master from Liu Shaohui
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=e16d2cf ]
KYLIN-3882: kylin master build failed for pom issues
> kylin master build failed for pom issues
>
>
> Key: KYLIN-3882
> URL: https://issues.apache.org/jira/browse/KYLIN-3882
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Priority: Major
>
> As title.
> 1, Kyligence repo id : nexus conflicts with local maven settings.xml
> {code:java}
> [ERROR] Failed to execute goal on project kylin-core-metadata: Could not
> resolve dependencies for project
> org.apache.kylin:kylin-core-metadata:jar:3.0.0-SNAPSHOT: Failure to find
> org.apache.calcite:calcite-core:jar:1.16.0-kylin-r2 in
> http://nexus.x./nexus/content/groups/public was cached in the local
> repository, resolution will not be reattempted until the update interval of
> nexus has elapsed or updates are forced -> [Help 1]
> {code}
>
> 2, maven.compiler.source/target is not set
> {code:java}
> [INFO] Compiling 2 Scala sources and 18 Java sources to
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/target/classes ...
> [WARNING] [Warn] : bootstrap class path not set in conjunction with -source
> 1.6
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkBatchCubingJobBuilder2.java:148:
> diamond operator is not supported in -source 1.6
> (use -source 7 or higher to enable diamond operator)
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkCubingByLayer.java:239:
> try-with-resources is not supported in -source 1.6
> (use -source 7 or higher to enable try-with-resources)
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkCubingByLayer.java:251:
> diamond operator is not supported in -source 1.6
> (use -source 7 or higher to enable diamond operator){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3864) Provide a function to judge whether the os type is Mac os x or not
[ https://issues.apache.org/jira/browse/KYLIN-3864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3864: Fix Version/s: v3.0.0 > Provide a function to judge whether the os type is Mac os x or not > -- > > Key: KYLIN-3864 > URL: https://issues.apache.org/jira/browse/KYLIN-3864 > Project: Kylin > Issue Type: Improvement > Components: Environment >Reporter: vinoyang >Assignee: vinoyang >Priority: Major > Fix For: v3.0.0 > > > Currently, Kylin's related shell scripts cannot be run under Mac os x (some > commands cannot be supported). In order to be compatible with Mac os x > system, we need to first determine whether the current system environment is > Mac os x. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] shaofengshi merged pull request #526: KYLIN-3882: kylin master build failed for pom issues
shaofengshi merged pull request #526: KYLIN-3882: kylin master build failed for pom issues URL: https://github.com/apache/kylin/pull/526 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3882) kylin master build failed for pom issues
[
https://issues.apache.org/jira/browse/KYLIN-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794706#comment-16794706
]
ASF GitHub Bot commented on KYLIN-3882:
---
shaofengshi commented on pull request #526: KYLIN-3882: kylin master build
failed for pom issues
URL: https://github.com/apache/kylin/pull/526
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> kylin master build failed for pom issues
>
>
> Key: KYLIN-3882
> URL: https://issues.apache.org/jira/browse/KYLIN-3882
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Priority: Major
>
> As title.
> 1, Kyligence repo id : nexus conflicts with local maven settings.xml
> {code:java}
> [ERROR] Failed to execute goal on project kylin-core-metadata: Could not
> resolve dependencies for project
> org.apache.kylin:kylin-core-metadata:jar:3.0.0-SNAPSHOT: Failure to find
> org.apache.calcite:calcite-core:jar:1.16.0-kylin-r2 in
> http://nexus.x./nexus/content/groups/public was cached in the local
> repository, resolution will not be reattempted until the update interval of
> nexus has elapsed or updates are forced -> [Help 1]
> {code}
>
> 2, maven.compiler.source/target is not set
> {code:java}
> [INFO] Compiling 2 Scala sources and 18 Java sources to
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/target/classes ...
> [WARNING] [Warn] : bootstrap class path not set in conjunction with -source
> 1.6
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkBatchCubingJobBuilder2.java:148:
> diamond operator is not supported in -source 1.6
> (use -source 7 or higher to enable diamond operator)
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkCubingByLayer.java:239:
> try-with-resources is not supported in -source 1.6
> (use -source 7 or higher to enable try-with-resources)
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkCubingByLayer.java:251:
> diamond operator is not supported in -source 1.6
> (use -source 7 or higher to enable diamond operator){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Resolved] (KYLIN-3864) Provide a function to judge whether the os type is Mac os x or not
[ https://issues.apache.org/jira/browse/KYLIN-3864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI resolved KYLIN-3864. - Resolution: Fixed > Provide a function to judge whether the os type is Mac os x or not > -- > > Key: KYLIN-3864 > URL: https://issues.apache.org/jira/browse/KYLIN-3864 > Project: Kylin > Issue Type: Improvement > Components: Environment >Reporter: vinoyang >Assignee: vinoyang >Priority: Major > Fix For: v3.0.0 > > > Currently, Kylin's related shell scripts cannot be run under Mac os x (some > commands cannot be supported). In order to be compatible with Mac os x > system, we need to first determine whether the current system environment is > Mac os x. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3864) Provide a function to judge whether the os type is Mac os x or not
[ https://issues.apache.org/jira/browse/KYLIN-3864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794697#comment-16794697 ] ASF subversion and git services commented on KYLIN-3864: Commit aa61c1a062d8cb336c67df7803a09b52f139b643 in kylin's branch refs/heads/master from yanghua [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=aa61c1a ] KYLIN-3864 Provide a function to judge whether the os type is Mac os x or not > Provide a function to judge whether the os type is Mac os x or not > -- > > Key: KYLIN-3864 > URL: https://issues.apache.org/jira/browse/KYLIN-3864 > Project: Kylin > Issue Type: Improvement > Components: Environment >Reporter: vinoyang >Assignee: vinoyang >Priority: Major > > Currently, Kylin's related shell scripts cannot be run under Mac os x (some > commands cannot be supported). In order to be compatible with Mac os x > system, we need to first determine whether the current system environment is > Mac os x. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (KYLIN-3817) Duration in Cube building is a negative number
[ https://issues.apache.org/jira/browse/KYLIN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI resolved KYLIN-3817. - Resolution: Fixed > Duration in Cube building is a negative number > -- > > Key: KYLIN-3817 > URL: https://issues.apache.org/jira/browse/KYLIN-3817 > Project: Kylin > Issue Type: Bug >Affects Versions: v2.6.0 >Reporter: Na Zhai >Assignee: Liu Shaohui >Priority: Major > Fix For: v2.6.2 > > Attachments: Duration error.png > > > After building the cube for a few minutes, click the Refresh button and the > duration of the job becomes negative. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] shaofengshi commented on issue #509: KYLIN-3864 Provide a function to judge whether the os type is Mac os x or not
shaofengshi commented on issue #509: KYLIN-3864 Provide a function to judge whether the os type is Mac os x or not URL: https://github.com/apache/kylin/pull/509#issuecomment-473761504 I see, there will be subsequent changes based on this. I will merge it. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3864) Provide a function to judge whether the os type is Mac os x or not
[ https://issues.apache.org/jira/browse/KYLIN-3864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794696#comment-16794696 ] ASF GitHub Bot commented on KYLIN-3864: --- shaofengshi commented on pull request #509: KYLIN-3864 Provide a function to judge whether the os type is Mac os x or not URL: https://github.com/apache/kylin/pull/509 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Provide a function to judge whether the os type is Mac os x or not > -- > > Key: KYLIN-3864 > URL: https://issues.apache.org/jira/browse/KYLIN-3864 > Project: Kylin > Issue Type: Improvement > Components: Environment >Reporter: vinoyang >Assignee: vinoyang >Priority: Major > > Currently, Kylin's related shell scripts cannot be run under Mac os x (some > commands cannot be supported). In order to be compatible with Mac os x > system, we need to first determine whether the current system environment is > Mac os x. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] shaofengshi merged pull request #509: KYLIN-3864 Provide a function to judge whether the os type is Mac os x or not
shaofengshi merged pull request #509: KYLIN-3864 Provide a function to judge whether the os type is Mac os x or not URL: https://github.com/apache/kylin/pull/509 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #527: KYLIN-3880: DataType is incompatible in Kylin HBase coprocessor
asfgit commented on issue #527: KYLIN-3880: DataType is incompatible in Kylin HBase coprocessor URL: https://github.com/apache/kylin/pull/527#issuecomment-473761291 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #527: KYLIN-3880: DataType is incompatible in Kylin HBase coprocessor
asfgit commented on issue #527: KYLIN-3880: DataType is incompatible in Kylin HBase coprocessor URL: https://github.com/apache/kylin/pull/527#issuecomment-473761296 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] lshmouse opened a new pull request #527: KYLIN-3880: DataType is incompatible in Kylin HBase coprocessor
lshmouse opened a new pull request #527: KYLIN-3880: DataType is incompatible in Kylin HBase coprocessor URL: https://github.com/apache/kylin/pull/527 See: https://issues.apache.org/jira/browse/KYLIN-3880 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Assigned] (KYLIN-3817) Duration in Cube building is a negative number
[ https://issues.apache.org/jira/browse/KYLIN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI reassigned KYLIN-3817: --- Assignee: Liu Shaohui (was: Na Zhai) Thanks Shaohui for the fix! > Duration in Cube building is a negative number > -- > > Key: KYLIN-3817 > URL: https://issues.apache.org/jira/browse/KYLIN-3817 > Project: Kylin > Issue Type: Bug >Affects Versions: v2.6.0 >Reporter: Na Zhai >Assignee: Liu Shaohui >Priority: Major > Fix For: v2.6.2 > > Attachments: Duration error.png > > > After building the cube for a few minutes, click the Refresh button and the > duration of the job becomes negative. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3813) don't do push down when both of the children of CompareTupleFilter are CompareTupleFilter with column included
[
https://issues.apache.org/jira/browse/KYLIN-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhong Yanghong updated KYLIN-3813:
--
Description:
When dynamic column is enabled, kylin will try to push down group by case when
to hbase. However, in the following case, the push down should not be enabled,
since currently it's not well supported for CompareTupleFilter to have a child
of CompareTupleFilter.
Sample SQL:
{code}
select colA
case
when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
else 'n/a'
end as phase,
count(*)
from T
where session_date between '2018-08-01' and '2018-08-31'
group by colA
case
when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
else 'n/a'
end;
{code}
was:
When dynamic column is enabled, kylin will try to push down group by case when
to hbase. However, in the following case, the push down should not be enabled,
since currently it's not well supported for CompareTupleFilter to have a child
of CompareTupleFilter.
{code}
case when (colA = (1=1)) = (colB = (1=1)) then 'XXX'
{code}
> don't do push down when both of the children of CompareTupleFilter are
> CompareTupleFilter with column included
> --
>
> Key: KYLIN-3813
> URL: https://issues.apache.org/jira/browse/KYLIN-3813
> Project: Kylin
> Issue Type: Improvement
> Components: Query Engine
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Fix For: v3.0.0
>
>
> When dynamic column is enabled, kylin will try to push down group by case
> when to hbase. However, in the following case, the push down should not be
> enabled, since currently it's not well supported for CompareTupleFilter to
> have a child of CompareTupleFilter.
> Sample SQL:
> {code}
> select colA
>case
>when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
>when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
>else 'n/a'
>end as phase,
>count(*)
> from T
> where session_date between '2018-08-01' and '2018-08-31'
> group by colA
>case
>when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
>when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
>else 'n/a'
>end;
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3881) Calcite isolating expression with its condition may throw 'Division Undefined' exception
[
https://issues.apache.org/jira/browse/KYLIN-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhong Yanghong updated KYLIN-3881:
--
Description: (was: Sample SQLs:
{code}
select colA
case
when colB = (1 = 1) then 'B'
when colC = (1 = 1) then 'C'
when colD = (1 = 1) then 'D'
else 'n/a'
end as phase,
count(*)
from T
where session_date between '2018-08-01' and '2018-08-31'
group by colA
case
when colB = (1 = 1) then 'B'
when colC = (1 = 1) then 'C'
when colD = (1 = 1) then 'D'
else 'n/a'
end;
{code}
In the final result, all of the keys will become 'B'.
{code}
select colA
case
when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
else 'n/a'
end as phase,
count(*)
from T
where session_date between '2018-08-01' and '2018-08-31'
group by colA
case
when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
else 'n/a'
end;
{code})
> Calcite isolating expression with its condition may throw 'Division
> Undefined' exception
>
>
> Key: KYLIN-3881
> URL: https://issues.apache.org/jira/browse/KYLIN-3881
> Project: Kylin
> Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Fix For: v3.0.0
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3812) optimize the child CompareTupleFilter in a CompareTupleFilter
[
https://issues.apache.org/jira/browse/KYLIN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhong Yanghong updated KYLIN-3812:
--
Description:
Currently it's not well supported for CompareTupleFilter to have a child of
CompareTupleFilter. However, in some cases, it's better to support it.
{code}
where (colA = (1=1))
{code}
The *(1=1)* can be transformed to "true". And then this filter can be pushed
down to hbase. Otherwise, the filter *(colA = (1=1))* does not work in hbase.
And it may return incorrect results for the following SQL:
{code}
select colA
case
when colB = (1 = 1) then 'B'
when colC = (1 = 1) then 'C'
when colD = (1 = 1) then 'D'
else 'n/a'
end as phase,
count(*)
from T
where session_date between '2018-08-01' and '2018-08-31'
group by colA
case
when colB = (1 = 1) then 'B'
when colC = (1 = 1) then 'C'
when colD = (1 = 1) then 'D'
else 'n/a'
end;
{code}
In the final result, all of the keys will become 'B'.
was:
Currently it's not well supported for CompareTupleFilter to have a child of
CompareTupleFilter. However, in some cases, it's better to support it.
{code}
where (colA = (1=1))
{code}
The *(1=1)* can be transformed to "true". And then this filter can be pushed
down to hbase. Otherwise, the filter *(colA = (1=1))* does not work in hbase.
> optimize the child CompareTupleFilter in a CompareTupleFilter
> -
>
> Key: KYLIN-3812
> URL: https://issues.apache.org/jira/browse/KYLIN-3812
> Project: Kylin
> Issue Type: Improvement
> Components: Query Engine
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Fix For: v3.0.0
>
>
> Currently it's not well supported for CompareTupleFilter to have a child of
> CompareTupleFilter. However, in some cases, it's better to support it.
> {code}
> where (colA = (1=1))
> {code}
> The *(1=1)* can be transformed to "true". And then this filter can be pushed
> down to hbase. Otherwise, the filter *(colA = (1=1))* does not work in hbase.
> And it may return incorrect results for the following SQL:
> {code}
> select colA
>case
>when colB = (1 = 1) then 'B'
>when colC = (1 = 1) then 'C'
>when colD = (1 = 1) then 'D'
>else 'n/a'
>end as phase,
>count(*)
> from T
> where session_date between '2018-08-01' and '2018-08-31'
> group by colA
>case
>when colB = (1 = 1) then 'B'
>when colC = (1 = 1) then 'C'
>when colD = (1 = 1) then 'D'
>else 'n/a'
>end;
> {code}
> In the final result, all of the keys will become 'B'.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3812) optimize the child CompareTupleFilter in a CompareTupleFilter
[
https://issues.apache.org/jira/browse/KYLIN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhong Yanghong updated KYLIN-3812:
--
Fix Version/s: v3.0.0
> optimize the child CompareTupleFilter in a CompareTupleFilter
> -
>
> Key: KYLIN-3812
> URL: https://issues.apache.org/jira/browse/KYLIN-3812
> Project: Kylin
> Issue Type: Improvement
> Components: Query Engine
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Fix For: v3.0.0
>
>
> Currently it's not well supported for CompareTupleFilter to have a child of
> CompareTupleFilter. However, in some cases, it's better to support it.
> {code}
> where (colA = (1=1))
> {code}
> The *(1=1)* can be transformed to "true". And then this filter can be pushed
> down to hbase. Otherwise, the filter *(colA = (1=1))* does not work in hbase.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] [kylin] lshmouse opened a new pull request #526: KYLIN-3882: kylin master build failed for pom issues
lshmouse opened a new pull request #526: KYLIN-3882: kylin master build failed for pom issues URL: https://github.com/apache/kylin/pull/526 See: https://issues.apache.org/jira/browse/KYLIN-3882 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #526: KYLIN-3882: kylin master build failed for pom issues
asfgit commented on issue #526: KYLIN-3882: kylin master build failed for pom issues URL: https://github.com/apache/kylin/pull/526#issuecomment-473760059 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (KYLIN-3813) don't do push down when both of the children of CompareTupleFilter are CompareTupleFilter with column included
[
https://issues.apache.org/jira/browse/KYLIN-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhong Yanghong updated KYLIN-3813:
--
Fix Version/s: v3.0.0
> don't do push down when both of the children of CompareTupleFilter are
> CompareTupleFilter with column included
> --
>
> Key: KYLIN-3813
> URL: https://issues.apache.org/jira/browse/KYLIN-3813
> Project: Kylin
> Issue Type: Improvement
> Components: Query Engine
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Fix For: v3.0.0
>
>
> When dynamic column is enabled, kylin will try to push down group by case
> when to hbase. However, in the following case, the push down should not be
> enabled, since currently it's not well supported for CompareTupleFilter to
> have a child of CompareTupleFilter.
> {code}
> case when (colA = (1=1)) = (colB = (1=1)) then 'XXX'
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] [kylin] asfgit commented on issue #526: KYLIN-3882: kylin master build failed for pom issues
asfgit commented on issue #526: KYLIN-3882: kylin master build failed for pom issues URL: https://github.com/apache/kylin/pull/526#issuecomment-473760058 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3882) kylin master build failed for pom issues
[
https://issues.apache.org/jira/browse/KYLIN-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794685#comment-16794685
]
ASF GitHub Bot commented on KYLIN-3882:
---
lshmouse commented on pull request #526: KYLIN-3882: kylin master build failed
for pom issues
URL: https://github.com/apache/kylin/pull/526
See: https://issues.apache.org/jira/browse/KYLIN-3882
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> kylin master build failed for pom issues
>
>
> Key: KYLIN-3882
> URL: https://issues.apache.org/jira/browse/KYLIN-3882
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Priority: Major
>
> As title.
> 1, Kyligence repo id : nexus conflicts with local maven settings.xml
> {code:java}
> [ERROR] Failed to execute goal on project kylin-core-metadata: Could not
> resolve dependencies for project
> org.apache.kylin:kylin-core-metadata:jar:3.0.0-SNAPSHOT: Failure to find
> org.apache.calcite:calcite-core:jar:1.16.0-kylin-r2 in
> http://nexus.x./nexus/content/groups/public was cached in the local
> repository, resolution will not be reattempted until the update interval of
> nexus has elapsed or updates are forced -> [Help 1]
> {code}
>
> 2, maven.compiler.source/target is not set
> {code:java}
> [INFO] Compiling 2 Scala sources and 18 Java sources to
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/target/classes ...
> [WARNING] [Warn] : bootstrap class path not set in conjunction with -source
> 1.6
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkBatchCubingJobBuilder2.java:148:
> diamond operator is not supported in -source 1.6
> (use -source 7 or higher to enable diamond operator)
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkCubingByLayer.java:239:
> try-with-resources is not supported in -source 1.6
> (use -source 7 or higher to enable try-with-resources)
> [ERROR] [Error]
> /ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkCubingByLayer.java:251:
> diamond operator is not supported in -source 1.6
> (use -source 7 or higher to enable diamond operator){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3881) Calcite isolating expression with its condition may throw 'Division Undefined' exception
[
https://issues.apache.org/jira/browse/KYLIN-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhong Yanghong updated KYLIN-3881:
--
Summary: Calcite isolating expression with its condition may throw
'Division Undefined' exception (was: Kylin may return incorrect results when
there's a CompareTupleFilter, like colName = (1 = 1) )
> Calcite isolating expression with its condition may throw 'Division
> Undefined' exception
>
>
> Key: KYLIN-3881
> URL: https://issues.apache.org/jira/browse/KYLIN-3881
> Project: Kylin
> Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Fix For: v3.0.0
>
>
> Sample SQLs:
> {code}
> select colA
>case
>when colB = (1 = 1) then 'B'
>when colC = (1 = 1) then 'C'
>when colD = (1 = 1) then 'D'
>else 'n/a'
>end as phase,
>count(*)
> from T
> where session_date between '2018-08-01' and '2018-08-31'
> group by colA
>case
>when colB = (1 = 1) then 'B'
>when colC = (1 = 1) then 'C'
>when colD = (1 = 1) then 'D'
>else 'n/a'
>end;
> {code}
> In the final result, all of the keys will become 'B'.
> {code}
> select colA
>case
>when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
>when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
>else 'n/a'
>end as phase,
>count(*)
> from T
> where session_date between '2018-08-01' and '2018-08-31'
> group by colA
>case
>when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
>when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
>else 'n/a'
>end;
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (KYLIN-3882) kylin master build failed for pom issues
Liu Shaohui created KYLIN-3882:
--
Summary: kylin master build failed for pom issues
Key: KYLIN-3882
URL: https://issues.apache.org/jira/browse/KYLIN-3882
Project: Kylin
Issue Type: Bug
Reporter: Liu Shaohui
As title.
1, Kyligence repo id : nexus conflicts with local maven settings.xml
{code:java}
[ERROR] Failed to execute goal on project kylin-core-metadata: Could not
resolve dependencies for project
org.apache.kylin:kylin-core-metadata:jar:3.0.0-SNAPSHOT: Failure to find
org.apache.calcite:calcite-core:jar:1.16.0-kylin-r2 in
http://nexus.x./nexus/content/groups/public was cached in the local
repository, resolution will not be reattempted until the update interval of
nexus has elapsed or updates are forced -> [Help 1]
{code}
2, maven.compiler.source/target is not set
{code:java}
[INFO] Compiling 2 Scala sources and 18 Java sources to
/ssd/liushaohui/workspace/computing/kylin/engine-spark/target/classes ...
[WARNING] [Warn] : bootstrap class path not set in conjunction with -source 1.6
[ERROR] [Error]
/ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkBatchCubingJobBuilder2.java:148:
diamond operator is not supported in -source 1.6
(use -source 7 or higher to enable diamond operator)
[ERROR] [Error]
/ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkCubingByLayer.java:239:
try-with-resources is not supported in -source 1.6
(use -source 7 or higher to enable try-with-resources)
[ERROR] [Error]
/ssd/liushaohui/workspace/computing/kylin/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkCubingByLayer.java:251:
diamond operator is not supported in -source 1.6
(use -source 7 or higher to enable diamond operator){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Closed] (KYLIN-3827) kylin 某一字段必须使用trim才可以查出来
[
https://issues.apache.org/jira/browse/KYLIN-3827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shaofeng SHI closed KYLIN-3827.
---
> kylin 某一字段必须使用trim才可以查出来
>
>
> Key: KYLIN-3827
> URL: https://issues.apache.org/jira/browse/KYLIN-3827
> Project: Kylin
> Issue Type: Bug
>Affects Versions: v2.5.1
>Reporter: litewood
>Priority: Major
> Attachments: image-2019-03-04-14-51-50-736.png,
> image-2019-03-04-14-52-35-683.png
>
>
> SELECT pt ,pageid from st.ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1 where pt =
> '20190114' and pageid='用户标签文档' GROUP BY pt,pageid;
> 当前sql 使用hive查询可以查出来结果。
> 但是使用kylin接口查询，除去一个近视去重选用全局字段的cube能查询出来，其他cube 必须trim(pageid) 或者使用like
> 关键字才能查出来。下面帖出三个cube信息。
>
> {color:#FF}可以查出来的cube info （近视去重）{color}
> {
> "uuid": "ad8cbc65-dd6c-8c12-7d18-2f625cedf7ea",
> "last_modified": 1550719049143,
> "version": "2.5.1.20500",
> "name": "c_pageview",
> "is_draft": false,
> "model_name": "m_bury_point_analysis",
> "description": "c_pageview",
> "null_string": null,
> "dimensions": [
> \{
> "name": "APPTYPE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "APPTYPE",
> "derived": null
> },
> \{
> "name": "PLATFORM",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "PLATFORM",
> "derived": null
> },
> \{
> "name": "UTM_SOURCE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "UTM_SOURCE",
> "derived": null
> },
> \{
> "name": "ADCODE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "ADCODE",
> "derived": null
> },
> \{
> "name": "ADDITIONTYPE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "ADDITIONTYPE",
> "derived": null
> },
> \{
> "name": "ADDITIONVALUE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "ADDITIONVALUE",
> "derived": null
> },
> \{
> "name": "APPVERSION",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "APPVERSION",
> "derived": null
> },
> \{
> "name": "CATEGORYID",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "CATEGORYID",
> "derived": null
> },
> \{
> "name": "CITYCODE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "CITYCODE",
> "derived": null
> },
> \{
> "name": "FLAGVALUE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "FLAGVALUE",
> "derived": null
> },
> \{
> "name": "PAGEID",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "PAGEID",
> "derived": null
> },
> \{
> "name": "H_DATE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "H_DATE",
> "derived": null
> },
> \{
> "name": "PT",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "PT",
> "derived": null
> },
> \{
> "name": "WEEKYTH_CNT_CN",
> "table": "DIM_PUB_DATE",
> "column": null,
> "derived": [
> "WEEKYTH_CNT_CN"
> ]
> },
> \{
> "name": "WEEKYTH_START_DATA_CN",
> "table": "DIM_PUB_DATE",
> "column": null,
> "derived": [
> "WEEKYTH_START_DATA_CN"
> ]
> },
> \{
> "name": "WEEKYTH_END_DATA_CN",
> "table": "DIM_PUB_DATE",
> "column": null,
> "derived": [
> "WEEKYTH_END_DATA_CN"
> ]
> }
> ],
> "measures": [
> \{
> "name": "PV",
> "function": {
> "expression": "COUNT",
> "parameter": {
> "type": "constant",
> "value": "1"
> },
> "returntype": "bigint"
> }
> },
> \{
> "name": "UV",
> "function": {
> "expression": "COUNT_DISTINCT",
> "parameter": {
> "type": "column",
> "value": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1.USERGUID"
> },
> "returntype": "hllc(16)"
> }
> },
> \{
> "name": "DUV",
> "function": {
> "expression": "COUNT_DISTINCT",
> "parameter": {
> "type": "column",
> "value": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1.SSID"
> },
> "returntype": "hllc(16)"
> }
> }
> ],
> "dictionaries": [],
> "rowkey": \{
> "rowkey_columns": [
> {
> "column": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1.PT",
> "encoding": "dict",
> "encoding_version": 1,
> "isShardBy": false
> },
> \{
> "column": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1.H_DATE",
> "encoding": "dict",
> "encoding_version": 1,
> "isShardBy": false
>
[jira] [Resolved] (KYLIN-3827) kylin 某一字段必须使用trim才可以查出来
[
https://issues.apache.org/jira/browse/KYLIN-3827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shaofeng SHI resolved KYLIN-3827.
-
Resolution: Resolved
> kylin 某一字段必须使用trim才可以查出来
>
>
> Key: KYLIN-3827
> URL: https://issues.apache.org/jira/browse/KYLIN-3827
> Project: Kylin
> Issue Type: Bug
>Affects Versions: v2.5.1
>Reporter: litewood
>Priority: Major
> Attachments: image-2019-03-04-14-51-50-736.png,
> image-2019-03-04-14-52-35-683.png
>
>
> SELECT pt ,pageid from st.ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1 where pt =
> '20190114' and pageid='用户标签文档' GROUP BY pt,pageid;
> 当前sql 使用hive查询可以查出来结果。
> 但是使用kylin接口查询，除去一个近视去重选用全局字段的cube能查询出来，其他cube 必须trim(pageid) 或者使用like
> 关键字才能查出来。下面帖出三个cube信息。
>
> {color:#FF}可以查出来的cube info （近视去重）{color}
> {
> "uuid": "ad8cbc65-dd6c-8c12-7d18-2f625cedf7ea",
> "last_modified": 1550719049143,
> "version": "2.5.1.20500",
> "name": "c_pageview",
> "is_draft": false,
> "model_name": "m_bury_point_analysis",
> "description": "c_pageview",
> "null_string": null,
> "dimensions": [
> \{
> "name": "APPTYPE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "APPTYPE",
> "derived": null
> },
> \{
> "name": "PLATFORM",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "PLATFORM",
> "derived": null
> },
> \{
> "name": "UTM_SOURCE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "UTM_SOURCE",
> "derived": null
> },
> \{
> "name": "ADCODE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "ADCODE",
> "derived": null
> },
> \{
> "name": "ADDITIONTYPE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "ADDITIONTYPE",
> "derived": null
> },
> \{
> "name": "ADDITIONVALUE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "ADDITIONVALUE",
> "derived": null
> },
> \{
> "name": "APPVERSION",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "APPVERSION",
> "derived": null
> },
> \{
> "name": "CATEGORYID",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "CATEGORYID",
> "derived": null
> },
> \{
> "name": "CITYCODE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "CITYCODE",
> "derived": null
> },
> \{
> "name": "FLAGVALUE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "FLAGVALUE",
> "derived": null
> },
> \{
> "name": "PAGEID",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "PAGEID",
> "derived": null
> },
> \{
> "name": "H_DATE",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "H_DATE",
> "derived": null
> },
> \{
> "name": "PT",
> "table": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1",
> "column": "PT",
> "derived": null
> },
> \{
> "name": "WEEKYTH_CNT_CN",
> "table": "DIM_PUB_DATE",
> "column": null,
> "derived": [
> "WEEKYTH_CNT_CN"
> ]
> },
> \{
> "name": "WEEKYTH_START_DATA_CN",
> "table": "DIM_PUB_DATE",
> "column": null,
> "derived": [
> "WEEKYTH_START_DATA_CN"
> ]
> },
> \{
> "name": "WEEKYTH_END_DATA_CN",
> "table": "DIM_PUB_DATE",
> "column": null,
> "derived": [
> "WEEKYTH_END_DATA_CN"
> ]
> }
> ],
> "measures": [
> \{
> "name": "PV",
> "function": {
> "expression": "COUNT",
> "parameter": {
> "type": "constant",
> "value": "1"
> },
> "returntype": "bigint"
> }
> },
> \{
> "name": "UV",
> "function": {
> "expression": "COUNT_DISTINCT",
> "parameter": {
> "type": "column",
> "value": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1.USERGUID"
> },
> "returntype": "hllc(16)"
> }
> },
> \{
> "name": "DUV",
> "function": {
> "expression": "COUNT_DISTINCT",
> "parameter": {
> "type": "column",
> "value": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1.SSID"
> },
> "returntype": "hllc(16)"
> }
> }
> ],
> "dictionaries": [],
> "rowkey": \{
> "rowkey_columns": [
> {
> "column": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1.PT",
> "encoding": "dict",
> "encoding_version": 1,
> "isShardBy": false
> },
> \{
> "column": "ST_T_BIKE_YUKON_PRO_PAGEVIEW_CLEAN1.H_DATE",
> "encoding": "dict",
> "encoding_version": 1,
>
[jira] [Updated] (KYLIN-3821) Expose real-time streaming data consuming lag info
[ https://issues.apache.org/jira/browse/KYLIN-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3821: Fix Version/s: v3.0.0 > Expose real-time streaming data consuming lag info > -- > > Key: KYLIN-3821 > URL: https://issues.apache.org/jira/browse/KYLIN-3821 > Project: Kylin > Issue Type: Improvement > Components: Real-time Streaming >Reporter: Ma Gang >Assignee: XiaoXiang Yu >Priority: Major > Fix For: v3.0.0 > > > Expose real-time streaming data consuming lag info, so that user can easily > know the lag information. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] yanghua commented on issue #509: KYLIN-3864 Provide a function to judge whether the os type is Mac os x or not
yanghua commented on issue #509: KYLIN-3864 Provide a function to judge whether the os type is Mac os x or not URL: https://github.com/apache/kylin/pull/509#issuecomment-473759267 Hi @shaofengshi Now, In kylin project, there are many places where the code would check the os type is **Darwin** (Mac os X) such as `download-spark.sh`, `download-flink.sh`, `tool-wrapper.sh`. And there are some places where Kylin is not compatible with Mac os X (it does not check the os type), it caused some errors, such as [KYLIN-3756](https://issues.apache.org/jira/browse/KYLIN-3756) and [KYLIN-3757](https://issues.apache.org/jira/browse/KYLIN-3757). This util method provides a general function to verify whether the current os type is Mac os X or not. By providing this function, we can do generic checking for the different `like-UNIX` os, and fix those compatible issues existing in the shell script. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (KYLIN-3881) Kylin may return incorrect results when there's a CompareTupleFilter, like colName = (1 = 1)
[
https://issues.apache.org/jira/browse/KYLIN-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhong Yanghong updated KYLIN-3881:
--
Description:
Sample SQLs:
{code}
select colA
case
when colB = (1 = 1) then 'B'
when colC = (1 = 1) then 'C'
when colD = (1 = 1) then 'D'
else 'n/a'
end as phase,
count(*)
from T
where session_date between '2018-08-01' and '2018-08-31'
group by colA
case
when colB = (1 = 1) then 'B'
when colC = (1 = 1) then 'C'
when colD = (1 = 1) then 'D'
else 'n/a'
end;
{code}
In the final result, all of the keys will become 'B'.
{code}
select colA
case
when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
else 'n/a'
end as phase,
count(*)
from T
where session_date between '2018-08-01' and '2018-08-31'
group by colA
case
when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
else 'n/a'
end;
{code}
was:
Sample SQLs:
{code}
select colA
case
when colB = (1 = 1) then 'B'
when colC = (1 = 1) then 'C'
when colD = (1 = 1) then 'D'
else 'n/a'
end as phase,
count(*)
from T
where session_date between '2018-08-01' and '2018-08-31'
group by colA
case
when colB = (1 = 1) then 'B'
when colC = (1 = 1) then 'C'
when colD = (1 = 1) then 'D'
else 'n/a'
end;
{code}
{code}
select colA
case
when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
else 'n/a'
end as phase,
count(*)
from T
where session_date between '2018-08-01' and '2018-08-31'
group by colA
case
when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
else 'n/a'
end;
{code}
> Kylin may return incorrect results when there's a CompareTupleFilter, like
> colName = (1 = 1)
> -
>
> Key: KYLIN-3881
> URL: https://issues.apache.org/jira/browse/KYLIN-3881
> Project: Kylin
> Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Fix For: v3.0.0
>
>
> Sample SQLs:
> {code}
> select colA
>case
>when colB = (1 = 1) then 'B'
>when colC = (1 = 1) then 'C'
>when colD = (1 = 1) then 'D'
>else 'n/a'
>end as phase,
>count(*)
> from T
> where session_date between '2018-08-01' and '2018-08-31'
> group by colA
>case
>when colB = (1 = 1) then 'B'
>when colC = (1 = 1) then 'C'
>when colD = (1 = 1) then 'D'
>else 'n/a'
>end;
> {code}
> In the final result, all of the keys will become 'B'.
> {code}
> select colA
>case
>when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
>when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
>else 'n/a'
>end as phase,
>count(*)
> from T
> where session_date between '2018-08-01' and '2018-08-31'
> group by colA
>case
>when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
>when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
>else 'n/a'
>end;
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3881) Kylin may return incorrect results when there's a CompareTupleFilter, like colName = (1 = 1)
[
https://issues.apache.org/jira/browse/KYLIN-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhong Yanghong updated KYLIN-3881:
--
Description:
Sample SQLs:
{code}
select colA
case
when colB = (1 = 1) then 'B'
when colC = (1 = 1) then 'C'
when colD = (1 = 1) then 'D'
else 'n/a'
end as phase,
count(*)
from T
where session_date between '2018-08-01' and '2018-08-31'
group by colA
case
when colB = (1 = 1) then 'B'
when colC = (1 = 1) then 'C'
when colD = (1 = 1) then 'D'
else 'n/a'
end;
{code}
{code}
select colA
case
when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
else 'n/a'
end as phase,
count(*)
from T
where session_date between '2018-08-01' and '2018-08-31'
group by colA
case
when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
else 'n/a'
end;
{code}
> Kylin may return incorrect results when there's a CompareTupleFilter, like
> colName = (1 = 1)
> -
>
> Key: KYLIN-3881
> URL: https://issues.apache.org/jira/browse/KYLIN-3881
> Project: Kylin
> Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
>
> Sample SQLs:
> {code}
> select colA
>case
>when colB = (1 = 1) then 'B'
>when colC = (1 = 1) then 'C'
>when colD = (1 = 1) then 'D'
>else 'n/a'
>end as phase,
>count(*)
> from T
> where session_date between '2018-08-01' and '2018-08-31'
> group by colA
>case
>when colB = (1 = 1) then 'B'
>when colC = (1 = 1) then 'C'
>when colD = (1 = 1) then 'D'
>else 'n/a'
>end;
> {code}
> {code}
> select colA
>case
>when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
>when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
>else 'n/a'
>end as phase,
>count(*)
> from T
> where session_date between '2018-08-01' and '2018-08-31'
> group by colA
>case
>when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
>when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
>else 'n/a'
>end;
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3881) Kylin may return incorrect results when there's a CompareTupleFilter, like colName = (1 = 1)
[
https://issues.apache.org/jira/browse/KYLIN-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhong Yanghong updated KYLIN-3881:
--
Fix Version/s: v3.0.0
> Kylin may return incorrect results when there's a CompareTupleFilter, like
> colName = (1 = 1)
> -
>
> Key: KYLIN-3881
> URL: https://issues.apache.org/jira/browse/KYLIN-3881
> Project: Kylin
> Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Fix For: v3.0.0
>
>
> Sample SQLs:
> {code}
> select colA
>case
>when colB = (1 = 1) then 'B'
>when colC = (1 = 1) then 'C'
>when colD = (1 = 1) then 'D'
>else 'n/a'
>end as phase,
>count(*)
> from T
> where session_date between '2018-08-01' and '2018-08-31'
> group by colA
>case
>when colB = (1 = 1) then 'B'
>when colC = (1 = 1) then 'C'
>when colD = (1 = 1) then 'D'
>else 'n/a'
>end;
> {code}
> {code}
> select colA
>case
>when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
>when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
>else 'n/a'
>end as phase,
>count(*)
> from T
> where session_date between '2018-08-01' and '2018-08-31'
> group by colA
>case
>when (colB = (1 = 1)) = (colC = (1 = 1)) then 'B&C'
>when (colC = (1 = 1)) = (colD = (1 = 1)) then 'C&D'
>else 'n/a'
>end;
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (KYLIN-3881) Kylin may return incorrect results when there's a CompareTupleFilter, like colName = (1 = 1)
Zhong Yanghong created KYLIN-3881: - Summary: Kylin may return incorrect results when there's a CompareTupleFilter, like colName = (1 = 1) Key: KYLIN-3881 URL: https://issues.apache.org/jira/browse/KYLIN-3881 Project: Kylin Issue Type: Bug Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] shaofengshi commented on issue #509: KYLIN-3864 Provide a function to judge whether the os type is Mac os x or not
shaofengshi commented on issue #509: KYLIN-3864 Provide a function to judge whether the os type is Mac os x or not URL: https://github.com/apache/kylin/pull/509#issuecomment-473755179 Hi Hua, which script will use this? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3817) Duration in Cube building is a negative number
[ https://issues.apache.org/jira/browse/KYLIN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794677#comment-16794677 ] ASF subversion and git services commented on KYLIN-3817: Commit 90879fbd0904c5f77836e0418fabbec38a4e0fa2 in kylin's branch refs/heads/master from Shaohui Liu [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=90879fb ] KYLIN-3817: Duration in Cube building is a negative number > Duration in Cube building is a negative number > -- > > Key: KYLIN-3817 > URL: https://issues.apache.org/jira/browse/KYLIN-3817 > Project: Kylin > Issue Type: Bug >Affects Versions: v2.6.0 >Reporter: Na Zhai >Assignee: Na Zhai >Priority: Major > Fix For: v2.6.2 > > Attachments: Duration error.png > > > After building the cube for a few minutes, click the Refresh button and the > duration of the job becomes negative. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3817) Duration in Cube building is a negative number
[ https://issues.apache.org/jira/browse/KYLIN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794676#comment-16794676 ] ASF GitHub Bot commented on KYLIN-3817: --- shaofengshi commented on pull request #522: KYLIN-3817: Duration in Cube building is a negative number URL: https://github.com/apache/kylin/pull/522 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Duration in Cube building is a negative number > -- > > Key: KYLIN-3817 > URL: https://issues.apache.org/jira/browse/KYLIN-3817 > Project: Kylin > Issue Type: Bug >Affects Versions: v2.6.0 >Reporter: Na Zhai >Assignee: Na Zhai >Priority: Major > Fix For: v2.6.2 > > Attachments: Duration error.png > > > After building the cube for a few minutes, click the Refresh button and the > duration of the job becomes negative. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3869) Implement Flink batch merge job builder
[ https://issues.apache.org/jira/browse/KYLIN-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794675#comment-16794675 ] ASF subversion and git services commented on KYLIN-3869: Commit e9b520b3c8c89419f757a2b7fcf6a34a66ae4acb in kylin's branch refs/heads/engine-flink from yanghua [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=e9b520b ] KYLIN-3869 Implement Flink batch merge job builder > Implement Flink batch merge job builder > --- > > Key: KYLIN-3869 > URL: https://issues.apache.org/jira/browse/KYLIN-3869 > Project: Kylin > Issue Type: Sub-task > Components: Flink Engine >Reporter: vinoyang >Assignee: vinoyang >Priority: Major > > The builder used to config cube merge steps. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] shaofengshi merged pull request #522: KYLIN-3817: Duration in Cube building is a negative number
shaofengshi merged pull request #522: KYLIN-3817: Duration in Cube building is a negative number URL: https://github.com/apache/kylin/pull/522 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3869) Implement Flink batch merge job builder
[ https://issues.apache.org/jira/browse/KYLIN-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794674#comment-16794674 ] ASF GitHub Bot commented on KYLIN-3869: --- shaofengshi commented on pull request #523: KYLIN-3869 Implement Flink batch merge job builder URL: https://github.com/apache/kylin/pull/523 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Implement Flink batch merge job builder > --- > > Key: KYLIN-3869 > URL: https://issues.apache.org/jira/browse/KYLIN-3869 > Project: Kylin > Issue Type: Sub-task > Components: Flink Engine >Reporter: vinoyang >Assignee: vinoyang >Priority: Major > > The builder used to config cube merge steps. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3879) Implement FlinkEntry
[ https://issues.apache.org/jira/browse/KYLIN-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794672#comment-16794672 ] ASF subversion and git services commented on KYLIN-3879: Commit 277f21f5b3b56c9a24750440cc798c187aac0783 in kylin's branch refs/heads/engine-flink from yanghua [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=277f21f ] KYLIN-3879 Implement FlinkEntry > Implement FlinkEntry > > > Key: KYLIN-3879 > URL: https://issues.apache.org/jira/browse/KYLIN-3879 > Project: Kylin > Issue Type: Sub-task > Components: Flink Engine >Reporter: vinoyang >Assignee: vinoyang >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] shaofengshi merged pull request #523: KYLIN-3869 Implement Flink batch merge job builder
shaofengshi merged pull request #523: KYLIN-3869 Implement Flink batch merge job builder URL: https://github.com/apache/kylin/pull/523 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3879) Implement FlinkEntry
[ https://issues.apache.org/jira/browse/KYLIN-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794671#comment-16794671 ] ASF GitHub Bot commented on KYLIN-3879: --- shaofengshi commented on pull request #525: KYLIN-3879 Implement FlinkEntry URL: https://github.com/apache/kylin/pull/525 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Implement FlinkEntry > > > Key: KYLIN-3879 > URL: https://issues.apache.org/jira/browse/KYLIN-3879 > Project: Kylin > Issue Type: Sub-task > Components: Flink Engine >Reporter: vinoyang >Assignee: vinoyang >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] shaofengshi merged pull request #525: KYLIN-3879 Implement FlinkEntry
shaofengshi merged pull request #525: KYLIN-3879 Implement FlinkEntry URL: https://github.com/apache/kylin/pull/525 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Created] (KYLIN-3880) DataType is incompatible in Kylin HBase coprocessor
Liu Shaohui created KYLIN-3880:
--
Summary: DataType is incompatible in Kylin HBase coprocessor
Key: KYLIN-3880
URL: https://issues.apache.org/jira/browse/KYLIN-3880
Project: Kylin
Issue Type: Bug
Reporter: Liu Shaohui
During upgrade kylin from 2.4.1 to 2.5.2, the query will failed for the
incompatible class in Kylin HBase coprocessor
{code:java}
2019-03-12,17:48:11,530 INFO
[FifoRWQ.default.readRpcServer.handler=197,queue=13,port=24600]
org.apache.hadoop.hdfs.DFSClient: Access token was invalid when connecting to
/10.152.33.45:22402 :
org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got
access token error for OP_READ_BLOCK, self=/10.152.33.44:55387,
remote=/10.152.33.45:22402, for file
/hbase/zjyprc-xiaomi/data/miui_sec/data/4b88a72f5bd37daca00efb842e676ca8/C/6593503eb213431998db117cf3dab3a6,
for pool BP-792581576-10.152.48.22-1510572454905 block 1899006034_825272806
2019-03-12,17:48:12,135 INFO
[FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600]
org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService:
start query dc0fadcf-3689-5508-9a45-559aaebfd4e0 in thread
FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600
2019-03-12,17:48:12,135 ERROR
[FifoRWQ.default.readRpcServer.handler=231,queue=15,port=24600]
org.apache.hadoop.ipc.RpcServer: Unexpected throwable object
java.lang.RuntimeException: java.io.InvalidClassException:
org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream
classdesc serialVersionUID = -8891652700267537109, local class serialVersionUID
= -406124487097947
at
org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem.readDimensionEncoding(TrimmedCubeCodeSystem.java:87)
at
org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:122)
at
org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem$1.deserialize(TrimmedCubeCodeSystem.java:91)
at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:346)
at org.apache.kylin.gridtable.GTInfo$1.deserialize(GTInfo.java:307)
at
org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:466)
at
org.apache.kylin.gridtable.GTScanRequest$2.deserialize(GTScanRequest.java:412)
at
org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:259)
at
org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:)
at
org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:6625)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.execServiceOnRegion(HRegionServer.java:4336)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.execService(HRegionServer.java:4318)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34964)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2059)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:126)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:152)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:128)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.InvalidClassException:
org.apache.kylin.metadata.datatype.DataType; local class incompatible: stream
classdesc serialVersionUID = -8891652700267537109, local class serialVersionUID
= -406124487097947
at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:699)
at
java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1885)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1751)
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2042)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431)
at
org.apache.kylin.dimension.AbstractDateDimEnc.readExternal(AbstractDateDimEnc.java:137)
at
java.io.ObjectInputStream.readExternalData(ObjectInputStream.java:2118)
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2067)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431)
at
org.apache.kylin.cube.gridtable.TrimmedCubeCodeSystem.
