[
https://issues.apache.org/jira/browse/KYLIN-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15238392#comment-15238392
]
hongbin ma commented on KYLIN-1077:
-----------------------------------
Today we leveraged the TableSignature of managed table to avoid duplication in
snapshots. If you use the temporal CTAS table and delete it later in the clean
up job, you'll end up duplicating snapshots for the same look up view. Although
it is not a show stop issue, it's worthwhile to overwrite the getTableSignature
logic for CTAS table(actually the view table), maybe by saving all the
TableSignatures of the managed tables that compose the view? Just a treat it as
a reminder
> Support Hive View as Lookup Table
> ---------------------------------
>
> Key: KYLIN-1077
> URL: https://issues.apache.org/jira/browse/KYLIN-1077
> Project: Kylin
> Issue Type: Improvement
> Affects Versions: v1.1
> Reporter: Francesco Palmiotto
> Assignee: Shaofeng SHI
> Labels: newbie
>
> If we use a view as a lookup table the cube building job fails when executing
> the 3rd step (Build Dimension Dictionary) with this log:
> java.io.IOException: java.lang.NullPointerException
> at
> org.apache.kylin.dict.lookup.HiveTable.getSignature(HiveTable.java:72)
> at
> org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager.java:202)
> at
> org.apache.kylin.cube.CubeManager.buildDictionary(CubeManager.java:166)
> at
> org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:52)
> at
> org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:41)
> at
> org.apache.kylin.job.hadoop.dict.CreateDictionaryJob.run(CreateDictionaryJob.java:52)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> at
> org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:62)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NullPointerException
> result code:2
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)