Richard Calaba created KYLIN-1810:
-------------------------------------
Summary: NPE in
org.apache.kylin.dict.lookup.SnapshotTable.equals(SnapshotTable.java:164)
Key: KYLIN-1810
URL: https://issues.apache.org/jira/browse/KYLIN-1810
Project: Kylin
Issue Type: Bug
Affects Versions: v1.5.2.1
Reporter: Richard Calaba
Attachments: job_2016_06_21_16_23_51-err.zip
Hello,
running into weird issue. I have designed Kylin cube. Clonned it to another
cube without any changes and run the Build job. The Build succeeded. Then I
have discarder the build job and disabled and dropped the cube. Clonned the
same cube again (into different name than previously) and then again started
to build the cube. Getting an NPE below every time in Step 4 - Build Dimension
Dictionary":
Kylin
jambajuice_3_0
Insight
Model
Monitor
System
Help
Welcome, ADMIN
Jobs
Slow Queries
Cube Name:
Filter ...
Jobs in: NEW PENDING RUNNING FINISHED ERROR DISCARDED
Job Name Cube Progress Last Modified Time Duration
Actions
JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626042000 - BUILD
- PDT 2016-06-21 16:29:03 JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone
ERROR
2016-06-21 15:35:21 PST 5.80 mins Action
JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626042000 - BUILD
- PDT 2016-06-21 16:06:48 JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone
100%
2016-06-21 15:14:24 PST 6.85 mins Action
JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626000000 - BUILD
- PDT 2016-06-21 14:10:10 JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone
14.29%
2016-06-21 14:59:37 PST 5.70 mins Action
Total: 3
Detail Information
Job Name JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone -
19700101000000_20160626042000 - BUILD - PDT 2016-06-21 16:29:03
Job ID ac090c87-496d-4173-9503-6a9ec97a764e
Status ERROR
Duration 5.80 mins
MapReduce Waiting 0.18 mins
Start 2016-06-21 15:29:32 PST
2016-06-21 15:29:32 PST
#1 Step Name: Create Intermediate Flat Hive Table
Duration: 2.82 mins
2016-06-21 15:32:21 PST
#2 Step Name: Materialize Hive View in Lookup Tables
Duration: 2.11 mins
2016-06-21 15:34:28 PST
#3 Step Name: Extract Fact Table Distinct Columns
Duration: 0.86 mins
2016-06-21 15:35:20 PST
#4 Step Name: Build Dimension Dictionary
Duration: 0.02 mins
#5 Step Name: Save Cuboid Statistics
Duration: 0 seconds
#6 Step Name: Create HTable
Duration: 0 seconds
#7 Step Name: Build Base Cuboid Data
Duration: 0 seconds
#8 Step Name: Build N-Dimension Cuboid Data : 8-Dimension
Duration: 0 seconds
#9 Step Name: Build N-Dimension Cuboid Data : 7-Dimension
Duration: 0 seconds
#10 Step Name: Build N-Dimension Cuboid Data : 6-Dimension
Duration: 0 seconds
#11 Step Name: Build N-Dimension Cuboid Data : 5-Dimension
Duration: 0 seconds
#12 Step Name: Build N-Dimension Cuboid Data : 4-Dimension
Duration: 0 seconds
#13 Step Name: Build N-Dimension Cuboid Data : 3-Dimension
Duration: 0 seconds
#14 Step Name: Build N-Dimension Cuboid Data : 2-Dimension
Duration: 0 seconds
#15 Step Name: Build N-Dimension Cuboid Data : 1-Dimension
Duration: 0 seconds
#16 Step Name: Build N-Dimension Cuboid Data : 0-Dimension
Duration: 0 seconds
#17 Step Name: Build Cube
Duration: 0 seconds
#18 Step Name: Convert Cuboid Data to HFile
Duration: 0 seconds
#19 Step Name: Load HFile to HBase Table
Duration: 0 seconds
#20 Step Name: Update Cube Info
Duration: 0 seconds
#21 Step Name: Garbage Collection
Duration: 0 seconds
End
Apache Kylin | Apache Kylin Community
Output
java.lang.NullPointerException
at
org.apache.kylin.dict.lookup.SnapshotTable.equals(SnapshotTable.java:164)
at
org.apache.kylin.dict.lookup.SnapshotManager.checkDupByContent(SnapshotManager.java:167)
at
org.apache.kylin.dict.lookup.SnapshotManager.trySaveNewSnapshot(SnapshotManager.java:128)
at
org.apache.kylin.dict.lookup.SnapshotManager.buildSnapshot(SnapshotManager.java:108)
at
org.apache.kylin.cube.CubeManager.buildSnapshotTable(CubeManager.java:215)
at
org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:59)
at
org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:42)
at
org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:56)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at
org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:60)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
result code:2
Attaching the Diagnostic logs.
Any clue how to resolve this ???
I am thinking to wipe all Kylin metadata from repository and try to restore
from backup.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
