Please check this : https://issues.apache.org/jira/browse/KYLIN-1985
When new column is added to lookup table, this error will happen. 2016-09-12 16:37 GMT+08:00 邢兆华 <[email protected]>: > > > Hi all, > > > > Recently, I met a trouble when we built and refreshed cube. This is in > forth step, “Build Dimension Dictionary”, occurred > ArrayIndexOutOfBoundsException as follow: > > > > Java.lang.ArrayIndexOutOfBoundsException: 14 > > at org.apache.kylin.dict.lookup.LookupStringTable.convertRow( > LookupStringTable.java:85) > > at org.apache.kylin.dict.lookup.LookupStringTable.convertRow( > LookupStringTable.java:34) > > at org.apache.kylin.dict.lookup.LookupTable.initRow( > LookupTable.java:76) > > at org.apache.kylin.dict.lookup.LookupTable.init(LookupTable. > java:67) > > at org.apache.kylin.dict.lookup.LookupStringTable.init( > LookupStringTable.java:79) > > at org.apache.kylin.dict.lookup.LookupTable.<init>( > LookupTable.java:55) > > at org.apache.kylin.dict.lookup.LookupStringTable.<init>( > LookupStringTable.java:65) > > at org.apache.kylin.cube.CubeManager.getLookupTable( > CubeManager.java:619) > > at org.apache.kylin.cube.cli.DictionaryGeneratorCLI. > processSegment(DictionaryGeneratorCLI.java:61) > > at org.apache.kylin.cube.cli.DictionaryGeneratorCLI. > processSegment(DictionaryGeneratorCLI.java:42) > > at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run( > CreateDictionaryJob.java:56) > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) > > at org.apache.kylin.engine.mr.common.HadoopShellExecutable. > doWork(HadoopShellExecutable.java:63) > > at org.apache.kylin.job.execution.AbstractExecutable. > execute(AbstractExecutable.java:112) > > at org.apache.kylin.job.execution.DefaultChainedExecutable. > doWork(DefaultChainedExecutable.java:57) > > at org.apache.kylin.job.execution.AbstractExecutable. > execute(AbstractExecutable.java:112) > > at org.apache.kylin.job.impl.threadpool.DefaultScheduler$ > JobRunner.run(DefaultScheduler.java:127) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1145) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:615) > > at java.lang.Thread.run(Thread.java:745) > > > > result code:2 > > > > *Our environment: * > > Kylin version: 1.5.3; HBase version: 1.2 > > > > *Cube infos:* > > 1 fact table and 4 dimension tables > > > > *Cube size:* 270.33GB and source records: 1,300,012,200 > > > > > > Because of exception messages are less, I read some source codes, but I > still cannot find the cause of error. So I hope to get help. Could you > please help locate the problem or give some ideas to find the problem. We > have been using kylin online, so I want to fix it as early as possible. > Please give me replies as soon as possible. Thanks! > > > > Sincerely! > > > > > > > > 问题描述: > > > > 在对cube执行build和refresh时,在第四步“Build Dimension Dictionary”发生ArrayIndexOutOfBo > undsException: > > > > java.lang.ArrayIndexOutOfBoundsException: 14 > > at org.apache.kylin.dict.lookup.LookupStringTable.convertRow( > LookupStringTable.java:85) > > at org.apache.kylin.dict.lookup.LookupStringTable.convertRow( > LookupStringTable.java:34) > > at org.apache.kylin.dict.lookup.LookupTable.initRow( > LookupTable.java:76) > > at org.apache.kylin.dict.lookup.LookupTable.init(LookupTable. > java:67) > > at org.apache.kylin.dict.lookup.LookupStringTable.init( > LookupStringTable.java:79) > > at org.apache.kylin.dict.lookup.LookupTable.<init>( > LookupTable.java:55) > > at org.apache.kylin.dict.lookup.LookupStringTable.<init>( > LookupStringTable.java:65) > > at org.apache.kylin.cube.CubeManager.getLookupTable( > CubeManager.java:619) > > at org.apache.kylin.cube.cli.DictionaryGeneratorCLI. > processSegment(DictionaryGeneratorCLI.java:61) > > at org.apache.kylin.cube.cli.DictionaryGeneratorCLI. > processSegment(DictionaryGeneratorCLI.java:42) > > at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run( > CreateDictionaryJob.java:56) > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) > > at org.apache.kylin.engine.mr.common.HadoopShellExecutable. > doWork(HadoopShellExecutable.java:63) > > at org.apache.kylin.job.execution.AbstractExecutable. > execute(AbstractExecutable.java:112) > > at org.apache.kylin.job.execution.DefaultChainedExecutable. > doWork(DefaultChainedExecutable.java:57) > > at org.apache.kylin.job.execution.AbstractExecutable. > execute(AbstractExecutable.java:112) > > at org.apache.kylin.job.impl.threadpool.DefaultScheduler$ > JobRunner.run(DefaultScheduler.java:127) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1145) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:615) > > at java.lang.Thread.run(Thread.java:745) > > > > result code:2 > > > > > > 版本说明: > > kylin版本1.5.3 > > hbase版本1.2 > > > > cube信息: > > 1张事实表,4张维表 > > > > cube size:270.33GB > > Source Records 1,300,012,200 > > > > > > 请问这个有可能是维表中什么问题导致的?因为异常信息太过简单,查看源码也没看出更多的信息, > > 所以能否帮忙定位下问题或者给出一些定位问题得思路,这样有利于我们定位问题。 > > kylin1.5.3已经在正式环境上被使用了一段时间了,希望尽快得到答复,多谢。 > > > > > > > > > > > -- Best regards, Shaofeng Shi
