kylin 2.5.1 the engin is mapreduce --------------原始邮件-------------- 发件人:"Chao Long "<wayn...@qq.com>; 发送时间:2018年12月13日(星期四) 晚上9:18 收件人:"user" <user@kylin.apache.org>; 主题:Re: when create htable ,occur error -----------------------------------
Hi, What's your Kylin version and which build engine you use? ------------------ Best Regards, Chao Long ------------------ Original ------------------ From: "梅振楠"<meizhen...@zuoyebang.com>; Date: Thu, Dec 13, 2018 09:10 PM To: "user"<user@kylin.apache.org>; Subject: when create htable ,occur error hi,all when Create HTable ,i get this errors. resume this cube, do not work. how can i resolve the problem . ---------------------------------------------------- 2018-12-13 20:49:50,439 INFO [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] common.HadoopShellExecutable:59 : parameters of the HadoopShellExecutable: -cubename kuaidui_offline_action_crm_cube -segmentid e26a43d4-879a-6219-7edf-8b2528851207 -partitions hdfs://ns1/kylin/kylin_metadata/kylin-feed250d-4bbc-242f-ab6f-aa8317aacd87/kuaidui_offline_action_crm_cube/rowkey_stats/part-r-00000 -cuboidMode CURRENT -hbaseConfPath hdfs://ns1/kylin/kylin_metadata/kylin-feed250d-4bbc-242f-ab6f-aa8317aacd87/hbase-conf.xml 2018-12-13 20:49:50,533 ERROR [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] common.HadoopShellExecutable:65 : error execute HadoopShellExecutable{id=feed250d-4bbc-242f-ab6f-aa8317aacd87-05, name=Create HTable, state=RUNNING} java.lang.NullPointerException at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:207) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:165) at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:100) at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92) at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-12-13 20:49:50,550 INFO [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] execution.ExecutableManager:434 : job id:feed250d-4bbc-242f-ab6f-aa8317aacd87-05 from RUNNING to ERROR 2018-12-13 20:49:50,552 ERROR [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] execution.AbstractExecutable:165 : error running Executable: CubingJob{id=feed250d-4bbc-242f-ab6f-aa8317aacd87, name=BUILD CUBE - kuaidui_offline_action_crm_cube - 20181201000000_20181202000000 - GMT+08:00 2018-12-13 20:25:57, state=RUNNING} 2018-12-13 20:49:50,561 DEBUG [pool-12-thread-1] cachesync.Broadcaster:113 : Servers in the cluster: [localhost:7070] 2018-12-13 20:49:50,562 DEBUG [pool-12-thread-1] cachesync.Broadcaster:123 : Announcing new broadcast to all: BroadcastEvent{entity=execute_output, event=update, cacheKey=feed250d-4bbc-242f-ab6f-aa8317aacd87} 2018-12-13 20:49:50,566 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:247 : Broadcasting UPDATE, execute_output, feed250d-4bbc-242f-ab6f-aa8317aacd87 2018-12-13 20:49:50,569 INFO [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] execution.ExecutableManager:434 : job id:feed250d-4bbc-242f-ab6f-aa8317aacd87 from RUNNING to ERROR 2018-12-13 20:49:50,569 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:281 : Done broadcasting UPDATE, execute_output, feed250d-4bbc-242f-ab6f-aa8317aacd87 2018-12-13 20:49:50,569 DEBUG [pool-12-thread-1] cachesync.Broadcaster:113 : Servers in the cluster: [localhost:7070] 2018-12-13 20:49:50,569 DEBUG [pool-12-thread-1] cachesync.Broadcaster:123 : Announcing new broadcast to all: BroadcastEvent{entity=execute_output, event=update, cacheKey=feed250d-4bbc-242f-ab6f-aa8317aacd87} 2018-12-13 20:49:50,575 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:247 : Broadcasting UPDATE, execute_output, feed250d-4bbc-242f-ab6f-aa8317aacd87 2018-12-13 20:49:50,578 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:281 : Done broadcasting UPDATE, execute_output, feed250d-4bbc-242f-ab6f-aa8317aacd87 2018-12-13 20:49:50,613 INFO [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] execution.AbstractExecutable:343 : prepare to send email to:[meizhen...@zuoyebang.com, liwenji...@zuoyebang.com] 2018-12-13 20:49:50,614 INFO [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] execution.AbstractExecutable:344 : job name:BUILD CUBE - kuaidui_offline_action_crm_cube - 20181201000000_20181202000000 - GMT+08:00 2018-12-13 20:25:57 2018-12-13 20:49:50,614 INFO [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] execution.AbstractExecutable:345 : submitter:ADMIN 2018-12-13 20:49:50,614 INFO [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] execution.AbstractExecutable:346 : notify list:[meizhen...@zuoyebang.com, liwenji...@zuoyebang.com] 2018-12-13 20:49:52,898 ERROR [pool-10-thread-8] threadpool.DefaultScheduler:115 : ExecuteException job:feed250d-4bbc-242f-ab6f-aa8317aacd87 org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.engine.mr.exception.HadoopShellException: java.lang.NullPointerException at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:207) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:165) at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:100) at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92) at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) result code:2 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.engine.mr.exception.HadoopShellException: java.lang.NullPointerException at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:207) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:165) at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:100) at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92) at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) result code:2 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) ... 4 more Caused by: org.apache.kylin.engine.mr.exception.HadoopShellException: java.lang.NullPointerException at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:207) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:165) at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:100) at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92) at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) result code:2 at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:73) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) ... 6 more