now i use the kylin-0.71.
i have create two cubes, but no one can run the job successful.they failed at
step 2.
the error log is :
[http-bio-7070-exec-2]:[2015-07-08
09:58:40,464][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35 (Store
/home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
[http-bio-7070-exec-2]:[2015-07-08
09:58:40,514][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
- job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35 from ERROR to READY
[http-bio-7070-exec-2]:[2015-07-08
09:58:40,527][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35-01
(Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
[http-bio-7070-exec-2]:[2015-07-08
09:58:40,533][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
- job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35-01 from ERROR to READY
[pool-4-thread-1]:[2015-07-08
09:59:10,027][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:107)]
- CubingJob{id=9d3f5524-49d2-4a7b-89c5-b9e694006d35, name=cube2 -
19700101000000_2922789940817071255 - BUILD - PDT 2015-07-07 03:25:36,
state=READY} prepare to schedule
[pool-4-thread-1]:[2015-07-08
09:59:10,028][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:111)]
- CubingJob{id=9d3f5524-49d2-4a7b-89c5-b9e694006d35, name=cube2 -
19700101000000_2922789940817071255 - BUILD - PDT 2015-07-07 03:25:36,
state=READY} scheduled
[pool-4-thread-1]:[2015-07-08
09:59:10,037][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:117)]
- Job Fetcher: 0 running, 1 actual running, 1 ready, 5 others
[pool-5-thread-10]:[2015-07-08
09:59:10,077][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35 (Store
/home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
[pool-5-thread-10]:[2015-07-08
09:59:10,082][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
- job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35 from READY to RUNNING
[pool-5-thread-10]:[2015-07-08
09:59:10,140][ERROR][org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:109)]
- error running Executable
java.lang.NullPointerException
at
org.apache.kylin.job.common.MapReduceExecutable.onExecuteStart(MapReduceExecutable.java:73)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[pool-5-thread-10]:[2015-07-08
09:59:10,148][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35-01
(Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
[pool-5-thread-10]:[2015-07-08
09:59:10,155][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35-01
(Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
[pool-5-thread-10]:[2015-07-08
09:59:10,160][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
- job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35-01 from READY to ERROR
[pool-5-thread-10]:[2015-07-08
09:59:10,160][ERROR][org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:109)]
- error running Executable
org.apache.kylin.job.exception.ExecuteException: java.lang.NullPointerException
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:111)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at
org.apache.kylin.job.common.MapReduceExecutable.onExecuteStart(MapReduceExecutable.java:73)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
... 6 more
[pool-5-thread-10]:[2015-07-08
09:59:10,165][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35 (Store
/home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
[pool-5-thread-10]:[2015-07-08
09:59:10,170][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35 (Store
/home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
[pool-5-thread-10]:[2015-07-08
09:59:10,174][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
- job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35 from RUNNING to ERROR
[pool-5-thread-10]:[2015-07-08
09:59:10,174][ERROR][org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:134)]
- ExecuteException job:9d3f5524-49d2-4a7b-89c5-b9e694006d35
org.apache.kylin.job.exception.ExecuteException:
org.apache.kylin.job.exception.ExecuteException: java.lang.NullPointerException
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:111)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.kylin.job.exception.ExecuteException:
java.lang.NullPointerException
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:111)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
... 4 more
Caused by: java.lang.NullPointerException
at
org.apache.kylin.job.common.MapReduceExecutable.onExecuteStart(MapReduceExecutable.java:73)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
... 6 more
and another error log is :
[http-bio-7070-exec-1]:[2015-07-08
15:51:50,698][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099 (Store
kylin_metadata@hbase)
[http-bio-7070-exec-1]:[2015-07-08
15:51:50,703][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
- job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099 from ERROR to READY
[http-bio-7070-exec-1]:[2015-07-08
15:51:50,718][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099-01
(Store kylin_metadata@hbase)
[http-bio-7070-exec-1]:[2015-07-08
15:51:50,723][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
- job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099-01 from ERROR to READY
[pool-4-thread-1]:[2015-07-08
15:52:29,305][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:107)]
- CubingJob{id=d1f2ffa2-902b-4200-965d-5ed43a9ec099, name=cube1 -
19700101000000_2922789940817071255 - BUILD - PDT 2015-07-07 01:40:36,
state=READY} prepare to schedule
[pool-4-thread-1]:[2015-07-08
15:52:29,306][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:111)]
- CubingJob{id=d1f2ffa2-902b-4200-965d-5ed43a9ec099, name=cube1 -
19700101000000_2922789940817071255 - BUILD - PDT 2015-07-07 01:40:36,
state=READY} scheduled
[pool-4-thread-1]:[2015-07-08
15:52:29,311][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:117)]
- Job Fetcher: 0 running, 1 actual running, 1 ready, 5 others
[pool-5-thread-3]:[2015-07-08
15:52:29,355][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099 (Store
kylin_metadata@hbase)
[pool-5-thread-3]:[2015-07-08
15:52:29,360][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
- job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099 from READY to RUNNING
[pool-5-thread-3]:[2015-07-08
15:52:29,378][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099-01
(Store kylin_metadata@hbase)
[pool-5-thread-3]:[2015-07-08
15:52:29,383][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
- job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099-01 from READY to RUNNING
[pool-5-thread-3]:[2015-07-08
15:52:29,389][INFO][org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:107)]
- parameters of the MapReduceExecutable:
[pool-5-thread-3]:[2015-07-08
15:52:29,389][INFO][org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:108)]
- -conf /home/eway/kylin-0.7.1/conf/kylin_job_conf.xml -cubename cube1
-output
/tmp/kylin-d1f2ffa2-902b-4200-965d-5ed43a9ec099/cube1/fact_distinct_columns
-jobname Kylin_Fact_Distinct_Columns_cube1_Step -tablename
kylin_intermediate_cube1_19700101000000_2922789940817071255_d1f2ffa2_902b_4200_965d_5ed43a9ec099
[pool-5-thread-3]:[2015-07-08
15:52:29,433][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:149)]
- append job jar: /home/eway/kylin-0.7.1/lib/kylin-job-0.7.1-incubating.jar
[pool-5-thread-3]:[2015-07-08
15:52:29,433][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:156)]
- append kylin.hive.dependency:
/home/eway/hive-0.12.0/conf:/home/eway/hive-0.12.0/lib/*:/home/eway/hive-0.12.0/hcatalog/share/hcatalog:/home/eway/hive-0.12.0/bin
and kylin.hive.dependency:
/home/eway/hbase-0.96.0-hadoop2/lib/hbase-common-0.96.0-hadoop2.jar to
mapreduce.application.classpath
[pool-5-thread-3]:[2015-07-08
15:52:29,433][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:161)]
- Didn't find mapreduce.application.classpath in job configuration, will run
'mapred classpath' to get the default value.
[pool-5-thread-3]:[2015-07-08
15:52:29,457][DEBUG][org.apache.kylin.job.cmd.ShellCmdOutput.appendOutput(ShellCmdOutput.java:66)]
-
/home/eway/hadoop-2.2.0/etc/hadoop:/home/eway/hadoop-2.2.0/share/hadoop/common/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/common/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/eway/hadoop-2.2.0/modules/*.jar
[pool-5-thread-3]:[2015-07-08
15:52:29,457][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:163)]
- The default mapred classpath is:
/home/eway/hadoop-2.2.0/etc/hadoop:/home/eway/hadoop-2.2.0/share/hadoop/common/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/common/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/eway/hadoop-2.2.0/modules/*.jar
[pool-5-thread-3]:[2015-07-08
15:52:29,458][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:180)]
- Hadoop job classpath is:
/home/eway/hadoop-2.2.0/etc/hadoop:/home/eway/hadoop-2.2.0/share/hadoop/common/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/common/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/eway/hadoop-2.2.0/modules/*.jar
,/home/eway/hbase-0.96.0-hadoop2/lib/hbase-common-0.96.0-hadoop2.jar,/home/eway/hive-0.12.0/conf,/home/eway/hive-0.12.0/lib/*,/home/eway/hive-0.12.0/hcatalog/share/hcatalog,/home/eway/hive-0.12.0/bin,/home/eway/hive-0.12.0/conf,/home/eway/hive-0.12.0/lib/*,/home/eway/hive-0.12.0/hcatalog/share/hcatalog,/home/eway/hive-0.12.0/bin
[pool-5-thread-3]:[2015-07-08
15:52:29,590][ERROR][org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:83)]
- error in FactDistinctColumnsJob
java.io.IOException: java.lang.TypeNotPresentException: Type decimal(10,0) not
present
at
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:94)
at
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:48)
at
org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:94)
at
org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:74)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at
org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:112)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.TypeNotPresentException: Type decimal(10,0) not present
at
org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getPrimitiveHType(HCatSchemaUtils.java:159)
at
org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getHCatFieldSchema(HCatSchemaUtils.java:121)
at
org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getHCatFieldSchema(HCatSchemaUtils.java:114)
at
org.apache.hive.hcatalog.common.HCatUtil.getHCatFieldSchemaList(HCatUtil.java:163)
at
org.apache.hive.hcatalog.common.HCatUtil.extractSchema(HCatUtil.java:170)
at
org.apache.hive.hcatalog.mapreduce.HCatTableInfo.valueOf(HCatTableInfo.java:146)
at
org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:110)
at
org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86)
at
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:92)
... 13 more
[pool-5-thread-3]:[2015-07-08
15:52:29,596][ERROR][org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:115)]
- error execute
MapReduceExecutable{id=d1f2ffa2-902b-4200-965d-5ed43a9ec099-01, name=Extract
Fact Table Distinct Columns, state=RUNNING}
java.io.IOException: java.lang.TypeNotPresentException: Type decimal(10,0) not
present
at
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:94)
at
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:48)
at
org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:94)
at
org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:74)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at
org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:112)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.TypeNotPresentException: Type decimal(10,0) not present
at
org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getPrimitiveHType(HCatSchemaUtils.java:159)
at
org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getHCatFieldSchema(HCatSchemaUtils.java:121)
at
org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getHCatFieldSchema(HCatSchemaUtils.java:114)
at
org.apache.hive.hcatalog.common.HCatUtil.getHCatFieldSchemaList(HCatUtil.java:163)
at
org.apache.hive.hcatalog.common.HCatUtil.extractSchema(HCatUtil.java:170)
at
org.apache.hive.hcatalog.mapreduce.HCatTableInfo.valueOf(HCatTableInfo.java:146)
at
org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:110)
at
org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86)
at
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:92)
... 13 more
[pool-5-thread-3]:[2015-07-08
15:52:29,601][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099-01
(Store kylin_metadata@hbase)
[pool-5-thread-3]:[2015-07-08
15:52:29,615][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099-01
(Store kylin_metadata@hbase)
[pool-5-thread-3]:[2015-07-08
15:52:29,621][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
- job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099-01 from RUNNING to ERROR
[pool-5-thread-3]:[2015-07-08
15:52:29,632][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099 (Store
kylin_metadata@hbase)
[pool-5-thread-3]:[2015-07-08
15:52:29,643][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099 (Store
kylin_metadata@hbase)
[pool-5-thread-3]:[2015-07-08
15:52:29,651][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
- Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099 (Store
kylin_metadata@hbase)
[pool-5-thread-3]:[2015-07-08
15:52:29,656][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
- job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099 from RUNNING to ERROR
[pool-4-thread-1]:[2015-07-08
15:53:29,301][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:117)]
- Job Fetcher: 0 running, 0 actual running, 0 ready, 6 others
error 1 :i cant't find the reason.is there any necessary configuration about it?
error 2: it seems like that kylin cant't support the type decimal.
Can you help me with this problem?
Thank you very much.
