Hi hefeng,

It seems the hcatalog jars doesn't exist on your hadoop node; The solution
is to upload the jar files to an HDFS folder, and then set  that patch as
the value of "kylin.job.mr.lib.dir" in kylin.properties, you can checkout
this JIRA: https://issues.apache.org/jira/browse/KYLIN-1021

In our env, the "kylin.job.mr.lib.dir" folder has the following 4 jar
files, just for your reference:
hive-common-xx.jar
hive-exec-xx.jar
hive-hcatalog-core-xx.jar
hive-metastore-xx.jar

Here "xx" means the version number;

Just take a try and let us know whether it works.

2016-01-05 14:47 GMT+08:00 和风 <[email protected]>:

> Thanks for your help. error logs:
> [pool-7-thread-1]:[2016-01-05
> 14:45:31,312][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:241)]
> - job id:d0e2f259-9541-4b6f-9f54-c502781549e2-00 from RUNNING to SUCCEED
> [pool-7-thread-1]:[2016-01-05
> 14:45:31,438][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:241)]
> - job id:d0e2f259-9541-4b6f-9f54-c502781549e2 from RUNNING to READY
> [pool-6-thread-1]:[2016-01-05
> 14:45:31,483][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:102)]
> - CubingJob{id=d0e2f259-9541-4b6f-9f54-c502781549e2, name=learn_kylin_four
> - 20150201000000_20151229000000 - BUILD - GMT-08:00 2016-01-04 22:44:05,
> state=READY} prepare to schedule
> [pool-6-thread-1]:[2016-01-05
> 14:45:31,484][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:106)]
> - CubingJob{id=d0e2f259-9541-4b6f-9f54-c502781549e2, name=learn_kylin_four
> - 20150201000000_20151229000000 - BUILD - GMT-08:00 2016-01-04 22:44:05,
> state=READY} scheduled
> [pool-6-thread-1]:[2016-01-05
> 14:45:31,490][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
> - Job Fetcher: 0 running, 1 actual running, 1 ready, 5 others
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,560][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:241)]
> - job id:d0e2f259-9541-4b6f-9f54-c502781549e2 from READY to RUNNING
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,586][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:241)]
> - job id:d0e2f259-9541-4b6f-9f54-c502781549e2-01 from READY to RUNNING
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,599][INFO][org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:115)]
> - parameters of the MapReduceExecutable:
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,599][INFO][org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:116)]
> -  -conf /usr/local/kylin/conf/kylin_job_conf.xml -cubename
> learn_kylin_four -output
> /kylin/kylin_metadata/kylin-d0e2f259-9541-4b6f-9f54-c502781549e2/learn_kylin_four/fact_distinct_columns
> -jobname Kylin_Fact_Distinct_Columns_learn_kylin_four_Step -tablename
> default.kylin_intermediate_learn_kylin_four_20150201000000_20151229000000_d0e2f259_9541_4b6f_9f54_c502781549e2
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,661][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:137)]
> - append job jar: /usr/local/kylin/lib/kylin-job-1.2.jar
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,661][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:144)]
> - append kylin.hive.dependency:
> /usr/local/hive/conf:/usr/local/hive/lib/jsr305-1.3.9.jar:/usr/local/hive/lib/jetty-all-7.6.0.v20120127.jar:/usr/local/hive/lib/servlet-api-2.5.jar:/usr/local/hive/lib/jets3t-0.9.0.jar:/usr/local/hive/lib/accumulo-core-1.6.0.jar:/usr/local/hive/lib/libfb303-0.9.2.jar:/usr/local/hive/lib/json-serde-1.3.6-jar-with-dependencies.jar:/usr/local/hive/lib/commons-httpclient-3.0.1.jar:/usr/local/hive/lib/ivy-2.4.0.jar:/usr/local/hive/lib/hbase-examples-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/jersey-client-1.9.jar:/usr/local/hive/lib/jersey-server-1.9.jar:/usr/local/hive/lib/slf4j-log4j12-1.7.5.jar:/usr/local/hive/lib/zookeeper-3.4.6.jar:/usr/local/hive/lib/bonecp-0.8.0.RELEASE.jar:/usr/local/hive/lib/activation-1.1.jar:/usr/local/hive/lib/snappy-java-1.0.5.jar:/usr/local/hive/lib/commons-cli-1.2.jar:/usr/local/hive/lib/ST4-4.0.4.jar:/usr/local/hive/lib/asm-3.1.jar:/usr/local/hive/lib/hive-common-1.2.1.jar:/usr/local/hive/lib/avro-1.7.5.jar:/usr/local/hive/lib/findbugs-annotations-1.3.9-1.jar:/usr/local/hive/lib/accumulo-trace-1.6.0.jar:/usr/local/hive/lib/jcommander-1.32.jar:/usr/local/hive/lib/commons-lang-2.6.jar:/usr/local/hive/lib/hadoop-yarn-client-2.7.1.jar:/usr/local/hive/lib/hadoop-mapreduce-client-common-2.7.1.jar:/usr/local/hive/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hive/lib/hbase-hadoop-compat-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/stringtemplate-3.2.1.jar:/usr/local/hive/lib/hbase-it-0.98.16.1-hadoop2-tests.jar:/usr/local/hive/lib/hadoop-yarn-api-2.7.1.jar:/usr/local/hive/lib/hadoop-yarn-common-2.7.1.jar:/usr/local/hive/lib/log4j-1.2.16.jar:/usr/local/hive/lib/hadoop-mapreduce-client-core-2.7.1.jar:/usr/local/hive/lib/protobuf-java-2.5.0.jar:/usr/local/hive/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/hive/lib/jetty-6.1.26.jar:/usr/local/hive/lib/hbase-common-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/jasper-compiler-5.5.23.jar:/usr/local/hive/lib/paranamer-2.3.jar:/usr/local/hive/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/local/hive/lib/java-xmlbuilder-0.4.jar:/usr/local/hive/lib/hbase-thrift-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/snappy-java-1.0.4.1.jar:/usr/local/hive/lib/netty-all-4.0.23.Final.jar:/usr/local/hive/lib/htrace-core-2.04.jar:/usr/local/hive/lib/gson-2.2.4.jar:/usr/local/hive/lib/libthrift-0.9.0.jar:/usr/local/hive/lib/mail-1.4.1.jar:/usr/local/hive/lib/maven-scm-provider-svnexe-1.4.jar:/usr/local/hive/lib/eigenbase-properties-1.1.5.jar:/usr/local/hive/lib/antlr-runtime-3.4.jar:/usr/local/hive/lib/commons-codec-1.9.jar:/usr/local/hive/lib/xz-1.0.jar:/usr/local/hive/lib/mysql-connector-java-5.1.31.jar:/usr/local/hive/lib/hive-service-1.2.1.jar:/usr/local/hive/lib/netty-3.7.0.Final.jar:/usr/local/hive/lib/antlr-2.7.7.jar:/usr/local/hive/lib/jetty-sslengine-6.1.26.jar:/usr/local/hive/lib/hadoop-mapreduce-client-jobclient-2.7.1.jar:/usr/local/hive/lib/parquet-hadoop-bundle-1.6.0.jar:/usr/local/hive/lib/derby-10.10.2.0.jar:/usr/local/hive/lib/hive-shims-scheduler-1.2.1.jar:/usr/local/hive/lib/jersey-core-1.9.jar:/usr/local/hive/lib/ant-launcher-1.9.1.jar:/usr/local/hive/lib/accumulo-start-1.6.0.jar:/usr/local/hive/lib/metrics-core-2.2.0.jar:/usr/local/hive/lib/hive-hwi-1.2.1.jar:/usr/local/hive/lib/commons-logging-1.2.jar:/usr/local/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/usr/local/hive/lib/jdo-api-3.0.1.jar:/usr/local/hive/lib/joda-time-2.5.jar:/usr/local/hive/lib/jetty-all-server-7.6.0.v20120127.jar:/usr/local/hive/lib/commons-beanutils-1.7.0.jar:/usr/local/hive/lib/hadoop-common-2.7.1.jar:/usr/local/hive/lib/velocity-1.5.jar:/usr/local/hive/lib/hadoop-mapreduce-client-shuffle-2.7.1.jar:/usr/local/hive/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/hive/lib/hbase-checkstyle-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/hbase-shell-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/commons-math-2.2.jar:/usr/local/hive/lib/commons-net-3.1.jar:/usr/local/hive/lib/stax-api-1.0.1.jar:/usr/local/hive/lib/hbase-protocol-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/regexp-1.3.jar:/usr/local/hive/lib/httpcore-4.1.3.jar:/usr/local/hive/lib/hbase-it-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/hive-ant-1.2.1.jar:/usr/local/hive/lib/curator-recipes-2.6.0.jar:/usr/local/hive/lib/jackson-xc-1.9.13.jar:/usr/local/hive/lib/leveldbjni-all-1.8.jar:/usr/local/hive/lib/guava-14.0.1.jar:/usr/local/hive/lib/hbase-prefix-tree-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/jsp-2.1-6.1.14.jar:/usr/local/hive/lib/log4j-1.2.17.jar:/usr/local/hive/lib/libthrift-0.9.2.jar:/usr/local/hive/lib/ant-1.9.1.jar:/usr/local/hive/lib/hbase-resource-bundle-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/usr/local/hive/lib/jcodings-1.0.8.jar:/usr/local/hive/lib/apacheds-i18n-2.0.0-M15.jar:/usr/local/hive/lib/hamcrest-core-1.1.jar:/usr/local/hive/lib/hive-hbase-handler-1.2.1.jar:/usr/local/hive/lib/javax.inject-1.jar:/usr/local/hive/lib/hive-shims-0.20S-1.2.1.jar:/usr/local/hive/lib/junit-4.11.jar:/usr/local/hive/lib/hive-shims-1.2.1.jar:/usr/local/hive/lib/commons-collections-3.2.1.jar:/usr/local/hive/lib/commons-daemon-1.0.13.jar:/usr/local/hive/lib/commons-configuration-1.6.jar:/usr/local/hive/lib/joni-2.1.2.jar:/usr/local/hive/lib/jpam-1.1.jar:/usr/local/hive/lib/guice-servlet-3.0.jar:/usr/local/hive/lib/hbase-testing-util-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/jsr305-3.0.0.jar:/usr/local/hive/lib/xmlenc-0.52.jar:/usr/local/hive/lib/httpclient-4.2.5.jar:/usr/local/hive/lib/curator-framework-2.6.0.jar:/usr/local/hive/lib/htrace-core-3.1.0-incubating.jar:/usr/local/hive/lib/hive-beeline-1.2.1.jar:/usr/local/hive/lib/hadoop-yarn-server-common-2.7.1.jar:/usr/local/hive/lib/jline-2.12.jar:/usr/local/hive/lib/tempus-fugit-1.1.jar:/usr/local/hive/lib/jersey-json-1.9.jar:/usr/local/hive/lib/groovy-all-2.1.6.jar:/usr/local/hive/lib/hive-serde-1.2.1.jar:/usr/local/hive/lib/datanucleus-core-3.2.10.jar:/usr/local/hive/lib/commons-httpclient-3.1.jar:/usr/local/hive/lib/guava-12.0.1.jar:/usr/local/hive/lib/slf4j-api-1.7.7.jar:/usr/local/hive/lib/jersey-guice-1.9.jar:/usr/local/hive/lib/hbase-rest-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/hive-shims-0.23-1.2.1.jar:/usr/local/hive/lib/oro-2.0.8.jar:/usr/local/hive/lib/jaxb-api-2.2.2.jar:/usr/local/hive/lib/jamon-runtime-2.3.1.jar:/usr/local/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/usr/local/hive/lib/json-20090211.jar:/usr/local/hive/lib/hadoop-mapreduce-client-app-2.7.1.jar:/usr/local/hive/lib/hbase-server-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/hadoop-hdfs-2.7.1.jar:/usr/local/hive/lib/servlet-api-2.5-6.1.14.jar:/usr/local/hive/lib/jta-1.1.jar:/usr/local/hive/lib/spymemcached-2.11.6.jar:/usr/local/hive/lib/commons-beanutils-core-1.8.0.jar:/usr/local/hive/lib/curator-client-2.6.0.jar:/usr/local/hive/lib/jsp-api-2.1-6.1.14.jar:/usr/local/hive/lib/commons-digester-1.8.jar:/usr/local/hive/lib/jetty-util-6.1.26.jar:/usr/local/hive/lib/hive-testutils-1.2.1.jar:/usr/local/hive/lib/jsch-0.1.42.jar:/usr/local/hive/lib/commons-el-1.0.jar:/usr/local/hive/lib/asm-commons-3.1.jar:/usr/local/hive/lib/data-hive-udf.jar:/usr/local/hive/lib/guice-3.0.jar:/usr/local/hive/lib/commons-dbcp-1.4.jar:/usr/local/hive/lib/hive-shims-common-1.2.1.jar:/usr/local/hive/lib/hbase-annotations-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/hadoop-auth-2.7.1.jar:/usr/local/hive/lib/maven-scm-provider-svn-commons-1.4.jar:/usr/local/hive/lib/opencsv-2.3.jar:/usr/local/hive/lib/aopalliance-1.0.jar:/usr/local/hive/lib/hbase-client-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/jruby-complete-1.6.8.jar:/usr/local/hive/lib/plexus-utils-1.5.6.jar:/usr/local/hive/lib/hive-exec-1.2.1.jar:/usr/local/hive/lib/hbase-common-0.98.16.1-hadoop2-tests.jar:/usr/local/hive/lib/high-scale-lib-1.1.1.jar:/usr/local/hive/lib/netty-3.2.4.Final.jar:/usr/local/hive/lib/hive-accumulo-handler-1.2.1.jar:/usr/local/hive/lib/hive-cli-1.2.1.jar:/usr/local/hive/lib/httpclient-4.4.jar:/usr/local/hive/lib/asm-tree-3.1.jar:/usr/local/hive/lib/jackson-core-asl-1.9.13.jar:/usr/local/hive/lib/commons-vfs2-2.0.jar:/usr/local/hive/lib/hive-jdbc-1.2.1-standalone.jar:/usr/local/hive/lib/super-csv-2.2.0.jar:/usr/local/hive/lib/commons-codec-1.4.jar:/usr/local/hive/lib/maven-scm-api-1.4.jar:/usr/local/hive/lib/jettison-1.3.3.jar:/usr/local/hive/lib/api-asn1-api-1.0.0-M20.jar:/usr/local/hive/lib/hbase-hadoop2-compat-0.98.16.1-hadoop2.jar:/usr/local/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/usr/local/hive/lib/avro-1.7.4.jar:/usr/local/hive/lib/hive-metastore-1.2.1.jar:/usr/local/hive/lib/commons-compress-1.4.1.jar:/usr/local/hive/lib/disruptor-3.3.0.jar:/usr/local/hive/lib/jasper-runtime-5.5.23.jar:/usr/local/hive/lib/jackson-jaxrs-1.9.13.jar:/usr/local/hive/lib/commons-io-2.4.jar:/usr/local/hive/lib/httpcore-4.4.jar:/usr/local/hive/lib/commons-pool-1.5.4.jar:/usr/local/hive/lib/accumulo-fate-1.6.0.jar:/usr/local/hive/lib/commons-compiler-2.7.6.jar:/usr/local/hive/lib/janino-2.7.6.jar:/usr/local/hive/lib/hive-contrib-1.2.1.jar:/usr/local/hive/lib/commons-math3-3.1.1.jar:/usr/local/hive/lib/hive-jdbc-1.2.1.jar:/usr/local/hive/lib/hbase-server-0.98.16.1-hadoop2-tests.jar:/usr/local/hive/lib/api-util-1.0.0-M20.jar:/usr/local/hive/lib/commons-math-2.1.jar:/usr/local/hive/lib/hadoop-annotations-2.7.1.jar:/usr/local/hive/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/hive/lib/commons-logging-1.1.3.jar:/usr/local/hive/lib/apache-log4j-extras-1.2.17.jar:/usr/local/hive/hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1.jar
> and kylin.hbase.dependency:
> /usr/local/hadoop/share/hadoop/mapreduce/hbase-common-0.98.16.1-hadoop2.jar
> to mapreduce.application.classpath
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,661][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:149)]
> - Didn't find mapreduce.application.classpath in job configuration, will
> run 'mapred classpath' to get the default value.
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,786][DEBUG][org.apache.kylin.job.cmd.ShellCmdOutput.appendOutput(ShellCmdOutput.java:65)]
> -
> /usr/local/hadoop/etc/hadoop:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hadoop/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/hdfs:/usr/local/hadoop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/usr/local/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/mapreduce/lib/*:/usr/local/hadoop/share/hadoop/mapreduce/*:/usr/local/hadoop/share/hadoop/mapreduce/commons-pool2-2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/fastjson-1.2.4.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.1-tests.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-annotations-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-checkstyle-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-client-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-common-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-common-0.98.16.1-hadoop2-tests.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-examples-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-hadoop2-compat-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-hadoop-compat-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-it-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-it-0.98.16.1-hadoop2-tests.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-prefix-tree-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-protocol-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-resource-bundle-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-rest-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-server-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-server-0.98.16.1-hadoop2-tests.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-shell-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-testing-util-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/hbase-thrift-0.98.16.1-hadoop2.jar:/usr/local/hadoop/share/hadoop/mapreduce/high-scale-lib-1.1.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/htrace-core-2.04.jar:/usr/local/hadoop/share/hadoop/mapreduce/jedis-2.6.2.jar:/usr/local/hadoop/share/hadoop/mapreduce/metrics-core-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/namecount-0.0.1-SNAPSHOT.jar:/usr/local/hadoop/share/hadoop/mapreduce/world-0.0.1-SNAPSHOT.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.7.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.7.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-registry-2.7.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.7.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/junit-4.11.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/usr/local/hadoop/modules/*.jar
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,788][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:152)]
> - The default mapred classpath is:
> /usr/local/hadoop/etc/hadoop,/usr/local/hadoop/share/hadoop/common/lib/*,/usr/local/hadoop/share/hadoop/common/*,/usr/local/hadoop/share/hadoop/hdfs,/usr/local/hadoop/share/hadoop/hdfs/lib/*,/usr/local/hadoop/share/hadoop/hdfs/*,/usr/local/hadoop/share/hadoop/yarn/lib/*,/usr/local/hadoop/share/hadoop/yarn/*,/usr/local/hadoop/share/hadoop/mapreduce/lib/*,/usr/local/hadoop/share/hadoop/mapreduce/*,/usr/local/hadoop/share/hadoop/mapreduce/commons-pool2-2.0.jar,/usr/local/hadoop/share/hadoop/mapreduce/fastjson-1.2.4.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.1-tests.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-annotations-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-checkstyle-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-client-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-common-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-common-0.98.16.1-hadoop2-tests.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-examples-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-hadoop2-compat-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-hadoop-compat-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-it-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-it-0.98.16.1-hadoop2-tests.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-prefix-tree-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-protocol-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-resource-bundle-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-rest-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-server-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-server-0.98.16.1-hadoop2-tests.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-shell-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-testing-util-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-thrift-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/high-scale-lib-1.1.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/htrace-core-2.04.jar,/usr/local/hadoop/share/hadoop/mapreduce/jedis-2.6.2.jar,/usr/local/hadoop/share/hadoop/mapreduce/metrics-core-2.2.0.jar,/usr/local/hadoop/share/hadoop/mapreduce/namecount-0.0.1-SNAPSHOT.jar,/usr/local/hadoop/share/hadoop/mapreduce/world-0.0.1-SNAPSHOT.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-registry-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-io-2.4.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/junit-4.11.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar,/usr/local/hadoop/modules/*.jar
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,789][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:168)]
> - Hadoop job classpath is:
> /usr/local/hadoop/etc/hadoop,/usr/local/hadoop/share/hadoop/common/lib/*,/usr/local/hadoop/share/hadoop/common/*,/usr/local/hadoop/share/hadoop/hdfs,/usr/local/hadoop/share/hadoop/hdfs/lib/*,/usr/local/hadoop/share/hadoop/hdfs/*,/usr/local/hadoop/share/hadoop/yarn/lib/*,/usr/local/hadoop/share/hadoop/yarn/*,/usr/local/hadoop/share/hadoop/mapreduce/lib/*,/usr/local/hadoop/share/hadoop/mapreduce/*,/usr/local/hadoop/share/hadoop/mapreduce/commons-pool2-2.0.jar,/usr/local/hadoop/share/hadoop/mapreduce/fastjson-1.2.4.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.1-tests.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-annotations-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-checkstyle-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-client-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-common-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-common-0.98.16.1-hadoop2-tests.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-examples-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-hadoop2-compat-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-hadoop-compat-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-it-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-it-0.98.16.1-hadoop2-tests.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-prefix-tree-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-protocol-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-resource-bundle-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-rest-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-server-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-server-0.98.16.1-hadoop2-tests.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-shell-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-testing-util-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-thrift-0.98.16.1-hadoop2.jar,/usr/local/hadoop/share/hadoop/mapreduce/high-scale-lib-1.1.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/htrace-core-2.04.jar,/usr/local/hadoop/share/hadoop/mapreduce/jedis-2.6.2.jar,/usr/local/hadoop/share/hadoop/mapreduce/metrics-core-2.2.0.jar,/usr/local/hadoop/share/hadoop/mapreduce/namecount-0.0.1-SNAPSHOT.jar,/usr/local/hadoop/share/hadoop/mapreduce/world-0.0.1-SNAPSHOT.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-registry-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.1.jar,/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-io-2.4.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/junit-4.11.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar,/usr/local/hadoop/modules/*.jar,/usr/local/hadoop/share/hadoop/mapreduce/hbase-common-0.98.16.1-hadoop2.jar,/usr/local/hive/conf,/usr/local/hive/lib/jsr305-1.3.9.jar,/usr/local/hive/lib/jetty-all-7.6.0.v20120127.jar,/usr/local/hive/lib/servlet-api-2.5.jar,/usr/local/hive/lib/jets3t-0.9.0.jar,/usr/local/hive/lib/accumulo-core-1.6.0.jar,/usr/local/hive/lib/libfb303-0.9.2.jar,/usr/local/hive/lib/json-serde-1.3.6-jar-with-dependencies.jar,/usr/local/hive/lib/commons-httpclient-3.0.1.jar,/usr/local/hive/lib/ivy-2.4.0.jar,/usr/local/hive/lib/hbase-examples-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/jersey-client-1.9.jar,/usr/local/hive/lib/jersey-server-1.9.jar,/usr/local/hive/lib/slf4j-log4j12-1.7.5.jar,/usr/local/hive/lib/zookeeper-3.4.6.jar,/usr/local/hive/lib/bonecp-0.8.0.RELEASE.jar,/usr/local/hive/lib/activation-1.1.jar,/usr/local/hive/lib/snappy-java-1.0.5.jar,/usr/local/hive/lib/commons-cli-1.2.jar,/usr/local/hive/lib/ST4-4.0.4.jar,/usr/local/hive/lib/asm-3.1.jar,/usr/local/hive/lib/hive-common-1.2.1.jar,/usr/local/hive/lib/avro-1.7.5.jar,/usr/local/hive/lib/findbugs-annotations-1.3.9-1.jar,/usr/local/hive/lib/accumulo-trace-1.6.0.jar,/usr/local/hive/lib/jcommander-1.32.jar,/usr/local/hive/lib/commons-lang-2.6.jar,/usr/local/hive/lib/hadoop-yarn-client-2.7.1.jar,/usr/local/hive/lib/hadoop-mapreduce-client-common-2.7.1.jar,/usr/local/hive/lib/jaxb-impl-2.2.3-1.jar,/usr/local/hive/lib/hbase-hadoop-compat-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/stringtemplate-3.2.1.jar,/usr/local/hive/lib/hbase-it-0.98.16.1-hadoop2-tests.jar,/usr/local/hive/lib/hadoop-yarn-api-2.7.1.jar,/usr/local/hive/lib/hadoop-yarn-common-2.7.1.jar,/usr/local/hive/lib/log4j-1.2.16.jar,/usr/local/hive/lib/hadoop-mapreduce-client-core-2.7.1.jar,/usr/local/hive/lib/protobuf-java-2.5.0.jar,/usr/local/hive/lib/jackson-mapper-asl-1.9.13.jar,/usr/local/hive/lib/jetty-6.1.26.jar,/usr/local/hive/lib/hbase-common-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/jasper-compiler-5.5.23.jar,/usr/local/hive/lib/paranamer-2.3.jar,/usr/local/hive/lib/apacheds-kerberos-codec-2.0.0-M15.jar,/usr/local/hive/lib/java-xmlbuilder-0.4.jar,/usr/local/hive/lib/hbase-thrift-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/snappy-java-1.0.4.1.jar,/usr/local/hive/lib/netty-all-4.0.23.Final.jar,/usr/local/hive/lib/htrace-core-2.04.jar,/usr/local/hive/lib/gson-2.2.4.jar,/usr/local/hive/lib/libthrift-0.9.0.jar,/usr/local/hive/lib/mail-1.4.1.jar,/usr/local/hive/lib/maven-scm-provider-svnexe-1.4.jar,/usr/local/hive/lib/eigenbase-properties-1.1.5.jar,/usr/local/hive/lib/antlr-runtime-3.4.jar,/usr/local/hive/lib/commons-codec-1.9.jar,/usr/local/hive/lib/xz-1.0.jar,/usr/local/hive/lib/mysql-connector-java-5.1.31.jar,/usr/local/hive/lib/hive-service-1.2.1.jar,/usr/local/hive/lib/netty-3.7.0.Final.jar,/usr/local/hive/lib/antlr-2.7.7.jar,/usr/local/hive/lib/jetty-sslengine-6.1.26.jar,/usr/local/hive/lib/hadoop-mapreduce-client-jobclient-2.7.1.jar,/usr/local/hive/lib/parquet-hadoop-bundle-1.6.0.jar,/usr/local/hive/lib/derby-10.10.2.0.jar,/usr/local/hive/lib/hive-shims-scheduler-1.2.1.jar,/usr/local/hive/lib/jersey-core-1.9.jar,/usr/local/hive/lib/ant-launcher-1.9.1.jar,/usr/local/hive/lib/accumulo-start-1.6.0.jar,/usr/local/hive/lib/metrics-core-2.2.0.jar,/usr/local/hive/lib/hive-hwi-1.2.1.jar,/usr/local/hive/lib/commons-logging-1.2.jar,/usr/local/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar,/usr/local/hive/lib/jdo-api-3.0.1.jar,/usr/local/hive/lib/joda-time-2.5.jar,/usr/local/hive/lib/jetty-all-server-7.6.0.v20120127.jar,/usr/local/hive/lib/commons-beanutils-1.7.0.jar,/usr/local/hive/lib/hadoop-common-2.7.1.jar,/usr/local/hive/lib/velocity-1.5.jar,/usr/local/hive/lib/hadoop-mapreduce-client-shuffle-2.7.1.jar,/usr/local/hive/lib/datanucleus-rdbms-3.2.9.jar,/usr/local/hive/lib/hbase-checkstyle-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/hbase-shell-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/commons-math-2.2.jar,/usr/local/hive/lib/commons-net-3.1.jar,/usr/local/hive/lib/stax-api-1.0.1.jar,/usr/local/hive/lib/hbase-protocol-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/regexp-1.3.jar,/usr/local/hive/lib/httpcore-4.1.3.jar,/usr/local/hive/lib/hbase-it-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/hive-ant-1.2.1.jar,/usr/local/hive/lib/curator-recipes-2.6.0.jar,/usr/local/hive/lib/jackson-xc-1.9.13.jar,/usr/local/hive/lib/leveldbjni-all-1.8.jar,/usr/local/hive/lib/guava-14.0.1.jar,/usr/local/hive/lib/hbase-prefix-tree-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/jsp-2.1-6.1.14.jar,/usr/local/hive/lib/log4j-1.2.17.jar,/usr/local/hive/lib/libthrift-0.9.2.jar,/usr/local/hive/lib/ant-1.9.1.jar,/usr/local/hive/lib/hbase-resource-bundle-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar,/usr/local/hive/lib/jcodings-1.0.8.jar,/usr/local/hive/lib/apacheds-i18n-2.0.0-M15.jar,/usr/local/hive/lib/hamcrest-core-1.1.jar,/usr/local/hive/lib/hive-hbase-handler-1.2.1.jar,/usr/local/hive/lib/javax.inject-1.jar,/usr/local/hive/lib/hive-shims-0.20S-1.2.1.jar,/usr/local/hive/lib/junit-4.11.jar,/usr/local/hive/lib/hive-shims-1.2.1.jar,/usr/local/hive/lib/commons-collections-3.2.1.jar,/usr/local/hive/lib/commons-daemon-1.0.13.jar,/usr/local/hive/lib/commons-configuration-1.6.jar,/usr/local/hive/lib/joni-2.1.2.jar,/usr/local/hive/lib/jpam-1.1.jar,/usr/local/hive/lib/guice-servlet-3.0.jar,/usr/local/hive/lib/hbase-testing-util-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/jsr305-3.0.0.jar,/usr/local/hive/lib/xmlenc-0.52.jar,/usr/local/hive/lib/httpclient-4.2.5.jar,/usr/local/hive/lib/curator-framework-2.6.0.jar,/usr/local/hive/lib/htrace-core-3.1.0-incubating.jar,/usr/local/hive/lib/hive-beeline-1.2.1.jar,/usr/local/hive/lib/hadoop-yarn-server-common-2.7.1.jar,/usr/local/hive/lib/jline-2.12.jar,/usr/local/hive/lib/tempus-fugit-1.1.jar,/usr/local/hive/lib/jersey-json-1.9.jar,/usr/local/hive/lib/groovy-all-2.1.6.jar,/usr/local/hive/lib/hive-serde-1.2.1.jar,/usr/local/hive/lib/datanucleus-core-3.2.10.jar,/usr/local/hive/lib/commons-httpclient-3.1.jar,/usr/local/hive/lib/guava-12.0.1.jar,/usr/local/hive/lib/slf4j-api-1.7.7.jar,/usr/local/hive/lib/jersey-guice-1.9.jar,/usr/local/hive/lib/hbase-rest-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/hive-shims-0.23-1.2.1.jar,/usr/local/hive/lib/oro-2.0.8.jar,/usr/local/hive/lib/jaxb-api-2.2.2.jar,/usr/local/hive/lib/jamon-runtime-2.3.1.jar,/usr/local/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar,/usr/local/hive/lib/json-20090211.jar,/usr/local/hive/lib/hadoop-mapreduce-client-app-2.7.1.jar,/usr/local/hive/lib/hbase-server-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/hadoop-hdfs-2.7.1.jar,/usr/local/hive/lib/servlet-api-2.5-6.1.14.jar,/usr/local/hive/lib/jta-1.1.jar,/usr/local/hive/lib/spymemcached-2.11.6.jar,/usr/local/hive/lib/commons-beanutils-core-1.8.0.jar,/usr/local/hive/lib/curator-client-2.6.0.jar,/usr/local/hive/lib/jsp-api-2.1-6.1.14.jar,/usr/local/hive/lib/commons-digester-1.8.jar,/usr/local/hive/lib/jetty-util-6.1.26.jar,/usr/local/hive/lib/hive-testutils-1.2.1.jar,/usr/local/hive/lib/jsch-0.1.42.jar,/usr/local/hive/lib/commons-el-1.0.jar,/usr/local/hive/lib/asm-commons-3.1.jar,/usr/local/hive/lib/data-hive-udf.jar,/usr/local/hive/lib/guice-3.0.jar,/usr/local/hive/lib/commons-dbcp-1.4.jar,/usr/local/hive/lib/hive-shims-common-1.2.1.jar,/usr/local/hive/lib/hbase-annotations-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/hadoop-auth-2.7.1.jar,/usr/local/hive/lib/maven-scm-provider-svn-commons-1.4.jar,/usr/local/hive/lib/opencsv-2.3.jar,/usr/local/hive/lib/aopalliance-1.0.jar,/usr/local/hive/lib/hbase-client-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/jruby-complete-1.6.8.jar,/usr/local/hive/lib/plexus-utils-1.5.6.jar,/usr/local/hive/lib/hive-exec-1.2.1.jar,/usr/local/hive/lib/hbase-common-0.98.16.1-hadoop2-tests.jar,/usr/local/hive/lib/high-scale-lib-1.1.1.jar,/usr/local/hive/lib/netty-3.2.4.Final.jar,/usr/local/hive/lib/hive-accumulo-handler-1.2.1.jar,/usr/local/hive/lib/hive-cli-1.2.1.jar,/usr/local/hive/lib/httpclient-4.4.jar,/usr/local/hive/lib/asm-tree-3.1.jar,/usr/local/hive/lib/jackson-core-asl-1.9.13.jar,/usr/local/hive/lib/commons-vfs2-2.0.jar,/usr/local/hive/lib/hive-jdbc-1.2.1-standalone.jar,/usr/local/hive/lib/super-csv-2.2.0.jar,/usr/local/hive/lib/commons-codec-1.4.jar,/usr/local/hive/lib/maven-scm-api-1.4.jar,/usr/local/hive/lib/jettison-1.3.3.jar,/usr/local/hive/lib/api-asn1-api-1.0.0-M20.jar,/usr/local/hive/lib/hbase-hadoop2-compat-0.98.16.1-hadoop2.jar,/usr/local/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar,/usr/local/hive/lib/avro-1.7.4.jar,/usr/local/hive/lib/hive-metastore-1.2.1.jar,/usr/local/hive/lib/commons-compress-1.4.1.jar,/usr/local/hive/lib/disruptor-3.3.0.jar,/usr/local/hive/lib/jasper-runtime-5.5.23.jar,/usr/local/hive/lib/jackson-jaxrs-1.9.13.jar,/usr/local/hive/lib/commons-io-2.4.jar,/usr/local/hive/lib/httpcore-4.4.jar,/usr/local/hive/lib/commons-pool-1.5.4.jar,/usr/local/hive/lib/accumulo-fate-1.6.0.jar,/usr/local/hive/lib/commons-compiler-2.7.6.jar,/usr/local/hive/lib/janino-2.7.6.jar,/usr/local/hive/lib/hive-contrib-1.2.1.jar,/usr/local/hive/lib/commons-math3-3.1.1.jar,/usr/local/hive/lib/hive-jdbc-1.2.1.jar,/usr/local/hive/lib/hbase-server-0.98.16.1-hadoop2-tests.jar,/usr/local/hive/lib/api-util-1.0.0-M20.jar,/usr/local/hive/lib/commons-math-2.1.jar,/usr/local/hive/lib/hadoop-annotations-2.7.1.jar,/usr/local/hive/lib/datanucleus-api-jdo-3.2.6.jar,/usr/local/hive/lib/commons-logging-1.1.3.jar,/usr/local/hive/lib/apache-log4j-extras-1.2.17.jar,/usr/local/hive/hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1.jar
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,791][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.cleanupTempConfFile(AbstractHadoopJob.java:401)]
> - tempMetaFileString is : null
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,792][ERROR][org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:109)]
> - error running Executable
> java.lang.NoClassDefFoundError:
> org/apache/hive/hcatalog/mapreduce/HCatInputFormat
>         at
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:101)
>         at
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:77)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>         at
> org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
>         at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
>         at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51)
>         at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
>         at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat
>         at
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1720)
>         at
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1571)
>         ... 12 more
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,817][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:241)]
> - job id:d0e2f259-9541-4b6f-9f54-c502781549e2-01 from RUNNING to ERROR
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,817][ERROR][org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:109)]
> - error running Executable
> org.apache.kylin.job.exception.ExecuteException:
> java.lang.NoClassDefFoundError:
> org/apache/hive/hcatalog/mapreduce/HCatInputFormat
>         at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:111)
>         at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51)
>         at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
>         at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoClassDefFoundError:
> org/apache/hive/hcatalog/mapreduce/HCatInputFormat
>         at
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:101)
>         at
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:77)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>         at
> org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
>         at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
>         ... 6 more
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat
>         at
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1720)
>         at
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1571)
>         ... 12 more
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,841][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:241)]
> - job id:d0e2f259-9541-4b6f-9f54-c502781549e2 from RUNNING to ERROR
> [pool-7-thread-2]:[2016-01-05
> 14:45:31,842][ERROR][org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:134)]
> - ExecuteException job:d0e2f259-9541-4b6f-9f54-c502781549e2
> org.apache.kylin.job.exception.ExecuteException:
> org.apache.kylin.job.exception.ExecuteException:
> java.lang.NoClassDefFoundError:
> org/apache/hive/hcatalog/mapreduce/HCatInputFormat
>         at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:111)
>         at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.kylin.job.exception.ExecuteException:
> java.lang.NoClassDefFoundError:
> org/apache/hive/hcatalog/mapreduce/HCatInputFormat
>         at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:111)
>         at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51)
>         at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
>         ... 4 more
> Caused by: java.lang.NoClassDefFoundError:
> org/apache/hive/hcatalog/mapreduce/HCatInputFormat
>         at
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:101)
>         at
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:77)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>         at
> org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
>         at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
>         ... 6 more
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat
>         at
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1720)
>         at
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1571)
>
>
>
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "hongbin ma";<[email protected]>;
> 发送时间: 2016年1月5日(星期二) 下午2:34
> 收件人: "dev"<[email protected]>;
>
> 主题: Re: org.apache.hadoop.hive.ql.metadata.HiveException
>
>
>
> can't see attachment. please provide detailed log
>
>
> --
> Regards,
>
> *Bin Mahone | 马洪宾*
> Apache Kylin: http://kylin.io
> Github: https://github.com/binmahone
>



-- 
Best regards,

Shaofeng Shi

Reply via email to