Yes, our env is hadoop cluster and all the hcatalog jar in same location. But there is just one hive running on one note.
------------------ ???????? ------------------ ??????: "Shi, Shaofeng";<[email protected]>; ????????: 2015??8??12??(??????) ????5:18 ??????: "[email protected]"<[email protected]>; ????: Re: NoClassDefFoundError:org/apache/hive/hcatalog/mapreduce/HCatInputFormat is your hadoop a clustered env? If yes, are hive Hcatalog jar existing in other nodes? Kylin assume all the machines in cluster have the same classpath settings; It will find the hive dependency jars in current machine, and then use the value as the classpath for MR jobs; If your MR node doesn??t have hive jars, or in different locations, the mapper/reducer will report such error. On 8/12/15, 5:05 PM, "??????????" <[email protected]> wrote: >Hi team, > > >We have installed Kylin-0.7.3 in for test environment. Currently we meet >2 problems need your help.Could you help to look into it. >Thank you very much. > > >Hadoop :2.5.0-cdh-5.2.0 >Hive : 0.13.1 >Hbase : 0.98.6 > > > > >[pool-7-thread-3]:[2015-08-10 >17:30:49,415][ERROR][org.apache.kylin.job.execution.AbstractExecutable.exe >cute(AbstractExecutable.java:108)] - error running Executable >java.lang.NoClassDefFoundError: >org/apache/hive/hcatalog/mapreduce/HCatInputFormat > at >org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDi >stinctColumnsJob.java:94) > at >org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctCo >lumnsJob.java:74) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) > at >org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable >.java:112) > at >org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutab >le.java:106) > at >org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChai >nedExecutable.java:50) > at >org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutab >le.java:106) > at >org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(Defaul >tScheduler.java:134) > at >java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java: >1145) > at >java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java >:615) > at java.lang.Thread.run(Thread.java:744) > > >SEVERE: Servlet.service() for servlet [kylin] in context with path >[/kylin] threw exception [Handler processing failed; nested exception is >java.lang.NoClassDefFoundError: >org/apache/hadoop/hive/ql/session/SessionState] with root cause > > >hive dependency: >:/home/vipshop/platform/hive/lib/hive-beeline-0.13.1-cdh5.2.0.jar:/home/vi >pshop/platform/hive/lib/jetty-util-6.1.26.jar:/home/vipshop/platform/hive/ >lib/jetty-all-7.6.0.v20120127.jar:/home/vipshop/platform/hive/lib/hive-ser >de-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/commons-lang3-3.1.j >ar:/home/vipshop/platform/hive/lib/antlr-2.7.7.jar:/home/vipshop/platform/ >hive/lib/junit-4.10.jar:/home/vipshop/platform/hive/lib/velocity-1.5.jar:/ >home/vipshop/platform/hive/lib/commons-lang-2.6.jar:/home/vipshop/platform >/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/home/vipshop/platform/hive/lib/ >asm-tree-3.1.jar:/home/vipshop/platform/hive/lib/jpam-1.1.jar:/home/vipsho >p/platform/hive/lib/hive-jdbc-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/h >ive/lib/opencsv-2.3.jar:/home/vipshop/platform/hive/lib/hive-common-0.13.1 >-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/stax-api-1.0.1.jar:/home/vip >shop/platform/hive/lib/hive-ant-0.13.1-cdh5.2.0.jar:/home/vipshop/platform >/hive/lib/hive-cli-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/ser >vlet-api-2.5-20081211.jar:/home/vipshop/platform/hive/lib/libthrift-0.9.0- >cdh5-2.jar:/home/vipshop/platform/hive/lib/jsr305-1.3.9.jar:/home/vipshop/ >platform/hive/lib/hive-shims-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hi >ve/lib/derby-10.10.1.1.jar:/home/vipshop/platform/hive/lib/tempus-fugit-1. >1.jar:/home/vipshop/platform/hive/lib/hive-hwi-0.13.1-cdh5.2.0.jar:/home/v >ipshop/platform/hive/lib/ant-launcher-1.9.1.jar:/home/vipshop/platform/hiv >e/lib/hive-shims-common-secure-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/ >hive/lib/hive-exec-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/hiv >e-shims-0.23-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/httpcore- >4.2.5.jar:/home/vipshop/platform/hive/lib/mail-1.4.1.jar:/home/vipshop/pla >tform/hive/lib/activation-1.1.jar:/home/vipshop/platform/hive/lib/paraname >r-2.3.jar:/home/vipshop/platform/hive/lib/bonecp-0.8.0.RELEASE.jar:/home/v >ipshop/platform/hive/lib/ST4-4.0.4.jar:/home/vipshop/platform/hive/lib/com >mons-logging-1.1.3.jar:/home/vipshop/platform/hive/lib/zookeeper-3.4.5-cdh >5.2.0.jar:/home/vipshop/platform/hive/lib/oro-2.0.8.jar:/home/vipshop/plat >form/hive/lib/hive-shims-common-0.13.1-cdh5.2.0.jar:/home/vipshop/platform >/hive/lib/ant-1.9.1.jar:/home/vipshop/platform/hive/lib/mysql-connector-ja >va-5.1.25.jar:/home/vipshop/platform/hive/lib/commons-compress-1.4.1.jar:/ >home/vipshop/platform/hive/lib/asm-commons-3.1.jar:/home/vipshop/platform/ >hive/lib/commons-codec-1.4.jar:/home/vipshop/platform/hive/lib/jersey-serv >er-1.14.jar:/home/vipshop/platform/hive/lib/datanucleus-rdbms-3.2.9.jar:/h >ome/vipshop/platform/hive/lib/datanucleus-core-3.2.10.jar:/home/vipshop/pl >atform/hive/lib/hive-service-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hi >ve/lib/avro-1.7.6-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/stringtempl >ate-3.2.1.jar:/home/vipshop/platform/hive/lib/datanucleus-api-jdo-3.2.6.ja >r:/home/vipshop/platform/hive/lib/guava-11.0.2.jar:/home/vipshop/platform/ >hive/lib/antlr-runtime-3.4.jar:/home/vipshop/platform/hive/lib/super-csv-2 >.2.0.jar:/home/vipshop/platform/hive/lib/servlet-api-2.5.jar:/home/vipshop >/platform/hive/lib/hive-testutils-0.13.1-cdh5.2.0.jar:/home/vipshop/platfo >rm/hive/lib/jta-1.1.jar:/home/vipshop/platform/hive/lib/snappy-java-1.0.4. >1.jar:/home/vipshop/platform/hive/lib/hive-hbase-handler-0.13.1-cdh5.2.0.j >ar:/home/vipshop/platform/hive/lib/hive-contrib-0.13.1-cdh5.2.0.jar:/home/ >vipshop/platform/hive/lib/asm-3.2.jar:/home/vipshop/platform/hive/lib/hamc >rest-core-1.1.jar:/home/vipshop/platform/hive/lib/geronimo-annotation_1.0_ >spec-1.1.1.jar:/home/vipshop/platform/hive/lib/commons-httpclient-3.0.1.ja >r:/home/vipshop/platform/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/home/v >ipshop/platform/hive/lib/commons-cli-1.2.jar:/home/vipshop/platform/hive/l >ib/httpclient-4.2.5.jar:/home/vipshop/platform/hive/lib/log4j-1.2.16.jar:/ >home/vipshop/platform/hive/lib/jline-0.9.94.jar:/home/vipshop/platform/hiv >e/lib/jetty-6.1.26.jar:/home/vipshop/platform/hive/lib/groovy-all-2.1.6.ja >r:/home/vipshop/platform/hive/lib/jersey-servlet-1.14.jar:/home/vipshop/pl >atform/hive/lib/commons-io-2.4.jar:/home/vipshop/platform/hive/lib/jdo-api >-3.0.1.jar:/home/vipshop/platform/hive/lib/hive-metastore-0.13.1-cdh5.2.0. >jar:/home/vipshop/platform/hive/lib/xz-1.0.jar:/home/vipshop/platform/hive >/lib/libfb303-0.9.0.jar:/home/vipshop/platform/hive-0.13.1-cdh5.2.0/hcatal >og/share/hcatalog/hive-hcatalog-core-0.13.1-cdh5.2.0.jar
