I think this could be good reference to resolve this issue: "hcatalog lib not found": https://github.com/KylinOLAP/Kylin/issues/462#issuecomment-127864482
Thanks. Best Regards! --------------------- Luke Han On Wed, Aug 12, 2015 at 6:44 PM, 奔跑的蜗牛 <[email protected]> wrote: > Yes, our env is hadoop cluster and all the hcatalog jar in same location. > But there is just one hive running on one note. > > > > > ------------------ 原始邮件 ------------------ > 发件人: "Shi, Shaofeng";<[email protected]>; > 发送时间: 2015年8月12日(星期三) 下午5:18 > 收件人: "[email protected]"<[email protected]>; > > 主题: Re: > NoClassDefFoundError:org/apache/hive/hcatalog/mapreduce/HCatInputFormat > > > > is your hadoop a clustered env? If yes, are hive Hcatalog jar existing in > other nodes? > > Kylin assume all the machines in cluster have the same classpath settings; > It will find the hive dependency jars in current machine, and then use the > value as the classpath for MR jobs; If your MR node doesn’t have hive > jars, or in different locations, the mapper/reducer will report such error. > > On 8/12/15, 5:05 PM, "奔跑的蜗牛" <[email protected]> wrote: > > >Hi team, > > > > > >We have installed Kylin-0.7.3 in for test environment. Currently we meet > >2 problems need your help.Could you help to look into it. > >Thank you very much. > > > > > >Hadoop :2.5.0-cdh-5.2.0 > >Hive : 0.13.1 > >Hbase : 0.98.6 > > > > > > > > > >[pool-7-thread-3]:[2015-08-10 > >17:30:49,415][ERROR][org.apache.kylin.job.execution.AbstractExecutable.exe > >cute(AbstractExecutable.java:108)] - error running Executable > >java.lang.NoClassDefFoundError: > >org/apache/hive/hcatalog/mapreduce/HCatInputFormat > > at > >org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDi > >stinctColumnsJob.java:94) > > at > >org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctCo > >lumnsJob.java:74) > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) > > at > >org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable > >.java:112) > > at > >org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutab > >le.java:106) > > at > >org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChai > >nedExecutable.java:50) > > at > >org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutab > >le.java:106) > > at > >org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(Defaul > >tScheduler.java:134) > > at > >java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java: > >1145) > > at > >java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java > >:615) > > at java.lang.Thread.run(Thread.java:744) > > > > > >SEVERE: Servlet.service() for servlet [kylin] in context with path > >[/kylin] threw exception [Handler processing failed; nested exception is > >java.lang.NoClassDefFoundError: > >org/apache/hadoop/hive/ql/session/SessionState] with root cause > > > > > >hive dependency: > >:/home/vipshop/platform/hive/lib/hive-beeline-0.13.1-cdh5.2.0.jar:/home/vi > >pshop/platform/hive/lib/jetty-util-6.1.26.jar:/home/vipshop/platform/hive/ > >lib/jetty-all-7.6.0.v20120127.jar:/home/vipshop/platform/hive/lib/hive-ser > >de-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/commons-lang3-3.1.j > >ar:/home/vipshop/platform/hive/lib/antlr-2.7.7.jar:/home/vipshop/platform/ > >hive/lib/junit-4.10.jar:/home/vipshop/platform/hive/lib/velocity-1.5.jar:/ > >home/vipshop/platform/hive/lib/commons-lang-2.6.jar:/home/vipshop/platform > >/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/home/vipshop/platform/hive/lib/ > >asm-tree-3.1.jar:/home/vipshop/platform/hive/lib/jpam-1.1.jar:/home/vipsho > >p/platform/hive/lib/hive-jdbc-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/h > >ive/lib/opencsv-2.3.jar:/home/vipshop/platform/hive/lib/hive-common-0.13.1 > >-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/stax-api-1.0.1.jar:/home/vip > >shop/platform/hive/lib/hive-ant-0.13.1-cdh5.2.0.jar:/home/vipshop/platform > >/hive/lib/hive-cli-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/ser > >vlet-api-2.5-20081211.jar:/home/vipshop/platform/hive/lib/libthrift-0.9.0- > >cdh5-2.jar:/home/vipshop/platform/hive/lib/jsr305-1.3.9.jar:/home/vipshop/ > >platform/hive/lib/hive-shims-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hi > >ve/lib/derby-10.10.1.1.jar:/home/vipshop/platform/hive/lib/tempus-fugit-1. > >1.jar:/home/vipshop/platform/hive/lib/hive-hwi-0.13.1-cdh5.2.0.jar:/home/v > >ipshop/platform/hive/lib/ant-launcher-1.9.1.jar:/home/vipshop/platform/hiv > >e/lib/hive-shims-common-secure-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/ > >hive/lib/hive-exec-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/hiv > >e-shims-0.23-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/httpcore- > >4.2.5.jar:/home/vipshop/platform/hive/lib/mail-1.4.1.jar:/home/vipshop/pla > >tform/hive/lib/activation-1.1.jar:/home/vipshop/platform/hive/lib/paraname > >r-2.3.jar:/home/vipshop/platform/hive/lib/bonecp-0.8.0.RELEASE.jar:/home/v > >ipshop/platform/hive/lib/ST4-4.0.4.jar:/home/vipshop/platform/hive/lib/com > >mons-logging-1.1.3.jar:/home/vipshop/platform/hive/lib/zookeeper-3.4.5-cdh > >5.2.0.jar:/home/vipshop/platform/hive/lib/oro-2.0.8.jar:/home/vipshop/plat > >form/hive/lib/hive-shims-common-0.13.1-cdh5.2.0.jar:/home/vipshop/platform > >/hive/lib/ant-1.9.1.jar:/home/vipshop/platform/hive/lib/mysql-connector-ja > >va-5.1.25.jar:/home/vipshop/platform/hive/lib/commons-compress-1.4.1.jar:/ > >home/vipshop/platform/hive/lib/asm-commons-3.1.jar:/home/vipshop/platform/ > >hive/lib/commons-codec-1.4.jar:/home/vipshop/platform/hive/lib/jersey-serv > >er-1.14.jar:/home/vipshop/platform/hive/lib/datanucleus-rdbms-3.2.9.jar:/h > >ome/vipshop/platform/hive/lib/datanucleus-core-3.2.10.jar:/home/vipshop/pl > >atform/hive/lib/hive-service-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hi > >ve/lib/avro-1.7.6-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/stringtempl > >ate-3.2.1.jar:/home/vipshop/platform/hive/lib/datanucleus-api-jdo-3.2.6.ja > >r:/home/vipshop/platform/hive/lib/guava-11.0.2.jar:/home/vipshop/platform/ > >hive/lib/antlr-runtime-3.4.jar:/home/vipshop/platform/hive/lib/super-csv-2 > >.2.0.jar:/home/vipshop/platform/hive/lib/servlet-api-2.5.jar:/home/vipshop > >/platform/hive/lib/hive-testutils-0.13.1-cdh5.2.0.jar:/home/vipshop/platfo > >rm/hive/lib/jta-1.1.jar:/home/vipshop/platform/hive/lib/snappy-java-1.0.4. > >1.jar:/home/vipshop/platform/hive/lib/hive-hbase-handler-0.13.1-cdh5.2.0.j > >ar:/home/vipshop/platform/hive/lib/hive-contrib-0.13.1-cdh5.2.0.jar:/home/ > >vipshop/platform/hive/lib/asm-3.2.jar:/home/vipshop/platform/hive/lib/hamc > >rest-core-1.1.jar:/home/vipshop/platform/hive/lib/geronimo-annotation_1.0_ > >spec-1.1.1.jar:/home/vipshop/platform/hive/lib/commons-httpclient-3.0.1.ja > >r:/home/vipshop/platform/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/home/v > >ipshop/platform/hive/lib/commons-cli-1.2.jar:/home/vipshop/platform/hive/l > >ib/httpclient-4.2.5.jar:/home/vipshop/platform/hive/lib/log4j-1.2.16.jar:/ > >home/vipshop/platform/hive/lib/jline-0.9.94.jar:/home/vipshop/platform/hiv > >e/lib/jetty-6.1.26.jar:/home/vipshop/platform/hive/lib/groovy-all-2.1.6.ja > >r:/home/vipshop/platform/hive/lib/jersey-servlet-1.14.jar:/home/vipshop/pl > >atform/hive/lib/commons-io-2.4.jar:/home/vipshop/platform/hive/lib/jdo-api > >-3.0.1.jar:/home/vipshop/platform/hive/lib/hive-metastore-0.13.1-cdh5.2.0. > >jar:/home/vipshop/platform/hive/lib/xz-1.0.jar:/home/vipshop/platform/hive > >/lib/libfb303-0.9.0.jar:/home/vipshop/platform/hive-0.13.1-cdh5.2.0/hcatal > >og/share/hcatalog/hive-hcatalog-core-0.13.1-cdh5.2.0.jar >
