I visited 蜗牛. The problem is caused by HBASE_CLASSPATH being overwritten in
hbase-config.sh. It's now fixed.

For people who may encounter the same issue, `kylin.sh` exports
HBASE_CLASSPATH and HBASE_CLASSPATH_PREFIX, then launch tomcat via `hbase`
command. If the vars get overwritten by some config or env script inside
`hbase`, you will get class not found issues like this.


Cheers
Yang


On Wed, Aug 12, 2015 at 10:09 PM, Luke Han <[email protected]> wrote:

> I think this could be good reference to resolve this issue:
>
> "hcatalog lib not found":
> https://github.com/KylinOLAP/Kylin/issues/462#issuecomment-127864482
>
> Thanks.
>
>
> Best Regards!
> ---------------------
>
> Luke Han
>
> On Wed, Aug 12, 2015 at 6:44 PM, 奔跑的蜗牛 <[email protected]> wrote:
>
> > Yes, our env is hadoop cluster and all the  hcatalog jar in same
> location.
> > But there is just one hive running on one note.
> >
> >
> >
> >
> > ------------------ 原始邮件 ------------------
> > 发件人: "Shi, Shaofeng";<[email protected]>;
> > 发送时间: 2015年8月12日(星期三) 下午5:18
> > 收件人: "[email protected]"<[email protected]>;
> >
> > 主题: Re:
> > NoClassDefFoundError:org/apache/hive/hcatalog/mapreduce/HCatInputFormat
> >
> >
> >
> > is your hadoop a clustered env? If yes, are hive Hcatalog jar existing in
> > other nodes?
> >
> > Kylin assume all the machines in cluster have the same classpath
> settings;
> > It will find the hive dependency jars in current machine, and then use
> the
> > value as the classpath for MR jobs; If your MR node doesn’t have hive
> > jars, or in different locations, the mapper/reducer will report such
> error.
> >
> > On 8/12/15, 5:05 PM, "奔跑的蜗牛" <[email protected]> wrote:
> >
> > >Hi team,
> > >
> > >
> > >We have installed Kylin-0.7.3 in for test environment. Currently we meet
> > >2 problems need your help.Could you help to look into it.
> > >Thank you very much.
> > >
> > >
> > >Hadoop :2.5.0-cdh-5.2.0
> > >Hive : 0.13.1
> > >Hbase : 0.98.6
> > >
> > >
> > >
> > >
> > >[pool-7-thread-3]:[2015-08-10
> >
> >17:30:49,415][ERROR][org.apache.kylin.job.execution.AbstractExecutable.exe
> > >cute(AbstractExecutable.java:108)] - error running Executable
> > >java.lang.NoClassDefFoundError:
> > >org/apache/hive/hcatalog/mapreduce/HCatInputFormat
> > >       at
> >
> >org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDi
> > >stinctColumnsJob.java:94)
> > >       at
> >
> >org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctCo
> > >lumnsJob.java:74)
> > >       at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> > >       at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> > >       at
> >
> >org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable
> > >.java:112)
> > >       at
> >
> >org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutab
> > >le.java:106)
> > >       at
> >
> >org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChai
> > >nedExecutable.java:50)
> > >       at
> >
> >org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutab
> > >le.java:106)
> > >       at
> >
> >org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(Defaul
> > >tScheduler.java:134)
> > >       at
> >
> >java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
> > >1145)
> > >       at
> >
> >java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java
> > >:615)
> > >       at java.lang.Thread.run(Thread.java:744)
> > >
> > >
> > >SEVERE: Servlet.service() for servlet [kylin] in context with path
> > >[/kylin] threw exception [Handler processing failed; nested exception is
> > >java.lang.NoClassDefFoundError:
> > >org/apache/hadoop/hive/ql/session/SessionState] with root cause
> > >
> > >
> > >hive dependency:
> >
> >:/home/vipshop/platform/hive/lib/hive-beeline-0.13.1-cdh5.2.0.jar:/home/vi
> >
> >pshop/platform/hive/lib/jetty-util-6.1.26.jar:/home/vipshop/platform/hive/
> >
> >lib/jetty-all-7.6.0.v20120127.jar:/home/vipshop/platform/hive/lib/hive-ser
> >
> >de-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/commons-lang3-3.1.j
> >
> >ar:/home/vipshop/platform/hive/lib/antlr-2.7.7.jar:/home/vipshop/platform/
> >
> >hive/lib/junit-4.10.jar:/home/vipshop/platform/hive/lib/velocity-1.5.jar:/
> >
> >home/vipshop/platform/hive/lib/commons-lang-2.6.jar:/home/vipshop/platform
> >
> >/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/home/vipshop/platform/hive/lib/
> >
> >asm-tree-3.1.jar:/home/vipshop/platform/hive/lib/jpam-1.1.jar:/home/vipsho
> >
> >p/platform/hive/lib/hive-jdbc-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/h
> >
> >ive/lib/opencsv-2.3.jar:/home/vipshop/platform/hive/lib/hive-common-0.13.1
> >
> >-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/stax-api-1.0.1.jar:/home/vip
> >
> >shop/platform/hive/lib/hive-ant-0.13.1-cdh5.2.0.jar:/home/vipshop/platform
> >
> >/hive/lib/hive-cli-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/ser
> >
> >vlet-api-2.5-20081211.jar:/home/vipshop/platform/hive/lib/libthrift-0.9.0-
> >
> >cdh5-2.jar:/home/vipshop/platform/hive/lib/jsr305-1.3.9.jar:/home/vipshop/
> >
> >platform/hive/lib/hive-shims-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hi
> >
> >ve/lib/derby-10.10.1.1.jar:/home/vipshop/platform/hive/lib/tempus-fugit-1.
> >
> >1.jar:/home/vipshop/platform/hive/lib/hive-hwi-0.13.1-cdh5.2.0.jar:/home/v
> >
> >ipshop/platform/hive/lib/ant-launcher-1.9.1.jar:/home/vipshop/platform/hiv
> >
> >e/lib/hive-shims-common-secure-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/
> >
> >hive/lib/hive-exec-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/hiv
> >
> >e-shims-0.23-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/httpcore-
> >
> >4.2.5.jar:/home/vipshop/platform/hive/lib/mail-1.4.1.jar:/home/vipshop/pla
> >
> >tform/hive/lib/activation-1.1.jar:/home/vipshop/platform/hive/lib/paraname
> >
> >r-2.3.jar:/home/vipshop/platform/hive/lib/bonecp-0.8.0.RELEASE.jar:/home/v
> >
> >ipshop/platform/hive/lib/ST4-4.0.4.jar:/home/vipshop/platform/hive/lib/com
> >
> >mons-logging-1.1.3.jar:/home/vipshop/platform/hive/lib/zookeeper-3.4.5-cdh
> >
> >5.2.0.jar:/home/vipshop/platform/hive/lib/oro-2.0.8.jar:/home/vipshop/plat
> >
> >form/hive/lib/hive-shims-common-0.13.1-cdh5.2.0.jar:/home/vipshop/platform
> >
> >/hive/lib/ant-1.9.1.jar:/home/vipshop/platform/hive/lib/mysql-connector-ja
> >
> >va-5.1.25.jar:/home/vipshop/platform/hive/lib/commons-compress-1.4.1.jar:/
> >
> >home/vipshop/platform/hive/lib/asm-commons-3.1.jar:/home/vipshop/platform/
> >
> >hive/lib/commons-codec-1.4.jar:/home/vipshop/platform/hive/lib/jersey-serv
> >
> >er-1.14.jar:/home/vipshop/platform/hive/lib/datanucleus-rdbms-3.2.9.jar:/h
> >
> >ome/vipshop/platform/hive/lib/datanucleus-core-3.2.10.jar:/home/vipshop/pl
> >
> >atform/hive/lib/hive-service-0.13.1-cdh5.2.0.jar:/home/vipshop/platform/hi
> >
> >ve/lib/avro-1.7.6-cdh5.2.0.jar:/home/vipshop/platform/hive/lib/stringtempl
> >
> >ate-3.2.1.jar:/home/vipshop/platform/hive/lib/datanucleus-api-jdo-3.2.6.ja
> >
> >r:/home/vipshop/platform/hive/lib/guava-11.0.2.jar:/home/vipshop/platform/
> >
> >hive/lib/antlr-runtime-3.4.jar:/home/vipshop/platform/hive/lib/super-csv-2
> >
> >.2.0.jar:/home/vipshop/platform/hive/lib/servlet-api-2.5.jar:/home/vipshop
> >
> >/platform/hive/lib/hive-testutils-0.13.1-cdh5.2.0.jar:/home/vipshop/platfo
> >
> >rm/hive/lib/jta-1.1.jar:/home/vipshop/platform/hive/lib/snappy-java-1.0.4.
> >
> >1.jar:/home/vipshop/platform/hive/lib/hive-hbase-handler-0.13.1-cdh5.2.0.j
> >
> >ar:/home/vipshop/platform/hive/lib/hive-contrib-0.13.1-cdh5.2.0.jar:/home/
> >
> >vipshop/platform/hive/lib/asm-3.2.jar:/home/vipshop/platform/hive/lib/hamc
> >
> >rest-core-1.1.jar:/home/vipshop/platform/hive/lib/geronimo-annotation_1.0_
> >
> >spec-1.1.1.jar:/home/vipshop/platform/hive/lib/commons-httpclient-3.0.1.ja
> >
> >r:/home/vipshop/platform/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/home/v
> >
> >ipshop/platform/hive/lib/commons-cli-1.2.jar:/home/vipshop/platform/hive/l
> >
> >ib/httpclient-4.2.5.jar:/home/vipshop/platform/hive/lib/log4j-1.2.16.jar:/
> >
> >home/vipshop/platform/hive/lib/jline-0.9.94.jar:/home/vipshop/platform/hiv
> >
> >e/lib/jetty-6.1.26.jar:/home/vipshop/platform/hive/lib/groovy-all-2.1.6.ja
> >
> >r:/home/vipshop/platform/hive/lib/jersey-servlet-1.14.jar:/home/vipshop/pl
> >
> >atform/hive/lib/commons-io-2.4.jar:/home/vipshop/platform/hive/lib/jdo-api
> >
> >-3.0.1.jar:/home/vipshop/platform/hive/lib/hive-metastore-0.13.1-cdh5.2.0.
> >
> >jar:/home/vipshop/platform/hive/lib/xz-1.0.jar:/home/vipshop/platform/hive
> >
> >/lib/libfb303-0.9.0.jar:/home/vipshop/platform/hive-0.13.1-cdh5.2.0/hcatal
> > >og/share/hcatalog/hive-hcatalog-core-0.13.1-cdh5.2.0.jar
> >
>

Reply via email to