it is ok,thanks
if my emr cluster has a directory /usr/lib/oozie/lib??HBASE_ENV_INIT??true, i
do not change /usr/lib/hbase/conf/hbase-env.sh, i do not konw why you judge by
/usr/lib/oozie/lib directory
if [ -n is_aws ] && [ -d "/usr/lib/oozie/lib" ]; then
export HBASE_ENV_INIT="true"
fi
------------------ ???????? ------------------
??????: "liuyiming.vip";<[email protected]>;
????????: 2016??10??19??(??????) ????2:47
??????: "dev"<[email protected]>;
????: Re: java.lang.NoClassDefFoundError:
org/apache/hive/hcatalog/mapreduce/HCatInputFormat
Edit /usr/lib/hbase/conf/hbase-env.sh
Change the first line from
export HBASE_CLASSPATH=/etc/hadoop/conf
to
export HBASE_CLASSPATH=$HBASE_CLASSPATH:/etc/hadoop/conf
2016-10-19 14:24 GMT+08:00 ???? <[email protected]>:
> Hi when i build the sample kylin_sales_cube, in the kylin.log,i find
> java.lang.NoClassDefFoundError. but in the log i find some messages, i do
> not konw why?
>
>
> /usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-core-2.1.0-amzn-0.jar
> is loaded, why class is not foung?
>
>
> 016-10-18 23:17:59,902 INFO [pool-8-thread-3]
> common.AbstractHadoopJob:203 : Hive Dependencies After Filtered:
> /usr/lib/hive/lib/hive-metastore-2.1.0-amzn-0.jar,/
> usr/lib/hive/lib/hive-exec-2.1.0-amzn-0.jar,/usr/lib/hive-
> hcatalog/share/hcatalog/hive-hcatalog-core-2.1.0-amzn-0.jar
>
>
> 2016-10-18 23:17:59,907 INFO [pool-8-thread-3]
> common.AbstractHadoopJob:371 : Job 'tmpjars' updated --
> file:/usr/lib/hive/lib/hive-metastore-2.1.0-amzn-0.jar,
> file:/usr/lib/hive/lib/hive-exec-2.1.0-amzn-0.jar,file:/
> usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-core-2.1.0-amzn-0.jar
>
>
> 2016-10-18 23:17:59,934 ERROR [pool-8-thread-3]
> threadpool.DefaultScheduler:140 : ExecuteException
> job:845380a7-63b7-4315-8d71-6bb290018790
> org.apache.kylin.job.exception.ExecuteException:
> org.apache.kylin.job.exception.ExecuteException:
> java.lang.NoClassDefFoundError: org/apache/hive/hcatalog/
> mapreduce/HCatInputFormat
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:123)
> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$
> JobRunner.run(DefaultScheduler.java:136)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.kylin.job.exception.ExecuteException:
> java.lang.NoClassDefFoundError:
> org/apache/hive/hcatalog/mapreduce/HCatInputFormat
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:123)
> at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(
> DefaultChainedExecutable.java:57)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> ... 4 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/hive/hcatalog/
> mapreduce/HCatInputFormat
> at org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.
> configureJob(HiveMRInput.java:89)
> at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> setupMapper(FactDistinctColumnsJob.java:123)
> at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> run(FactDistinctColumnsJob.java:103)
> at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:88)
> at org.apache.kylin.engine.mr.common.MapReduceExecutable.
> doWork(MapReduceExecutable.java:120)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> ... 6 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hive.hcatalog.
> mapreduce.HCatInputFormat
> at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(
> WebappClassLoaderBase.java:1858)
> at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(
> WebappClassLoaderBase.java:1701)
> ... 12 more
--
With Warm regards
Yiming Liu (??????)
