Hi,all
I'm a green hand in using apache tez. Recently,I met some of the difficulty:
our team has developed a plug-in on hive. It is similar to the function of
HBaseHandler,but customized code. Now my task is to ensure it can be compatible
with tez. while that is the background.My question is:
(1)I have a directory named nbconf,it is created under $HIVE_HOME, under
it,there is a sub-directory named conf/hbasetable.
(2)I also have a directory named nblib,it is created under $HIVE_HOME,used for
Tez JARs.
(3)when I set hive.compute.splits.in.am=true,it throws Exception in hive log:
……
[map1]java.lang.ExceptionInInitializerError:
……
……
Caused by java.lang.RuntimeException:[conf/hbasetable/] path not exsit or is
not a directory
……
But actually it exists!It is under local $HIVE_HOME/nbconf. When I set
hive.compute.splits.in.am=FALSE,it works well. So, I guess,maybe because
computing splits in Cluster AM,not in localdisk. Mybe I should load some files
or directory(eg.conf/hbasetable)HDFS,If tez wish to do so,where should I put
them?:
the tez session dirctory?
/tmp/hadoop_yarn/root/_tez_session_dir/?
/tmp/hadoop_yarn/root/_tez_session_dir/.tez/?
/tmp/hadoop_yarn/root/_tez_session_dir/.tez/AppId/?
I tryed these,but they all didn't work.
becase it is OK when debugging, so I don`t know how to take up the matter. I
don't know where to put this customed directory "[conf/hbasetable]" on HDFS.
I am eager to get your guidance. Any help is greatly appreciated .
(Please forgive my poor English)
LLBian