[
https://issues.apache.org/jira/browse/AMBARI-21607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16107506#comment-16107506
]
Eric Yang commented on AMBARI-21607:
------------------------------------
HIVE_AUX_JARS_PATH is not configured properly after the upgrade. Before
upgrade, it shows:
{code}
# Set HIVE_AUX_JARS_PATH
export HIVE_AUX_JARS_PATH=/usr/iop/current/hbase-client/lib/hbase-client.jar,\
/usr/iop/current/hbase-client/lib/hbase-common.jar,\
/usr/iop/current/hbase-client/lib/hbase-hadoop2-compat.jar,\
/usr/iop/current/hbase-client/lib/hbase-prefix-tree.jar,\
/usr/iop/current/hbase-client/lib/hbase-protocol.jar,\
/usr/iop/current/hbase-client/lib/hbase-server.jar,\
/usr/iop/current/hbase-client/lib/htrace-core-3.1.0-incubating.jar,\
${HIVE_AUX_JARS_PATH}
{code}
After upgrade:
{code}
# Set HIVE_AUX_JARS_PATH
export HIVE_AUX_JARS_PATH=/hbase-client.jar,\
/hbase-common.jar,\
/hbase-hadoop2-compat.jar,\
/hbase-prefix-tree.jar,\
/hbase-protocol.jar,\
/hbase-server.jar,\
/htrace-core-3.1.0-incubating.jar,\
${HIVE_AUX_JARS_PATH}
{code}
In IOP there is a variable called {{hbase_lib}} which helped to translate the
prefix path to HBase lib directory. It looks like HDP is missing this
configuration.
> Hive can not write to session directory after upgrade
> -----------------------------------------------------
>
> Key: AMBARI-21607
> URL: https://issues.apache.org/jira/browse/AMBARI-21607
> Project: Ambari
> Issue Type: Bug
> Components: stacks
> Affects Versions: 2.5.2
> Reporter: Eric Yang
> Fix For: 2.5.2
>
>
> After upgrade, start hive shell. This error message is shown:
> {code}
> Exception in thread "main" java.lang.RuntimeException: java.io.IOException:
> Previous writer likely failed to write
> hdfs://eyang-1.openstacklocal:8020/tmp/hive/hive/_tez_session_dir/6a2cab98-2e71-4223-bc9d-6301b3c6a5d5/hbase-client.jar.
> Failing because I am unlikely to write too.
> at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:560)
> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:233)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
> Caused by: java.io.IOException: Previous writer likely failed to write
> hdfs://eyang-1.openstacklocal:8020/tmp/hive/hive/_tez_session_dir/6a2cab98-2e71-4223-bc9d-6301b3c6a5d5/hbase-client.jar.
> Failing because I am unlikely to write too.
> at
> org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeResource(DagUtils.java:1002)
> at
> org.apache.hadoop.hive.ql.exec.tez.DagUtils.addTempResources(DagUtils.java:882)
> at
> org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeTempFilesFromConf(DagUtils.java:809)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.refreshLocalResourcesFromConf(TezSessionState.java:258)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:157)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116)
> at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:557)
> ... 8 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
