[
https://issues.apache.org/jira/browse/TEZ-4089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16947414#comment-16947414
]
Zoltan Haindrich commented on TEZ-4089:
---------------------------------------
[~jeagles] thank you for replying. Yes it seems like I'm doing "Mode B"
I would like to give you some background; to explain why I can't do "Mode A"
I'm working on creating a docker environment in which developmnet version of
hive can be test-drived - and for that I install some versions of
hadoop/tez/hive from release tarballs for start.
Using release artifacts also makes it possible to more easily test for bugs in
older versions.
To install Tez, I do something like this:
* download a release tarball from https://www-eu.apache.org/dist/tez/0.9.1/
* install {release}/share/tez.tar.gz as /apps/tez/tez.tar.gz
* configure tez/tez-site/tez.lib.uris to ${fs.defaultFS}/apps/tez/tez.tar.gz
* and have the environment variable:
{{HADOOP_CLASSPATH='/etc/tez/:/active/tez/lib/**:/active/tez/**:/apps/lib/**'}}
This is a "Mode B" installation because the share/tez.tar.gz contains a bunch
of hadoop jars
For "Mode A" I would need a "minimal" jar; but that doesn't seem to be present
in neither the release; nor at https://www-eu.apache.org/dist/tez/0.9.1/
I've built 0.9.1 and copied the minimal tar.gz to its place enabled
tez.use.cluster.hadoop-libs => and it works...
I don't know where could I obtain the minimal.tar.gz
> Upgrade to hadoop 2.8.4 to make 0.9.x releases work with Hive 3.x
> -----------------------------------------------------------------
>
> Key: TEZ-4089
> URL: https://issues.apache.org/jira/browse/TEZ-4089
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Zoltan Haindrich
> Priority: Major
> Attachments: TEZ-4089.branch-0.9.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> HADOOP-12209 have changed slightly the api of the FileStatus class - and
> because of that applications compiled against hadoop >=2.8 can't run with tez
> 0.9.x because of some exceptions arising from that.
> Right now I think its not possible to deploy an upstream hive release (which
> would use tez) without rebuilding tez along the way.
> http://mail-archives.apache.org/mod_mbox/tez-dev/201910.mbox/%3C0879b9ec-f334-2349-ca71-90ad053b20cd%40rxd.hu%3E
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
