[
https://issues.apache.org/jira/browse/HBASE-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748756#comment-13748756
]
Sergey Shelukhin commented on HBASE-9213:
-----------------------------------------
There were some problems with maven not pulling transitive dependencies due to
a variable in pom file, which was solved by separating builds in the jira
mentioned above. Other projects have to specify internal modules to get
compatibility with hadoop1 and hadoop2. It's also not clear now with 2 builds
how people will organize their builds (e.g. will Flume have to have two builds
or Hbase shim too?), and how deployment is going to work - deployed -hadoop1
build will not be able to work with hadoop2 is that is upgraded as far as I
understand.
Hive shim - I am not aware of any documentation, so code is something that can
be read :) Here's my understanding, I think this is correct in general, might
have some incorrect details. Hive has an advantage of not shipping dependencies
such as Hadoop. So, at build time, for tests/etc., they get all dependencies
for both hadoop versions; build points to the correct one based on profile. At
runtime, the user is expected to supply hadoop. The shim creator determines at
runtime which hadoop is used and provides the appropriate shim.
So, one build of Hive can run on multiple versions and user doesn't need to
bother as long as there's Hadoop in the cluster.
> create a unified shim for hadoop 1 and 2 so that there's one build of HBase
> ---------------------------------------------------------------------------
>
> Key: HBASE-9213
> URL: https://issues.apache.org/jira/browse/HBASE-9213
> Project: HBase
> Issue Type: Brainstorming
> Components: build
> Reporter: Sergey Shelukhin
>
> This is a brainstorming JIRA. Working with HBase dependency at this point
> seems to be rather painful from what I hear from other folks. We could do the
> hive model with unified shim, built in such manner that it can work with
> either version, where at build time dependencies for all 2-3 versions are
> pulled and the appropriate one is used for tests, and when running HBase you
> have to point at Hadoop directory to get the dependencies. I am not very
> proficient at maven so not quite certain of the best solution yet.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira