[
https://issues.apache.org/jira/browse/HADOOP-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649040#comment-15649040
]
Sean Busbey commented on HADOOP-11804:
--------------------------------------
{quote}
I tried it with Avro and got NoClassDefFound for Log4J
I think this is expected based on the contents of the hadoop-client-runtime
pom.xml, which marks log4j as optional.
{quote}
Yes, that's correct. Since Avro uses JobConf it will have to add a dependency
on log4j. I'll make sure to call that out in docs that provide examples of use.
If I wanted to try to refactor out the use of log4j in JobConf, do you think
that'd be feasible in time for 3.0?
{quote}
I decompiled the SerializationFactory class, and noticed that it messed with
the config key. I think we need to add some kind of exclusion for
CommonConfigurationKeysPublic.
{code}
// before
if (conf.get(CommonConfigurationKeys.IO_SERIALIZATIONS_KEY).equals("")) {
// decompiled
if (conf.get("org.apache.hadoop.shaded.io.serializations").equals("")) {
{code}
{quote}
Interesting. Let me figure out a test for this and come up with a fix.
> POC Hadoop Client w/o transitive dependencies
> ---------------------------------------------
>
> Key: HADOOP-11804
> URL: https://issues.apache.org/jira/browse/HADOOP-11804
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: build
> Reporter: Sean Busbey
> Assignee: Sean Busbey
> Attachments: HADOOP-11804.1.patch, HADOOP-11804.2.patch,
> HADOOP-11804.3.patch, HADOOP-11804.4.patch, HADOOP-11804.5.patch,
> HADOOP-11804.6.patch, HADOOP-11804.7.patch
>
>
> make a hadoop-client-api and hadoop-client-runtime that i.e. HBase can use to
> talk with a Hadoop cluster without seeing any of the implementation
> dependencies.
> see proposal on parent for details.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
