[
https://issues.apache.org/jira/browse/HADOOP-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674707#comment-15674707
]
Sean Busbey commented on HADOOP-11804:
--------------------------------------
Okay, I've updated [~andrew.wang]'s patch for avro master:
https://gist.github.com/busbey/caccd2fedda36409df4a319deb3e69c2
And given v9 locally installed, I get a clean run of {{./build.sh test}} in
{{lang/java}}.
the avro-mapred module ends up with this dep tree:
{code}
[INFO] --- maven-dependency-plugin:2.8:tree (default-cli) @ avro-mapred ---
[INFO] org.apache.avro:avro-mapred:bundle:1.9.0-SNAPSHOT
[INFO] +- org.apache.avro:avro-ipc:jar:1.9.0-SNAPSHOT:compile
[INFO] | +- org.apache.avro:avro:jar:1.9.0-SNAPSHOT:compile
[INFO] | +- org.mortbay.jetty:jetty:jar:6.1.26:compile
[INFO] | +- org.mortbay.jetty:jetty-util:jar:6.1.26:compile
[INFO] | +- io.netty:netty:jar:3.5.13.Final:compile
[INFO] | +- org.apache.velocity:velocity:jar:1.7:compile
[INFO] | | +- commons-collections:commons-collections:jar:3.2.1:compile
[INFO] | | \- commons-lang:commons-lang:jar:2.4:compile
[INFO] | \- org.mortbay.jetty:servlet-api:jar:2.5-20081211:compile
[INFO] +- org.apache.avro:avro-ipc:jar:tests:1.9.0-SNAPSHOT:test
[INFO] +- org.apache.avro:avro:test-jar:tests:1.9.0-SNAPSHOT:test
[INFO] | +- org.apache.avro:avro-guava-dependencies:jar:1.9.0-SNAPSHOT:compile
[INFO] | | +- com.google.guava:guava:jar:11.0.2:compile
[INFO] | | \-
com.github.stephenc.findbugs:findbugs-annotations:jar:1.3.9-1:compile
[INFO] | +- com.thoughtworks.paranamer:paranamer:jar:2.7:compile
[INFO] | +- org.xerial.snappy:snappy-java:jar:1.1.1.3:compile
[INFO] | +- org.apache.commons:commons-compress:jar:1.8.1:compile
[INFO] | \- org.tukaani:xz:jar:1.5:compile
[INFO] +- org.easymock:easymock:jar:3.2:test
[INFO] | +- cglib:cglib-nodep:jar:2.2.2:test
[INFO] | \- org.objenesis:objenesis:jar:1.3:test
[INFO] +- org.hamcrest:hamcrest-library:jar:1.3:test
[INFO] | \- org.hamcrest:hamcrest-core:jar:1.3:test
[INFO] +- org.codehaus.jackson:jackson-core-asl:jar:1.9.13:compile
[INFO] +- org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13:compile
[INFO] +- commons-codec:commons-codec:jar:1.9:compile
[INFO] +- org.apache.hadoop:hadoop-client-api:jar:3.0.0-alpha2-SNAPSHOT:compile
[INFO] +-
org.apache.hadoop:hadoop-client-runtime:jar:3.0.0-alpha2-SNAPSHOT:provided
[INFO] | +- org.apache.htrace:htrace-core4:jar:4.1.0-incubating:provided
[INFO] | \- commons-logging:commons-logging:jar:1.1.3:provided
[INFO] +- log4j:log4j:jar:1.2.17:provided
[INFO] +- junit:junit:jar:4.11:test
[INFO] +- org.slf4j:slf4j-api:jar:1.7.7:compile
[INFO] \- org.slf4j:slf4j-simple:jar:1.7.7:runtime
{code}
Which looks about as I'd expect (maybe hadoop-client-api should be provided as
well, given the notes in the avro pom, but that's probably immaterial).
and avro-tools looks reasonable:
{code}
[INFO] --- maven-dependency-plugin:2.8:tree (default-cli) @ avro-tools ---
[INFO] org.apache.avro:avro-tools:jar:1.9.0-SNAPSHOT
[INFO] +- org.apache.avro:avro:jar:1.9.0-SNAPSHOT:compile
[INFO] | +- org.apache.avro:avro-guava-dependencies:jar:1.9.0-SNAPSHOT:compile
[INFO] | | \- com.google.guava:guava:jar:11.0.2:compile
[INFO] | +- org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13:compile
[INFO] | +- com.thoughtworks.paranamer:paranamer:jar:2.7:compile
[INFO] | +- org.xerial.snappy:snappy-java:jar:1.1.1.3:compile
[INFO] | +- org.apache.commons:commons-compress:jar:1.8.1:compile
[INFO] | \- org.tukaani:xz:jar:1.5:compile
[INFO] +- org.apache.avro:avro:jar:tests:1.9.0-SNAPSHOT:test
[INFO] +- org.apache.avro:avro-compiler:jar:1.9.0-SNAPSHOT:compile
[INFO] | +- commons-lang:commons-lang:jar:2.6:compile
[INFO] | +- org.apache.velocity:velocity:jar:1.7:compile
[INFO] | | \- commons-collections:commons-collections:jar:3.2.1:compile
[INFO] | \- joda-time:joda-time:jar:2.7:compile
[INFO] +- org.apache.avro:avro-ipc:jar:1.9.0-SNAPSHOT:compile
[INFO] | +- org.mortbay.jetty:jetty:jar:6.1.26:compile
[INFO] | +- org.mortbay.jetty:jetty-util:jar:6.1.26:compile
[INFO] | +- io.netty:netty:jar:3.5.13.Final:compile
[INFO] | \- org.mortbay.jetty:servlet-api:jar:2.5-20081211:compile
[INFO] +- org.apache.avro:avro-mapred:jar:1.9.0-SNAPSHOT:compile
[INFO] | \- commons-codec:commons-codec:jar:1.9:compile
[INFO] +- org.apache.avro:avro-mapred:test-jar:tests:1.9.0-SNAPSHOT:test
[INFO] +- commons-cli:commons-cli:jar:1.2:compile
[INFO] +- commons-logging:commons-logging:jar:1.1.1:compile
[INFO] +- commons-httpclient:commons-httpclient:jar:3.1:compile
[INFO] +- org.apache.avro:trevni-core:jar:1.9.0-SNAPSHOT:compile
[INFO] +- org.apache.avro:trevni-avro:jar:1.9.0-SNAPSHOT:compile
[INFO] | \- org.apache.avro:avro-mapred:jar:hadoop2:1.9.0-SNAPSHOT:compile
[INFO] +- org.apache.avro:trevni-core:jar:tests:1.9.0-SNAPSHOT:compile
[INFO] +- org.apache.avro:trevni-avro:jar:tests:1.9.0-SNAPSHOT:compile
[INFO] +- org.codehaus.jackson:jackson-core-asl:jar:1.9.13:compile
[INFO] +-
org.apache.hadoop:hadoop-client-runtime:jar:3.0.0-alpha2-SNAPSHOT:runtime
[INFO] | \- org.apache.htrace:htrace-core4:jar:4.1.0-incubating:runtime
[INFO] +- org.apache.hadoop:hadoop-client-api:jar:3.0.0-alpha2-SNAPSHOT:compile
[INFO] +- log4j:log4j:jar:1.2.17:compile
[INFO] +- net.sf.jopt-simple:jopt-simple:jar:4.7:compile
[INFO] +- com.github.stephenc.findbugs:findbugs-annotations:jar:1.3.9-1:compile
[INFO] +- junit:junit:jar:4.11:test
[INFO] | \- org.hamcrest:hamcrest-core:jar:1.3:test
[INFO] +- org.slf4j:slf4j-api:jar:1.7.7:compile
[INFO] \- org.slf4j:slf4j-simple:jar:1.7.7:runtime
{code}
> POC Hadoop Client w/o transitive dependencies
> ---------------------------------------------
>
> Key: HADOOP-11804
> URL: https://issues.apache.org/jira/browse/HADOOP-11804
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: build
> Reporter: Sean Busbey
> Assignee: Sean Busbey
> Attachments: HADOOP-11804.1.patch, HADOOP-11804.2.patch,
> HADOOP-11804.3.patch, HADOOP-11804.4.patch, HADOOP-11804.5.patch,
> HADOOP-11804.6.patch, HADOOP-11804.7.patch, HADOOP-11804.8.patch,
> HADOOP-11804.9.patch
>
>
> make a hadoop-client-api and hadoop-client-runtime that i.e. HBase can use to
> talk with a Hadoop cluster without seeing any of the implementation
> dependencies.
> see proposal on parent for details.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
