Sebastian Nagel resolved NUTCH-1805.
    Resolution: Resolved

We rely now only on a fixed set of Hadoop sub-dependencies ("hadoop-common", 
"hadoop-hdfs", "hadoop-mapreduce-*"). Explicit exclusions of transitive 
dependencies are configured.

> Remove unnecessary transitive dependencies from Hadoop core 
> ------------------------------------------------------------
>                 Key: NUTCH-1805
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1805
>             Project: Nutch
>          Issue Type: Improvement
>          Components: build
>            Reporter: Julien Nioche
>            Priority: Minor
> The Hadoop libs are not included in the job file as a Hadoop cluster must 
> already be available in order to use it, however some of its transitive 
> dependencies make it to the job file. We already prevent some but could 
> extend that to :
>                       <exclude org="org.mortbay.jetty"/>
>                       <exclude org="com.sun.jersey"/>
>                       <exclude org="tomcat"/>
> Note that we need some of the Hadoop classes and dependencies in order to run 
> Nutch in local mode.
> Alternatively we could have a separate Ivy profile only for Hadoop and store 
> the dependencies in a separate location so that they do not get copied to the 
> job jar, however this is probably an overkill if the dependencies above are 
> not needed when running in local mode.

This message was sent by Atlassian Jira

Reply via email to