[ 
https://issues.apache.org/jira/browse/NUTCH-1805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14144619#comment-14144619
 ] 

Viacheslav Dobromyslov commented on NUTCH-1805:
-----------------------------------------------

hadoop-core-1.0.1 breaks execution under Hadoop 2.4.0

> Remove unnecessary transitive dependencies from Hadoop core 
> ------------------------------------------------------------
>
>                 Key: NUTCH-1805
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1805
>             Project: Nutch
>          Issue Type: Improvement
>          Components: build
>            Reporter: Julien Nioche
>            Priority: Minor
>             Fix For: 1.10
>
>
> The Hadoop libs are not included in the job file as a Hadoop cluster must 
> already be available in order to use it, however some of its transitive 
> dependencies make it to the job file. We already prevent some but could 
> extend that to :
>                       <exclude org="org.mortbay.jetty"/>
>                       <exclude org="com.sun.jersey"/>
>                       <exclude org="tomcat"/>
> Note that we need some of the Hadoop classes and dependencies in order to run 
> Nutch in local mode.
> Alternatively we could have a separate Ivy profile only for Hadoop and store 
> the dependencies in a separate location so that they do not get copied to the 
> job jar, however this is probably an overkill if the dependencies above are 
> not needed when running in local mode.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to