Author: markus
Date: Thu Aug 11 16:38:58 2011
New Revision: 1156665

URL: http://svn.apache.org/viewvc?rev=1156665&view=rev
Log:
NUTCH-1069 Readlinkdb broken on Hadoop > 0.20

Modified:
    nutch/branches/branch-1.4/CHANGES.txt
    nutch/branches/branch-1.4/src/java/org/apache/nutch/crawl/LinkDbMerger.java

Modified: nutch/branches/branch-1.4/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/nutch/branches/branch-1.4/CHANGES.txt?rev=1156665&r1=1156664&r2=1156665&view=diff
==============================================================================
--- nutch/branches/branch-1.4/CHANGES.txt (original)
+++ nutch/branches/branch-1.4/CHANGES.txt Thu Aug 11 16:38:58 2011
@@ -2,6 +2,8 @@ Nutch Change Log
 
 Release 1.4 - Current development
 
+* NUTCH-1069 Readlinkdb broken on Hadoop > 0.20 (markus)
+
 * NUTCH-1044 Redirected URLs and possibly all of their outlinked URLs have 
invalid scores (jnioche)
 
 * NUTCH-1028 Log urls when parsing (markus)

Modified: 
nutch/branches/branch-1.4/src/java/org/apache/nutch/crawl/LinkDbMerger.java
URL: 
http://svn.apache.org/viewvc/nutch/branches/branch-1.4/src/java/org/apache/nutch/crawl/LinkDbMerger.java?rev=1156665&r1=1156664&r2=1156665&view=diff
==============================================================================
--- nutch/branches/branch-1.4/src/java/org/apache/nutch/crawl/LinkDbMerger.java 
(original)
+++ nutch/branches/branch-1.4/src/java/org/apache/nutch/crawl/LinkDbMerger.java 
Thu Aug 11 16:38:58 2011
@@ -140,6 +140,9 @@ public class LinkDbMerger extends Config
     job.setOutputKeyClass(Text.class);
     job.setOutputValueClass(Inlinks.class);
 
+    // https://issues.apache.org/jira/browse/NUTCH-1069
+    job.setBoolean("mapreduce.fileoutputcommitter.marksuccessfuljobs", false);
+
     return job;
   }
   


Reply via email to