Author: ab
Date: Wed Jul 19 16:54:51 2006
New Revision: 423665
URL: http://svn.apache.org/viewvc?rev=423665&view=rev
Log:
If a transient exception is thrown, don't mark the page as gone but retry.
Modified:
lucene/nutch/trunk/src/java/org/apache/nutch/fetcher/Fetcher.java
Modified: lucene/nutch/trunk/src/java/org/apache/nutch/fetcher/Fetcher.java
URL:
http://svn.apache.org/viewvc/lucene/nutch/trunk/src/java/org/apache/nutch/fetcher/Fetcher.java?rev=423665&r1=423664&r2=423665&view=diff
==============================================================================
--- lucene/nutch/trunk/src/java/org/apache/nutch/fetcher/Fetcher.java (original)
+++ lucene/nutch/trunk/src/java/org/apache/nutch/fetcher/Fetcher.java Wed Jul
19 16:54:51 2006
@@ -222,7 +222,7 @@
} catch (Throwable t) { // unexpected exception
logError(url, t.toString());
- output(url, datum, null, CrawlDatum.STATUS_FETCH_GONE);
+ output(url, datum, null, CrawlDatum.STATUS_FETCH_RETRY);
}
}
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys -- and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Nutch-cvs mailing list
Nutch-cvs@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nutch-cvs
