Author: jnioche
Date: Thu Jul 28 15:01:39 2011
New Revision: 1151884
URL: http://svn.apache.org/viewvc?rev=1151884&view=rev
Log:
NUTCH-1072 Display number and size of queues in Fetcher status
Modified:
nutch/branches/branch-1.4/CHANGES.txt
nutch/branches/branch-1.4/src/java/org/apache/nutch/fetcher/Fetcher.java
Modified: nutch/branches/branch-1.4/CHANGES.txt
URL:
http://svn.apache.org/viewvc/nutch/branches/branch-1.4/CHANGES.txt?rev=1151884&r1=1151883&r2=1151884&view=diff
==============================================================================
--- nutch/branches/branch-1.4/CHANGES.txt (original)
+++ nutch/branches/branch-1.4/CHANGES.txt Thu Jul 28 15:01:39 2011
@@ -2,6 +2,8 @@ Nutch Change Log
Release 1.4 - Current development
+* NUTCH-1072 Display number and size of queues in Fetcher status (jnioche)
+
* NUTCH-1071 Crawldb update displays total number of URLs per status (jnioche)
* NUTCH-1045 MimeUtil to rely on default config provided by Tika (jnioche)
Modified:
nutch/branches/branch-1.4/src/java/org/apache/nutch/fetcher/Fetcher.java
URL:
http://svn.apache.org/viewvc/nutch/branches/branch-1.4/src/java/org/apache/nutch/fetcher/Fetcher.java?rev=1151884&r1=1151883&r2=1151884&view=diff
==============================================================================
--- nutch/branches/branch-1.4/src/java/org/apache/nutch/fetcher/Fetcher.java
(original)
+++ nutch/branches/branch-1.4/src/java/org/apache/nutch/fetcher/Fetcher.java
Thu Jul 28 15:01:39 2011
@@ -971,6 +971,8 @@ public class Fetcher extends Configured
String status;
long elapsed = (System.currentTimeMillis() - start)/1000;
status = activeThreads + " threads, " +
+ fetchQueues.getQueueCount() + " queues, "+
+ fetchQueues.getTotalSize() + " URLs queued, "+
pages+" pages, "+errors+" errors, "
+ Math.round(((float)pages.get()*10)/elapsed)/10.0+" pages/s, "
+ Math.round(((((float)bytes.get())*8)/1000)/elapsed)+" kbits/s, ";
