Update of /cvsroot/nutch/nutch/conf
In directory sc8-pr-cvs1.sourceforge.net:/tmp/cvs-serv2281/conf
Modified Files:
nutch-default.xml
Log Message:
Added a new command, crawl, that constructs a database, injects a url
file and performs a few rounds of generate/fetch/updatedb. This
simplifies use for intranet sites. Changed some defaults to be
more intranet friendly.
Also fixed a bug where Fetcher.java didn't construct correct relative links
when a page was redirected.
Index: nutch-default.xml
===================================================================
RCS file: /cvsroot/nutch/nutch/conf/nutch-default.xml,v
retrieving revision 1.27
retrieving revision 1.28
diff -C2 -d -r1.27 -r1.28
*** nutch-default.xml 1 Apr 2004 21:00:12 -0000 1.27
--- nutch-default.xml 21 Apr 2004 22:52:01 -0000 1.28
***************
*** 133,137 ****
<property>
<name>fetcher.server.delay</name>
! <value>20</value>
<description>The number of seconds the fetcher will delay between
successive requests to the same server.</description>
--- 133,137 ----
<property>
<name>fetcher.server.delay</name>
! <value>5</value>
<description>The number of seconds the fetcher will delay between
successive requests to the same server.</description>
***************
*** 140,144 ****
<property>
<name>fetcher.threads.fetch</name>
! <value>300</value>
<description>The number of FetcherThreads the fetcher should use.
This is also determines the maximum number of requests that are
--- 140,144 ----
<property>
<name>fetcher.threads.fetch</name>
! <value>10</value>
<description>The number of FetcherThreads the fetcher should use.
This is also determines the maximum number of requests that are
-------------------------------------------------------
This SF.Net email is sponsored by: IBM Linux Tutorials
Free Linux tutorial presented by Daniel Robbins, President and CEO of
GenToo technologies. Learn everything from fundamentals to system
administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
_______________________________________________
Nutch-cvs mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/nutch-cvs
