svn commit: r393330 - /lucene/nutch/trunk/src/java/org/apache/nutch/segment/SegmentReader.java

2006-04-11 Thread ab
Author: ab Date: Tue Apr 11 16:36:44 2006 New Revision: 393330 URL: http://svn.apache.org/viewcvs?rev=393330&view=rev Log: Improved SegmentReader: * fix breakage - couldn't write to already existing subdirectory. Now output directory is specified in arguments. * add functionality to retrieve i

svn commit: r393329 - /lucene/nutch/trunk/src/java/org/apache/nutch/fetcher/Fetcher.java

2006-04-11 Thread ab
Author: ab Date: Tue Apr 11 16:23:08 2006 New Revision: 393329 URL: http://svn.apache.org/viewcvs?rev=393329&view=rev Log: Update the fetch time. Modified: lucene/nutch/trunk/src/java/org/apache/nutch/fetcher/Fetcher.java Modified: lucene/nutch/trunk/src/java/org/apache/nutch/fetcher/Fetcher

svn commit: r393297 - /lucene/nutch/trunk/src/java/org/apache/nutch/fetcher/Fetcher.java

2006-04-11 Thread ab
Author: ab Date: Tue Apr 11 12:18:52 2006 New Revision: 393297 URL: http://svn.apache.org/viewcvs?rev=393297&view=rev Log: Re-instate support for content-level redirects. Use the correct key, when FetcherThread.output() is called after redirects. It should use the new URL as the key, and not the