Did you edit your nutch-default.xml/nutch-site.xml and added your agent name/crawler version etc? look for the propety http.agent.name
Cheers Zaheed On 8/6/06, Feng Ji <[EMAIL PROTECTED]> wrote:
Hi there, I wonder if any one has the similar experience as mine. I checked out a nutch 08 today, "svn checkout http://svn.apache.org/repos/asf/lucene/nutch/trunk/ nutch" , with version tag of 428997 However, somehow, I got the following weird error log for a single url crawling Fetcher: starting Fetcher: segment: segments/20060806000317 Fetcher: threads: 10 fetching http://www.ufl.edu/ fetch of http://www.ufl.edu/ failed with: java.lang.NullPointerException Fetcher: done I wonder if that is because I miss some setup in config? or nutch 08 is unstable currently, thanks, Michael
