FYI

This has been fixed in the mapred branch, but that patch is not in 0.7.1. This alone might be a reason to make a 0.7.2 release.

Doug

-------- Original Message --------
Subject: Crawler submits forms?
Date: Tue, 13 Dec 2005 16:57:34 -0000
From: Andy Read <[EMAIL PROTECTED]>
Reply-To: [email protected]
Organization: Azurite Systems Ltd.
To: <[email protected]>

Hi,

I'm using nutch to create a site search facility for a couple of site.

I upgraded from 0.6 to 0.7.1 a few days ago and have just noticed that blank
users are being registered on my site at the exact times the cron job runs
the crawl tool to re-index the site.  This means that the crawler is now
submitting a post request from the registration form!  Is this a new
'feature' of 0.7 or 0.7.1?  I can't find any mention in changes.txt and I
can't find any config option referring to it.  Surely the crawler should
never submit form input?

Any help appreciated.

Thanks,

Andy Read

www.azurite.co.uk



Reply via email to