We just blocked Nutch

[Jerry Durand]

If you're going to give out web scrapers, PLEASE put a delay between
file downloads.  Nutch was locking up our system, almost a DOS attack. 
Hopefully Nutch obeys the robots.txt file.