Hi there i had similiar experiences with nutch - general unstability, i experienced a vast range of different crashes and hangups. Actually it worked stable only on single machine, however when number of urls grown higher it became useless. So generally speaking i would not recommend it for using in production environment to anyone. Maybe there is a way to set it up properly for large internet fetches, but i couldn't accomplish that.
-- Karol Rybak Programista / Programmer Sekcja aplikacji / Applications section Wyższa Szkoła Informatyki i Zarządzania / University of Internet Technology and Management +48(17)8661277
