I saw an earlier post along these lines. Is nutch bad on the harddrive, I dont have a raid setup and I was wondering if I should be prepared and maybe setup a raid configuration. I want to recrawl a site every hour or every two hours. Generally I have heard bad things with java and intensive file-io like this?
Would you agree or maybe I shouldbe be worried? In terms of the segment directory size; I dont except it to go over 100-300MB.
