Another possibility might be the "tmp" memory[1]:

"The answer we find addressed the situation is that you're most likely out
of disk space in /tmp. Consider using another location, or possibly another
partition for hadoop.tmp.dir (which can be set in nutch-site.xml) with
plenty of room for large transient files or using a Hadoop cluster."

Remi

[1]:http://wiki.apache.org/nutch/NutchGotchas

On Sat, Feb 25, 2012 at 10:40 AM, hadi <[email protected]> wrote:

> Hi remi
>
> Would you please tell me when this exception occur? is it depends on
> the type of urls or nutch configuration?
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/IOExeption-when-crawling-with-nutch-in-Fetching-process-tp3756272p3774618.html
> Sent from the Nutch - User mailing list archive at Nabble.com.
>

Reply via email to