Hi Tomislav,

2007/9/11, Doğacan Güney <[EMAIL PROTECTED]>:
> Has your fetch been going on for a long time? Nutch can leak some
> plugins and classes in local mode. But it only becomes a problem if
> you have too many maps (because each new map task loads new classes
> without, it seems, unloading older ones.)

One comment:
Increasing the  perm size might help.  This is _not_ done with the -mx
parameter but with MaxPermSize-Parameter.

Anyway, when parsing huge segments in local mode this does not help. A
memory leak  is a serious bug. There is no solution afaik, but a
workaround:
Reduce the number of urls per segment (use -topn with generate).
If you run into trouble while fetching, you will most probably not be
able to parse it afterwards.

Good luck!

Karsten

Reply via email to