Hi, so I have dedicated 1000 Mb (-Xmx1000m) to Nutch java process when fetching (default settings). When using 10 threads I can fetch 25000 urls, but when using 20 threads fetcher fails with: java.lang.OutOfMemoryError: Java heap space even when fetching 15000 url fetchlist. Is 20 threads to much for -Xmx1000m or is something else wrong? What would be recommended settings (number of threads, how much RAM is needed) for fetching a list of 100k urls (with best performance)?
Thanks,
Tomislav
