There is a well known bug - nutch can throw OutOfMemoryException
if there is not closed double-quote in query:
eg:
"search engine
or
"search engine" "jakarta nutch
I have posted a patch for it on the list some time ago but it was not applied - it was for old "pre-jakarta" package structure - so I will change it to new package structure and send again next week.
Please verify if it is the cause of your OutOfMemory errors.
BTW. I am using 64bit JVM with nutch without problems (JDK 1.5 - Linux on Opterons), but I have not tried to allocate more than 2GB per JVM.
Regards Piotr
Egor Chernodarov wrote:
Hello, Stefan!
Friday, March 25, 2005, 7:26:56 PM, вы писали:
Periodically, when I try to search, I get "Out of memory" error:
Stefan Groschupf> Do you have other webapps in your tomcat? No. Only nutch.
~1.5Gb is not enough for ~4mln index?
Stefan Groschupf> That should be fine, if you have Stefan Groschupf> more RAM searching will be just faster. That is tomcat should not crash? Even with minimal size of RAM?
How I need to calculate required RAM for stable work?
Stefan Groschupf> See old wiki hard ware requirements. Yeah.. Thanks! I have found it :)
Stefan Groschupf> As far I know 2GB is the maximum
Stefan Groschupf> manageable memory for java in 32 bit Stefan Groschupf> os systems, isn't it?
It is bad... Somebody tried to use 64 bit JVM and nutch? Which problems can arise? Nutch will work on 64 bit JVM?
