RE: Memory leaks(?)
From: Rogier Peters [mailto:[EMAIL PROTECTED]] Hi all, thanks for the quick reply.. We've been running cocoon for some time now, and we really like it, but we keep having problems with memory usage. The problem is that with each page, looking at the Windows Task Manager, memory use increases by about 25M and although in the processes window java.exe will reduce memory now and again, system memory use stays high. Memory leak occurs when memory is allocated from the heap and never returned. Situation you describe is different and (except may be increase in 25M) normal. OK, maybe I wasn't too clear on this;) I know this is probably too general OS and JVM to ask, but my real question is if java.exe shows 20Mb in use, no other applications are running and my system shows 600Mb in use and slows down to a crawl, where did all the memory go? Is the size of java.exe the real size of the JVM? Except mem usage column, Windoze task manager features VM size column. Also, I do experience OutOfMemporyExceptions ... In the set components I use there is no memory leaks. You should provide more information on what do you use, what your sitemap looks like, what is the size of XML docs. I assume that you have OutOfMemoryErrors when testing with just one concurrent user. PS Consider using memory debugging tools Vadim Unless you are experiencing OutOfMemporyExceptions I would consider that system behaves normally. The only thing you may want to investigate is 25Mb per request - but this is observed only in your setup, so you should pick a tool and do memory debug. Vadim I played around with the jvm -Xmx option, and with cocoon.xconf heapsize and cached objects, but that didn't help. I was wondering whether anyone had the same problems with cocoon, and I am of course very interested in solutions, tweaks, or configuration options that I may have overlooked. Regards, Rogier Peters - Content Management Department Hippo Webworks Grasweg 35 1031 HW Amsterdam The Netherlands Tel +31 (0)20 6345173 Fax +31 (0)20 6345179 Rogier(at)hippo(dot)nl / www.hippo.nl - Please check that your question has not already been answered in the FAQ before posting. http://xml.apache.org/cocoon/faqs.html To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
RE: Memory leaks(?)
would this be a case for cactus? http://jakarta.apache.org/cactus :) What is this? I use OptimizeIt. Downloading it now Vadim Rogier - Please check that your question has not already been answered in the FAQ before posting. http://xml.apache.org/cocoon/faqs.html To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - Please check that your question has not already been answered in the FAQ before posting. http://xml.apache.org/cocoon/faqs.html To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: Memory leaks(?)
Hello, I have the same problem for Tomcat 4.0.1 + Cocoon 2.0.1 + Xindice 1.0rc2 on NT for one client. To avoid it I have to set CATALINA_OPTS to ' -Xms64M -Xmx256M '. For the moment it works without problems. Roman Vadim Gritsenko wrote: From: Rogier Peters [mailto:[EMAIL PROTECTED]] Hi all, thanks for the quick reply.. We've been running cocoon for some time now, and we really like it, but we keep having problems with memory usage. The problem is that with each page, looking at the Windows Task Manager, memory use increases by about 25M and although in the processes window java.exe will reduce memory now and again, system memory use stays high. Memory leak occurs when memory is allocated from the heap and never returned. Situation you describe is different and (except may be increase in 25M) normal. OK, maybe I wasn't too clear on this;) I know this is probably too general OS and JVM to ask, but my real question is if java.exe shows 20Mb in use, no other applications are running and my system shows 600Mb in use and slows down to a crawl, where did all the memory go? Is the size of java.exe the real size of the JVM? Except mem usage column, Windoze task manager features VM size column. Also, I do experience OutOfMemporyExceptions ... In the set components I use there is no memory leaks. You should provide more information on what do you use, what your sitemap looks like, what is the size of XML docs. I assume that you have OutOfMemoryErrors when testing with just one concurrent user. PS Consider using memory debugging tools Vadim Unless you are experiencing OutOfMemporyExceptions I would consider that system behaves normally. The only thing you may want to investigate is 25Mb per request - but this is observed only in your setup, so you should pick a tool and do memory debug. Vadim I played around with the jvm -Xmx option, and with cocoon.xconf heapsize and cached objects, but that didn't help. I was wondering whether anyone had the same problems with cocoon, and I am of course very interested in solutions, tweaks, or configuration options that I may have overlooked. Regards, Rogier Peters - Content Management Department Hippo Webworks Grasweg 35 1031 HW Amsterdam The Netherlands Tel +31 (0)20 6345173 Fax +31 (0)20 6345179 Rogier(at)hippo(dot)nl / www.hippo.nl - Please check that your question has not already been answered in the FAQ before posting. http://xml.apache.org/cocoon/faqs.html To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - Please check that your question has not already been answered in the FAQ before posting. http://xml.apache.org/cocoon/faqs.html To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: Memory leaks(?)
Roman: I have the same problem for Tomcat 4.0.1 + Cocoon 2.0.1 + Xindice 1.0rc2 on NT for one client. To avoid it I have to set CATALINA_OPTS to ' -Xms64M -Xmx256M '. For the moment it works without problems. Do you have *any* sense how much your increased RAM requirements are due to your use of Xindice? Thanks. Diana - Please check that your question has not already been answered in the FAQ before posting. http://xml.apache.org/cocoon/faqs.html To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: Memory leaks(?)
Diana, For the moment I'm not sure, but it seems that the problem is due to a big amount of data processed in a pipeline. It's because Xindice supports only ASCII for xpath queries and I have to filter some big amount of data got from a generator (file generator with dbxml protocol) by means of XSL transformers. Roman Diana Shannon wrote: Roman: I have the same problem for Tomcat 4.0.1 + Cocoon 2.0.1 + Xindice 1.0rc2 on NT for one client. To avoid it I have to set CATALINA_OPTS to ' -Xms64M -Xmx256M '. For the moment it works without problems. Do you have *any* sense how much your increased RAM requirements are due to your use of Xindice? Thanks. Diana - Please check that your question has not already been answered in the FAQ before posting. http://xml.apache.org/cocoon/faqs.html To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - Please check that your question has not already been answered in the FAQ before posting. http://xml.apache.org/cocoon/faqs.html To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: Memory leaks(?)
With 1Gb of memory, I suggest starting with something like this and tuning from there: -Xms200m -Xmx600m store-janitor class=org.apache.cocoon.components.store.StoreJanitorImpl logger=core.store-janitor parameter name=freememory value=500/ parameter name=heapsize value=5/ parameter name=cleanupthreadinterval value=10/ parameter name=threadpriority value=5/ parameter name=percent_to_free value=10/ /store-janitor Regards, Lajos galatea.com Rogier Peters wrote: Hi, We've been running cocoon for some time now, and we really like it, but we keep having problems with memory usage. We're running on a dual pII-700 with 1Gb memory and windows 2000 server. I just upgraded from jdk1.3.1_01 to 1.3.1_03, using the hotspot jvm, and from cocoon 2.0.1 to 2.0.2 but is doesn't seem to solve the problems. The site we're developing is largish, about 1000 pages, and probably very (too?) transformation intensive. A typical page transforms the aggregate of about 5 elements, which each come from pipelines that do a couple of transform on data that is retrieved from an xml database with a custom Source. The problem is that with each page, looking at the Windows Task Manager, memory use increases by about 25M and although in the processes window java.exe will reduce memory now and again, system memory use stays high. I played around with the jvm -Xmx option, and with cocoon.xconf heapsize and cached objects, but that didn't help. I was wondering whether anyone had the same problems with cocoon, and I am of course very interested in solutions, tweaks, or configuration options that I may have overlooked. Regards, Rogier Peters - Content Management Department Hippo Webworks Grasweg 35 1031 HW Amsterdam The Netherlands Tel +31 (0)20 6345173 Fax +31 (0)20 6345179 Rogier(at)hippo(dot)nl / www.hippo.nl - Please check that your question has not already been answered in the FAQ before posting. http://xml.apache.org/cocoon/faqs.html To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - Please check that your question has not already been answered in the FAQ before posting. http://xml.apache.org/cocoon/faqs.html To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
RE: Memory leaks(?)
From: Rogier Peters [mailto:[EMAIL PROTECTED]] Hi, Hi, We've been running cocoon for some time now, and we really like it, but we keep having problems with memory usage. We're running on a dual pII-700 with 1Gb memory and windows 2000 server. I just upgraded from jdk1.3.1_01 to 1.3.1_03, using the hotspot jvm, and from cocoon 2.0.1 to 2.0.2 but is doesn't seem to solve the problems. The site we're developing is largish, about 1000 pages, and probably very (too?) transformation intensive. A typical page transforms the aggregate of about 5 elements, which each come from pipelines that do a couple of transform on data that is retrieved from an xml database with a custom Source. The problem is that with each page, looking at the Windows Task Manager, memory use increases by about 25M and although in the processes window java.exe will reduce memory now and again, system memory use stays high. Memory leak occurs when memory is allocated from the heap and never returned. Situation you describe is different and (except may be increase in 25M) normal. Unless you are experiencing OutOfMemporyExceptions I would consider that system behaves normally. The only thing you may want to investigate is 25Mb per request - but this is observed only in your setup, so you should pick a tool and do memory debug. Vadim I played around with the jvm -Xmx option, and with cocoon.xconf heapsize and cached objects, but that didn't help. I was wondering whether anyone had the same problems with cocoon, and I am of course very interested in solutions, tweaks, or configuration options that I may have overlooked. Regards, Rogier Peters - Content Management Department Hippo Webworks Grasweg 35 1031 HW Amsterdam The Netherlands Tel +31 (0)20 6345173 Fax +31 (0)20 6345179 Rogier(at)hippo(dot)nl / www.hippo.nl - Please check that your question has not already been answered in the FAQ before posting. http://xml.apache.org/cocoon/faqs.html To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
