Re: SSL issues with Tomcat - OutOfMemory
.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:525) at org .apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java: 128) at org .apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java: 102) at org .apache .catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java: 263) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java: 844) at org.apache.coyote.http11.Http11Protocol $Http11ConnectionHandler.process(Http11Protocol.java:584) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java: 447) at java.lang.Thread.run(Unknown Source) It didn't specify PermGen or anything, even though that seems quite low in our QA testing. I'd like to look at the memory utilization in production with SSL enabled, but my business and operations counterparts don't want to inconvenience users. And unfortunately, we're unable to replicate the problem in QA with any sort of clue as to why it happens. As this point, with the exact codebase running in production as HTTP without issue, it's hard to suggest it's anything but a configuration issue in Tomcat. Chris Stewart cstewart...@gmail.com On Apr 28, 2009, at 5:38 PM, Mark Thomas wrote: Chris Stewart wrote: I put Lambda Probe (http://www.lambdaprobe.org/d/index.htm) on the web server to monitor some of the memory usage. Here's what I'm finding after 20 minutes of running. Keep in mind this is without SSL enabled. Something I should have asked before - exactly what was out of memory when you saw the OOME? Name Used Committed MaximumInitial Group Tenured Gen 129.73Mb 138.86Mb 945.25Mb 118.19Mb HEAP Perm Gen 45.88Mb 46.00Mb 64.00Mb 12.00Mb NON_HEAP Survivor Space 957.74Kb 1.13Mb 7.88Mb 960.00Kb HEAP Code Cache 12.19Mb 12.22Mb 32.00Mb 192.00Kb NON_HEAP Eden Space 6.75Mb 9.38Mb 63.00Mb 7.94Mb HEAP Total 195.48Mb 207.58Mb 1.09Gb 139.25Mb TOTAL Everything is running fine at the moment but I'm a little concerned about Perm Gen and the space we have allocated for it. I imagine that it's possible, with SSL enabled, that the space is being used up. Is there enough overhead with SSL to have this scenario? I did some reading on Perm Gen and we do use an extensive about of Hibernate in this application, and it's JSF based. You really need to look at this with SSL enabled. Mark - To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org - To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org
SSL issues with Tomcat - OutOfMemory
Over the weekend we added SSL security to a Tomcat 6 instance that has been running for awhile without error. This morning, after the number of sessions increased on the machine, Tomcat began throwing 500 errors to users. I checked the logs and found an instance of OutOfMemory, followed by dozens of errors related to Google Guice attempting to start new threads. I can only image that with the addition of SSL, more memory is being used by more threads being created, or some such situation. I'm not terribly sure where or how the extra resources are being used. I was hoping that those with the experience of using SSL on Tomcat could point me in some direction on places to look for clues. At the moment I'm not sure where the issue could be. Here are a few of the statistics about our setup and configuration: -XX:ThreadStackSize=512 Initial Memory Pool: 128MB Maximum Memory Pool: 1024MB Thread Stack Size: 512KB I've been adjusting these in various ways to attempt to at least find a path towards success. So far, about 5 minutes after the server is restarted the performance begins to plummet. Chris Stewart cstewart...@gmail.com - To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org
Re: SSL issues with Tomcat - OutOfMemory
Running Windows 2003 Server and we're not using APR. Chris Stewart cstewart...@gmail.com On Apr 28, 2009, at 10:51 AM, Pid wrote: Chris Stewart wrote: Over the weekend we added SSL security to a Tomcat 6 instance that has been running for awhile without error. This morning, after the number of sessions increased on the machine, Tomcat began throwing 500 errors to users. I checked the logs and found an instance of OutOfMemory, followed by dozens of errors related to Google Guice attempting to start new threads. I can only image that with the addition of SSL, more memory is being used by more threads being created, or some such situation. I'm not terribly sure where or how the extra resources are being used. I was hoping that those with the experience of using SSL on Tomcat could point me in some direction on places to look for clues. At the moment I'm not sure where the issue could be. Here are a few of the statistics about our setup and configuration: -XX:ThreadStackSize=512 Initial Memory Pool: 128MB Maximum Memory Pool: 1024MB Thread Stack Size: 512KB I've been adjusting these in various ways to attempt to at least find a path towards success. So far, about 5 minutes after the server is restarted the performance begins to plummet. OS? Are you using APR? p Chris Stewart cstewart...@gmail.com - To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org - To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org - To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org
Re: SSL issues with Tomcat - OutOfMemory
On Apr 28, 2009, at 10:56 AM, Mark Thomas wrote: Chris Stewart wrote: Over the weekend we added SSL security to a Tomcat 6 instance that has been running for awhile without error. This morning, after the number of sessions increased on the machine, Tomcat began throwing 500 errors to users. I checked the logs and found an instance of OutOfMemory, followed by dozens of errors related to Google Guice attempting to start new threads. I can only image that with the addition of SSL, more memory is being used by more threads being created, or some such situation. I'm not terribly sure where or how the extra resources are being used. I was hoping that those with the experience of using SSL on Tomcat could point me in some direction on places to look for clues. At the moment I'm not sure where the issue could be. Here are a few of the statistics about our setup and configuration: -XX:ThreadStackSize=512 Initial Memory Pool: 128MB Maximum Memory Pool: 1024MB Thread Stack Size: 512KB Tomcat version? OS vendor/version? OS memory? JVM vendor version? Connector settings in server.xml? Tomcat 6.0.14. Windows 2003 Server. 2GB of memory on system. Java 1.6.0_06. Connector port=80 protocol=HTTP/1.1 connectionTimeout=2 redirectPort=443 / Connector protocol=org.apache.coyote.http11.Http11Protocol port=443 minSpareThreads=5 maxSpareThreads=75 enableLookups=true disableUploadTimeout=true acceptCount=100 maxThreads=400 scheme=https secure=true SSLEnabled=true keystoreFile=D:\Certificate\Cert.key keystorePass=pwd clientAuth=false sslProtocol=TLS / I've been adjusting these in various ways to attempt to at least find a path towards success. So far, about 5 minutes after the server is restarted the performance begins to plummet. Grab yourself a profiler and see what is using the memory. Mark - To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org - To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org
Re: SSL issues with Tomcat - OutOfMemory
I put Lambda Probe (http://www.lambdaprobe.org/d/index.htm) on the web server to monitor some of the memory usage. Here's what I'm finding after 20 minutes of running. Keep in mind this is without SSL enabled. NameUsage score PlotUsedCommitted Maximum Initial Group Tenured Gen 129.73Mb138.86Mb945.25Mb118.19MbHEAP Perm Gen45.88Mb 46.00Mb 64.00Mb 12.00Mb NON_HEAP Survivor Space 957.74Kb 1.13Mb 7.88Mb 960.00KbHEAP Code Cache 12.19Mb 12.22Mb 32.00Mb 192.00KbNON_HEAP Eden Space 6.75Mb 9.38Mb 63.00Mb 7.94Mb HEAP Total 195.48Mb 207.58Mb1.09Gb 139.25MbTOTAL Everything is running fine at the moment but I'm a little concerned about Perm Gen and the space we have allocated for it. I imagine that it's possible, with SSL enabled, that the space is being used up. Is there enough overhead with SSL to have this scenario? I did some reading on Perm Gen and we do use an extensive about of Hibernate in this application, and it's JSF based. Chris Stewart cstewart...@gmail.com On Apr 28, 2009, at 10:56 AM, Mark Thomas wrote: Chris Stewart wrote: Over the weekend we added SSL security to a Tomcat 6 instance that has been running for awhile without error. This morning, after the number of sessions increased on the machine, Tomcat began throwing 500 errors to users. I checked the logs and found an instance of OutOfMemory, followed by dozens of errors related to Google Guice attempting to start new threads. I can only image that with the addition of SSL, more memory is being used by more threads being created, or some such situation. I'm not terribly sure where or how the extra resources are being used. I was hoping that those with the experience of using SSL on Tomcat could point me in some direction on places to look for clues. At the moment I'm not sure where the issue could be. Here are a few of the statistics about our setup and configuration: -XX:ThreadStackSize=512 Initial Memory Pool: 128MB Maximum Memory Pool: 1024MB Thread Stack Size: 512KB Tomcat version? OS vendor/version? OS memory? JVM vendor version? Connector settings in server.xml? I've been adjusting these in various ways to attempt to at least find a path towards success. So far, about 5 minutes after the server is restarted the performance begins to plummet. Grab yourself a profiler and see what is using the memory. Mark - To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org - To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org
Performance with Tomcat
We've been running into some issues lately with our Tomcat 6 instances where performance will slow to a crawl. Unfortunately, no error messages are present in the logs and we really don't know why this is happening. It does appear that the issue is happening when we get a lot of users on the system at one time. It would make sense, but we're only talking about 300 or so concurrent users. There must be a point of misconfiguration on our part but none of us really have any experience with Tomcat outside of simply setting it up and running it out of the box, which isn't much. So, that leads me to why I'm posting to the user list: 1. Are there any tools or utilities we can use to get an understanding of what Tomcat is doing while it's running (processes, memory per process, and more)? 2. I suspect there are some very large Tomcat installations out there. Has any information from those installations been published? Is there a guide or set of documentation on how to scale with Tomcat as a web server? Chris Stewart cstewart...@gmail.com - To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org
Re: error message, can you tell me where I went wrong
Rick, The JAVA_HOME\bin directory needs to be added to the PATH variable on your machine. Do that and then try to restart the server. Chris Stewart [EMAIL PROTECTED] On May 22, 2008, at 10:44 AM, Rick Simpson wrote: I am new to Tomcat and I am trying to setup a new 2003 server to replace an existing 2k server. I have downloaded the Tomcat 5.5 and installed. When I get it installed it says it is stopped and when trying to start just goes back to stopped. I have tried to look at all the faq and tried to compare old server to new. I am sure it is someting that I am missing. I have created an environamental variable called JAVA_HOME with a path pointing to the JDK folder. I have also uninstalled and reinstalled Tomcat 4.1 with same results. The log in Jakarta for both versions says [174 javajni.c] [error] the specified module could not be found. [986 prunsrv.c] [error] failed creating java c:\program Files\java\jre1.6.0_06\bin\client\jvm.dll. This file does exist in this location. As an additional note when I load version 4.1 I can start Tomcat using the startup.bat file, and get to the tomcat default page on server, but taskbar icon still shows Tomcat stopped. Thanks for any help you can provide. Rick Simpson Insl-x 308 Old County Road Edgewater, FL 32132 T/386-428-6461, x164 F/386-427-7130 Email: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] === This e-mail is intended only for the use of the addressees. Any copying, forwarding, printing or other use of this e-mail by persons other than the addressees is not authorized. This e-mail may contain information that is privileged, confidential and exempt from disclosure. If you are not the intended recipient, please notify us immediately by return e-mail (including the original message in your reply) and then delete and discard all copies of the e-mail. - To start a new topic, e-mail: users@tomcat.apache.org To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: error message, can you tell me where I went wrong
Chuck, Randomly throwing around versions of DLLs is not the answer to this problem. I had the exact issue as the original poster described and what I posted solved my issue. What fixes the issue is putting the msvcr71.dll file in the system32 directory on the machine. Of course this isn't a wise choice when simply adding the Java bin directory to your PATH will work just fine. Chris Stewart [EMAIL PROTECTED] On May 22, 2008, at 11:13 AM, Caldarale, Charles R wrote: From: Chris Stewart [mailto:[EMAIL PROTECTED] Subject: Re: error message, can you tell me where I went wrong The JAVA_HOME\bin directory needs to be added to the PATH variable on your machine. The above is useless - Tomcat is being run as a service, so there is no PATH in effect. I have created an environamental variable called JAVA_HOME with a path pointing to the JDK folder. Also a waste of time when running Tomcat as a service. The log in Jakarta for both versions says [174 javajni.c] [error] the specified module could not be found. You may well be missing a .dll file that the service launcher needs; find a copy of msvcr71.dll and put it in Tomcat's bin directory and see if that fixes the problem. java\jre1.6.0_06\bin\client\jvm.dll You probably want to use the server version of the JVM. Use the tomcat5w.exe program to change that. - Chuck THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers. - To start a new topic, e-mail: users@tomcat.apache.org To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - To start a new topic, e-mail: users@tomcat.apache.org To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Data lost on response in 6.0.16, works fine in 6.0.14
We're noticing an interesting behavior after upgrading to Tomcat 6.0.16 from 5.5. Our responses are generally large XML documents. Once we upgraded our QA lab to Tomcat 6.0.16, we've noticed that these XML documents are being truncated. Has there been a change in how Tomcat handles the size of responses? For reference, Tomcat 5.5 has been working great for us. Also, we installed 6.0.14 as a test and that version worked fine as well. Did something change from .14 to .16 that would cause our specific problem? Chris Stewart [EMAIL PROTECTED] - To start a new topic, e-mail: users@tomcat.apache.org To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Data lost on response in 6.0.16, works fine in 6.0.14
We're noticing an interesting behavior after upgrading to Tomcat 6.0.16 from 5.5. Our responses are generally large XML documents. Once we upgraded our QA lab to Tomcat 6.0.16, we've noticed that these XML documents are being truncated. Has there been a change in how Tomcat handles the size of responses? For reference, Tomcat 5.5 has been working great for us. Also, we installed 6.0.14 as a test and that version worked fine as well. Did something change from .14 to .16 that would cause our specific problem? Chris Stewart [EMAIL PROTECTED] - To start a new topic, e-mail: users@tomcat.apache.org To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
