Re: CF8 Instance hogs cpu
Client variables being stored in registry? Paul On 03/10/2012, at 8:32 AM, Richard Steele r...@photoeye.com wrote: We have a problem with one of our CF8 Enterprise instances. Almost daily, it hogs the entire cpu of the server and the service has to be restarted. Over 2.5 gb of memory is dedicated to this instance. It reaches that ceiling within several hours of use. Perhaps garbage collection can't keep up? Is there a way to limit the cpu resources given to an instance? How do we troubleshoot what might be causing this? Thanks! Rick ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:352836 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
RE: CF8 Instance hogs cpu
The fact that FR wouldn't crash it tends to make me think that ColdFusion is waiting for a response from the SQL Server. As I understand it, once its waiting on the database server its out of ColdFusion's hands in JAVA is waiting for the response. You should look at both your ColdFusion and SQL code. Just because the code hasn't changed doesn't mean there wasn't a problem in the first place that just never got found. I had a piece of code that worked for years, the users would pick a date range and it would summarize the data and put it in a report. For two years users did date ranges anywhere from a single date to a month, then one user decided that he needed the data summarized for an entire quarter. The system crashed under the load because of some bad SQL that hadn't been caught and yes we did see similar problems with the ColdFusion server but it was because it was waiting for the SQL server. Steve -Original Message- From: Richard Steele [mailto:r...@photoeye.com] Sent: Tuesday, October 02, 2012 7:04 PM To: cf-talk Subject: Re: CF8 Instance hogs cpu We had set this up before, but did not have good results. More often than not, it wouldn't crash the request, and would just keep it in limbo. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:352838 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: CF8 Instance hogs cpu
Client variables being stored in registry? Paul On 03/10/2012, at 8:32 AM, Richard Steele r...@photoeye.com wrote: We have a problem with one of our CF8 Enterprise instances. Almost daily, it hogs the entire cpu of the server and the service has to be restarted. Over 2.5 gb of memory is dedicated to this instance. It reaches that ceiling within several hours of use. Perhaps garbage collection can't keep up? Is there a way to limit the cpu resources given to an instance? How do we troubleshoot what might be causing this? Thanks! Rick ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:352850 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: CF8 Instance hogs cpu
Client variables being stored in registry? No, both instances are stored in one database. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:352851 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
CF8 Instance hogs cpu
We have a problem with one of our CF8 Enterprise instances. Almost daily, it hogs the entire cpu of the server and the service has to be restarted. Over 2.5 gb of memory is dedicated to this instance. It reaches that ceiling within several hours of use. Perhaps garbage collection can't keep up? Is there a way to limit the cpu resources given to an instance? How do we troubleshoot what might be causing this? Thanks! Rick ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:352819 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: CF8 Instance hogs cpu
Perhaps code is the issue. Perhaps a custom tag is the issue. Details are needed before anyone can give any sort of reasonable answer. How much traffic is the site getting? requests/second? What is the code processing? What is the code accessing? Is the database responding properly? These and many more questions need to be answered. ColdFusion iteself does not just suck up all your CPU cycles. Wil Genovese Sr. Web Application Developer/ Systems Administrator CF Webtools www.cfwebtools.com wilg...@trunkful.com www.trunkful.com On Oct 2, 2012, at 5:32 PM, Richard Steele wrote: We have a problem with one of our CF8 Enterprise instances. Almost daily, it hogs the entire cpu of the server and the service has to be restarted. Over 2.5 gb of memory is dedicated to this instance. It reaches that ceiling within several hours of use. Perhaps garbage collection can't keep up? Is there a way to limit the cpu resources given to an instance? How do we troubleshoot what might be causing this? Thanks! Rick ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:352820 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: CF8 Instance hogs cpu
Are you logging long-running requests? Any requests hanging? Can you correlate the memory/cpu spike with site traffic or spiders? Like Wil said, it's probably the code in a certain request / page that's using more memory/cycles than it needs to. You may need something like FusionReactor to see what's causing issues. On 10/2/12 3:37 PM, Wil Genovese wrote: Perhaps code is the issue. Perhaps a custom tag is the issue. Details are needed before anyone can give any sort of reasonable answer. How much traffic is the site getting? requests/second? What is the code processing? What is the code accessing? Is the database responding properly? These and many more questions need to be answered. ColdFusion iteself does not just suck up all your CPU cycles. Wil Genovese Sr. Web Application Developer/ Systems Administrator CF Webtools www.cfwebtools.com wilg...@trunkful.com www.trunkful.com On Oct 2, 2012, at 5:32 PM, Richard Steele wrote: We have a problem with one of our CF8 Enterprise instances. Almost daily, it hogs the entire cpu of the server and the service has to be restarted. Over 2.5 gb of memory is dedicated to this instance. It reaches that ceiling within several hours of use. Perhaps garbage collection can't keep up? Is there a way to limit the cpu resources given to an instance? How do we troubleshoot what might be causing this? Thanks! Rick ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:352821 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: CF8 Instance hogs cpu
have you tried using the built in server monitor or fusionReactor to diagnose the issue ? On Tue, Oct 2, 2012 at 11:32 PM, Richard Steele r...@photoeye.com wrote: We have a problem with one of our CF8 Enterprise instances. Almost daily, it hogs the entire cpu of the server and the service has to be restarted. Over 2.5 gb of memory is dedicated to this instance. It reaches that ceiling within several hours of use. Perhaps garbage collection can't keep up? Is there a way to limit the cpu resources given to an instance? How do we troubleshoot what might be causing this? Thanks! Rick ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:352824 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: CF8 Instance hogs cpu
Are you logging long-running requests? How do we log these? Any requests hanging? All requests start to hang at 97% cpu usage. Can you correlate the memory/cpu spike with site traffic or spiders? We think it may be spider related. Like Wil said, it's probably the code in a certain request / page that's using more memory/cycles than it needs to. Our code has been in place for years. You may need something like FusionReactor to see what's causing issues. We have F-R but can't get to it when this occurs as the 97% cpu usage freezes everthing. Is there a way to limit cpu usage for a particular instance? Thanks. Rick ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:352825 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: CF8 Instance hogs cpu
look at the request activity graph and activity logs to see what was running at the time the issue occurred. Have you setup crash protection to kill long running requests? On Tue, Oct 2, 2012 at 11:57 PM, Richard Steele r...@photoeye.com wrote: Are you logging long-running requests? How do we log these? Any requests hanging? All requests start to hang at 97% cpu usage. Can you correlate the memory/cpu spike with site traffic or spiders? We think it may be spider related. Like Wil said, it's probably the code in a certain request / page that's using more memory/cycles than it needs to. Our code has been in place for years. You may need something like FusionReactor to see what's causing issues. We have F-R but can't get to it when this occurs as the 97% cpu usage freezes everthing. Is there a way to limit cpu usage for a particular instance? Thanks. Rick ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:352826 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: CF8 Instance hogs cpu
Perhaps code is the issue. Perhaps a custom tag is the issue. Details are needed before anyone can give any sort of reasonable answer. It's always on the same instance of a multi-instance, load-balanced cf8 server. How much traffic is the site getting? requests/second? We get about 6,000 visitors a day. Not sure about the request/second. What is the code processing? Same code that's been in place for many years. What is the code accessing? SQL Server 2005 Is the database responding properly? Yes Can we isolate / limit cpu usage for this instance? Thanks. Rick ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:352827 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: CF8 Instance hogs cpu
look at the request activity graph and activity logs to see what was running at the time the issue occurred. Again, F-R can't be viewed during this time as 97% cpu hog prevents anything from working. Have you setup crash protection to kill long running requests? We had set this up before, but did not have good results. More often than not, it wouldn't crash the request, and would just keep it in limbo. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:352829 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: CF8 Instance hogs cpu
On Wed, Oct 3, 2012 at 12:03 AM, Richard Steele r...@photoeye.com wrote: look at the request activity graph and activity logs to see what was running at the time the issue occurred. Again, F-R can't be viewed during this time as 97% cpu hog prevents anything from working. so look at it after you restart cf Have you setup crash protection to kill long running requests? We had set this up before, but did not have good results. More often than not, it wouldn't crash the request, and would just keep it in limbo. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:352831 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: CF8 Instance hogs cpu
Hi Richard, I wrote a post a while back about memory leaks in CF8 Ent., although it is not specifically related to high CPU usage, some of the settings here may be of help. http://thinkinglemur.com/index.php/2010/02/memory-leaks-with-coldfusion-8/ The two things that helped the most (aside from refactoring code) was updating the JVM and using -XX:+AgressiveHeap. Is this only happening on 1 specific instance? What about the other instances on the server, are they fine? Do they interact with the instance that is having issues? HTH. Donnie ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:352834 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm