Beyond what Ajas has shared, Tony, while I realize you may hope someone could offer the key solution here in email, I'll tell you that as an independent consultant who spends his days troubleshooting CF server problems for companies large and small (on an on-demand, short-term basis), I see problems like yours all the time. There is rarely any "one" solution that can be spotted from email interchanges alone.
Instead, what works best is to use those very tools (and other diagnostics, some free) to more clearly understand exactly what's going on. It can be daunting for those who don't use them often to find (and/or install/enable) them, then learn how to use them, then to make sense of what they say, let alone connect the dots to a solution. All that could take hours if not days. Given that, and when it's crunch time, it may be far more efficient and effective to bring someone in for just an hour or two (remotely, via Adobe Connect, not remote desktop, so no login/firewall/vpn issues) to look over your shoulders with you at your problem and help connect those dots to solve that problem. I do this for people daily, and can often solve even such knotty problems as yours that quickly. Of course, sometimes once you solve one problem, you find another that was lurking behind it, but many times finding and solving the one root cause problem makes any others pale in comparison. And it's often NOT code, believe it or not. It could be configuration, or it could be a problem in a system that CF relies on, whether the web server, the database server, the network, or some machine you call remotely (as in perhaps your RTUs). When we work together, you not only get a clear understanding of the tools, but more than that you will typically learn also new things about how CF works (that are often misunderstood by most). All this helps you to better understand future challenges, so the value is far more than just the one problem solved. Finally, if despite all that, anyone fears it might prove to be a waste of time, I offer a satisfaction guarantee. If you don't feel the time spent together was worthwhile, you don't have to pay for it. I hope folks here will forgive if this seems a sales pitch, but when someone like you is in the position that you're in, it seems unfortunate to leave you (or others in your position) feeling that you're entirely on your own to figure things out, when in fact there are people who specialize in helping solve just these sort of problems, and more than that helping you become better able to solve them on your own should they (or other problems) arise again. If I don't speak up, how else will you (and folks in such a position) ever know? :-) You can learn more from the page linked to in my signature below. /charlie arehart [email protected] Providing fast, remote, on-demand troubleshooting services for CF (and CFBuilder) More at http://www.carehart.org/consulting From: [email protected] [mailto:[email protected]] On Behalf Of Ajas Mohammed Sent: Friday, July 22, 2011 12:26 PM To: [email protected] Subject: Re: [ACFUG Discuss] Jrun Pegging CPU to 100% CF9.01 Couple of things that might help you pinpoint the issue. 1. Do you have FusionReactor or SeeFusion Installed? If not, I would highly recommend a monitoring tool. We use FusionReactor and its the best 300$ investment we have done. You could try the trial version at least to see why you are having issues. 2. You mentioned, its Enterprise CF license. You can also try using CF built-in monitoring tool available for CFers since CF 8. Try those first and see if you can isolate the issue. CFDirectory was famous for issues in CF 7. I am not sure how it does in CF9. Look for permissions etc also. I remember one app of ours was using CFDirectory and the location of directory was wrong. This caused the page to hang up like crazy causing issues. One more thing. Check out the CF logs and run time logs. That will also give some insight about the problems you are having. Hope this helps. <Ajas Mohammed /> http://ajashadi.blogspot.com We cannot become what we need to be, remaining what we are. No matter what, find a way. Because thats what winners do. You can't improve what you don't measure. Quality is never an accident; it is always the result of high intention, sincere effort, intelligent direction and skillful execution; it represents the wise choice of many alternatives. On Fri, Jul 22, 2011 at 12:16 PM, Tony Childers <[email protected]> wrote: Yesterday we experienced our Production ColdFusion servers performance deteriorate after a URL to access an Energy usage Website was released to the user community. This Website allows users to click a link to view a dashboard of meters showing the energy being used on the EPA campus, the page was extremely slow to respond. The slow response was due to unresponsive RTUs (Remote Transmitting Units) that monitor the energy usage for our campus and supply the content for our energy dashboard page. The page requests kept coming in and eventually appeared to overwhelm the server. The energy dashboard dials are programed in FLASH. Thinking the slow response from the RTU's and the FLASH code not having the data to work with could be causing the JRun service to chew up the CPU cycles. Our application programers commented out the code that pulled the data from the RTU's and displayed the dashboard meters. This did not alleviate JRun from going to 100% CPU cycles. Stopping and restarting the service did not correct the problem. These are several of the errors that we encountered: The request has exceeded the allowable time limit Tag: CFLOOP." "The request has exceeded the allowable time limit Tag: cfdirectory" "Server: rtfusion.rtp.epa.gov Message: Error Executing Database Query. Detail: Timed out trying to establish connection" "A timeout occurred while attempting to lock application_room_apploader." We failed over to our Standby server and continued serving the user community. During the maintenance window we re-activated the production server and it exhibited the same errors: time outs and JRun eating up the CPU cycles to 100%. We notice this occurred when an application began execution, if the application loaded or timed out, the cycles would drop to 0% or normal levels. I eventually had to uninstall ColdFusion, clean up the directories (remove files that remained) and re-install ColdFusion9.01 and the most recent hotfixes (chf9010001). As of this email posting everything is back functioning properly. Platform: Windows Server 2003 Enterprise Hardware: DELL 2850 XEON Memory: 4.0GB MEMORY ColdFusion: System Information Server Details Server Product ColdFusion Version 9,0,1,274733 Edition Enterprise Operating System Windows 2003 OS Version 5.2 Update Level /D:/public/server/apps/ColdFusion9/lib/updates/chf9010001.jar Adobe Driver Version 4.0 (Build 0005) JVM arguments -server -XX:PermSize=256m -XX:MaxPermSize=256m -Dsun.rmi.dgc.client.gcInterval=300000 -Dsun.rmi.dgc.server.gcInterval=300000 -Dsun.io.useCanonCaches=false -XX:+UseConcMarkSweepGC -Dcoldfusion.fckupload=true -Dcoldfusion.rootDir={application.home}/../ -Dcoldfusion.libPath={application.home}/../lib ________________________________ Tony Childers Database Analyst / Software Developer Lead CACI A member of the ECSTeam - ITS-EPA II - Contractor 109 TW Alexander Drive, Building NCC, Research Triangle Park, NC 27711 Information Technology Infrastructure Solutions phone: 919.541.3933 | fax: 919.541.3641 email: [email protected] |[email protected] |[email protected] ------------------------------------------------------------- To unsubscribe from this list, manage your profile @ http://www.acfug.org?falogin.edituserform For more info, see http://www.acfug.org/mailinglists Archive @ http://www.mail-archive.com/discussion%40acfug.org/ List hosted by http://www.fusionlink.com ------------------------------------------------------------- ------------------------------------------------------------- To unsubscribe from this list, manage your profile @ http://www.acfug.org?fa=login.edituserform For more info, see http://www.acfug.org/mailinglists Archive @ http://www.mail-archive.com/discussion%40acfug.org/ List hosted by http://www.fusionlink.com -------------------------------------------------------------
