Yesterday we experienced our Production ColdFusion servers performance
deteriorate after a URL to access an Energy usage Website was released to the
user community. This Website allows users to click a link to view a dashboard
of meters showing the energy being used on the EPA campus, the page was
extremely slow to respond. The slow response was due to unresponsive RTUs
(Remote Transmitting Units) that monitor the energy usage for our campus and
supply the content for our energy dashboard page. The page requests kept
coming
in and eventually appeared to overwhelm the server.
The energy dashboard dials are programed in FLASH. Thinking the slow response
from the RTU's and the FLASH code not having the data to work with could be
causing the JRun service to chew up the CPU cycles. Our application programers
commented out the code that pulled the data from the RTU's and displayed the
dashboard meters. This did not alleviate JRun from going to 100% CPU cycles.
Stopping and restarting the service did not correct the problem.
These are several of the errors that we encountered:
The request has exceeded the allowable time limit Tag: CFLOOP.”
“The request has exceeded the allowable time limit Tag: cfdirectory”
“Server: rtfusion.rtp.epa.gov
Message: Error Executing Database Query.
Detail: Timed out trying to establish connection”
“A timeout occurred while attempting to lock application_room_apploader.”
We failed over to our Standby server and continued serving the user community.
During the maintenance window we re-activated the production server and it
exhibited the same errors: time outs and JRun eating up the CPU cycles to 100%.
We notice this occurred when an application began execution, if the application
loaded or timed out, the cycles would drop to 0% or normal levels.
I eventually had to uninstall ColdFusion, clean up the directories (remove
files
that remained) and re-install ColdFusion9.01 and the most recent hotfixes
(chf9010001).
As of this email posting everything is back functioning properly.
Platform: Windows Server 2003 Enterprise
Hardware: DELL 2850 XEON
Memory: 4.0GB MEMORY
ColdFusion:
System Information
Server Details
Server Product ColdFusion
Version 9,0,1,274733
Edition Enterprise
Operating System Windows 2003
OS Version 5.2
Update Level /D:/public/server/apps/ColdFusion9/lib/updates/chf9010001.jar
Adobe Driver Version 4.0 (Build 0005)
JVM arguments
-server -XX:PermSize=256m -XX:MaxPermSize=256m
-Dsun.rmi.dgc.client.gcInterval=300000 -Dsun.rmi.dgc.server.gcInterval=300000
-Dsun.io.useCanonCaches=false -XX:+UseConcMarkSweepGC
-Dcoldfusion.fckupload=true -Dcoldfusion.rootDir={application.home}/../
-Dcoldfusion.libPath={application.home}/../lib
________________________________
Tony Childers
Database Analyst / Software Developer Lead
CACI
A member of the
ECSTeam - ITS-EPA II – Contractor
109 TW Alexander Drive, Building NCC, Research Triangle Park, NC 27711
Information Technology Infrastructure Solutions
phone: 919.541.3933 | fax: 919.541.3641
email: [email protected] |[email protected] |[email protected]
-------------------------------------------------------------
To unsubscribe from this list, manage your profile @
http://www.acfug.org?fa=login.edituserform
For more info, see http://www.acfug.org/mailinglists
Archive @ http://www.mail-archive.com/discussion%40acfug.org/
List hosted by http://www.fusionlink.com
-------------------------------------------------------------
