We have been having a hung server issue lately, about once every two
months. Running CFMX on JRun(enterprise) with all teh updaters, both
JRun and CF. We have about 15 apps running on one instance, each has
its own DSN. The server gets pretty good traffic on our intranet,
about 10,000 employees use apps on the box. Has 3 CPUs and the CPU
use rarely goes above 20%. One of the apps gets long running requests
often, in the 60 sec area, can't get around this.
We were getting
'Removeonexctptions is true...' in the logs. Thought this might be a
problem, so I turned off maintian connections for all our DSNs.
Didn't help any.
I have metrics logging on. Thread use seems fine and memory use too.
Here is some data right before a hung server, looks peachy, eh?
DateTime,,listenTh,delayTh,idleTh,busyTh,totalTh,delayRq,droppedRq,delayMs,TotalMem,FreeMem
02/15 11:50:02,metrics ,2,0,5,1,8,0,0,0,655296,498459
02/15 11:50:12,metrics ,2,0,6,0,8,0,0,0,655296,520777
02/15 11:50:24,metrics ,2,0,5,1,8,0,0,0,655296,563355
02/15 11:50:34,metrics ,3,0,2,3,8,0,0,0,655296,524728
02/15 11:50:44,metrics ,3,0,4,2,9,0,0,0,655296,532549
I have the JVM memory setup to 640MB
java.args=-server -Xms640m -Xmx640m -Dsun.io.useCanonCaches=false
-Xbootclasspath/a:"{application.home}/servers/cfusion/cfusion-ear/cfusion-war/WEB-INF/cfusion/lib/webchartsJava2D.jar"
-XX:MaxPermSize=128m -XX:PermSize=64m -XX:+UseConcMarkSweepGC
-XX:NewSize=48m -DJINTEGRA_NATIVE_MODE -DJINTEGRA_PREFETCH_ENUMS
Now, there are a whole slew of errors in the IIS connector log when
the server was hung
2005-02-15 12:35:31 jrISAPI[4664:1888] 127.0.0.1:51020 connect
failed: 10060 Connection timed out, no sock added to pool
2005-02-15 12:35:31 jrISAPI[4664:1888] returning error page for
Connection timed out
Could this maybe be an issue with the connector? Thoughts anyone?
The only other error in the logs is this one in the -err.log...seems
to point at a DB or JDBC issue
A non-SQL error occurred while requesting a connection from trend_prod
coldfusion.sql.DatabaseConnectionException: Timed out trying to
establish connection
at
coldfusion.server.j2ee.sql.pool.ConnectionRunner$RunnableConnection.fetchConnection(ConnectionRunner.java:72)
at
coldfusion.server.j2ee.sql.pool.ConnectionRunner.fetchConnection(ConnectionRunner.java:46)
at coldfusion.server.j2ee.sql.pool.JDBCPool.create(JDBCPool.java:516)
at coldfusion.server.j2ee.sql.pool.JDBCPool._checkOut(JDBCPool.java:441)
at coldfusion.server.j2ee.sql.pool.JDBCPool.checkOut(JDBCPool.java:355)
at
coldfusion.server.j2ee.sql.pool.JDBCPool.requestConnection(JDBCPool.java:717)
at
coldfusion.server.j2ee.sql.pool.JDBCManager.requestConnection(JDBCManager.java:123)
at
coldfusion.server.j2ee.sql.JRunDataSource.getConnection(JRunDataSource.java:138)
at
coldfusion.server.j2ee.sql.JRunDataSource.getConnection(JRunDataSource.java:125)
at coldfusion.sql.DataSrcImpl.getCachedConnection(DataSrcImpl.java:120)
at coldfusion.sql.DataSrcImpl.getConnection(DataSrcImpl.java:75)
at coldfusion.sql.SqlImpl.execute(SqlImpl.java:214)
at coldfusion.tagext.sql.QueryTag.doEndTag(QueryTag.java:447)
at
cfappglobals2ecfm1639967351.runPage(D:\Inetpub\wwwroot\trend\appglobals.cfm:14)
at coldfusion.runtime.CfJspPage.invoke(CfJspPage.java:147)
at coldfusion.tagext.lang.IncludeTag.doStartTag(IncludeTag.java:357)
at coldfusion.runtime.CfJspPage._emptyTag(CfJspPage.java:1876)
at
cfApplication2ecfm1827355547.runPage(D:\Inetpub\wwwroot\trend\zeroclick\Application.cfm:3)
at coldfusion.runtime.CfJspPage.invoke(CfJspPage.java:147)
at coldfusion.tagext.lang.IncludeTag.doStartTag(IncludeTag.java:357)
at coldfusion.filter.CfincludeFilter.invoke(CfincludeFilter.java:62)
at coldfusion.filter.CfincludeFilter.include(CfincludeFilter.java:30)
at coldfusion.filter.ApplicationFilter.invoke(ApplicationFilter.java:93)
at
coldfusion.filter.RequestMonitorFilter.invoke(RequestMonitorFilter.java:48)
at coldfusion.filter.PathFilter.invoke(PathFilter.java:80)
at coldfusion.filter.ExceptionFilter.invoke(ExceptionFilter.java:47)
at
coldfusion.filter.ClientScopePersistenceFilter.invoke(ClientScopePersistenceFilter.java:28)
at coldfusion.filter.BrowserFilter.invoke(BrowserFilter.java:35)
at coldfusion.filter.GlobalsFilter.invoke(GlobalsFilter.java:43)
at coldfusion.filter.DatasourceFilter.invoke(DatasourceFilter.java:22)
at coldfusion.CfmServlet.service(CfmServlet.java:105)
at
coldfusion.bootstrap.BootstrapServlet.service(BootstrapServlet.java:89)
at jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:91)
at jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
at
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:249)
at
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:527)
at
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:204)
at
jrunx.scheduler.ThreadPool$DownstreamMetrics.invokeRunnable(ThreadPool.java:349)
at
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:457)
at
jrunx.scheduler.ThreadPool$UpstreamMetrics.invokeRunnable(ThreadPool.java:295)
at jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)
--
Douglas Knudsen
http://www.cubicleman.com
this is my signature, like it?
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Find out how CFTicket can increase your company's customer support
efficiency by 100%
http://www.houseoffusion.com/banners/view.cfm?bannerid=49
Message: http://www.houseoffusion.com/lists.cfm/link=i:10:5160
Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/10
Subscription: http://www.houseoffusion.com/lists.cfm/link=s:10
Unsubscribe:
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.10
Donations & Support: http://www.houseoffusion.com/tiny.cfm/54
