Hi there, We've been having a lot of problems recently with one of our Cluster instances whereby it keeps either shutting itself down or starts to reject threads. There isn't a set pattern to when this happens but it is only happening on one instance (we have four in total separated 50/50 on two servers).
When JRun starts rejecting requests we're seeing this kind of thing in the logs: 27/02 10:44:01 metrics Web threads (busy/total): 0/10 Sessions: 4520 Total Memory=65472 Free=8732 27/02 10:45:01 metrics Web threads (busy/total): 0/11 Sessions: 4515 Total Memory=56320 Free=8533 27/02 10:46:01 metrics Web threads (busy/total): 1/10 Sessions: 4512 Total Memory=57600 Free=7505 27/02 10:47:01 metrics Web threads (busy/total): 0/10 Sessions: 4518 Total Memory=57920 Free=6622 27/02 10:48:01 metrics Web threads (busy/total): 1/10 Sessions: 4503 Total Memory=57216 Free=9725 27/02 10:49:01 metrics Web threads (busy/total): 0/10 Sessions: 4501 Total Memory=54976 Free=7224 27/02 10:50:01 metrics Web threads (busy/total): 0/9 Sessions: 4431 Total Memory=61376 Free=12289 27/02 10:50:41 info Clusterable service JRunProxyClusterHelper successfully removed a peer when that peer left the cluster 27/02 10:51:01 metrics Web threads (busy/total): 0/9 Sessions: 4413 Total Memory=56832 Free=11473 27/02 10:52:01 metrics Web threads (busy/total): 0/9 Sessions: 4377 Total Memory=56064 Free=11637 27/02 10:53:01 metrics Web threads (busy/total): 0/9 Sessions: 4341 Total Memory=53504 Free=11657 27/02 10:54:02 metrics Web threads (busy/total): 0/9 Sessions: 4300 Total Memory=53568 Free=11636 27/02 10:55:02 metrics Web threads (busy/total): 0/9 Sessions: 4263 Total Memory=53568 Free=11543 27/02 10:56:02 metrics Web threads (busy/total): 0/1 Sessions: 4213 Total Memory=53504 Free=11598 27/02 10:57:02 metrics Web threads (busy/total): 0/1 Sessions: 4173 Total Memory=52544 Free=11585 27/02 10:58:02 metrics Web threads (busy/total): 0/1 Sessions: 4132 Total Memory=52608 Free=11501 27/02 10:59:02 metrics Web threads (busy/total): 0/1 Sessions: 4089 Total Memory=52608 Free=11370 27/02 11:00:02 metrics Web threads (busy/total): 0/1 Sessions: 4051 Total Memory=52608 Free=11454 27/02 11:01:02 metrics Web threads (busy/total): 0/1 Sessions: 4014 Total Memory=52096 Free=11537 27/02 11:02:02 metrics Web threads (busy/total): 0/1 Sessions: 3967 Total Memory=52096 Free=11190 .....so note that JRun rejects the instance from the cluster but the logs carry on. Also note that the Web Threads just carry on as 0/1 until the instance is started up again. The frequency of this has started to increase and we're now getting this at least once a day. The server is a virtual machine, Win Server 2003, CF7.0 with multiserver JRun. We have it setup on Round Robin with sticky sessions. Just to give you a breakdown on what we've tried already.... The problem started on the 29th of Jan this year and looking at our logs nothing has changed on or around this time apart from an upgrade to our backup software on the other "working" server. So I wouldn't expect this to effect the one that is now faulty. We started to add Hotfixes to the server on the 5th of Feb but this hasn't resolved the problem. These included JRun Updater 7 and CF HotFix 3 which had stability fixes for clustering. This was applied to both servers. Checking logs in IIS I'm not seeing anything abnormal. We've compared the setup of the failing instance to the other server instance and apart from a few unique configuration settings both are identifical in JRun. We are considering the option of rebuilding the instance using the working one but to be honest that drawing at straws. Has anybody else had a similar kind of problem or can think of any other ideas as to what might be causing this. Your help would be appreciated and if there is anymore information you need please let me know. Cheers, James ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;160198600;22374440;w Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:300055 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
