Re: What would you call high traffic for CF8 standard?

2013-06-14 Thread Jochem van Dieten
On Thu, Jun 13, 2013 at 7:49 PM, Paul Vernon wrote: The sites already make extensive use of NOLOCK hints especially around the job search functions. If you have control over the database server the easiest way to solve most database locking issues when your usage pattern is read-mostly is to

RE: What would you call high traffic for CF8 standard?

2013-06-14 Thread Paul Vernon
Just to round this off. It seems I've solved the issue today. Thankfully. It turns out one of the ATS vendors has been posting jobs en-masse repeatedly at a rate of a few thousand per minute. There are only 4,500 jobs but they're repeatedly posting the same jobs over and over and over again all

Re: What would you call high traffic for CF8 standard?

2013-06-14 Thread Russ Michaels
FYII, FusionReactor would have shown you that right away as you would have seen all the web service requests running. On Fri, Jun 14, 2013 at 4:04 PM, Paul Vernon paul.ver...@web-architect.co.uk wrote: Just to round this off. It seems I've solved the issue today. Thankfully. It turns out

Re: What would you call high traffic for CF8 standard?

2013-06-14 Thread Steve 'Cutter' Blades
+1 for FusionReactor. It Rocks Steve 'Cutter' Blades Adobe Community Professional Adobe Certified Expert Advanced Macromedia ColdFusion MX 7 Developer http://cutterscrossing.com Co-Author Learning Ext JS 3.2 Packt Publishing 2010

RE: What would you call high traffic for CF8 standard?

2013-06-14 Thread Mark A. Kruger
10:04 AM To: cf-talk Subject: RE: What would you call high traffic for CF8 standard? Just to round this off. It seems I've solved the issue today. Thankfully. It turns out one of the ATS vendors has been posting jobs en-masse repeatedly at a rate of a few thousand per minute. There are only 4,500

RE: What would you call high traffic for CF8 standard?

2013-06-13 Thread Paul Vernon
I've been looking at the memory usage over the last 24 hours and spotted an optimisation that may benefit the server. The MaxPermSize was set to 384MB and the Eden space was set to 256MB. Looking at the memory usage, the MaxPermSize was nowhere near its limit and the Eden space was so I've

RE: What would you call high traffic for CF8 standard?

2013-06-13 Thread Mark A. Kruger
Great points Byron. -Original Message- From: Byron Mann [mailto:byronos...@gmail.com] Sent: Wednesday, June 12, 2013 9:26 PM To: cf-talk Subject: RE: What would you call high traffic for CF8 standard? Being a job site, aside from the search, are the other CF pages really dynamic? You

RE: What would you call high traffic for CF8 standard?

2013-06-13 Thread Mark A. Kruger
- From: Paul Vernon [mailto:paul.ver...@web-architect.co.uk] Sent: Thursday, June 13, 2013 5:51 AM To: cf-talk Subject: RE: What would you call high traffic for CF8 standard? I've been looking at the memory usage over the last 24 hours and spotted an optimisation that may benefit the server

RE: What would you call high traffic for CF8 standard?

2013-06-13 Thread Paul Vernon
After looking through the logs (and there are a lot of logs) when the server crashes, the first thing to start appearing is cfquery timing out. The DB however is fully responsive to other clients when this happens, so the issue is CF data source related rather than the DB directly. This all

Re: What would you call high traffic for CF8 standard?

2013-06-13 Thread Steve 'Cutter' Blades
In my experience, many CF problems are actually DB performance issues. Not the DB server, per se, but a specific datasource and the queries running against it. Run your trouble queries through a query optimizer, and ensure you have the best query written for the task. Check out your indexes

RE: What would you call high traffic for CF8 standard?

2013-06-13 Thread Mark A. Kruger
-talk Subject: RE: What would you call high traffic for CF8 standard? After looking through the logs (and there are a lot of logs) when the server crashes, the first thing to start appearing is cfquery timing out. The DB however is fully responsive to other clients when this happens, so the issue

Re: What would you call high traffic for CF8 standard?

2013-06-13 Thread Byron Mann
Here's a simple one to show you real time what is executing on the server. set transaction isolation level read uncommitted go SELECT s.blocked as blockedBy, r.session_id, st.text, r.status, r.command, r.cpu_time, db_name(r.database_id), object_name(st.objectid, r.database_id),

RE: What would you call high traffic for CF8 standard?

2013-06-13 Thread Paul Vernon
Locks and blocks can occur and have no overall impact on general DB server performance - but still bring down your site because they prevent other queries from completing. I'd bet my left eye that's what's happening. Here's what I would do snip On this server, I've done all what

RE: What would you call high traffic for CF8 standard?

2013-06-13 Thread Paul Vernon
Hi Byron, Here's a simple one to show you real time what is executing on the server. What version of SQL Server is that for? Paul ~| Order the Adobe Coldfusion Anthology now!

Re: What would you call high traffic for CF8 standard?

2013-06-13 Thread Russ Michaels
are you checking for hung requests when the issues occur? On Thu, Jun 13, 2013 at 6:49 PM, Paul Vernon paul.ver...@web-architect.co.uk wrote: Hi Byron, Here's a simple one to show you real time what is executing on the server. What version of SQL Server is that for? Paul

Re: What would you call high traffic for CF8 standard?

2013-06-13 Thread Byron Mann
That should work on 2005 and above as best I know. Not sure about 2000. Also, I noticed in the trace, some of the queries look a bit sequential, based on the parameters. Maybe like you are looping over a result set and doing queries for each record in that first result set. If so, that could

RE: What would you call high traffic for CF8 standard?

2013-06-13 Thread Mark A. Kruger
: Paul Vernon [mailto:paul.ver...@web-architect.co.uk] Sent: Thursday, June 13, 2013 12:49 PM To: cf-talk Subject: RE: What would you call high traffic for CF8 standard? Locks and blocks can occur and have no overall impact on general DB server performance - but still bring down your site because

RE: What would you call high traffic for CF8 standard?

2013-06-13 Thread Paul Vernon
That should work on 2005 and above as best I know. Not sure about 2000. Not SQL 2000 then :-( Also, I noticed in the trace, some of the queries look a bit sequential, based on the parameters. Maybe like you are looping over a result set and doing queries for each record in that first

RE: What would you call high traffic for CF8 standard?

2013-06-13 Thread Paul Vernon
Yeah... again I would say you are getting all you can out of this setup. I'm not finding a lot to criticize :) -Mark Thanks. It just crashed again. Albeit the reliability is much improved over what it was by reducing the time for cleaning up connections and switching the memory allocations

Re: What would you call high traffic for CF8 standard?

2013-06-13 Thread Brian Cain
I second the DB issue theory. I also run several job boards, and have found that most of my performance issues relate to the database. Sometime I can optimize the DB with the help of the profiler, other times I have simply reworked the code for better efficient. Use of nolock, small simple

Re: What would you call high traffic for CF8 standard?

2013-06-12 Thread Russ Michaels
that is a lot for standard edition. Enterprise is meant to be able to handle more connections, but I have never tested the difference. how many simultaneous requests have you got it set to handle. average should be 10 per cpu/core but you will need to tweak to see what it can handle. It also

RE: What would you call high traffic for CF8 standard?

2013-06-12 Thread Mark A. Kruger
Paul, I assume this is 32bit given the amount of RAM. If by 750 pages per second (bursts up to 1250-1500) you mean ColdFusion templates executing (and I assume you do) then you are getting quite a bit out of the server I'd say and making good use of your xeon 3.3's :) Your options for tweaking

Re: What would you call high traffic for CF8 standard?

2013-06-12 Thread Steve 'Cutter' Blades
You can also look at your CF allocation in your jvm.config. The default is 512kb, which is pretty small. With everything you have running on this machine, your options here may be limited, and in a 32bit environment you might only be able to bump this up to 1400 on the top end. Steve 'Cutter'

RE: What would you call high traffic for CF8 standard?

2013-06-12 Thread Paul Vernon
I assume this is 32bit given the amount of RAM. If by 750 pages per second (bursts up to 1250-1500) you mean ColdFusion templates executing (and I assume you do) then you are getting quite a bit out of the server I'd say and making good use of your xeon 3.3's :) Your options for tweaking

Re: What would you call high traffic for CF8 standard?

2013-06-12 Thread Russ Michaels
are you sure this server can cope with 50 simultaneous requests? see my previous reply for calculations based on cpu. If not then putting it up that high would cause more problems than queuing the requests. You really should try fusionreactor as I suggested, there is a free trial version if that

Re: What would you call high traffic for CF8 standard?

2013-06-12 Thread Mark Drew
I am with Russ on this. Get Fusion Reactor, and start getting *REAL* information about how your server is running then you can make choices about what to change. The number of queued requests my lead you to increase the memory and the problem to go away (for example) but without knowing, you

RE: What would you call high traffic for CF8 standard?

2013-06-12 Thread Mark A. Kruger
be doing about as well as expected on a 32bit standard machine. Mark Kruger - CFG -Original Message- From: Paul Vernon [mailto:paul.ver...@web-architect.co.uk] Sent: Wednesday, June 12, 2013 10:56 AM To: cf-talk Subject: RE: What would you call high traffic for CF8 standard? I assume

RE: What would you call high traffic for CF8 standard?

2013-06-12 Thread Byron Mann
Being a job site, aside from the search, are the other CF pages really dynamic? You could maybe do things like dump all the job descriptions and corporate jargon pages to html a couple times a day and serve those instead. If you have that many page hits, ask yourself how many unique users you