Re: [PERFORM] how delete/insert/update affects select performace?

2011-09-09 Thread Kevin Grittner
"Anibal David Acosta" wrote: >> The general guidelines for Windows servers such as >> http://wiki.postgresql.org/wiki/Tuning_Your_PostgreSQL_Server >> recommend a fairly small setting for the shared_buffers parameters >> on Windows--no more than 512MB. > Even if I have a server with 16GB of ra

[PERFORM] Migrated from 8.3 to 9.0 - need to update config (re-post)

2011-09-09 Thread Carlo Stonebanks
Hello performance wizards! (Sorry for the re-post if this appears twice - I see no evidence e-mailing to pgsql-perfomrance is working yet.) My client has migrated his 8.3 hosted DB to new machines running PG 9.0. It’s time to look at the config settings. Immediately below are the confi

[PERFORM] PostgreSQL insights: does it use DMA?

2011-09-09 Thread Antonio Rodriges
Hello, Does anyone know whether PostgreSQL uses DMA (Direct Memory Access) in certain cases to improve networking IO performance? I mean "simple" query is which doesn't require any CPU processing, for ex SELECT column_a FROM table_b WHERE date = "2001-10-05" I need this to devise the best logic

Re: [PERFORM] Migrated from 8.3 to 9.0 - need to update config (re-post)

2011-09-09 Thread Kevin Grittner
Carlo Stonebanks wrote: > this is a full-time ETL system, with only a handful of actual > *users* and automated processes over 300 connections running > *import* programs 24/7 > Intel* Xeon* Processor X5560 (8M Cache, 2.80 GHz, 6.40 > GT/s Intel* QPI) x 2, dual quad core 48 GB RAM > RAID 10,

Re: [PERFORM] PostgreSQL insights: does it use DMA?

2011-09-09 Thread Scott Marlowe
On Fri, Sep 9, 2011 at 11:55 AM, Antonio Rodriges wrote: > Hello, > > Does anyone know whether PostgreSQL uses DMA (Direct Memory Access) in > certain cases to improve networking IO performance? > > I mean "simple" query is which doesn't require any CPU processing, for ex > SELECT column_a FROM ta

Re: [PERFORM] PostgreSQL insights: does it use DMA?

2011-09-09 Thread Antonio Rodriges
Scott, regardless of operating system support for DMA, an application may not benefit from it if it doesn't use appropriate system calls. PostgreSQL is implemented mostly in C, so I do not know whether it needs to use special procedure calls, however this is true, for example, for Java http://www.

Re: [PERFORM] PostgreSQL insights: does it use DMA?

2011-09-09 Thread pasman pasmański
Look at developer faq. 2011/9/9, Antonio Rodriges : > Hello, > > Does anyone know whether PostgreSQL uses DMA (Direct Memory Access) in > certain cases to improve networking IO performance? > > I mean "simple" query is which doesn't require any CPU processing, for ex > SELECT column_a FROM table_b

Re: [PERFORM] PostgreSQL insights: does it use DMA?

2011-09-09 Thread Kevin Grittner
Antonio Rodriges wrote: > PostgreSQL is implemented mostly in C, so I do not know whether it > needs to use special procedure calls, however this is true, for > example, for Java > http://www.ibm.com/developerworks/library/j-zerocopy/ After scanning that I'm inclined to think that the only pla

Re: [PERFORM] Migrated from 8.3 to 9.0 - need to update config (re-post)

2011-09-09 Thread Claudio Freire
On Fri, Sep 9, 2011 at 5:38 PM, Kevin Grittner wrote: > This is getting back to that issue of using only enough processes at > one time to keep all the bottleneck resources fully utilized.  Some > people tend to assuem that if they throw a few more concurrent > processes into the mix, it'll all ge

Re: [PERFORM] Migrated from 8.3 to 9.0 - need to update config (re-post)

2011-09-09 Thread Claudio Freire
On Fri, Sep 9, 2011 at 3:16 PM, Kevin Grittner wrote: > Add together the shared_buffers setting and whatever the OS tells > you is used for cache under your normal load.  It's usually 75% of > RM or higher.  (NOTE: This doesn't cause any allocation of RAM; it's > a hint to the cost calculations.)

Re: [PERFORM] Migrated from 8.3 to 9.0 - need to update config (re-post)

2011-09-09 Thread Kevin Grittner
Claudio Freire wrote: > On Fri, Sep 9, 2011 at 3:16 PM, Kevin Grittner > wrote: >> Add together the shared_buffers setting and whatever the OS tells >> you is used for cache under your normal load. It's usually 75% >> of RM or higher. (NOTE: This doesn't cause any allocation of >> RAM; it's a h

Re: [PERFORM] Migrated from 8.3 to 9.0 - need to update config (re-post)

2011-09-09 Thread Kevin Grittner
Claudio Freire wrote: > On the other hand, in order to benefit from synchro scans and > stuff like that, one has to increase concurrency beyond what is > normally considered optimal. That's a good example of why any general configuration advice should just be used as a starting point. There's

Re: [PERFORM] PostgreSQL insights: does it use DMA?

2011-09-09 Thread Craig Ringer
On 10/09/2011 1:55 AM, Antonio Rodriges wrote: Hello, Does anyone know whether PostgreSQL uses DMA (Direct Memory Access) in certain cases to improve networking IO performance? From what you described in your message it sounds like what you really want is not DMA, but use of something like th