Re: [PERFORM] PostreSQL v9.2 uses a lot of memory in Windows XP

2012-11-13 Thread Craig Ringer
On 11/14/2012 01:56 PM, Wu Ming wrote: > This is interesting. About the "virtual size of one of the process", > which process I should look up? Is the one who has the biggest virtual > size? Thinking about this some more, I haven't checked to see if Windows adds dirtied shared_buffers to the proc

Re: [PERFORM] PostreSQL v9.2 uses a lot of memory in Windows XP

2012-11-13 Thread Wu Ming
Hi, > As I said, it just isn't that simple when shared memory is involved. A > rough measure for PostgreSQL is the "virtual size" of one of the > processes, plus the working sets of all the others. Alternately, you can > reasonably estimate the memory consumption by adding all the working > sets a

Re: [HACKERS] [PERFORM] pg_dump and thousands of schemas

2012-11-13 Thread Andrew Dunstan
On 11/13/2012 10:12 PM, Denis wrote: Please don't think that I'm trying to nitpick here, but pg_dump has options for dumping separate tables and that's not really consistent with the idea that "pg_dump is primarily designed for dumping entire databases". Sure it is. The word "primarily" is

Re: [HACKERS] [PERFORM] pg_dump and thousands of schemas

2012-11-13 Thread Jeff Janes
On Tue, Nov 13, 2012 at 7:12 PM, Denis wrote: > Jeff Janes wrote >> On Thu, Nov 8, 2012 at 1:04 AM, Denis < > >> socsam@ > >> > wrote: >>> >>> Still I can't undesrtand why pg_dump has to know about all the tables? >> >> Strictly speaking it probably doesn't need to. But it is primarily >> designe

Re: [HACKERS] [PERFORM] pg_dump and thousands of schemas

2012-11-13 Thread Denis
Jeff Janes wrote > On Thu, Nov 8, 2012 at 1:04 AM, Denis < > socsam@ > > wrote: >> >> Still I can't undesrtand why pg_dump has to know about all the tables? > > Strictly speaking it probably doesn't need to. But it is primarily > designed for dumping entire databases, and the efficient way to d

Re: [PERFORM] postgres 8.4, COPY, and high concurrency

2012-11-13 Thread Jon Nelson
On Tue, Nov 13, 2012 at 2:43 PM, Jeff Janes wrote: > On Tue, Nov 13, 2012 at 12:03 PM, Jon Nelson > wrote: >> On Tue, Nov 13, 2012 at 1:27 PM, Heikki Linnakangas >> wrote: >>> >>> On 13.11.2012 21:13, Jon Nelson wrote: >>> >>> I'd guess it's lock contention on WALInsertLock. That means, th

Re: [PERFORM] PostreSQL v9.2 uses a lot of memory in Windows XP

2012-11-13 Thread Craig Ringer
Please reply to the list, not directly to me. Comments follow in-line. On 11/13/2012 11:37 PM, Wu Ming wrote: > Hi, > > What column in Process Explorer to determine memory usage? Currently I > thought "Working Set" is the correct one. As I said, it just isn't that simple when shared memory is invo

Re: [PERFORM] postgres 8.4, COPY, and high concurrency

2012-11-13 Thread Jeff Janes
On Tue, Nov 13, 2012 at 12:03 PM, Jon Nelson wrote: > On Tue, Nov 13, 2012 at 1:27 PM, Heikki Linnakangas > wrote: >> >> On 13.11.2012 21:13, Jon Nelson wrote: >>> >> >> I'd guess it's lock contention on WALInsertLock. That means, the system is >> experiencing lock contention on generating WAL re

Re: [PERFORM] postgres 8.4, COPY, and high concurrency

2012-11-13 Thread Jon Nelson
On Tue, Nov 13, 2012 at 1:27 PM, Heikki Linnakangas wrote: > On 13.11.2012 21:13, Jon Nelson wrote: > >> I was working on a data warehousing project where a fair number of files >> could be COPY'd more or less directly into tables. I have a somewhat nice >> machine to work with, and I ran on 75%

Re: [PERFORM] postgres 8.4, COPY, and high concurrency

2012-11-13 Thread Jeff Janes
On Tue, Nov 13, 2012 at 11:13 AM, Jon Nelson wrote: > I was working on a data warehousing project where a fair number of files > could be COPY'd more or less directly into tables. I have a somewhat nice > machine to work with, and I ran on 75% of the cores I have (75% of 32 is > 24). > > Performan

Re: [PERFORM] postgres 8.4, COPY, and high concurrency

2012-11-13 Thread Heikki Linnakangas
On 13.11.2012 21:13, Jon Nelson wrote: I was working on a data warehousing project where a fair number of files could be COPY'd more or less directly into tables. I have a somewhat nice machine to work with, and I ran on 75% of the cores I have (75% of 32 is 24). Performance was pretty bad. With

[PERFORM] postgres 8.4, COPY, and high concurrency

2012-11-13 Thread Jon Nelson
I was working on a data warehousing project where a fair number of files could be COPY'd more or less directly into tables. I have a somewhat nice machine to work with, and I ran on 75% of the cores I have (75% of 32 is 24). Performance was pretty bad. With 24 processes going, each backend (in COP

Re: [PERFORM] Planner sometimes doesn't use a relevant index with IN (subquery) condition

2012-11-13 Thread Gavin Flower
On 12/11/12 22:06, RafaƂ Rzepecki wrote: This indeed works around the issue. Thanks! On Mon, Nov 12, 2012 at 9:53 AM, ashutosh durugkar wrote: Hey Rafal, SELECT * FROM (SELECT run_id, utilization FROM stats) AS s WHERE run_id IN (SELECT run_id FROM runs WHERE server_id = 515); could you t