[PERFORM] Database performance post-VACUUM FULL

2009-09-18 Thread Karl Wright
cover this problem with 8.3.7. Anybody know what's going on? Thanks, Karl -- Karl Wright Software Engineer MetaCarta, Inc. 350 Massachusetts Avenue, 4th Floor, Cambridge, MA 02139 USA (617)-301-5511 www.metacarta.com <http://www.metacarta.com> Where to find it. This message m

Re: [PERFORM] REINDEX/SELECT deadlock?

2008-07-11 Thread Karl Wright
Tom Lane wrote: Karl Wright <[EMAIL PROTECTED]> writes: I just noticed what looks like a deadlock situation on postgresql 8.2.4. Did you look into pg_locks to see what locks those transactions have and are waiting for? regards, tom lane No. Unlike a t

[PERFORM] REINDEX/SELECT deadlock?

2008-07-11 Thread Karl Wright
Hi, I just noticed what looks like a deadlock situation on postgresql 8.2.4. After more than an hour of running REINDEX, two processes are each in a "waiting" state and yet have no time used. This is also the first time I've seen this condition after some 48 hours of continuous load testing.

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-21 Thread Karl Wright
Scott Marlowe wrote: Karl Wright wrote: Scott Marlowe wrote: Karl Wright wrote: Shaun Thomas wrote: On Wednesday 20 June 2007 12:55:20 pm Karl Wright wrote: I am afraid that I did answer this. My largest tables are the ones continually being updated. The smaller ones are updated only

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-20 Thread Karl Wright
Scott Marlowe wrote: Karl Wright wrote: Shaun Thomas wrote: On Wednesday 20 June 2007 12:55:20 pm Karl Wright wrote: I am afraid that I did answer this. My largest tables are the ones continually being updated. The smaller ones are updated only infrequently. You know, it actually

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-20 Thread Karl Wright
Shaun Thomas wrote: On Wednesday 20 June 2007 12:55:20 pm Karl Wright wrote: I am afraid that I did answer this. My largest tables are the ones continually being updated. The smaller ones are updated only infrequently. You know, it actually sounds like you're getting whacked by the

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-20 Thread Karl Wright
Alvaro Herrera wrote: Karl Wright wrote: Alvaro Herrera wrote: Karl Wright wrote: (b) the performance of individual queries had already degraded significantly in the same manner as what I'd seen before. You didn't answer whether you had smaller, more frequently updated tables that

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-20 Thread Karl Wright
Francisco Reyes wrote: Karl Wright writes: Okay - I started a VACUUM with the 8.1 database yesterday morning, having the database remain under load. As of 12:30 today (~27 hours), the original VACUUM was still running. At that point: I don't recall if you said it already, but what is

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-20 Thread Karl Wright
Alvaro Herrera wrote: Karl Wright wrote: (b) the performance of individual queries had already degraded significantly in the same manner as what I'd seen before. You didn't answer whether you had smaller, more frequently updated tables that need more vacuuming. This comment make

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-20 Thread Karl Wright
Francisco Reyes wrote: Alvaro Herrera writes: How large is the database? I must admit I have never seen a database that took 4 days to vacuum. This could mean that your database is humongous, or that the vacuum strategy is wrong for some reason. Specially with 16GB of RAM. I have a setup w

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-19 Thread Karl Wright
Tom Lane wrote: Karl Wright <[EMAIL PROTECTED]> writes: [2007-06-18 09:39:49,797]ERROR Plan: Index Scan using i1181764142395 on intrinsiclink (cost=0.00..14177.29 rows=5 width=253) [2007-06-18 09:39:49,797]ERROR Plan: Index Cond: ((jobid = $2) AND ((childidhash)::text = ($3)::text))

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-19 Thread Karl Wright
Tom Lane wrote: Karl Wright <[EMAIL PROTECTED]> writes: Also, as I said before, I have done extensive query analysis and found that the plans for the queries that are taking a long time are in fact very reasonable. Here's an example from the application log of a query that took wa

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-19 Thread Karl Wright
Bill Moran wrote: In response to Karl Wright <[EMAIL PROTECTED]>: Alvaro Herrera wrote: Karl Wright wrote: Alvaro Herrera wrote: Karl Wright wrote: This particular run lasted four days before a VACUUM became essential. The symptom that indicates that VACUUM is needed seems to be th

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-19 Thread Karl Wright
Alvaro Herrera wrote: Karl Wright wrote: Alvaro Herrera wrote: Karl Wright wrote: This particular run lasted four days before a VACUUM became essential. The symptom that indicates that VACUUM is needed seems to be that the CPU usage of any given postgresql query skyrockets. Is this

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-19 Thread Karl Wright
Gregory Stark wrote: "Karl Wright" <[EMAIL PROTECTED]> writes: This particular run lasted four days before a VACUUM became essential. The symptom that indicates that VACUUM is needed seems to be that the CPU usage of any given postgresql query skyrockets. Is this ess

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-19 Thread Karl Wright
Alvaro Herrera wrote: Karl Wright wrote: This particular run lasted four days before a VACUUM became essential. The symptom that indicates that VACUUM is needed seems to be that the CPU usage of any given postgresql query skyrockets. Is this essentially correct? Are you saying you weren&#

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-19 Thread Karl Wright
f any given postgresql query skyrockets. Is this essentially correct? Karl Karl Wright wrote: Tom Lane wrote: Karl Wright <[EMAIL PROTECTED]> writes: - At any given time, there are up to 100 of these operations going on at once against the same database. It sounds like your hardware

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-19 Thread Karl Wright
Tom Lane wrote: Karl Wright <[EMAIL PROTECTED]> writes: - At any given time, there are up to 100 of these operations going on at once against the same database. It sounds like your hardware is far past "maxed out". Which is odd since tables with a million or so rows are

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-18 Thread Karl Wright
Karl Wright wrote: Hi, I have an application which really exercises the performance of postgresql in a major way, and I am running into a performance bottleneck with Postgresql 8.1 that I do not yet understand. Here are the details: - There is a primary table, with some secondary tables

[PERFORM] Performance query about large tables, lots of concurrent access

2007-06-18 Thread Karl Wright
Hi, I have an application which really exercises the performance of postgresql in a major way, and I am running into a performance bottleneck with Postgresql 8.1 that I do not yet understand. Here are the details: - There is a primary table, with some secondary tables - The principle transac