Re: [PERFORM] Table UPDATE is too slow

2004-09-05 Thread Kevin Barnard
Do all of the commands to swap tables in a transaction.  The table gets locked briefly but should have a lot less impact then the update command. On Mon, 06 Sep 2004 01:28:04 +0200, Marinos J. Yannikos [EMAIL PROTECTED] wrote: That said, I'm not entirely sure how well postgres' client

Re: [PERFORM] Table UPDATE is too slow

2004-08-31 Thread Thomas F . O'Connell
What is the datatype of the id column? -tfo On Aug 31, 2004, at 1:11 PM, Ron St-Pierre wrote: We have a web based application with data that is updated daily. The biggest bottleneck occurs when we try to update one of the tables. This table contains 58,000 rows and 62 columns, and EVERY column

Re: [PERFORM] Table UPDATE is too slow

2004-08-31 Thread Steinar H. Gunderson
On Tue, Aug 31, 2004 at 11:11:02AM -0700, Ron St-Pierre wrote: We have a web based application with data that is updated daily. The biggest bottleneck occurs when we try to update one of the tables. This table contains 58,000 rows and 62 columns, and EVERY column is indexed. That is usually

Re: [PERFORM] Table UPDATE is too slow

2004-08-31 Thread Ron St-Pierre
Thomas F. O'Connell wrote: What is the datatype of the id column? The id column is INTEGER. Ron ---(end of broadcast)--- TIP 6: Have you searched our list archives? http://archives.postgresql.org

Re: [PERFORM] Table UPDATE is too slow

2004-08-31 Thread Ron St-Pierre
Steinar H. Gunderson wrote: On Tue, Aug 31, 2004 at 11:11:02AM -0700, Ron St-Pierre wrote: We have a web based application with data that is updated daily. The biggest bottleneck occurs when we try to update one of the tables. This table contains 58,000 rows and 62 columns, and EVERY column

Re: [PERFORM] Table UPDATE is too slow

2004-08-31 Thread William Yu
Ron St-Pierre wrote: Yes, I know that it's not a very good idea, however queries are allowed against all of those columns. One option is to disable some or all of the indexes when we update, run the update, and recreate the indexes, however it may slow down user queries. Because there are so

Re: [PERFORM] Table UPDATE is too slow

2004-08-31 Thread Ron St-Pierre
Thanks for everyone's comments (Thomas, Steinar, Frank, Matt, William). Right now I'm bench-marking the time it takes for each step in the end of day update process and then I am going to test a few things: - dropping most indexes, and check the full processing time and see if there is any

Re: [PERFORM] Table UPDATE is too slow

2004-08-31 Thread Tom Lane
Ron St-Pierre [EMAIL PROTECTED] writes: Does anyone have some idea on how we can increase speed, either by changing the updates, designing the database differently, etc, etc? This is currently a big problem for us. Other notables: The UPDATE is run from a within a function: FOR rec