Re: [PERFORM] Large table performance

2007-01-14 Thread Luke Lonergan
Mark, Note that selecting an index column means that Postgres fetches the whole rows from disk. I think your performance problem is either: 1) slow disk or 2) index access of distributed data. If it¹s (1), there are plenty of references from this list on how to check for that and fix it. If it¹

Re: [PERFORM] Large table performance

2007-01-14 Thread Luke Lonergan
Mark, This behavior likely depends on how the data is loaded into the DBMS. If the records you are fetching are distributed widely among the 3M records on disk, then On 1/12/07 4:31 PM, "Mark Dobbrow" <[EMAIL PROTECTED]> wrote: > Hello - > > I have a fairly large table (3 million records),

Re: [PERFORM] Large table performance

2007-01-14 Thread Shoaib Mir
e of 3 million. If you post an EXPLAIN ANALYZE, it might give us a clue. Dave -Original Message- *From:* [EMAIL PROTECTED] [mailto: [EMAIL PROTECTED] *On Behalf Of *Mark Dobbrow *Sent:* Friday, January 12, 2007 6:31 PM *To:* pgsql-performance@postgresql.org *Subject:* [PERFORM] Large

Re: [PERFORM] Large table performance

2007-01-13 Thread Dave Dutcher
PROTECTED] On Behalf Of Mark Dobbrow Sent: Friday, January 12, 2007 6:31 PM To: pgsql-performance@postgresql.org Subject: [PERFORM] Large table performance Hello - I have a fairly large table (3 million records), and am fetching 10,000 non-contigous records doing a simple select on an indexed column

Re: [PERFORM] Large table performance

2007-01-13 Thread Daniel Cristian Cruz
What if we start a project where we define tests for PostgreSQL overall performance and individual points with any database structure? It could be done, throught a SQL logger and statistics, where we can see complete processess and measure then after. We have many things to measure, and something

Re: [PERFORM] Large table performance

2007-01-12 Thread Steinar H. Gunderson
On Fri, Jan 12, 2007 at 07:40:25PM -0500, Dave Cramer wrote: > 5000 is pretty low, you need at least 1/4 of memory for an 8.1.x or > newer server. Is this the new "common wisdom"? It looks like at some point, someone here said "oh, and it looks like you're better off using large values here for

Re: [PERFORM] Large table performance

2007-01-12 Thread Dave Cramer
On 12-Jan-07, at 7:31 PM, Mark Dobbrow wrote: Hello - I have a fairly large table (3 million records), and am fetching 10,000 non-contigous records doing a simple select on an indexed column ie select grades from large_table where teacher_id = X This is a test database, so the number of

[PERFORM] Large table performance

2007-01-12 Thread Mark Dobbrow
Hello - I have a fairly large table (3 million records), and am fetching 10,000 non-contigous records doing a simple select on an indexed column ie select grades from large_table where teacher_id = X This is a test database, so the number of records is always 10,000 and i have 300 different