[PERFORM] Configuration settings (shared_buffers, etc) in Linux: puzzled

2008-01-24 Thread Rick Schumeyer
On a linux box (Linux db1 2.6.18.8-md #1 SMP Wed May 23 17:21:37 EDT 2007 i686 GNU/Linux) I edited postgresql.conf and changed: shared_buffers = 5000 work_mem = 16384 max_stack_depth = 4096 and then restarted postgres. The puzzling part is that postgres actually started. When I

[PERFORM] table partitioning: effects of many sub-tables (was COPY too slow...)

2005-12-07 Thread Rick Schumeyer
Based on a suggestion on the postgis list, I partitioned my 80 million (for now) record table into subtables of about 230k records (the amount of data collected in five minutes). At the moment I have 350 subtables. Everything seems to be greatCOPY time is ok, building a geometric

[PERFORM] two disks - best way to use them?

2005-12-02 Thread Rick Schumeyer
I installed another drive in my linux pc in an attempt to improve performance on a large COPY to a table with a geometry index. Based on previous discussion, it seems there are three things competing for the hard drive: 1) the input data file 2) the pg table 3) the WAL What is

[PERFORM] COPY into table too slow with index

2005-12-01 Thread Rick Schumeyer
Im running postgresql 8.1.0 with postgis 1.0.4 on a FC3 system, 3Ghz, 1 GB memory. I am using COPY to fill a table that contains one postgis geometry column. With no geometry index, it takes about 45 seconds to COPY one file. If I add a geometry index, this time degrades. It keeps

Re: [PERFORM] COPY into table too slow with index: now an I/O question

2005-12-01 Thread Rick Schumeyer
pointers on the best way to set that up would be appreciated. Please let me know if anyone has additional ideas. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Rick Schumeyer Sent: Thursday, December 01, 2005 12:58 PM To: pgsql-performance@postgresql.org

Re: [PERFORM] COPY into table too slow with index: now an I/O question

2005-12-01 Thread Rick Schumeyer
the table has, say, 50 million rows. -Original Message- From: Luke Lonergan [mailto:[EMAIL PROTECTED] Sent: Thursday, December 01, 2005 9:27 PM To: Rick Schumeyer; pgsql-performance@postgresql.org Subject: Re: [PERFORM] COPY into table too slow with index: now an I/O question Rick