[PERFORM] import performance

2006-03-13 Thread Chris
Hi all, I'm trying to work out why my 8.1 system is slower than my 7.4 system for importing data. The import is a lot of insert into commands - it's a converted database from another system so I can't change it to copy commands. My uncommented config options: autovacuum = off

Re: [PERFORM] import performance

2006-03-13 Thread Gavin Sherry
On Tue, 14 Mar 2006, Chris wrote: Hi all, I'm trying to work out why my 8.1 system is slower than my 7.4 system for importing data. The import is a lot of insert into commands - it's a converted database from another system so I can't change it to copy commands. My uncommented config

Re: [PERFORM] import performance

2006-03-13 Thread Dave Dutcher
[Snip] shared_buffers = 256 Make this higher too. If this is a dedicated machine with 512 MB of ram, set it to something like 125000. You may need to adjust shared memory settings for your operating system. See the manual for details. Whoa. Maybe I'm wrong, but isn't each buffer

Re: [PERFORM] import performance

2006-03-13 Thread Chris
Gavin Sherry wrote: On Tue, 14 Mar 2006, Chris wrote: Hi all, I'm trying to work out why my 8.1 system is slower than my 7.4 system for importing data. The import is a lot of insert into commands - it's a converted database from another system so I can't change it to copy commands. snip

Re: [PERFORM] import performance

2006-03-13 Thread Chris
Frank Wiles wrote: On Tue, 14 Mar 2006 12:24:22 +1100 Chris [EMAIL PROTECTED] wrote: Gavin Sherry wrote: On Tue, 14 Mar 2006, Chris wrote: Hi all, I'm trying to work out why my 8.1 system is slower than my 7.4 system for importing data. The import is a lot of insert into commands -

Re: [PERFORM] import performance

2006-03-13 Thread Tom Lane
Chris [EMAIL PROTECTED] writes: Tons of difference :/ Have you checked that the I/O performance is comparable? It seems possible that there's something badly misconfigured about the disks on your new machine. Benchmarking with bonnie or some such would be useful; also try looking at iostat 1

Re: [PERFORM] import performance

2006-03-13 Thread Frank Wiles
On Tue, 14 Mar 2006 12:42:21 +1100 Chris [EMAIL PROTECTED] wrote: Different hardware. 7.4 is running on a 500MHz computer with 256M compared to 8.1 running on a 2.6GHz with 512M. Well when it comes to inserts CPU and RAM have almost nothing to do with it. What are the hard disk

Re: [PERFORM] import performance

2006-03-13 Thread Chris
Tom Lane wrote: Chris [EMAIL PROTECTED] writes: Tons of difference :/ Have you checked that the I/O performance is comparable? It seems possible that there's something badly misconfigured about the disks on your new machine. Benchmarking with bonnie or some such would be useful; also try

Re: [PERFORM] import performance

2006-03-13 Thread David Lang
On Tue, 14 Mar 2006, Chris wrote: The only other thing I can see is the old server is ext2: /dev/hda4 on / type ext2 (rw,errors=remount-ro) the new one is ext3: /dev/hda2 on / type ext3 (rw) this is actually a fairly significant difference. with ext3 most of your data actually gets written

Re: [PERFORM] import performance

2006-03-13 Thread Chris
David Lang wrote: On Tue, 14 Mar 2006, Chris wrote: The only other thing I can see is the old server is ext2: /dev/hda4 on / type ext2 (rw,errors=remount-ro) the new one is ext3: /dev/hda2 on / type ext3 (rw) this is actually a fairly significant difference. with ext3 most of your data