Re: [PERFORM] Migration study, step 1: bulk write performanceoptimization

2006-03-22 Thread Mikael Carneholm
On Mon, 2006-03-20 at 15:59 +0100, Mikael Carneholm wrote: This gives that 10Gb takes ~380s = ~27Mb/s (with fsync=off), compared to the raw dd result (~75.5Mb/s). I assume this difference is due to: - simultaneous WAL write activity (assumed: for each byte written to the table, at least

Re: [PERFORM] Migration study, step 1: bulk write performanceoptimization

2006-03-22 Thread Jim C. Nasby
On Wed, Mar 22, 2006 at 10:04:49AM +0100, Mikael Carneholm wrote: It does (LOG: checkpoints are occurring too frequently (2 seconds apart)) However, I tried increasing checkpoint_segments to 32 (512Mb) making it checkpoint every 15 second or so, but that gave a more uneven insert rate than

Re: [PERFORM] Migration study, step 1: bulk write performanceoptimization

2006-03-22 Thread Mikael Carneholm
To: Mikael Carneholm Cc: Simon Riggs; pgsql-performance@postgresql.org Subject: Re: [PERFORM] Migration study, step 1: bulk write performanceoptimization On Wed, Mar 22, 2006 at 10:04:49AM +0100, Mikael Carneholm wrote: It does (LOG: checkpoints are occurring too frequently (2 seconds apart

Re: [PERFORM] Migration study, step 1: bulk write performanceoptimization

2006-03-22 Thread Tom Lane
Jim C. Nasby [EMAIL PROTECTED] writes: On Wed, Mar 22, 2006 at 10:04:49AM +0100, Mikael Carneholm wrote: It does (LOG: checkpoints are occurring too frequently (2 seconds apart)) However, I tried increasing checkpoint_segments to 32 (512Mb) making it checkpoint every 15 second or so, but