Re: [PERFORM] pg_dump far too slow

2010-03-21 Thread Craig Ringer
On 21/03/2010 9:17 PM, David Newall wrote: Thanks for all of the suggestions, guys, which gave me some pointers on new directions to look, and I learned some interesting things. Unfortunately one of these processes dropped eventually, and, according to top, the only non-idle process running

Re: [PERFORM] pg_dump far too slow

2010-03-21 Thread Tom Lane
Craig Ringer cr...@postnewspapers.com.au writes: On 21/03/2010 9:17 PM, David Newall wrote: and wonder if I should read up on gzip to find why it would work so slowly on a pure text stream, albeit a representation of PDF which intrinsically is fairly compressed. In fact, PDF uses deflate

Re: [PERFORM] pg_dump far too slow

2010-03-21 Thread David Newall
Tom Lane wrote: I would bet that the reason for the slow throughput is that gzip is fruitlessly searching for compressible sequences. It won't find many. Indeed, I didn't expect much reduction in size, but I also didn't expect a four-order of magnitude increase in run-time (i.e. output

[PERFORM] GZIP of pre-zipped output

2010-03-21 Thread Dave Crooke
If you are really so desparate to save a couple of GB that you are resorting to -Z9 then I'd suggest using bzip2 instead. bzip is designed for things like installer images where there will be massive amounts of downloads, so it uses a ton of cpu during compression, but usually less than -Z9 and

Re: [PERFORM] pg_dump far too slow

2010-03-21 Thread Bob Lunney
If you have a multi-processor machine (more than 2) you could look into pigz, which is a parallelized implementation of gzip. I gotten dramatic reductions in wall time using it to zip dump files.  The compressed file is readable by ungzip. Bob Lunney From: Dave Crooke dcro...@gmail.com

Re: [PERFORM] mysql to postgresql, performance questions

2010-03-21 Thread Merlin Moncure
On Sat, Mar 20, 2010 at 11:47 PM, Andy Colson a...@squeakycode.net wrote: Don't underestimate mysql.  It was written to be fast.  But you have to understand the underling points:  It was written to be fast at the cost of other things... like concurrent access, and data integrity.  If you want

Re: [PERFORM] mysql to postgresql, performance questions

2010-03-21 Thread Dave Crooke
Note however that Oracle offeres full transactionality and does in place row updates. There is more than one way to do it. Cheers Dave On Mar 21, 2010 5:43 PM, Merlin Moncure mmonc...@gmail.com wrote: On Sat, Mar 20, 2010 at 11:47 PM, Andy Colson a...@squeakycode.net wrote: Don't underestimate

Re: [PERFORM] GZIP of pre-zipped output

2010-03-21 Thread Craig Ringer
On 22/03/2010 1:04 AM, Dave Crooke wrote: If you are really so desparate to save a couple of GB that you are resorting to -Z9 then I'd suggest using bzip2 instead. bzip is designed for things like installer images where there will be massive amounts of downloads, so it uses a ton of cpu during

Re: [PERFORM] GZIP of pre-zipped output

2010-03-21 Thread Scott Marlowe
On Sun, Mar 21, 2010 at 8:46 PM, Craig Ringer cr...@postnewspapers.com.au wrote: On 22/03/2010 1:04 AM, Dave Crooke wrote: If you are really so desparate to save a couple of GB that you are resorting to -Z9 then I'd suggest using bzip2 instead. bzip is designed for things like installer

Re: [PERFORM] pgbench installation

2010-03-21 Thread Greg Smith
Reydan Cankur wrote: I have compiled PostgreSQL 8.4 from source code and in order to install pgbench, I go under contrib folder and run below commands: make make install when I write pgbench as a command system cannot find pgbench as a command. Do regular PostgreSQL command such as psql