Re: [PERFORM] import performance

2006-03-13 Thread Chris
David Lang wrote: On Tue, 14 Mar 2006, Chris wrote: The only other thing I can see is the old server is ext2: /dev/hda4 on / type ext2 (rw,errors=remount-ro) the new one is ext3: /dev/hda2 on / type ext3 (rw) this is actually a fairly significant difference. with ext3 most of your data act

Re: [PERFORM] import performance

2006-03-13 Thread David Lang
On Tue, 14 Mar 2006, Chris wrote: The only other thing I can see is the old server is ext2: /dev/hda4 on / type ext2 (rw,errors=remount-ro) the new one is ext3: /dev/hda2 on / type ext3 (rw) this is actually a fairly significant difference. with ext3 most of your data actually gets written t

Re: [PERFORM] import performance

2006-03-13 Thread Chris
Tom Lane wrote: Chris <[EMAIL PROTECTED]> writes: Tons of difference :/ Have you checked that the I/O performance is comparable? It seems possible that there's something badly misconfigured about the disks on your new machine. Benchmarking with "bonnie" or some such would be useful; also t

Re: [PERFORM] import performance

2006-03-13 Thread Frank Wiles
On Tue, 14 Mar 2006 12:42:21 +1100 Chris <[EMAIL PROTECTED]> wrote: > Different hardware. > > 7.4 is running on a 500MHz computer with 256M compared to 8.1 running > on a 2.6GHz with 512M. Well when it comes to inserts CPU and RAM have almost nothing to do with it. What are the hard disk d

Re: [PERFORM] import performance

2006-03-13 Thread Tom Lane
Chris <[EMAIL PROTECTED]> writes: > Tons of difference :/ Have you checked that the I/O performance is comparable? It seems possible that there's something badly misconfigured about the disks on your new machine. Benchmarking with "bonnie" or some such would be useful; also try looking at "iosta

Re: [PERFORM] import performance

2006-03-13 Thread Chris
Frank Wiles wrote: On Tue, 14 Mar 2006 12:24:22 +1100 Chris <[EMAIL PROTECTED]> wrote: Gavin Sherry wrote: On Tue, 14 Mar 2006, Chris wrote: Hi all, I'm trying to work out why my 8.1 system is slower than my 7.4 system for importing data. The import is a lot of "insert into" commands -

Re: [PERFORM] import performance

2006-03-13 Thread Frank Wiles
On Tue, 14 Mar 2006 12:24:22 +1100 Chris <[EMAIL PROTECTED]> wrote: > Gavin Sherry wrote: > > On Tue, 14 Mar 2006, Chris wrote: > > > > > >>Hi all, > >> > >>I'm trying to work out why my 8.1 system is slower than my 7.4 > >>system for importing data. > >> > >>The import is a lot of "insert into"

Re: [PERFORM] import performance

2006-03-13 Thread Chris
Gavin Sherry wrote: On Tue, 14 Mar 2006, Chris wrote: Hi all, I'm trying to work out why my 8.1 system is slower than my 7.4 system for importing data. The import is a lot of "insert into" commands - it's a converted database from another system so I can't change it to copy commands. ne

Re: [PERFORM] import performance

2006-03-13 Thread Gavin Sherry
On Mon, 13 Mar 2006, Dave Dutcher wrote: > [Snip] > > > > > > shared_buffers = 256 > > > > Make this higher too. If this is a dedicated machine with 512 MB of > ram, > > set it to something like 125000. > > > > You may need to adjust shared memory settings for your operating > system. > > See the

Re: [PERFORM] import performance

2006-03-13 Thread Dave Dutcher
[Snip] > > > > shared_buffers = 256 > > Make this higher too. If this is a dedicated machine with 512 MB of ram, > set it to something like 125000. > > You may need to adjust shared memory settings for your operating system. > See the manual for details. > Whoa. Maybe I'm wrong, but isn't each

Re: [PERFORM] PG Statistics

2006-03-13 Thread Steve Poe
Tim, When I have done ODBC load tests with stats_block_level enabled on (20 mins. per test), I've seen about 3-4% performance hit. Your mileage may vary. Steve Poe On Mon, 2006-03-13 at 18:49 -0500, mcelroy, tim wrote: > Good evening, > > Does anyone know how much of a performance hit turning >

Re: [PERFORM] import performance

2006-03-13 Thread Gavin Sherry
On Tue, 14 Mar 2006, Chris wrote: > Hi all, > > I'm trying to work out why my 8.1 system is slower than my 7.4 system > for importing data. > > The import is a lot of "insert into" commands - it's a converted > database from another system so I can't change it to copy commands. > > > My uncommente

[PERFORM] import performance

2006-03-13 Thread Chris
Hi all, I'm trying to work out why my 8.1 system is slower than my 7.4 system for importing data. The import is a lot of "insert into" commands - it's a converted database from another system so I can't change it to copy commands. My uncommented config options: autovacuum = off bgwriter

Re: [PERFORM] PG Statistics

2006-03-13 Thread Michael Fuhr
On Mon, Mar 13, 2006 at 06:49:39PM -0500, mcelroy, tim wrote: > Does anyone know how much of a performance hit turning stats_block_level and > stats_row_level on will incur? Do both need to be on to gather cache > related statistics? I know the annotated_conf_80 document states to only > turn the

[PERFORM] PG Statistics

2006-03-13 Thread mcelroy, tim
Title: PG Statistics Good evening, Does anyone know how much of a performance hit turning stats_block_level and  stats_row_level on will incur?  Do both need to be on to gather cache related statistics?  I know the annotated_conf_80 document states to only turn them on for debug but if they'

Re: [PERFORM] No vacuum for insert-only database?

2006-03-13 Thread Bruno Wolff III
On Mon, Mar 13, 2006 at 09:19:32 -0800, "Craig A. James" <[EMAIL PROTECTED]> wrote: > Alvaro Herrera wrote: > >>If I only insert data into a table, never update or delete, then I should > >>never have to vacuum it. Is that correct? > > > >You still need to vacuum eventually, to avoid transactio

Re: [PERFORM] firebird X postgresql 8.1.2 windows, performance

2006-03-13 Thread Scott Marlowe
On Mon, 2006-03-13 at 12:11, andremachado wrote: > Hello, > Attached is the text file containing the last rounds of configurations. > This time, used "show all" just before issuing each relevant "explain analyze" > to ensure available information. > Note that the last runs are being executed concur

Re: [PERFORM] No vacuum for insert-only database?

2006-03-13 Thread Josh Berkus
Craig, > Transaction ID wraparound will be a problem at a bit less than 2 billion > transactions. So if you vacuum the table every 1 billion transactions > you are safe. I suggest you read the "routine maintenance" section in > the docs; the wraparound issue is explained there. For reference, w

Re: [PERFORM] firebird X postgresql 8.1.2 windows, performance comparison

2006-03-13 Thread Josh Berkus
Andre, > http://candle.pha.pa.us/main/writings/pgsql/hw_performance/ > brought some light over the subject. For few users, could be a viable > alternative. That article is very old. Read this instead: http://www.powerpostgresql.com/PerfList > select count(distinct NF.ID_NF ) as contagem, DE.AM_

[PERFORM] firebird X postgresql 8.1.2 windows, performance comparison

2006-03-13 Thread andremachado
Hello, Attached is the text file containing the last rounds of configurations. This time, used "show all" just before issuing each relevant "explain analyze" to ensure available information. Note that the last runs are being executed concurrently with other problematic query that is consuming 100%

Re: [PERFORM] No vacuum for insert-only database?

2006-03-13 Thread Alvaro Herrera
Craig A. James wrote: > Alvaro Herrera wrote: > >>If I only insert data into a table, never update or delete, then I should > >>never have to vacuum it. Is that correct? > > > >You still need to vacuum eventually, to avoid transaction Id wraparound > >issues. But not as often. > > Thanks. Any

Re: [PERFORM] No vacuum for insert-only database?

2006-03-13 Thread Craig A. James
Alvaro Herrera wrote: If I only insert data into a table, never update or delete, then I should never have to vacuum it. Is that correct? You still need to vacuum eventually, to avoid transaction Id wraparound issues. But not as often. Thanks. Any suggestions for what "not as often" means?

Re: [PERFORM] No vacuum for insert-only database?

2006-03-13 Thread Alvaro Herrera
Craig A. James wrote: > If I only insert data into a table, never update or delete, then I should > never have to vacuum it. Is that correct? You still need to vacuum eventually, to avoid transaction Id wraparound issues. But not as often. -- Alvaro Herrerahttp

[PERFORM] No vacuum for insert-only database?

2006-03-13 Thread Craig A. James
If I only insert data into a table, never update or delete, then I should never have to vacuum it. Is that correct? Thanks, Craig ---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster

[PERFORM] unsubscribe

2006-03-13 Thread Nick Howden
unsubscribe ---(end of broadcast)--- TIP 6: explain analyze is your friend

Re: [PERFORM] Query time

2006-03-13 Thread PFC
Information, Ruben - we can't do anything without information. What usefull information could I provide? Offending queries, EXPLAIN ANALYZE, tables description, condiguration parameters, hardware, intended use... ---(end of broadcast)--- T

Re: [PERFORM] Query time

2006-03-13 Thread Ruben Rubio Rey
Richard Huxton wrote: Ruben Rubio Rey wrote: Hi, I think im specting problems with a 7.4.8 postgres database. Sometimes some big query takes between 5 to 15 seconds. It happens sometimes all the day it does not depend if database is busy. I have measured that sentence in 15 - 70 ms in nor