Re: [PERFORM] Curious about dead rows.

2007-11-13 Thread Merlin Moncure
On Nov 13, 2007 9:26 PM, Jean-David Beyer <[EMAIL PROTECTED]> wrote: > Merlin Moncure wrote: > > what does pg_stat_all_tables say (assuming row level stats are on)? > It says stuff like this: > > relname | seq_scan | seq_tup_read | idx_scan | idx_tup_fetch | n_tup_ins | > n_tup_upd | n_tup_del >

Re: [PERFORM] dell versus hp

2007-11-13 Thread Merlin Moncure
On Nov 8, 2007 1:22 PM, Scott Marlowe <[EMAIL PROTECTED]> wrote: > Mine too. I would suggest though, that by the time you get to 14 > disks, you switch from RAID-5 to RAID-6 so you have double redundancy. > Performance of a degraded array is better in RAID6 than RAID5, and > you can run your rebu

Re: [PERFORM] Curious about dead rows.

2007-11-13 Thread Jean-David Beyer
Merlin Moncure wrote: > On Nov 10, 2007 1:38 PM, Jean-David Beyer <[EMAIL PROTECTED]> wrote: >> Tom Lane wrote: >>> Jean-David Beyer <[EMAIL PROTECTED]> writes: I am doing lots of INSERTs on a table that starts out empty (I did a TRUNCATE on it). I am not, AFAIK, doing DELETEs or UPDATEs.

Re: [PERFORM] Curious about dead rows.

2007-11-13 Thread Merlin Moncure
On Nov 10, 2007 1:38 PM, Jean-David Beyer <[EMAIL PROTECTED]> wrote: > Tom Lane wrote: > > Jean-David Beyer <[EMAIL PROTECTED]> writes: > >> I am doing lots of INSERTs on a table that starts out empty (I did a > >> TRUNCATE on it). I am not, AFAIK, doing DELETEs or UPDATEs. Autovacuum is > >> on. I

Re: [PERFORM] Curious about dead rows.

2007-11-13 Thread Ansgar -59cobalt- Wiechers
On 2007-11-13 Trevor Talbot wrote: > On 11/13/07, Alvaro Herrera <[EMAIL PROTECTED]> wrote: >> Jean-David Beyer wrote: >>> Sorry. Most of the lists I send to have ReplyTo set, but a few do >>> not. And then I forget. >> >> If you use "reply to all", it works wonderfully in both cases. > > Then it

Re: [PERFORM] Curious about dead rows.

2007-11-13 Thread Alvaro Herrera
Trevor Talbot escribió: > On 11/13/07, Alvaro Herrera <[EMAIL PROTECTED]> wrote: > > Jean-David Beyer wrote: > > > Andrew Sullivan wrote: > > > > I'm not a private support organisation; please send your replies to the > > > > list, not me. > > > > > > Sorry. Most of the lists I send to have ReplyTo

Re: [PERFORM] Curious about dead rows.

2007-11-13 Thread Trevor Talbot
On 11/13/07, Alvaro Herrera <[EMAIL PROTECTED]> wrote: > Jean-David Beyer wrote: > > Andrew Sullivan wrote: > > > I'm not a private support organisation; please send your replies to the > > > list, not me. > > > > Sorry. Most of the lists I send to have ReplyTo set, but a few do not. > > And then I

Re: [PERFORM] Curious about dead rows.

2007-11-13 Thread Alvaro Herrera
Jean-David Beyer wrote: > Andrew Sullivan wrote: > > I'm not a private support organisation; please send your replies to the > > list, not me. > > Sorry. Most of the lists I send to have ReplyTo set, but a few do not. > And then I forget. If you use "reply to all", it works wonderfully in both ca

Re: [PERFORM] Curious about dead rows.

2007-11-13 Thread Jean-David Beyer
Andrew Sullivan wrote: > I'm not a private support organisation; please send your replies to the > list, not me. Sorry. Most of the lists I send to have ReplyTo set, but a few do not. And then I forget. > > On Tue, Nov 13, 2007 at 04:57:23PM -0500, Jean-David Beyer wrote: >> What is it controlled

Re: [PERFORM] Curious about dead rows.

2007-11-13 Thread Andrew Sullivan
I'm not a private support organisation; please send your replies to the list, not me. On Tue, Nov 13, 2007 at 04:57:23PM -0500, Jean-David Beyer wrote: > What is it controlled by? The following are the non-default values in > postgresql.conf: > > redirect_stderr = on > log_directory = '/srv/dbms/

Re: [PERFORM] Curious about dead rows.

2007-11-13 Thread Andrew Sullivan
On Tue, Nov 13, 2007 at 02:50:59PM -0500, Jean-David Beyer wrote: > > How about ERROR? > > $ grep -i error Tue.log > $ Well, without actually logging into the machine and looking at the application, I confess I am stumped. Oh, wait. You do have the log level high enough that you should see erro

Re: [PERFORM] dell versus hp

2007-11-13 Thread Jeff Frost
On Tue, 13 Nov 2007, Alan Hodgson wrote: OK, I'll bite. Name one RAID controller that gives better write performance in RAID 6 than it does in RAID 10, and post the benchmarks. I'll grant a theoretical reliability edge to RAID 6 (although actual implementations are a lot more iffy), but not per

Re: [PERFORM] Curious about dead rows.

2007-11-13 Thread Jean-David Beyer
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Andrew Sullivan wrote: > Please don't drop the list, as someone else may see something. > > On Tue, Nov 13, 2007 at 10:06:13AM -0500, Jean-David Beyer wrote: >> OK. I turned logging from "none" to "mod" and got a gawdawful lot of stuff. > > Yes. > >

Re: [PERFORM] dell versus hp

2007-11-13 Thread Alan Hodgson
On November 9, 2007, Vivek Khera <[EMAIL PROTECTED]> wrote: > On Nov 8, 2007, at 3:56 PM, Alan Hodgson wrote: > > You can't touch RAID 10 for performance or reliability. The only > > reason to > > use RAID 5 or RAID 6 is to get more capacity out of the same > > drives. > > Maybe you can't, but I ca

Re: [PERFORM] Curious about dead rows.

2007-11-13 Thread Andrew Sullivan
Please don't drop the list, as someone else may see something. On Tue, Nov 13, 2007 at 10:06:13AM -0500, Jean-David Beyer wrote: > OK. I turned logging from "none" to "mod" and got a gawdawful lot of stuff. Yes. > Then I ran it and got all the inserts. Using > grep -i delete file > grep -i updat

Re: [PERFORM] ERROR: "invalid memory alloc request size" or "unexpected end of data" on large table

2007-11-13 Thread Stephane Bailliez
Tom Lane wrote: This sounds like corrupt data --- specifically, 1664639562 showing up where a variable-width field's length word ought to be. It may or may not be relevant that the ASCII equivalent of that bit pattern is Jb8c ... do you work with data that contains such substrings? Not spec

[PERFORM] random_page_cost etc. per tablespace?

2007-11-13 Thread Jens-Wolfhard Schicke
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi, how hard would it be to give users the ability to configure different random_page and seq_page costs per tablespace? Obviously this does not match with random_page_cost being a GUC variable but nonetheless I think it'd make a nice feature. I jus

Re: [PERFORM] Need to run CLUSTER to keep performance

2007-11-13 Thread Rafael Martinez
Rafael Martinez wrote: > Heikki Linnakangas wrote: > >> In 8.1, CLUSTER will remove those tuples anyway, but it's actually not >> correct. > > With other words, we have to be very carefull to not run CLUSTER on > a table been modified inside a transaction if we do not want to lose > data? .

Re: [PERFORM] Need to run CLUSTER to keep performance

2007-11-13 Thread Rafael Martinez
Heikki Linnakangas wrote: > Rafael Martinez wrote: >> DETAIL: 83623 dead row versions cannot be removed yet. > > Looks like you have a long-running transaction in the background, so > VACUUM can't remove all dead tuples. I didn't see that in the vacuum > verbose outputs you sent earlier. Is there