Re: [PERFORM] Memory and/or cache issues?

2006-05-09 Thread mcelroy, tim
Title: RE: [PERFORM] Memory and/or cache issues? Ok, thank you all again for your help in this matter.  Yes, Michael I (the original poster) did say or imply I guess is a better word for it that a combo of training and hands-on is the best way for one to learn PostgreSQL or just about

Re: [PERFORM] Memory and/or cache issues?

2006-05-08 Thread Michael Stone
On Mon, May 08, 2006 at 03:38:23PM -0400, Vivek Khera wrote: On May 8, 2006, at 1:30 PM, Jim C. Nasby wrote: Yeah, I prefer my surgeons to work this way too. training is for the birds. I think you read too quickly past the part where Tim said he'd taking a week-long training class. s/tra

Re: [PERFORM] Memory and/or cache issues?

2006-05-08 Thread Vivek Khera
On May 8, 2006, at 1:30 PM, Jim C. Nasby wrote: Yeah, I prefer my surgeons to work this way too. training is for the birds. I think you read too quickly past the part where Tim said he'd taking a week-long training class. s/training/apprenticeship/g; ---(end of

Re: [PERFORM] Memory and/or cache issues?

2006-05-08 Thread Jim C. Nasby
On Mon, May 08, 2006 at 11:06:42AM -0400, Vivek Khera wrote: > > On May 6, 2006, at 10:53 AM, mcelroy, tim wrote: > > >development side than DBA by the way), but there is no better way > >to learn > >and understand better than actual day-to-day working experience. > > Yeah, I prefer my surgeon

Re: [PERFORM] Memory and/or cache issues?

2006-05-08 Thread Vivek Khera
On May 6, 2006, at 10:53 AM, mcelroy, tim wrote: development side than DBA by the way), but there is no better way to learn and understand better than actual day-to-day working experience. Yeah, I prefer my surgeons to work this way too. training is for the birds. smime.p7s Descripti

Re: [PERFORM] Memory and/or cache issues?

2006-05-06 Thread mcelroy, tim
Title: RE: [PERFORM] Memory and/or cache issues? Thank you again to all who have offered advice, suggestions, tips and offers of support/training.  From the gist of some of the latter posts I must come off as a rank rookie, lol.  Deservedly so as I've only been working with postgres

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread David Boreham
2006-05-04 18:04:58 EDT USER=postgres DB=FIX1 [12427] PORT = [local] ERROR:  invalid memory alloc request size 18446744073709551613 Perhaps I'm off beam here, but any time I've seen an app try to allocate a gazillion bytes, it's due to some code incorrectly calculating the size of something

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread Jim C. Nasby
On Fri, May 05, 2006 at 10:27:10AM -0400, mcelroy, tim wrote: > Sorry, been up all night and maybe provided too much information or not the Do you have any budget for support or training, either from the company selling you the app or a company that provides PostgreSQL support? I suspect some mone

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread Jim C. Nasby
On Fri, May 05, 2006 at 01:09:53PM -0400, Michael Stone wrote: > On Fri, May 05, 2006 at 06:33:33PM +0200, G?briel ?kos wrote: > >if postgres tries to allocate more memory (because of settings enable > >it) than the kernel itself is configured for, then you will see similar > >error messages. >

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread Jim C. Nasby
On Fri, May 05, 2006 at 10:40:33AM -0400, Michael Stone wrote: > You've got 1.4G in use, 5.3G of disk cache, 165M of buffers and 667M > free. That doesn't seem unreasonable. If an application needs more Actually, it indiciates a bunch of memory not being used, but IIRC Tim's database is approxim

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread Michael Stone
On Fri, May 05, 2006 at 06:33:33PM +0200, Gábriel Ákos wrote: if postgres tries to allocate more memory (because of settings enable it) than the kernel itself is configured for, then you will see similar error messages. If you're talking about the shared memory limits, postgres will bomb out

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread Gábriel Ákos
Michael Stone wrote: On Fri, May 05, 2006 at 10:45:21AM -0400, mcelroy, tim wrote: Thanks Michael. Are you saying the 'used' column is the irrelevant number? Is the number that is more pertinent is 1416880? Is that the actual amount of memory in use? Yes. I agree about the allocation of

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread Craig A. James
mcelroy, tim wrote: Sorry, been up all night and maybe provided too much information or not the right information and only confused folks, tired I guess. When I say 'in use' I am referring to the 'used' column. Thanks all who have responded to this inquiry, I appreciate it. Here's free from

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread Michael Stone
On Fri, May 05, 2006 at 10:45:21AM -0400, mcelroy, tim wrote: Thanks Michael. Are you saying the 'used' column is the irrelevant number? Is the number that is more pertinent is 1416880? Is that the actual amount of memory in use? Yes. I agree about the allocation of a bogus amount of memo

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread mcelroy, tim
Title: RE: [PERFORM] Memory and/or cache issues? Thanks for a great explanation Craig, makes more sense now. Tim  -Original Message- From:   Craig A. James [mailto:[EMAIL PROTECTED]] Sent:   Friday, May 05, 2006 10:51 AM To: mcelroy, tim Cc: pgsql-performance

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread mcelroy, tim
Title: RE: [PERFORM] Memory and/or cache issues? Thanks Michael.  Are you saying the 'used' column is the irrelevant number?  Is the number that is more pertinent is 1416880?  Is that the actual amount of memory in use?  I agree about the allocation of a bogus amount of memory but

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread mcelroy, tim
  -Original Message- From: Dave Dutcher [mailto:[EMAIL PROTECTED] Sent: Friday, May 05, 2006 10:32 AM To: 'mcelroy, tim' Cc: pgsql-performance@postgresql.org Subject: RE: [PERFORM] Memory and/or cache issues?   For a standard config most of the memory used by Postgres is

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread Michael Stone
On Fri, May 05, 2006 at 10:27:10AM -0400, mcelroy, tim wrote: Sorry, been up all night and maybe provided too much information or not the right information and only confused folks, tired I guess. When I say 'in use' I am referring to the 'used' column. Which is a mostly irrelevant number. H

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread mcelroy, tim
Title: RE: [PERFORM] Memory and/or cache issues? Sorry, been up all night and maybe provided too much information or not the right information and only confused folks, tired I guess.  When I say 'in use' I am referring to the 'used' column.  Thanks all who have responde

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread Dave Dutcher
ginal Message-From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of mcelroy, timSent: Friday, May 05, 2006 8:58 AMTo: 'Tom Lane'Cc: pgsql-performance@postgresql.orgSubject: Re: [PERFORM] Memory and/or cache issues? Are you saying the kernel's disc

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread Michael Stone
On Fri, May 05, 2006 at 09:57:58AM -0400, mcelroy, tim wrote: Are you saying the kernel's disc cache may be getting whacked? No, I understand that PG should use as much memory as it can and the system as well. The main problem here is that with almost all the 8GB of RAM 'in use' when I try to d

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread mcelroy, tim
Title: RE: [PERFORM] Memory and/or cache issues? Are you saying the kernel's disc cache may be getting whacked?  No, I understand that PG should use as much memory as it can and the system as well.  The main problem here is that with almost all the 8GB of RAM 'in use' whe

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread Tom Lane
"mcelroy, tim" <[EMAIL PROTECTED]> writes: > I see this on all the postgres installations, no matter what I > set the postgresql.conf settings to regarding memory allocation, once > postgres starts up 95% of the memory on the box is used. Is there a way > within Linux to 'see' what or who is actua

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread mcelroy, tim
Title: RE: [PERFORM] Memory and/or cache issues? Thanks Tom.  I thought the same thing and waded through the archives trying various fixes such as vacuum, vacuum full (both with analyze), reindex and still the same issue.  However, once the box was rebooted the backup went smooth and the

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread Alvaro Herrera
Tom Lane wrote: > "mcelroy, tim" <[EMAIL PROTECTED]> writes: > > pg_dump: ERROR: invalid memory alloc request size 18446744073709551613 > > That looks more like a corrupt-data problem than anything directly to do > with having or not having enough memory. The bit pattern is certainly suspicious,

Re: [PERFORM] Memory and/or cache issues?

2006-05-05 Thread Tom Lane
"mcelroy, tim" <[EMAIL PROTECTED]> writes: > pg_dump: ERROR: invalid memory alloc request size 18446744073709551613 That looks more like a corrupt-data problem than anything directly to do with having or not having enough memory. regards, tom lane ---

[PERFORM] Memory and/or cache issues?

2006-05-05 Thread mcelroy, tim
Title: Memory and/or cache issues? Good morning, First the stats:  I'm using PostgreSQL 8.0.1 (I know I should upgrade, cannot due to vendor app. restrictions...), RedHat 9 on a SUN V40Z with 8GB of memory.  I'm using the "out-of-the-box" settings in postgresql.conf.  I've been testing vario