Re: [PERFORM]Is it possible to start two instances of postgresql?

2006-06-14 Thread kah_hang_ang
so what is the best way to implement two databases in one machine? implement with two postgresql instances with separate directory or implement under one instance? if I implement two database in one instance, if one of the database crash will it affect the other?

Re: [PERFORM]Is it possible to start two instances of postgresql?

2006-06-14 Thread A. Kretschmer
am 15.06.2006, um 13:58:20 +0800 mailte [EMAIL PROTECTED] folgendes: > > > > > Hi, > > Is it possible to start two instances of postgresql with different port and > directory which run simultaneously? Yes, this is possible, and this is the Debian way for updates. > If can then will this ca

Re: [PERFORM] Postgres fsync off (not needed) with NetApp

2006-06-14 Thread Dan Gorman
Currently I have jumbo frames enabled on the NA and the switches and also are using a the 32K R/W NFS options. Everything is gigE. Regards, Dan Gorman On Jun 14, 2006, at 10:51 PM, Joe Conway wrote: Dan Gorman wrote: That makes sense. Speaking of NetApp, we're using the 3050C with 4 FC s

[PERFORM]Is it possible to start two instances of postgresql?

2006-06-14 Thread kah_hang_ang
Hi, Is it possible to start two instances of postgresql with different port and directory which run simultaneously? If can then will this cause any problem or performance drop down? Thanks. ---(end of broadcast)--- TIP 1: if posting/reading th

Re: [PERFORM] Postgres fsync off (not needed) with NetApp

2006-06-14 Thread Joe Conway
Dan Gorman wrote: That makes sense. Speaking of NetApp, we're using the 3050C with 4 FC shelfs. Any generic advice other than the NetApp (their NFS oracle tuning options) that might be useful? (e.g. turning off snapshots) I'm not sure if this is in the tuning advice you already have, but we

Re: [PERFORM] Postgres fsync off (not needed) with NetApp

2006-06-14 Thread Jonah H. Harris
On 6/15/06, Jonah H. Harris <[EMAIL PROTECTED]> wrote: On 6/15/06, Dan Gorman <[EMAIL PROTECTED]> wrote: > shelfs. Any generic advice other than the NetApp (their NFS oracle > tuning options) that might be useful? (e.g. turning off snapshots) I was using PostgreSQL on a 980c, but feature-wise th

Re: [PERFORM] Postgres fsync off (not needed) with NetApp

2006-06-14 Thread Jonah H. Harris
On 6/15/06, Dan Gorman <[EMAIL PROTECTED]> wrote: shelfs. Any generic advice other than the NetApp (their NFS oracle tuning options) that might be useful? (e.g. turning off snapshots) I was using PostgreSQL on a 980c, but feature-wise they're probably pretty close. What type of application are

Re: [PERFORM] Postgres fsync off (not needed) with NetApp

2006-06-14 Thread Dan Gorman
That makes sense. Speaking of NetApp, we're using the 3050C with 4 FC shelfs. Any generic advice other than the NetApp (their NFS oracle tuning options) that might be useful? (e.g. turning off snapshots) Regards, Dan Gorman On Jun 14, 2006, at 10:14 PM, Jonah H. Harris wrote: On 14 Jun 200

Re: [PERFORM] Postgres fsync off (not needed) with NetApp

2006-06-14 Thread Jonah H. Harris
On 14 Jun 2006 23:33:53 -0400, Greg Stark <[EMAIL PROTECTED]> wrote: In fact the benefit of the NVRAM is precisely that it makes sure you *don't* have any reason to turn fsync off. It should make the fsync essentially free. Having run PostgreSQL on a NetApp with input from NetApp, this is corre

Re: [PERFORM] Precomputed constants?

2006-06-14 Thread Zoltan Boszormenyi
Jim C. Nasby írta: On Wed, Jun 14, 2006 at 01:30:10PM +0200, B?sz?rm?nyi Zolt?n wrote: Replacing random() with a true constant gives me index scan even if it's hidden inside other function calls. E.g.: The database has no choice but to compute random() for every row; it's marked VOLATI

Re: [PERFORM] Postgres fsync off (not needed) with NetApp

2006-06-14 Thread Greg Stark
Mark Lewis <[EMAIL PROTECTED]> writes: > On Wed, 2006-06-14 at 14:48 -0700, Dan Gorman wrote: > > > > However, if I have it attached to a NetApp that ensures data writes > > to via the NVRAM can I safely turn fsync off to gain additional > > performance? > > No. You need fsync on in order to

Re: [PERFORM] Confirmation of bad query plan generated by 7.4

2006-06-14 Thread Tom Lane
Jim Nasby <[EMAIL PROTECTED]> writes: > On Jun 13, 2006, at 8:50 PM, Tom Lane wrote: >> Hmm ... worksforme. Could you provide a complete test case? > decibel=# create table date_test(d date not null, i int not null); > [etc] Not sure what you are driving at. The estimates are clearly not defaul

Re: [PERFORM] Confirmation of bad query plan generated by 7.4

2006-06-14 Thread Jim Nasby
On Jun 13, 2006, at 8:50 PM, Tom Lane wrote: "Jim C. Nasby" <[EMAIL PROTECTED]> writes: On Tue, Jun 13, 2006 at 06:04:42PM -0400, Tom Lane wrote: It'd depend on the context, possibly, but it's easy to show that the current planner does fold "now() - interval_constant" when making estimates. S

Re: [PERFORM] Effects of cascading references in foreign keys

2006-06-14 Thread Bruce Momjian
Would someone please find the answer to Tom's last question? --- Tom Lane wrote: > I wrote: > > Looking at this, I wonder if there isn't a bug or at least an > > inefficiency in 8.1. The KeysEqual short circuit tests are st

Re: [PERFORM] Postgres fsync off (not needed) with NetApp

2006-06-14 Thread Mark Lewis
No. You need fsync on in order to force the data to get TO the NetApp at the right time. With fsync off, the data gets cached in the operating system. -- Mark Lewis On Wed, 2006-06-14 at 14:48 -0700, Dan Gorman wrote: > All, >So I thought I'd pose this question: > > If I have a pg database

Re: [PERFORM] Postgres fsync off (not needed) with NetApp

2006-06-14 Thread D'Arcy J.M. Cain
On Wed, 14 Jun 2006 14:48:04 -0700 Dan Gorman <[EMAIL PROTECTED]> wrote: > If I have a pg database attached to a powervault (PV) with just an > off-the-shelf SCSI card I generally want fsync on to prevent data > corruption in case the PV should loose power. > However, if I have it attached to a

[PERFORM] Postgres fsync off (not needed) with NetApp

2006-06-14 Thread Dan Gorman
All, So I thought I'd pose this question: If I have a pg database attached to a powervault (PV) with just an off-the-shelf SCSI card I generally want fsync on to prevent data corruption in case the PV should loose power. However, if I have it attached to a NetApp that ensures data writes

Re: [PERFORM] Solaris shared_buffers anomaly?

2006-06-14 Thread Josh Berkus
Folks, First off, you'll be glad to know that I've persuaded two of the Sun performance engineers to join this list soon. So you should be able to get more difinitive answers to these questions. Second, 7.4 still did linear scanning of shared_buffers as part of LRU and for other activities.

Re: [PERFORM] Performance of pg_dump on PGSQL 8.0

2006-06-14 Thread Jim C. Nasby
On Wed, Jun 14, 2006 at 05:18:14PM -0400, John Vincent wrote: > On 6/14/06, Jim C. Nasby <[EMAIL PROTECTED]> wrote: > > > >On Wed, Jun 14, 2006 at 02:11:19PM -0400, John Vincent wrote: > >> Out of curiosity, does anyone have any idea what the ratio of actual > >> datasize to backup size is if I use

Re: [PERFORM] Performance of pg_dump on PGSQL 8.0

2006-06-14 Thread John Vincent
On 6/14/06, Jim C. Nasby <[EMAIL PROTECTED]> wrote: On Wed, Jun 14, 2006 at 02:11:19PM -0400, John Vincent wrote:> Out of curiosity, does anyone have any idea what the ratio of actual> datasize to backup size is if I use the custom format with -Z 0 compression > or the tar format?-Z 0 should mean n

Re: [PERFORM] Performance of pg_dump on PGSQL 8.0

2006-06-14 Thread John Vincent
time gzip -6 claDW_PGSQL.test.bakreal    3m4.360suser    1m22.090ssys 0m6.050sWhich is still less time than it would take to do a compressed pg_dump. On 6/14/06, Scott Marlowe <[EMAIL PROTECTED]> wrote: How long does gzip take to compress this backup?On Wed, 2006-06-14 at 15:59, John Vincent w

Re: [PERFORM] Performance of pg_dump on PGSQL 8.0

2006-06-14 Thread Jim C. Nasby
On Wed, Jun 14, 2006 at 02:11:19PM -0400, John Vincent wrote: > Out of curiosity, does anyone have any idea what the ratio of actual > datasize to backup size is if I use the custom format with -Z 0 compression > or the tar format? -Z 0 should mean no compression. Something you can try is piping

Re: [PERFORM] Performance of pg_dump on PGSQL 8.0

2006-06-14 Thread Scott Marlowe
How long does gzip take to compress this backup? On Wed, 2006-06-14 at 15:59, John Vincent wrote: > Okay I did another test dumping using the uncompressed backup on the > system unloaded and the time dropped down to 8m for the backup. > There's still the size issue to contend with but as I said, I

Re: [PERFORM] Performance of pg_dump on PGSQL 8.0

2006-06-14 Thread John Vincent
On 6/14/06, Scott Marlowe <[EMAIL PROTECTED]> wrote: Description of "Queries gone wild" redacted.  hehe.Yeah, I've seen those kinds of queries before too.  you might be able tolimit your exposure by using alter user:alter user userwhoneedslotsofworkmem set work_mem=100; Is this applicable on  8

Re: [PERFORM] Performance of pg_dump on PGSQL 8.0

2006-06-14 Thread Scott Marlowe
On Wed, 2006-06-14 at 12:04, John Vincent wrote: > > On 6/14/06, Scott Marlowe <[EMAIL PROTECTED]> wrote: > On Wed, 2006-06-14 at 09:47, John E. Vincent wrote: > > -- this is the third time I've tried sending this and I > never saw it get > > through to the list. So

Re: [PERFORM] Postgres consuming way too much memory???

2006-06-14 Thread Tom Lane
"jody brownell" <[EMAIL PROTECTED]> writes: > 27116 postgres 15 0 1515m 901m 91m S 0.0 22.9 18:33.96 postgres: qradar > qradar :::x.x.x.x(51149) idle This looks like a memory leak, but you haven't provided enough info to let someone else reproduce it. Can you log what your application

Re: [PERFORM] Which processor runs better for Postgresql?

2006-06-14 Thread Dave Page
> -Original Message- > From: Scott Marlowe [mailto:[EMAIL PROTECTED] > Sent: 14 June 2006 20:52 > To: Dave Page > Cc: Joshua D. Drake; [EMAIL PROTECTED]; > pgsql-performance@postgresql.org > Subject: RE: [PERFORM] Which processor runs better for Postgresql? > > > Yeah, We've got a mi

Re: [PERFORM] Which processor runs better for Postgresql?

2006-06-14 Thread Scott Marlowe
On Wed, 2006-06-14 at 13:43, Dave Page wrote: > > > Just thought I'd point you to Dell's forums. > > > http://forums.us.dell.com/supportforums/board?board.id=pes_linux&page=1 > > wherein you'll find plenty of folks who have problems with >

[PERFORM] Postgres consuming way too much memory???

2006-06-14 Thread jody brownell
I have a box with an app and postgresql on it. Hardware includes with 2 2.8 Ghz xeons 512KB cache, 4 GB of memory, 6 scsi disk in a software raid 5 on a trustix 2.2 with a 2.6.15.3 kernel. The data and indexes are on the raid array while the tx log is on disk with the OS. All is well. The one

Re: [PERFORM] OT - select + must have from - sql standard syntax?

2006-06-14 Thread Antoine
You can get free "draft" versions that are close-enough-to-final to be perfectly usable. See our developers' FAQ for some links. I like the drafts partly because they're plain ASCII, and so far easier to search than PDFs ... Great to know - thanks! Cheers Antoine -- This is where I should put

Re: [PERFORM] Which processor runs better for Postgresql?

2006-06-14 Thread Dave Page
Title: RE: [PERFORM] Which processor runs better for Postgresql?   From: Scott Marlowe [mailto:[EMAIL PROTECTED] Sent: 14 June 2006 18:04To: Dave PageCc: Joshua D. Drake; [EMAIL PROTECTED]; pgsql-performance@postgresql.orgSubject: RE: [PERFORM] Which processor runs better fo

Re: [PERFORM] Performance of pg_dump on PGSQL 8.0

2006-06-14 Thread John Vincent
Out of curiosity, does anyone have any idea what the ratio of actual datasize to backup size is if I use the custom format with -Z 0 compression or the tar format? Thanks.On 6/14/06, Scott Marlowe <[EMAIL PROTECTED]> wrote: On Wed, 2006-06-14 at 09:47, John E. Vincent wrote:> -- this is the third

Re: [PERFORM] Performance of pg_dump on PGSQL 8.0

2006-06-14 Thread A.M.
On Wed, June 14, 2006 1:04 pm, John Vincent wrote: > I know it is but that's what we need for some of our queries. Our ETL > tool (informatica) and BI tool (actuate) won't let us set those things as > part of our jobs. We need it for those purposes. We have some really nasty > queries that will be

Re: [PERFORM] Performance of pg_dump on PGSQL 8.0

2006-06-14 Thread John Vincent
On 6/14/06, Scott Marlowe <[EMAIL PROTECTED]> wrote: On Wed, 2006-06-14 at 09:47, John E. Vincent wrote:> -- this is the third time I've tried sending this and I never saw it get> through to the list. Sorry if multiple copies show up.>> Hi all, BUNCHES SNIPPED> work_mem = 1048576 ( I know this is h

Re: [PERFORM] Which processor runs better for Postgresql?

2006-06-14 Thread Scott Marlowe
On Tue, 2006-06-13 at 15:11, Dave Page wrote: > > > -Original Message- > And how old are the 2600's now? > > Anyhoo, I'm not saying the current machines are excellent performers or > anything, but there are good business reasons to run them if you don't > need to squeeze out every last

Re: [PERFORM] Solaris shared_buffers anomaly?

2006-06-14 Thread Mischa Sandberg
Tom Lane wrote: Mischa Sandberg <[EMAIL PROTECTED]> writes: Tom Lane wrote: Does Solaris have any call that allows locking a shmem segment in RAM? Yes, mlock(). But want to understand what's going on before patching. Sure, but testing it with mlock() might help you understand what's going

Re: [PERFORM] Performance of pg_dump on PGSQL 8.0

2006-06-14 Thread Scott Marlowe
On Wed, 2006-06-14 at 09:47, John E. Vincent wrote: > -- this is the third time I've tried sending this and I never saw it get > through to the list. Sorry if multiple copies show up. > > Hi all, BUNCHES SNIPPED > work_mem = 1048576 ( I know this is high but you should see some of our > sorts

Re: [PERFORM] Performance of pg_dump on PGSQL 8.0

2006-06-14 Thread Tom Lane
"John E. Vincent" <[EMAIL PROTECTED]> writes: > I've watched the backup process and I/O is not a problem. Memory isn't a > problem either. It seems that we're CPU bound but NOT in I/O wait. Is it the pg_dump process, or the connected backend, that's chewing the bulk of the CPU time? (This should

Re: [PERFORM] Precomputed constants?

2006-06-14 Thread Jim C. Nasby
On Wed, Jun 14, 2006 at 01:30:10PM +0200, B?sz?rm?nyi Zolt?n wrote: > Replacing random() with a true constant gives me index scan > even if it's hidden inside other function calls. E.g.: The database has no choice but to compute random() for every row; it's marked VOLATILE. -- Jim C. Nasby, Sr. E

Re: [PERFORM] how to partition disks

2006-06-14 Thread Jim C. Nasby
On Wed, Jun 14, 2006 at 04:32:23PM +0200, Sven Geisler wrote: > Hi Richard, > > Richard Broersma Jr schrieb: > >>This depends on your application. Do you have a lot of disc reads? > >>Anyhow, I would put the xlog always to a RAID 10 volume because most of > >>the I/O for update and inserts is goi

[PERFORM] Performance of pg_dump on PGSQL 8.0

2006-06-14 Thread John E. Vincent
-- this is the third time I've tried sending this and I never saw it get through to the list. Sorry if multiple copies show up. Hi all, I've been lurking using the web archives for a while and haven't found an answer that seems to answer my questions about pg_dump. We have a 206GB data wareh

Re: [PERFORM] Which processor runs better for Postgresql?

2006-06-14 Thread Steve Poe
Dave, Joshua, Scott (and all), Thanks for your feedback, while I do appreciate it, I did not intent on making this discussion "buy this instead"...I whole-heartly agree with you. Joshua, you made the best comment, it is a business decision for the client. I don't agree with it, but I understand it

Re: [PERFORM] Confirmation of bad query plan generated by 7.4

2006-06-14 Thread Shaun Thomas
>>> On 6/13/2006 at 9:13 PM, Tom Lane <[EMAIL PROTECTED]> wrote: > Read what you wrote, and rethink... Hah. Yes, I understand the irony of that statement, but the point is that the value of the variable won't change during query execution. > If you're desperate you can construct a query string

Re: [PERFORM] how to partition disks

2006-06-14 Thread Sven Geisler
Hi Richard, Richard Broersma Jr schrieb: This depends on your application. Do you have a lot of disc reads? Anyhow, I would put the xlog always to a RAID 10 volume because most of the I/O for update and inserts is going to the xlog. 4 discs xlog 6 discs tables 4 discs tables2 I have a quest

Re: [PERFORM] how to partition disks

2006-06-14 Thread Richard Broersma Jr
> > raid 10 is of course not questionable. but are you sure that it will > > work faster than for example: > > 2 discs (raid 1) for xlog > > 6 discs (raid 10) for tables > > 6 discs (raid 10) for indices? > > > > This depends on your application. Do you have a lot of disc reads? > Anyhow, I woul

Re: [PERFORM] OT - select + must have from - sql standard syntax?

2006-06-14 Thread Tom Lane
Antoine <[EMAIL PROTECTED]> writes: > ps. shame the standard isn't "freely" consultable to save you guys > silly OT questions! You can get free "draft" versions that are close-enough-to-final to be perfectly usable. See our developers' FAQ for some links. I like the drafts partly because they're

Re: [PERFORM] OT - select + must have from - sql standard syntax?

2006-06-14 Thread Dave Dutcher
> -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > Greg Stark > Sent: Tuesday, June 13, 2006 11:16 PM > Subject: Re: [PERFORM] OT - select + must have from - sql > standard syntax? [SNIP] > > Well you could always create a "dual", it was always jus

Re: [PERFORM] Confirmation of bad query plan generated by 7.4

2006-06-14 Thread Jim C. Nasby
On Tue, Jun 13, 2006 at 09:50:49PM -0400, Tom Lane wrote: > "Jim C. Nasby" <[EMAIL PROTECTED]> writes: > > On Tue, Jun 13, 2006 at 06:04:42PM -0400, Tom Lane wrote: > >> It'd depend on the context, possibly, but it's easy to show that the > >> current planner does fold "now() - interval_constant" w

Re: [PERFORM] how to partition disks

2006-06-14 Thread Sven Geisler
Hi Hupert, hubert depesz lubaczewski schrieb: On 6/14/06, *Sven Geisler* <[EMAIL PROTECTED] > wrote: You should configure your discs to RAID 10 volumes. You should set up a separate volume for WAL. A volume for an additional table space may also useful.

Re: [PERFORM] Precomputed constants?

2006-06-14 Thread Böszörményi Zoltán
> On Jun 14 12:53, Böszörményi Zoltán wrote: >> # explain analyze select * from mxstrpartsbg where szam = >> round(80*random())::integer; > > AFAIK, you can use sth like that: > > SELECT * FROM mxstrpartsbg > WHERE szam = (SELECT round(80*random())::integer OFFSET 0); > > This will preven

Re: [PERFORM] how to partition disks

2006-06-14 Thread hubert depesz lubaczewski
On 6/14/06, Sven Geisler <[EMAIL PROTECTED]> wrote: You should configure your discs to RAID 10 volumes.You should set up a separate volume for WAL.A volume for an additional table space may also useful.In your case I would do 2 partitions:1. RAID 10 with 8 discs for general data raid 10 is of cours

Re: [PERFORM] Precomputed constants?

2006-06-14 Thread Volkan YAZICI
On Jun 14 12:53, Böszörményi Zoltán wrote: > # explain analyze select * from mxstrpartsbg where szam = > round(80*random())::integer; AFAIK, you can use sth like that: SELECT * FROM mxstrpartsbg WHERE szam = (SELECT round(80*random())::integer OFFSET 0); This will prevent calculation o

[PERFORM] Precomputed constants?

2006-06-14 Thread Böszörményi Zoltán
Hi, here's my problem: # explain analyze select * from mxstrpartsbg where szam = round(80*random())::integer; QUERY PLAN - Seq Sc

Re: [PERFORM] how to partition disks

2006-06-14 Thread Sven Geisler
Hi Hubert, hubert depesz lubaczewski schrieb: hi i'm waiting for new server to arrive. for the server i will get hp msa1000, with 14 discs (72g, 15000 rpm). what kind of partitioning you suggest, to get maximum performance? for system things i will have separate discs, so whole array is only for

[PERFORM] how to partition disks

2006-06-14 Thread hubert depesz lubaczewski
hii'm waiting for new server to arrive.for the server i will get hp msa1000, with 14 discs (72g, 15000 rpm).what kind of partitioning you suggest, to get maximum performance?for system things i will have separate discs, so whole array is only for postgresql. data processing is oltp, but with large