Re: [HACKERS] EXPLAIN ANALYZE

2006-12-11 Thread Simon Riggs
On Sun, 2006-12-10 at 18:09 -0500, Tom Lane wrote: > "Simon Riggs" <[EMAIL PROTECTED]> writes: > > The EA case is pretty straightforward though; > > Well, no its not, as you'll recall if you re-read the prior discussions. > The killer problem is that it's unclear whether the early termination of >

Re: [HACKERS] Load distributed checkpoint

2006-12-11 Thread Simon Riggs
On Fri, 2006-12-08 at 11:05 +0900, Takayuki Tsunakawa wrote: > I understand that checkpoints occur during crash > recovery and PITR, so time for those operations would get longer. A restorepoint happens during recovery, not a checkpoint. The recovery is merely repeating the work of the checkpoint

Re: [HACKERS] Load distributed checkpoint

2006-12-11 Thread ITAGAKI Takahiro
"Kevin Grittner" <[EMAIL PROTECTED]> wrote: > We have not experience any increase in I/O, just a smoothing. Keep in > mind that the file system cache will collapse repeated writes to the > same location until things settle, and the controller's cache also has a > chance of doing so. If we just

Re: [HACKERS] EXPLAIN ANALYZE

2006-12-11 Thread Gregory Stark
"Tom Lane" <[EMAIL PROTECTED]> writes: > We might be able to finesse the protocol problem by teaching EA to > respond to query cancel by emitting the data-so-far as a NOTICE (like it > used to do many moons ago), rather than a standard query result, then > allowing the query to error out. Howeve

Re: [HACKERS] EXPLAIN ANALYZE

2006-12-11 Thread Richard Huxton
Simon Riggs wrote: Intermediate results are always better than none at all. I do understand what a partial execution would look like - frequently it is the preparatory stages that slow a query down - costly sorts, underestimated hash joins etc. Other times it is loop underestimation, which can us

Re: [HACKERS] Load distributed checkpoint

2006-12-11 Thread Takayuki Tsunakawa
Hello, From: "ITAGAKI Takahiro" <[EMAIL PROTECTED]> "Takayuki Tsunakawa" <[EMAIL PROTECTED]> wrote: >> I'm afraid it is difficult for system designers to expect steady >> throughput/response time, as long as PostgreSQL depends on the >> flushing of file system cache. How does Oracle provide stable

Re: [HACKERS] Load distributed checkpoint

2006-12-11 Thread Takayuki Tsunakawa
Mr. Riggs, Thank you for teaching me the following. I seem to have misunderstood. I'll learn more. From: "Simon Riggs" <[EMAIL PROTECTED]> > On Fri, 2006-12-08 at 11:05 +0900, Takayuki Tsunakawa wrote: >> I understand that checkpoints occur during crash >> recovery and PITR, so time for those ope

Re: [HACKERS] Load distributed checkpoint

2006-12-11 Thread Inaam Rana
I wonder how the other big DBMS, IBM DB2, handles this. Is Itagaki-san referring to DB2? DB2 would also open data files with O_SYNC option and page_cleaners (counterparts of bgwriter) would exploit AIO if available on the system. Inaam Rana EnterpriseDB http://www.enterprisedb.com

[HACKERS] unixware and --with-ldap

2006-12-11 Thread ohp
Hi all, When I swithed to the newest version og pgbuildfarm, I noticed that --with-ldap (now by defaut) didn't work on UnixWare. This is because, on Unixware, ldap needs lber and resolv. Not being a configure guru, I made the change bellow locally and that works for me. Surely, one of you hacker

Re: [HACKERS] unixware and --with-ldap

2006-12-11 Thread Andrew Dunstan
ohp@pyrenet.fr wrote: Hi all, When I swithed to the newest version og pgbuildfarm, I noticed that --with-ldap (now by defaut) didn't work on UnixWare. This is because, on Unixware, ldap needs lber and resolv. Not being a configure guru, I made the change bellow locally and that works for me. S

Re: [HACKERS] unixware and --with-ldap

2006-12-11 Thread ohp
Thanks for replying, You are right but I have no knowedge on howto popagate this to Makefile.unixware. On Mon, 11 Dec 2006, Andrew Dunstan wrote: > Date: Mon, 11 Dec 2006 10:03:04 -0500 > From: Andrew Dunstan <[EMAIL PROTECTED]> > To: ohp@pyrenet.fr > Cc: pgsql-hackers list > Subject: Re: [HAC

[HACKERS] Quirk

2006-12-11 Thread Gregory Stark
Hm, in psql if I set FETCH_COUNT to a nonzero value I suddenly find I'm unable to use SELECT ... FOR UPDATE. I suspect this is unnecessary, that the only reason cursors can't hold locks is because we don't support the kind of read-write operations that clients may expect to be able to issue again

Re: [HACKERS] unixware and --with-ldap

2006-12-11 Thread Tom Lane
Andrew Dunstan <[EMAIL PROTECTED]> writes: > The right way to do this I think is to put an entry adjusting LIBS in > src/makefiles/Makefile.unixware, but first it looks like we need to > propagate the with-ldap switch into src/Makefile.global The Makefile is far too late --- this has to be adjus

Re: [HACKERS] Quirk

2006-12-11 Thread Tom Lane
Gregory Stark <[EMAIL PROTECTED]> writes: > I suspect this is unnecessary, that the only reason cursors can't hold locks > is because we don't support the kind of read-write operations that clients may > expect to be able to issue against read-write cursors? I think the rationale is that the SQL s

[HACKERS] Vacuum, analyze, and setting reltuples of pg_class

2006-12-11 Thread Greg Sabino Mullane
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Short version: is it optimal for vacuum to always populate reltuples with live rows + dead rows? I came across a problem in which I noticed that a vacuum did not change the reltuples value as I expected. A vacuum analyze indicated a correct estimate

Re: [HACKERS] Vacuum, analyze, and setting reltuples of pg_class

2006-12-11 Thread Tom Lane
"Greg Sabino Mullane" <[EMAIL PROTECTED]> writes: > Short version: is it optimal for vacuum to always populate reltuples > with live rows + dead rows? If we didn't do that, it would tend to encourage the use of seqscans on tables with lots of dead rows, which is probably a bad thing. > Is there a

Re: [HACKERS] Vacuum, analyze, and setting reltuples of pg_class

2006-12-11 Thread Greg Sabino Mullane
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Tom Lane replied: >> Short version: is it optimal for vacuum to always populate reltuples >> with live rows + dead rows? > If we didn't do that, it would tend to encourage the use of seqscans on > tables with lots of dead rows, which is probably a b

Re: [HACKERS] EXPLAIN ANALYZE

2006-12-11 Thread Simon Riggs
On Mon, 2006-12-11 at 11:00 +, Gregory Stark wrote: > "Tom Lane" <[EMAIL PROTECTED]> writes: > > > We might be able to finesse the protocol problem by teaching EA to > > respond to query cancel by emitting the data-so-far as a NOTICE (like it > > used to do many moons ago), rather than a stand

Re: [HACKERS] Vacuum, analyze, and setting reltuples of pg_class

2006-12-11 Thread Tom Lane
"Greg Sabino Mullane" <[EMAIL PROTECTED]> writes: > Bleh. Isn't that what a plain analyze would encourage then? Should analyze > be considering the dead rows somehow as well? Very possibly, at least for counting purposes (it mustn't try to analyze the content of such rows, since they could be inco

Re: [HACKERS] EXPLAIN ANALYZE

2006-12-11 Thread Tom Lane
"Simon Riggs" <[EMAIL PROTECTED]> writes: > On Mon, 2006-12-11 at 11:00 +, Gregory Stark wrote: >> What I suggested was introducing a new FE/BE message type for analyze query >> plans. > I like the idea, but its more work than I really wanted to get into > right now. Yeah ... a protocol chang

Re: [HACKERS] EXPLAIN ANALYZE

2006-12-11 Thread Neil Conway
Tom Lane wrote: Yeah ... a protocol change is *painful*, especially if you really want clients to behave in a significantly new way. A backward-incompatible protocol change is painful, sure, but ISTM we could implement what Greg describes as a straightforward extension to the V3 protocol. The

Re: [HACKERS] EXPLAIN ANALYZE

2006-12-11 Thread Neil Conway
Simon Riggs wrote: I like the idea, but its more work than I really wanted to get into right now. Well, from another point of view: do we need this feature so urgently that there is not enough time to do it properly? IMHO, no. -Neil ---(end of broadcast)-

Re: [HACKERS] EXPLAIN ANALYZE

2006-12-11 Thread Tom Lane
Neil Conway <[EMAIL PROTECTED]> writes: > Tom Lane wrote: >> Yeah ... a protocol change is *painful*, especially if you really want >> clients to behave in a significantly new way. > A backward-incompatible protocol change is painful, sure, but ISTM we > could implement what Greg describes as a s

Re: [HACKERS] Load distributed checkpoint

2006-12-11 Thread Ron Mayer
ITAGAKI Takahiro wrote: > "Kevin Grittner" <[EMAIL PROTECTED]> wrote: > >> ...the file system cache will collapse repeated writes to the >> same location until things settle ... >> If we just push dirty pages out to the OS as soon as possible, >> and let the file system do its job, I think we're

Re: [HACKERS] Grouped Index Tuples

2006-12-11 Thread Ron Mayer
Jim C. Nasby wrote: > On usage, ISTM it would be better to turn on GIT only for a clustered > index and not the PK? I'm guessing your automatic case is intended for > SERIAL PKs, but maybe it would be better to just make that explicit. Not necessarily; since often (in my tables at least) the data

Re: [HACKERS] Load distributed checkpoint

2006-12-11 Thread Kevin Grittner
>>> On Mon, Dec 11, 2006 at 3:31 PM, in message <[EMAIL PROTECTED]>, Ron Mayer <[EMAIL PROTECTED]> wrote: > > One thing I do worry about is if both postgresql and the OS > are both delaying write()s in the hopes of collapsing them > at the same time. If so, this would cause both to be experienc