Re: Interruptible sleeps (was Re: [HACKERS] CommitFest 2009-07: Yay, Kevin! Thanks, reviewers!)

2010-08-31 Thread Heikki Linnakangas
Here's a 2nd version of the latch patch. Now with a Windows implementation. Comments welcome. -- Heikki Linnakangas EnterpriseDB http://www.enterprisedb.com diff --git a/configure b/configure index bd9b347..432cd58 100755 --- a/configure +++ b/configure @@ -27773,6 +27773,13 @@ _ACEOF

Re: [HACKERS] How to construct an exact plan

2010-08-31 Thread PostgreSQL - Hans-Jürgen Schönig
hello ... here is the ultimate revelation of planner hints in postgres ... let us praise oleg and teodor for solving a practical problem for practical people ... http://www.sai.msu.su/~megera/wiki/plantuner try this one ... it is excellent and definitely helpful for many many people out there.

Re: [HACKERS] Performance Farm Release

2010-08-31 Thread Greg Smith
Stephen Frost wrote: You can certainly run it yourself locally w/o setting it up to report back to the build or performance farm.. So, yes, you can, you'll just have to look through the outputs yourself and it won't necessairly make much sense unless you've been doing those runs for a period of

[HACKERS] Estimation of Plan quality

2010-08-31 Thread vamsi krishna
Dear all Can someone tell me how to estimate the quality of my plan. For example if the ideal query plan generated by Dynamic Programming has a plan quality of 1.0, and suppose I generate my query plan with some greedy method or something, it will be worse (not as optimal as) than ideal plan by,

Re: [HACKERS] huia and moa versus old PG branches

2010-08-31 Thread Dave Page
On Mon, Aug 30, 2010 at 3:50 AM, Tom Lane t...@sss.pgh.pa.us wrote: The new buildfarm machines huia and moa aren't doing terribly well with the older PG branches.  This isn't really those machines' fault; what I find after a bit of digging is that we just didn't have good support for 64-bit

Re: [HACKERS] huia and moa versus old PG branches

2010-08-31 Thread Dave Page
On Tue, Aug 31, 2010 at 10:28 AM, Dave Page dp...@pgadmin.org wrote: On Mon, Aug 30, 2010 at 3:50 AM, Tom Lane t...@sss.pgh.pa.us wrote: Also, although moa is actually green for 8.3, it's showing an initdb failure in 8.4 and up (cache lookup failed for type 0 while processing

Re: Interruptible sleeps (was Re: [HACKERS] CommitFest 2009-07: Yay, Kevin! Thanks, reviewers!)

2010-08-31 Thread Fujii Masao
On Tue, Aug 31, 2010 at 4:06 PM, Heikki Linnakangas heikki.linnakan...@enterprisedb.com wrote: Here's a 2nd version of the latch patch. Now with a Windows implementation. Comments welcome. Seems good. Two minor comments: rc = WaitForSingleObject(latch-event, timeout / 1000); if (rc ==

Re: I: [HACKERS] About Our CLUSTER implementation is pessimal patch

2010-08-31 Thread Itagaki Takahiro
Sorry for the very delayed review. On Wed, Jul 21, 2010 at 11:15 PM, Leonardo Francalanci m_li...@yahoo.it wrote: 2) what other areas can I comment more? I think the patch is almost ready to commit, but still have some comments for the usability and documentations. I hope native English

Re: [HACKERS] Git conversion progress report and call for testing assistance

2010-08-31 Thread Magnus Hagander
On Sat, Aug 28, 2010 at 16:30, Tom Lane t...@sss.pgh.pa.us wrote: Magnus Hagander mag...@hagander.net writes: Should we consider actually removing the Log Message header and just put the message right at the start? If there's no link first, that would be fairly obvious, I think.. Either way

Re: [HACKERS] git: uh-oh

2010-08-31 Thread Magnus Hagander
On Mon, Aug 30, 2010 at 05:03, Robert Haas robertmh...@gmail.com wrote: On Wed, Aug 25, 2010 at 2:39 PM, Robert Haas robertmh...@gmail.com wrote: On Wed, Aug 25, 2010 at 1:27 PM, Tom Lane t...@sss.pgh.pa.us wrote: Robert Haas robertmh...@gmail.com writes: The fact that the file was modified

Re: [HACKERS] thousand unrelated data files in pg_default tablespace

2010-08-31 Thread Pavel Stehule
Hello there is a dump from 8KB files Regard Pavel Stehule *** * PostgreSQL File/Block Formatted Dump Utility - Version 8.3.0 * * File: /srv/postgresql/data/base/3400014/27059918 * Options used: None * * Dump created on: Tue

Re: Interruptible sleeps (was Re: [HACKERS] CommitFest 2009-07: Yay, Kevin! Thanks, reviewers!)

2010-08-31 Thread Fujii Masao
On Fri, Aug 27, 2010 at 4:39 PM, Fujii Masao masao.fu...@gmail.com wrote: /*  * XXX: Should we invent an API to wait for data coming from the  * client connection too? It's not critical, but we could then  * eliminate the timeout altogether and go to sleep for good.  */ Yes, it would be

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Dave Page
On Sun, Aug 29, 2010 at 12:05 PM, Magnus Hagander mag...@hagander.net wrote: On Thu, Aug 26, 2010 at 22:59, Cristian Bittel cbit...@gmail.com wrote: I still believe this exit code 128 is related to pgAdmin opened during the clossing session on Remote Desktop. I have a Windows user login wich is

Re: [HACKERS] huia and moa versus old PG branches

2010-08-31 Thread Tom Lane
Dave Page dp...@pgadmin.org writes: On Mon, Aug 30, 2010 at 3:50 AM, Tom Lane t...@sss.pgh.pa.us wrote: Also, although moa is actually green for 8.3, it's showing an initdb failure in 8.4 and up (cache lookup failed for type 0 while processing system_views.sql).  I'm betting this is some sort

Re: [HACKERS] huia and moa versus old PG branches

2010-08-31 Thread Tom Lane
Dave Page dp...@pgadmin.org writes: On Mon, Aug 30, 2010 at 3:50 AM, Tom Lane t...@sss.pgh.pa.us wrote: moa, which is claimed on the buildfarm dashboard to be using gcc but is actually using cc, hits the spinlock problem in 8.0 and 8.1 and the BYTE_ORDER problem in 8.2. Per above, moa is

Re: [HACKERS] huia and moa versus old PG branches

2010-08-31 Thread Dave Page
On Tue, Aug 31, 2010 at 2:51 PM, Tom Lane t...@sss.pgh.pa.us wrote: Dave Page dp...@pgadmin.org writes: On Mon, Aug 30, 2010 at 3:50 AM, Tom Lane t...@sss.pgh.pa.us wrote: Also, although moa is actually green for 8.3, it's showing an initdb failure in 8.4 and up (cache lookup failed for type 0

Re: [HACKERS] huia and moa versus old PG branches

2010-08-31 Thread Dave Page
On Tue, Aug 31, 2010 at 3:03 PM, Tom Lane t...@sss.pgh.pa.us wrote: Dave Page dp...@pgadmin.org writes: On Mon, Aug 30, 2010 at 3:50 AM, Tom Lane t...@sss.pgh.pa.us wrote: moa, which is claimed on the buildfarm dashboard to be using gcc but is actually using cc, hits the spinlock problem in

Re: [HACKERS] thousand unrelated data files in pg_default tablespace

2010-08-31 Thread Tom Lane
Pavel Stehule pavel.steh...@gmail.com writes: there is a dump from 8KB files Well, those certainly look like tables/indexes not temp files. So we can rule out one theory. You're *certain* these aren't referenced from pg_class.relfilenode of any of the databases in the server?

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Dave Page
On Tue, Aug 31, 2010 at 3:40 PM, Cristian Bittel cbit...@gmail.com wrote: To Dave's question, this behavior occurs on all Windows Server interactive sessions, no matter if Administrators or underpriviledge users, but is related to closing Windows interactive session while pgAdmin window is

Re: [HACKERS] git: uh-oh

2010-08-31 Thread Tom Lane
Magnus Hagander mag...@hagander.net writes: On Mon, Aug 30, 2010 at 05:03, Robert Haas robertmh...@gmail.com wrote: cvs admin -o ? Magnus, is this something that you can try?  Prune those could of wonky revisions after the delete and before the re-add prior to running the conversion, and

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Bruce Momjian
Dave Page wrote: On Tue, Aug 31, 2010 at 3:40 PM, Cristian Bittel cbit...@gmail.com wrote: To Dave's question, this behavior occurs on all Windows Server interactive sessions, no matter if Administrators or underpriviledge users, but is related to closing Windows interactive session while

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Dave Page
On Tue, Aug 31, 2010 at 4:27 PM, Bruce Momjian br...@momjian.us wrote: Dave Page wrote: On Tue, Aug 31, 2010 at 3:40 PM, Cristian Bittel cbit...@gmail.com wrote: To Dave's question, this behavior occurs on all Windows Server interactive sessions, no matter if Administrators or

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Bruce Momjian
Dave Page wrote: On Tue, Aug 31, 2010 at 4:27 PM, Bruce Momjian br...@momjian.us wrote: Dave Page wrote: On Tue, Aug 31, 2010 at 3:40 PM, Cristian Bittel cbit...@gmail.com wrote: To Dave's question, this behavior occurs on all Windows Server interactive sessions, no matter if

Re: Interruptible sleeps (was Re: [HACKERS] CommitFest 2009-07: Yay, Kevin! Thanks, reviewers!)

2010-08-31 Thread Bruce Momjian
Tom Lane wrote: Greg Smith g...@2ndquadrant.com writes: Tom Lane wrote: Well, yes they are. They cause unnecessary process wakeups and thereby consume cycles even when the database is idle. See for example a longstanding complaint here:

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Cristian Bittel
I am the remote support guy for a web developed application (Apache+PHP+Pg. Postgres is isolated on a server, Apache runs on another server), and installed at our client, our client is the Administrator user on Windows Server, I just have a limited privileges Windows user for monitoring. I have my

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Dave Page
On Tue, Aug 31, 2010 at 4:35 PM, Bruce Momjian br...@momjian.us wrote: Dave Page wrote: On Tue, Aug 31, 2010 at 4:27 PM, Bruce Momjian br...@momjian.us wrote: We have already found that exceeding desktop heap might cause a CreateProcess to return success but later fail with a return code of

Re: [HACKERS] Performance Farm Release

2010-08-31 Thread Joshua D. Drake
On Tue, 2010-08-31 at 03:28 -0400, Greg Smith wrote: 4) Merge the perfarm fork changes into the mainline buildfarm code. I expect continued bitrot of this code as changes are made to the regular buildfarm client, so it might be worth considering that sooner rather than later. As Andrew

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Bruce Momjian
Dave Page wrote: On Tue, Aug 31, 2010 at 4:35 PM, Bruce Momjian br...@momjian.us wrote: Dave Page wrote: On Tue, Aug 31, 2010 at 4:27 PM, Bruce Momjian br...@momjian.us wrote: We have already found that exceeding desktop heap might cause a CreateProcess to return success but later fail

Re: [HACKERS] git: uh-oh

2010-08-31 Thread Magnus Hagander
On Tue, Aug 31, 2010 at 17:12, Tom Lane t...@sss.pgh.pa.us wrote: Magnus Hagander mag...@hagander.net writes: On Mon, Aug 30, 2010 at 05:03, Robert Haas robertmh...@gmail.com wrote: cvs admin -o ? Magnus, is this something that you can try?  Prune those could of wonky revisions after the

Re: [HACKERS] git: uh-oh

2010-08-31 Thread Tom Lane
Magnus Hagander mag...@hagander.net writes: Ok. I've got a new migration runinng. Here's the revisions removed: RCS file: /usr/local/cvsroot/pgsql/src/backend/parser/Attic/gram.c,v deleting revision 2.88 RCS file: /usr/local/cvsroot/pgsql/src/interfaces/ecpg/preproc/Attic/pgc.c,v deleting

Re: [HACKERS] git: uh-oh

2010-08-31 Thread Magnus Hagander
On Tue, Aug 31, 2010 at 19:44, Tom Lane t...@sss.pgh.pa.us wrote: Magnus Hagander mag...@hagander.net writes: Ok. I've got a new migration runinng. Here's the revisions removed: RCS file: /usr/local/cvsroot/pgsql/src/backend/parser/Attic/gram.c,v deleting revision 2.88 RCS file:

[HACKERS] pg_resetxlog display bogosity

2010-08-31 Thread Alvaro Herrera
I just noticed that if I specify pg_resetxlog a timeline ID with the -l switch, it will display this value as TimeLineID of latest checkpoint. Which is not really the truth. I wonder if pg_resetxlog should display the actual pg_control values in one section, and the values that would be set after

Re: [HACKERS] Assertion failure on HEAD (or at least git copy of it)

2010-08-31 Thread Robert Haas
On Mon, Aug 30, 2010 at 12:47 PM, Tom Lane t...@sss.pgh.pa.us wrote: I wrote: I guess that something isn't properly setting up rnode.backend in recovery processing, but didn't find it yet. CreateFakeRelcacheEntry is the culprit ... Thanks for the fix. -- Robert Haas EnterpriseDB:

Re: [HACKERS] pg_resetxlog display bogosity

2010-08-31 Thread Tom Lane
Alvaro Herrera alvhe...@alvh.no-ip.org writes: I wonder if pg_resetxlog should display the actual pg_control values in one section, and the values that would be set after a reset in a different section, so that it is extra clear. Seems reasonable, although I'd suggest labeling the first

Re: [HACKERS] git: uh-oh

2010-08-31 Thread Magnus Hagander
On Tue, Aug 31, 2010 at 19:46, Magnus Hagander mag...@hagander.net wrote: On Tue, Aug 31, 2010 at 19:44, Tom Lane t...@sss.pgh.pa.us wrote: Magnus Hagander mag...@hagander.net writes: Ok. I've got a new migration runinng. Here's the revisions removed: RCS file:

Re: [HACKERS] string function - format function proposal

2010-08-31 Thread Pavel Stehule
Hello attached WIP patch. I implement only basic format's tags related to SQL: string, value, literal, sql identifier. These tags are basic, but there are not any break to implement any other formats or enhance a syntax. The mix with to_char function is more complex then I expected - so I don't

Re: [HACKERS] string function - format function proposal

2010-08-31 Thread A.M.
On Aug 31, 2010, at 5:07 PM, Pavel Stehule wrote: Hello attached WIP patch. I implement only basic format's tags related to SQL: string, value, literal, sql identifier. These tags are basic, but there are not any break to implement any other formats or enhance a syntax. The mix with

[HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread fazool mein
Hello everyone, I'm interested in benchmarking synchronous replication, to see how performance degrades compared to asynchronous streaming replication. I browsed through the archive of emails, but things still seem unclear. Do we have a final agreed upon patch that I can use? Any links for that?

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread Bruce Momjian
fazool mein wrote: Hello everyone, I'm interested in benchmarking synchronous replication, to see how performance degrades compared to asynchronous streaming replication. I browsed through the archive of emails, but things still seem unclear. Do we have a final agreed upon patch that I

[HACKERS] experimental: TSearch dictionary [de]serialization

2010-08-31 Thread Pavel Stehule
Hello I wrote a some very primitive code for testing serialization and de serialization of TSearch ISpell dictionary. This code working - but it is useful only for speed test now. Czech fulltext dictionary is serialized to cca 9MB long file. Saving needs about 90ms and reading needs same time.

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread David Fetter
On Tue, Aug 31, 2010 at 05:44:15PM -0400, Bruce Momjian wrote: fazool mein wrote: Hello everyone, I'm interested in benchmarking synchronous replication, to see how performance degrades compared to asynchronous streaming replication. I browsed through the archive of emails, but

Re: [HACKERS] string function - format function proposal

2010-08-31 Thread David Fetter
On Tue, Aug 31, 2010 at 11:07:40PM +0200, Pavel Stehule wrote: Hello attached WIP patch. I don't see it attached. Is it just me? Cheers, David. -- David Fetter da...@fetter.org http://fetter.org/ Phone: +1 415 235 3778 AIM: dfetter666 Yahoo!: dfetter Skype: davidfetter XMPP:

Re: [HACKERS] Performance Farm Release

2010-08-31 Thread Andrew Dunstan
On 08/31/2010 03:28 AM, Greg Smith wrote: 1) Nail down what subset of the information gathered locally should be uploaded to the buildfarm master server. Probably just the same columns of data already being saved for each test, but perhaps with some extra metadata. The local animal will

Re: [HACKERS] git: uh-oh

2010-08-31 Thread Robert Haas
On Tue, Aug 31, 2010 at 5:07 PM, Magnus Hagander mag...@hagander.net wrote: On Tue, Aug 31, 2010 at 19:46, Magnus Hagander mag...@hagander.net wrote: On Tue, Aug 31, 2010 at 19:44, Tom Lane t...@sss.pgh.pa.us wrote: Magnus Hagander mag...@hagander.net writes: Ok. I've got a new migration

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread Robert Haas
On Tue, Aug 31, 2010 at 6:24 PM, David Fetter da...@fetter.org wrote: On Tue, Aug 31, 2010 at 05:44:15PM -0400, Bruce Momjian wrote: fazool mein wrote: Hello everyone, I'm interested in benchmarking synchronous replication, to see how performance degrades compared to asynchronous

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread Robert Haas
On Tue, Aug 31, 2010 at 6:24 PM, David Fetter da...@fetter.org wrote: On Tue, Aug 31, 2010 at 05:44:15PM -0400, Bruce Momjian wrote: fazool mein wrote: Hello everyone, I'm interested in benchmarking synchronous replication, to see how performance degrades compared to asynchronous

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread David Fetter
On Tue, Aug 31, 2010 at 08:34:31PM -0400, Robert Haas wrote: On Tue, Aug 31, 2010 at 6:24 PM, David Fetter da...@fetter.org wrote: On Tue, Aug 31, 2010 at 05:44:15PM -0400, Bruce Momjian wrote: fazool mein wrote: Hello everyone, I'm interested in benchmarking synchronous replication,

Re: [HACKERS] string function - format function proposal

2010-08-31 Thread Itagaki Takahiro
On Wed, Sep 1, 2010 at 6:07 AM, Pavel Stehule pavel.steh...@gmail.com wrote: I don't found a nice mix for placeholders and positional placeholders How about %pos$format, used in C-printf()? It might be only in Linux's libc. printf(%2$s %1$d\n, 123, abc); = abc 123

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread Robert Haas
On Tue, Aug 31, 2010 at 8:45 PM, David Fetter da...@fetter.org wrote: I am pretty sure, however, that the performance will be terrible at this point.  Heikki is working on fixing that, but it ain't done yet. Is this something for an eDB feature, or for community PostgreSQL, or...? It's an

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread Fujii Masao
On Wed, Sep 1, 2010 at 9:34 AM, Robert Haas robertmh...@gmail.com wrote: There are patches, and the latest from Fujii Masao is probably worth looking at :) I am pretty sure, however, that the performance will be terrible at this point.  Heikki is working on fixing that, but it ain't done yet.

Re: [HACKERS] [BUGS] Estimation of Plan quality

2010-08-31 Thread Robert Haas
First, this is not a bug. Don't post to pgsql-bugs unless you're reporting a bug. On Tue, Aug 31, 2010 at 4:38 AM, vamsi krishna vamsikrishna1...@gmail.com wrote: Can someone tell me how to estimate the quality of my plan. For example if the ideal query plan generated by Dynamic Programming

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread fazool mein
Thanks! I'll wait for the merging then; there is no point in benchmarking otherwise. Regards On Tue, Aug 31, 2010 at 6:06 PM, Fujii Masao masao.fu...@gmail.com wrote: On Wed, Sep 1, 2010 at 9:34 AM, Robert Haas robertmh...@gmail.com wrote: There are patches, and the latest from Fujii Masao

Re: [HACKERS] string function - format function proposal

2010-08-31 Thread Pavel Stehule
2010/9/1 David Fetter da...@fetter.org: On Tue, Aug 31, 2010 at 11:07:40PM +0200, Pavel Stehule wrote: Hello attached WIP patch. I don't see it attached.  Is it just me? sorry, it was at 1 ofter midnight Regards Pavel Cheers, David. -- David Fetter da...@fetter.org

Re: [HACKERS] string function - format function proposal

2010-08-31 Thread Pavel Stehule
2010/9/1 Itagaki Takahiro itagaki.takah...@gmail.com: On Wed, Sep 1, 2010 at 6:07 AM, Pavel Stehule pavel.steh...@gmail.com wrote: I don't found a nice mix for placeholders and positional placeholders How about %pos$format, used in C-printf()? It might be only in Linux's libc. printf(%2$s

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread Heikki Linnakangas
On 01/09/10 04:02, Robert Haas wrote: See the thread on interruptible sleeps. The problem right now is that there are some polling loops that act to throttle the maximum rate at which a node doing sync rep can make forward progress, independent of the capabilities of the hardware. To be

[HACKERS] array_agg() NULL Handling

2010-08-31 Thread David E. Wheeler
The aggregate docs say: The first form of aggregate expression invokes the aggregate across all input rows for which the given expression(s) yield non-null values. (Actually, it is up to the aggregate function whether to ignore null values or not — but all the standard ones do.) --