Re: [PERFORM] commit so slow program looks frozen

2006-10-31 Thread Rob Lemley
Merlin Moncure wrote: On 10/28/06, Simon Riggs [EMAIL PROTECTED] wrote: On Thu, 2006-10-26 at 11:06 -0400, Merlin Moncure wrote: On 10/26/06, Carlo Stonebanks [EMAIL PROTECTED] wrote: This is pretty interesting - where can I read more on this? Windows isn't actually hanging, one single

Re: [PERFORM] commit so slow program looks frozen

2006-10-30 Thread Bucky Jordan
Yes, this issue comes up often - I wonder if the Woodcrest Xeons resolved this? Have these problems been experienced on both Linux and Windows (we are running Windows 2003 x64) Carlo IIRC Woodcrest doesn't have HT, just dual core with shared cache. - Bucky

Re: [PERFORM] commit so slow program looks frozen

2006-10-28 Thread Simon Riggs
On Thu, 2006-10-26 at 11:06 -0400, Merlin Moncure wrote: On 10/26/06, Carlo Stonebanks [EMAIL PROTECTED] wrote: This is pretty interesting - where can I read more on this? Windows isn't actually hanging, one single command line window is - from its behaviour, it looks like the TCL

Re: [PERFORM] commit so slow program looks frozen

2006-10-28 Thread Carlo Stonebanks
Ben Trewern [EMAIL PROTECTED] wrote in message news:[EMAIL PROTECTED] It might be worth turning off hyperthreading if your Xeons are using it. There have been reports of this causing inconsistent behaviour with PostgreSQL. Yes, this issue comes up often - I wonder if the Woodcrest Xeons

Re: [PERFORM] commit so slow program looks frozen

2006-10-28 Thread Carlo Stonebanks
I do think we need some better instrumentation for this kind of thing. Well, one thing's for sure - I have little other information to offer. The problem is that the lockups occur after hours of operation and thousands of rows being digested (which is the nature of the program). If better

Re: [PERFORM] commit so slow program looks frozen

2006-10-28 Thread Merlin Moncure
On 10/28/06, Simon Riggs [EMAIL PROTECTED] wrote: On Thu, 2006-10-26 at 11:06 -0400, Merlin Moncure wrote: On 10/26/06, Carlo Stonebanks [EMAIL PROTECTED] wrote: This is pretty interesting - where can I read more on this? Windows isn't actually hanging, one single command line window is -

Re: [PERFORM] commit so slow program looks frozen

2006-10-26 Thread Magnus Hagander
You may try to figure out what's the process doing (the backend obviously, not the frontend (Tcl) process) by attaching to it with strace. It's so sad when us poor Windows guys get helpful hints from people assume that we're smart enough to run *NIX... ;-) You should try a

Re: [PERFORM] commit so slow program looks frozen

2006-10-26 Thread Rocco Altier
I seem to remember Oleg/Teodor recently reporting a problem with Windows hanging on a multi-processor machine, during a heavy load operation. In their case it seemed like a vacuum would allow it to wake up. They did commit a patch that did not make it into the last minor version for lack of

Re: [PERFORM] commit so slow program looks frozen

2006-10-26 Thread Carlo Stonebanks
I can just see the postgresql group getting together at the next O'Reilley's conference and creating that band. And it will all be your fault. Finally, a chance for me to wear my black leather pants. A context switch storm is when your machine spends more time trying to figure out what to

Re: [PERFORM] commit so slow program looks frozen

2006-10-26 Thread Carlo Stonebanks
This is pretty interesting - where can I read more on this? Windows isn't actually hanging, one single command line window is - from its behaviour, it looks like the TCL postgresql package is waiting for pg_exec to come back from the commit (I believe the commit has actually gone through). It

Re: [PERFORM] commit so slow program looks frozen

2006-10-26 Thread Merlin Moncure
On 10/26/06, Carlo Stonebanks [EMAIL PROTECTED] wrote: This is pretty interesting - where can I read more on this? Windows isn't actually hanging, one single command line window is - from its behaviour, it looks like the TCL postgresql package is waiting for pg_exec to come back from the commit

Re: [PERFORM] commit so slow program looks frozen

2006-10-26 Thread Richard Troy
On Thu, 26 Oct 2006, Carlo Stonebanks wrote: It could even be that there's something wrong with the TCL package, but from my understanding it is one of the most complete interfaces out there - which is weird, because TCL seems to be the most unpopular language in the community. Not that

Re: [PERFORM] commit so slow program looks frozen

2006-10-26 Thread Carlo Stonebanks
when it happens, make sure to query pg_locks and see what is going on there lock issues are not supposed to manifest on a commit, which releases locks, but you never know. There aren't any pedning locks (assuming that pgAdmin is using pg_locks to display pendin glocks). There have been

OT: TCL vs Perl Re: [PERFORM] commit so slow program looks frozen

2006-10-26 Thread mark
Perl started out fast - TCL started out slow. Perl used syntax that, although it would drive some people crazy, followed a linguistic curve that Larry Wall claimed was healthy. The English language is crazy, and yet, it has become standard world wide as well. Designed, regular languages like

Re: OT: TCL vs Perl Re: [PERFORM] commit so slow program looks frozen

2006-10-26 Thread Joshua D. Drake
Perl has a wealth of modules on CPAN to do almost anything you need to. TCL has the beginning of one (not as rich), but comes built-in with things like event loops, and graphicals (Tk). I could go on and on - but I won't, because this is the PostgreSQL mailing list. People either get Perl,

[PERFORM] commit so slow program looks frozen

2006-10-25 Thread Carlo Stonebanks
(I tried this question on the interface forum and got no result, but I don't know how to tell if it's an interface issue or not) I have a TCL app which typically takes hours to complete. I found out that it is taking longer than it should because it occasionally stalls inexplicably (for tens

Re: [PERFORM] commit so slow program looks frozen

2006-10-25 Thread Alvaro Herrera
Carlo Stonebanks wrote: The delays are so long that I used to think the app was hopelessly frozen. By accident, I left the app alone in its frozen state and came back a good deal later and seen that it was running again. Sometimes I decide it *IS* frozen and have to restart. Because

Re: [PERFORM] commit so slow program looks frozen

2006-10-25 Thread Carlo Stonebanks
You may try to figure out what's the process doing (the backend obviously, not the frontend (Tcl) process) by attaching to it with strace. It's so sad when us poor Windows guys get helpful hints from people assume that we're smart enough to run *NIX... ;-) Maybe it's swamped by a context

Re: [PERFORM] commit so slow program looks frozen

2006-10-25 Thread Carlo Stonebanks
I have a question for you: did you have a long running query keeping open a transaction? I've just noticed the same problem here, but things cleaned up immediately when I aborted the long-running transaction. No, the only processes are from those in the import applications themselves:

Re: [PERFORM] commit so slow program looks frozen

2006-10-25 Thread Brian Hurt
Carlo Stonebanks wrote: You may try to figure out what's the process doing (the backend obviously, not the frontend (Tcl) process) by attaching to it with strace. It's so sad when us poor Windows guys get helpful hints from people assume that we're smart enough to run

Re: [PERFORM] commit so slow program looks frozen

2006-10-25 Thread Scott Marlowe
On Wed, 2006-10-25 at 15:07, Carlo Stonebanks wrote: You may try to figure out what's the process doing (the backend obviously, not the frontend (Tcl) process) by attaching to it with strace. It's so sad when us poor Windows guys get helpful hints from people assume that we're smart

Re: [PERFORM] commit so slow program looks frozen

2006-10-25 Thread Joshua D. Drake
Maybe it's swamped by a context switch storm (but in that case, probably the other processes would be affected as well). What is a context switch storm? (and what a great name for a heavy metal rock band!) I can just see the postgresql group getting together at the next O'Reilley's

Re: [PERFORM] commit so slow program looks frozen

2006-10-25 Thread Jim C. Nasby
On Wed, Oct 25, 2006 at 04:32:16PM -0400, Carlo Stonebanks wrote: I have a question for you: did you have a long running query keeping open a transaction? I've just noticed the same problem here, but things cleaned up immediately when I aborted the long-running transaction. No, the only