Re: [HACKERS] Differences in UTF8 between 8.0 and 8.1

2005-10-23 Thread Andrew - Supernews
On 2005-10-24, Paul Lindner <[EMAIL PROTECTED]> wrote: > Here's a cut and paste from emacs hexl-mode: > > : 3530 3833 6335 3038 330a 3c20 5641 4c55 5083c5083.< VALU > 0010: 4553 2028 3230 3235 3533 2c20 27c1 f9d4 ES (202553, '... > 0020: c2d0 c7d2 b927 2c20 0a2d 2d2d 0a3e 2056 ..

Re: [HACKERS] Differences in UTF8 between 8.0 and 8.1

2005-10-23 Thread Christopher Kings-Lynne
Thanks go out to John Hansen, he recommended to run the dump through iconv: iconv -c -f UTF8 -t UTF8 -o fixed.sql dump.sql This seems to strip out invalid UTF8 and will allow for a clean import. Someone should add this to the Release Notes/FAQ.. Yes I think that's extremely important to put

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Qingqing Zhou
"Andrew Dunstan" <[EMAIL PROTECTED]> wrote > > This patch passes regression and demonstrates the expected speedup on my > machine. > Looks good from here: - several rounds of regression test - psql -f set_time_out.sql - pg_ctl signal sending test - psql deadlock test Is there an

[HACKERS] broken link in 8.1 docs

2005-10-23 Thread Sergey E. Koposov
Hello, I just have found that the link to The Hitch-Hiker's Guide to Evolutionary Computation in http://developer.postgresql.org/docs/postgres/geqo-biblio.html is broken. It should be changed to one of the mirrors from http://www.cs.bham.ac.uk/Mirrors/ftp.de.uu.net/EC/clife/www/location.htm Wi

Re: [HACKERS] Differences in UTF8 between 8.0 and 8.1

2005-10-23 Thread Paul Lindner
On Sun, Oct 23, 2005 at 05:56:50AM -, Andrew - Supernews wrote: > On 2005-10-22, Paul Lindner <[EMAIL PROTECTED]> wrote: > > I've generated dumps using pg_dump from 8.0 and 8.1. Attempting to > > restore these results in > > > > Invalid UNICODE byte sequence detected near byte ... > > What w

Re: [HACKERS] Call for port reports

2005-10-23 Thread Sergey E. Koposov
Hello Tom, Slackware 10.0, kernel 2.6.12, x86, gcc 3.3.4 All 98 tests passed. Sergey * Sergey E. Koposov Max-Planck Institut fuer Astronomie Web: http://lnfm1.sai.msu.ru/~math E-mail: [EMAIL PROTECTED] ---(end of

Re: [HACKERS] Call for port reports

2005-10-23 Thread Josh Berkus
Tom, SuSE Linux 9.3 Professional, 2.6.11.4-20a-default, gcc (GCC) 3.3.5, Athlon64 --with-perl --with-integer-datetimes --with-pgport=5801 --prefix=/usr/local/pg81 == All 98 tests passed. == -- Josh Berkus Aglio Database Solutions San Francisco --

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Andrew Dunstan
Tom Lane wrote: "Magnus Hagander" <[EMAIL PROTECTED]> writes: Here's another version of this patch ;-) I've based it on your patch, so the changes to ovalue etc should sitill be there. In the spirit of incremental improvement ... I've taken Magnus' version and added the proposed cha

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Magnus Hagander
> > But. in theory, we can get a false positive from > > UNBLOCKED_SIGNAL_QUEUE(), right? > > We could have gotten a false positive from the old coding, too. > The event was certainly not any more tightly tied to the > presence of an unserviced signal flag than > UNBLOCKED_SIGNAL_QUEUE, and arg

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Tom Lane
Qingqing Zhou <[EMAIL PROTECTED]> writes: > Are we asserting that > UNBLOCKED_SIGNAL_QUEUE() != 0 > then > WaitForSingleObjectEx(0)==WAIT_OBJECT_0 No. > If so, we can put this assertion in. Only if you want it to crash every so often. The "race condition" is that a signal del

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Tom Lane
"Magnus Hagander" <[EMAIL PROTECTED]> writes: > But. in theory, we can get a false positive from > UNBLOCKED_SIGNAL_QUEUE(), right? We could have gotten a false positive from the old coding, too. The event was certainly not any more tightly tied to the presence of an unserviced signal flag than UN

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Magnus Hagander
> > In the spirit of incremental improvement ... I've taken Magnus' > > version and added the proposed change to re-enable > Qingqing's patch by > > skipping WaitForSingleObjectEx altogether in the > CHECK_FOR_INTERRUPTS code path. > > I also removed WaitForSingleObjectEx in > pgwin32_poll_sig

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Qingqing Zhou
On Sun, 23 Oct 2005, Magnus Hagander wrote: > > But. in theory, we can get a false positive from > UNBLOCKED_SIGNAL_QUEUE(), right? Since we do it unlocked between two > threads. If we do that, we'll "recover" in dispatch_signals, because > we'l lcheck again locked and not dispatch any signals.

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Qingqing Zhou
On Sun, 23 Oct 2005, Tom Lane wrote: > "Magnus Hagander" <[EMAIL PROTECTED]> writes: > > In the spirit of incremental improvement ... I've taken Magnus' version > and added the proposed change to re-enable Qingqing's patch by skipping > WaitForSingleObjectEx altogether in the CHECK_FOR_INTERRUPT

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Magnus Hagander
> > Here's another version of this patch ;-) I've based it on > your patch, > > so the changes to ovalue etc should sitill be there. > > In the spirit of incremental improvement ... I've taken > Magnus' version and added the proposed change to re-enable > Qingqing's patch by skipping WaitForSi

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Tom Lane
"Magnus Hagander" <[EMAIL PROTECTED]> writes: > Here's another version of this patch ;-) I've based it on your patch, so > the changes to ovalue etc should sitill be there. In the spirit of incremental improvement ... I've taken Magnus' version and added the proposed change to re-enable Qingqing's

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Qingqing Zhou
On Sun, 23 Oct 2005, Magnus Hagander wrote: > If we're going to create a separate thread, there is no need to deal > with APCs at all, I beleive. We can just use the existing timeout > functionality in WaitForSingleObjectEx(), which simplifies the code a > bit. [ Finally I copied it from the we

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Qingqing Zhou
On Sun, 23 Oct 2005, Magnus Hagander wrote: > > > Here's another version of this patch ;-) I've based it on > > your patch, > > > so the changes to ovalue etc should sitill be there. > > I didn't find a thread saying above? Something wrong with my newsreader? Regards, Qingqing -

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Magnus Hagander
> > Here's another version of this patch ;-) I've based it on > your patch, > > so the changes to ovalue etc should sitill be there. > > This looks fairly reasonable to me, but I'm feeling a bit > gun-shy after the previous fiasco. Before we consider > applying it so late in beta, I'd like to

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Tom Lane
"Magnus Hagander" <[EMAIL PROTECTED]> writes: > Here's another version of this patch ;-) I've based it on your patch, so > the changes to ovalue etc should sitill be there. This looks fairly reasonable to me, but I'm feeling a bit gun-shy after the previous fiasco. Before we consider applying it

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Magnus Hagander
> > Tom Lane wrote: > >> Well, you tried to "scale" into a domain where the performance is > >> going to be disk-I/O-limited, so I'm not sure it proves anything. > > > Good point. I took a 5% random extract from the lineitems table and > > saw the expected improvement. > > Sounds better. Certa

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Magnus Hagander
> Here is the full patch of the timer implemenation with threading safty > added. Basic test is by several rounds of "make check" and threading > safty test is by a SQL file with many lines of "set > statement_timeout = > x". I don't know if there are any corner cases that I should > consider, i

Re: [HACKERS] [PATCHES] Win32 CHECK_FOR_INTERRUPTS() performance

2005-10-23 Thread Andrew Dunstan
Qingqing Zhou wrote: I guess there are several ways to skin this cat - the way I had sort of worked out reading the MSDN docs was to call QueueUserAPC on the timer thread. I'd like to know what Magnus and Merlin especially think out it. I am not sure - does this not require another thre

[HACKERS] Call for port reports

2005-10-23 Thread Tom Lane
If you don't see your favorite platform already listed as tested for 8.1 at http://developer.postgresql.org/docs/postgres/supported-platforms.html then please give it a try and send in your results. I'd recommend using 8.1beta4 or later, as beta4 already includes a few small portability fixes over

[HACKERS] prepared queries in plpgsql

2005-10-23 Thread Dmitry Karasik
Hi all, I've finalized the patch that does prepared queries in plperl, tests included, it's at http://www.karasik.eu.org/software/patches/pgsql-plperl.patch I'd like to ask if there's a chance that it might be included in 8.2 -- Sincerely, Dmitry Karasik --- catpipe Systems ApS *BSD s

Re: [HACKERS] Question about Ctrl-C and less

2005-10-23 Thread Martijn van Oosterhout
On Sat, Oct 22, 2005 at 02:48:53PM -0700, Sean Utt wrote: > Except that if I am in less, and I do CONTROL-C, it doesn't do anything at > all. > > It doesn't exit. > > If I send a kill -2 to the process, it doesn't exit. less ignores SIGINT > completely. Not quite, It interprets it as "abort co

Re: [HACKERS] [Slony1-general] Slony1_funcs broken with 8.1

2005-10-23 Thread Andreas Pflug
Tom Lane wrote: Andreas Pflug <[EMAIL PROTECTED]> writes: So postmaster doesn't clean up pg_listener, It never has. If you're complaining about this patch http://archives.postgresql.org/pgsql-committers/2005-10/msg00073.php you ought to say so, rather than expecting us to guess it from an

[HACKERS] On externals sorts and other IO bottlenecks in postgresql.

2005-10-23 Thread Gregory Maxwell
I don't recall this being mentioned in the prior threads: http://www.cs.duke.edu/TPIE/ GPLed, but perhaps it has some good ideas. ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org