Re: [HACKERS] Fixed length datatypes. WAS [GENERAL] UUID's as

2006-06-30 Thread mark
On Fri, Jun 30, 2006 at 08:53:28AM +0200, Thomas Hallgren wrote: > Josh Berkus wrote: > >> I agree about splitting the utilities, except that I think the database > >> should be able to generate UUIDs somehow. > > There is a GUID add-in, and someone is working on a 2nd one. UUIDs > > are not part

Re: [HACKERS] Fixed length datatypes. WAS [GENERAL] UUID's as

2006-06-30 Thread Martijn van Oosterhout
On Fri, Jun 30, 2006 at 04:04:19AM -0400, [EMAIL PROTECTED] wrote: > > Martijn van Oosterhout wrote: > > > It seems to me that maybe the backend should include a 16-byte fixed > > > length object (after all, we've got 1, 2, 4 and 8 bytes already) and > > > then people can use that to build whatever

Re: [HACKERS] Index corruption

2006-06-30 Thread Marko Kreen
On 6/30/06, Tom Lane <[EMAIL PROTECTED]> wrote: I don't know the kernel nearly well enough to guess if these are related ... The sl_log_* tables are indexed on xid, where the relations between values are not exactly stable. When having high enough activity on one node or having nodes with XIDs

[HACKERS] mailing list problem ?

2006-06-30 Thread Oleg Bartunov
I have no messages since yesterday evening. Any problems with mailing list ? Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow Universi

Re: [HACKERS] mailing list problem ?

2006-06-30 Thread Marc G. Fournier
On Fri, 30 Jun 2006, Oleg Bartunov wrote: I have no messages since yesterday evening. Any problems with mailing list ? Not that I've seen ... been alot of posts going back and forth ... and yours definitely went through ... Marc G. Fournier Hub.Org Networking Services (http:/

Re: [HACKERS] Index corruption

2006-06-30 Thread Tom Lane
"Marko Kreen" <[EMAIL PROTECTED]> writes: > The sl_log_* tables are indexed on xid, where the relations between > values are not exactly stable. When having high enough activity on > one node or having nodes with XIDs on different enough positions > funny things happen. Yeah, that was one of the

Re: [HACKERS] Index corruption

2006-06-30 Thread Tom Lane
I trawled through the first, larger dump you sent me, and found multiple index entries pointing to quite a few heap tuples: Occurrences block item 2 43961 1 2 43961 2 2 43961 3 2 43961 4

Re: [HACKERS] Index corruption

2006-06-30 Thread Jan Wieck
On 6/30/2006 9:55 AM, Tom Lane wrote: "Marko Kreen" <[EMAIL PROTECTED]> writes: The sl_log_* tables are indexed on xid, where the relations between values are not exactly stable. When having high enough activity on one node or having nodes with XIDs on different enough positions funny things ha

Re: [HACKERS] Index corruption

2006-06-30 Thread Marko Kreen
On 6/30/06, Jan Wieck <[EMAIL PROTECTED]> wrote: With the final implementation of log switching, the problem of xxid wraparound will be avoided entirely. Every now and then slony will switch from one to another log table and when the old one is drained and logically empty, it is truncated, which

Re: [HACKERS] GIN index creation extremely slow ?

2006-06-30 Thread Stefan Kaltenbrunner
Teodor Sigaev wrote: >> Tom did commit a patch a while ago which made a huge difference in >> index creation time for tsearch by changing one routine. I don't know >> if it got backpatched, so it might be worth checking people are working >> on the same version. > > I saw that patch, but I still t

Re: [HACKERS] Index corruption

2006-06-30 Thread Jan Wieck
On 6/30/2006 11:17 AM, Marko Kreen wrote: On 6/30/06, Jan Wieck <[EMAIL PROTECTED]> wrote: With the final implementation of log switching, the problem of xxid wraparound will be avoided entirely. Every now and then slony will switch from one to another log table and when the old one is drained

Re: [HACKERS] Index corruption

2006-06-30 Thread Tom Lane
Jan Wieck <[EMAIL PROTECTED]> writes: > On 6/30/2006 11:17 AM, Marko Kreen wrote: >> If the xxid-s come from different DB-s, then there can still be problems. > How so? They are allways part of a multi-key index having the > originating node ID first. Really? create table @[EMAIL PROTECTED] (

Re: [HACKERS] Index corruption

2006-06-30 Thread Brad Nicholson
Tom Lane wrote: > Marc Munro <[EMAIL PROTECTED]> writes: >> I'll get back to you with kernel build information tomorrow. We'll also >> try to talk to some kernel hackers about this. > > Some googling turned up recent discussions about race conditions in > Linux NFS code: > > http://threebit.net/

Re: [HACKERS] Index corruption

2006-06-30 Thread Jan Wieck
On 6/30/2006 11:55 AM, Tom Lane wrote: Jan Wieck <[EMAIL PROTECTED]> writes: On 6/30/2006 11:17 AM, Marko Kreen wrote: If the xxid-s come from different DB-s, then there can still be problems. How so? They are allways part of a multi-key index having the originating node ID first. Really?

Re: [HACKERS] Index corruption

2006-06-30 Thread Brad Nicholson
Brad Nicholson wrote: > Tom Lane wrote: >> Marc Munro <[EMAIL PROTECTED]> writes: >>> I'll get back to you with kernel build information tomorrow. We'll also >>> try to talk to some kernel hackers about this. >> Some googling turned up recent discussions about race conditions in >> Linux NFS code:

Re: [HACKERS] Index corruption

2006-06-30 Thread Tom Lane
Brad Nicholson <[EMAIL PROTECTED]> writes: > It may or may not be the same issue, but for what it's worth, we've seen > the same sl_log_1 corruption on AIX 5.1 and 5.3 Hm, on what filesystem, and what PG version(s)? I'm not completely satisfied by the its-a-kernel-bug theory, because if it were

Re: [HACKERS] Index corruption

2006-06-30 Thread Brad Nicholson
Tom Lane wrote: > Brad Nicholson <[EMAIL PROTECTED]> writes: >> It may or may not be the same issue, but for what it's worth, we've seen >> the same sl_log_1 corruption on AIX 5.1 and 5.3 > > Hm, on what filesystem, and what PG version(s)? > > I'm not completely satisfied by the its-a-kernel-bu

Re: [HACKERS] Index corruption

2006-06-30 Thread Tom Lane
Jan Wieck <[EMAIL PROTECTED]> writes: > You're right ... forgot about that one. > However, transactions from different origins are NEVER selected together > and it wouldn't make sense to compare their xid's anyway. So the index > might return index tuples for rows from another origin, but the >

Re: [HACKERS] Index corruption

2006-06-30 Thread Hannu Krosing
Ühel kenal päeval, R, 2006-06-30 kell 12:05, kirjutas Jan Wieck: > On 6/30/2006 11:55 AM, Tom Lane wrote: > > > Jan Wieck <[EMAIL PROTECTED]> writes: > >> On 6/30/2006 11:17 AM, Marko Kreen wrote: > >>> If the xxid-s come from different DB-s, then there can still be problems. > > > >> How so? The

Re: [HACKERS] Fixed length datatypes. WAS [GENERAL] UUID's as

2006-06-30 Thread mark
On Fri, Jun 30, 2006 at 10:38:49AM +0200, Martijn van Oosterhout wrote: > On Fri, Jun 30, 2006 at 04:04:19AM -0400, [EMAIL PROTECTED] wrote: > > > > It seems to me that maybe the backend should include a 16-byte fixed > > > > length object (after all, we've got 1, 2, 4 and 8 bytes already) and > >

Re: [HACKERS] optimizing constant quals within outer joins

2006-06-30 Thread Tom Lane
Greg Stark <[EMAIL PROTECTED]> writes: >> I'm not sure why it's not pulling up from the left side of the left join >> though. That might be a bug. What PG version is this exactly? > In fact it doesn't even pull it up out of a regular join. I looked into this > when it was first brought up on IRC

Re: [HACKERS] Fixed length datatypes. WAS [GENERAL] UUID's as

2006-06-30 Thread Jim C. Nasby
On Fri, Jun 30, 2006 at 12:39:52PM -0400, [EMAIL PROTECTED] wrote: > > Only this could be used to create other types too, for cryptographic > > functions for example. PostgreSQL doesn't have any type generators yet, > > so I'm unsure whether a patch creating one would be accepted for core. > > Not

Re: [HACKERS] Fixed length datatypes. WAS [GENERAL] UUID's as

2006-06-30 Thread Tom Lane
[EMAIL PROTECTED] writes: > It depends how it is used. If the memory location needs to be > allocated, for the value to be used only a few times, the overhead of > allocation and redirection can be more expensive. If many though, than > the reduction in value copying can make the pointer faster. 64

[HACKERS] [RFC] txid: module for 64-bit external transaction IDs

2006-06-30 Thread Marko Kreen
Here's how we solved the XID indexing problem at Skype. We took Slony-s xxid module and made it output 8-byte numbers by keeping track of wraparound count. Thus having stable relationship between values. It would be good to have such functionality officially in PostgreSQL so that all replicatio

Re: [HACKERS] Index corruption

2006-06-30 Thread Marc Munro
On Thu, 2006-06-29 at 21:47 -0400, Tom Lane wrote: > One easy thing that would be worth trying is to build with > --enable-cassert and see if any Asserts get provoked during the > A couple other things to try, given that you can provoke the failure > fairly easily: > . . . > 1. In studying the cod

Re: [HACKERS] Index corruption

2006-06-30 Thread Tom Lane
Marc Munro <[EMAIL PROTECTED]> writes: > We tried all of these suggestions and still get the problem. Nothing > interesting in the log file so I guess the Asserts did not fire. Not surprising, it was a long shot that any of those things were really broken. But worth testing. > We are going to t

Re: [HACKERS] Interval aggregate regression failure (expected seems

2006-06-30 Thread Michael Glaesemann
On Jun 23, 2006, at 9:47 , Michael Glaesemann wrote: # select '41 mon'::interval / 10; ?column? 4 mons 2 days 24:00:00 My understanding is that as month_remainder is a float (as is month_remainder_days), month_remainder_days may be equal to 24 hours after r