[ZODB-Dev] Re: RelStorage now in Subversion

2008-01-31 Thread Shane Hathaway
Tres Seaver wrote: > Shane Hathaway wrote: >> However, I think we can still take advantage of listen and notify in a >> slightly different way. Currently, the Postgres adapter rolls back the >> load transaction on every connection close, but if it instead leaves the >> session idle with a transact

[ZODB-Dev] Re: RelStorage now in Subversion

2008-01-31 Thread Tres Seaver
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Shane Hathaway wrote: > Tres Seaver wrote: >> I've got a question for you on the removal of the LISTEN / NOTIFY stuff >> in the Postgresql adapter: it looks to me as though your code was not >> doing the async check-for-notifies as shown in the 'notif

Re: [ZODB-Dev] RelStorage now in Subversion

2008-01-31 Thread Shane Hathaway
Dieter Maurer wrote: > Shane Hathaway wrote at 2008-1-31 11:55 -0700: >> ... >> Yes, quite right! >> >> However, we don't necessarily have to roll back the Postgres transaction >> on every ZODB.Connection close, as we're doing now. > > That sounds very nasty! > > In Zope, I definitely *WANT* to e

Re: [ZODB-Dev] RelStorage now in Subversion

2008-01-31 Thread Dieter Maurer
Shane Hathaway wrote at 2008-1-31 11:55 -0700: > ... >Yes, quite right! > >However, we don't necessarily have to roll back the Postgres transaction >on every ZODB.Connection close, as we're doing now. That sounds very nasty! In Zope, I definitely *WANT* to either commit or roll back the transacti

Re: [ZODB-Dev] Speedy RelStorage/PostgreSQL

2008-01-31 Thread Dieter Maurer
Shane Hathaway wrote at 2008-1-31 11:35 -0700: >Dieter Maurer wrote: >> Shane Hathaway wrote at 2008-1-31 00:12 -0700: >>> ... >>> 1. Download ZODB and patch it with poll-invalidation-1-zodb-3-8-0.patch >> >> What does "poll invalidation" mean? >> >> The RelStorage maintains a sequence of (obje

Re: [ZODB-Dev] RelStorage now in Subversion

2008-01-31 Thread Shane Hathaway
Dieter Maurer wrote: > I am surprised that you think to be able to play with the polling > frequency. > > Postgres will deliver objects as they have been when the > transaction started. > Therefore, when you start a postgres transaction > you must invalidate any object in your cache that >

Re: [ZODB-Dev] Speedy RelStorage/PostgreSQL

2008-01-31 Thread Shane Hathaway
Dieter Maurer wrote: > Shane Hathaway wrote at 2008-1-31 00:12 -0700: >> ... >> 1. Download ZODB and patch it with poll-invalidation-1-zodb-3-8-0.patch > > What does "poll invalidation" mean? > > The RelStorage maintains a sequence of (object) invalidations ordered > by "transaction-id" and t

Re: [ZODB-Dev] RelStorage now in Subversion

2008-01-31 Thread Dieter Maurer
Shane Hathaway wrote at 2008-1-31 01:08 -0700: > ... >I admit that polling for invalidations probably limits scalability, but >I have not yet found a better way to match ZODB with relational >databases. Polling in both PostgreSQL and Oracle appears to cause no >delays right now, but if the poll

[ZODB-Dev] Re: RelStorage now in Subversion

2008-01-31 Thread Shane Hathaway
Tres Seaver wrote: > I've got a question for you on the removal of the LISTEN / NOTIFY stuff > in the Postgresql adapter: it looks to me as though your code was not > doing the async check-for-notifies as shown in the 'notify.py' in the > psycopg2 examples: > > http://www.initd.org/tracker/psycop

Re: [ZODB-Dev] Speedy RelStorage/PostgreSQL

2008-01-31 Thread Dieter Maurer
Shane Hathaway wrote at 2008-1-31 00:12 -0700: > ... >1. Download ZODB and patch it with poll-invalidation-1-zodb-3-8-0.patch What does "poll invalidation" mean? The RelStorage maintains a sequence of (object) invalidations ordered by "transaction-id" and the client can ask "give me all inval

Re: [ZODB-Dev] The write skew issue

2008-01-31 Thread Dieter Maurer
Christian Theune wrote at 2008-1-30 21:21 +0100: > ... >That would mean that the write skew phenomenon that you found would be >valid behaviour, wouldn't it? No. > Am I missing something? Yes. No matter how you order the two transactions in my example, the result will be different from what the

[ZODB-Dev] Re: RelStorage now in Subversion

2008-01-31 Thread Tres Seaver
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Shane Hathaway wrote: > Hi all, > > RelStorage now exists in the Zope subversion repository here: > >http://svn.zope.org/relstorage/trunk/ > > I have also created a wiki page: > >http://wiki.zope.org/ZODB/RelStorage > > Testing help and da

Re: [ZODB-Dev] RelStorage now in Subversion

2008-01-31 Thread Jim Fulton
On Jan 31, 2008, at 3:08 AM, Shane Hathaway wrote: Jim Fulton wrote: On Jan 27, 2008, at 3:11 AM, Shane Hathaway wrote: I hope the patch, or a modified version of the patch, will be accepted for inclusion in ZODB 3.9. A monkey patch version is possible, but I'm trying to avoid that. I'm t

Re: [ZODB-Dev] Speedy RelStorage/PostgreSQL

2008-01-31 Thread David Pratt
Ok, great. Woo hoo - 64 bit 2.5. Many thanks Shane. Regards, David Shane Hathaway wrote: David Pratt wrote: Hi Shane. Congratulations. Can you advise of compatibility with ZODB 3.8. Many thanks. Yes, it's fully compatible now. A few tests didn't pass at first, but they only failed due to t

Re: [ZODB-Dev] RelStorage now in Subversion

2008-01-31 Thread Shane Hathaway
Jim Fulton wrote: On Jan 27, 2008, at 3:11 AM, Shane Hathaway wrote: I hope the patch, or a modified version of the patch, will be accepted for inclusion in ZODB 3.9. A monkey patch version is possible, but I'm trying to avoid that. I'm tentatively planning on including it in 3.9. I need