Re: [ZODB-Dev] what could cause this kind of cache corruption?
Christian Theune wrote: However, I was hoping for inclusion of at least the `storage-iterator-branch` in 3.9 and I asked a few times over the past months already for review but haven't gotten any responses at all so far. This branch has been used in production for a few month already. In addition there's the `bushy-directory` branch which introduces a new blob directory structure to avoid scalability issues with filesystems like ext2/3 that only accept limited numbers of entries in a directory. This branch is being used in production but needs a little which should happen in the next days. (The packing is reported to block.) At last there's a small `ctheune-betterimport` branch which fixes ZEXP import for weakref objects and has been sitting around for almost a year now too. Any joy on getting these merged? How about getting ClientStorage fixed so zeoraid works properly? ;-) cheers, Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] what could cause this kind of cache corruption?
On Mon, 2008-08-11 at 10:19 +0100, Chris Withers wrote: > Christian Theune wrote: > > However, I was hoping for inclusion of at least the > > `storage-iterator-branch` in 3.9 and I asked a few times over the past > > months already for review but haven't gotten any responses at all so > > far. This branch has been used in production for a few month already. > > > > In addition there's the `bushy-directory` branch which introduces a new > > blob directory structure to avoid scalability issues with filesystems > > like ext2/3 that only accept limited numbers of entries in a directory. > > This branch is being used in production but needs a little which should > > happen in the next days. (The packing is reported to block.) > > > > At last there's a small `ctheune-betterimport` branch which fixes ZEXP > > import for weakref objects and has been sitting around for almost a year > > now too. > > Any joy on getting these merged? I'm not sure I understand the question 100%. I'd be happy to merge. Jim is currently on vacation (or at least was last week) and I want him to have a chance to reply here. > How about getting ClientStorage fixed so zeoraid works properly? ;-) FTR: Chris refers to an extended use case of ZEORaid. The iteration branch already makes it work properly for the current set of features. Christian -- Christian Theune · [EMAIL PROTECTED] gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany http://gocept.com · tel +49 345 1229889 7 · fax +49 345 1229889 1 Zope and Plone consulting and development ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] what could cause this kind of cache corruption?
On Aug 3, 2008, at 4:03 AM, Christian Theune wrote: > On Fri, 2008-08-01 at 09:21 -0400, Jim Fulton wrote: >> On Jul 31, 2008, at 1:53 PM, Chris Withers wrote: >>> What I'd *really* like is a stable zodb release with Christian's >>> patches for zeoraid and Shane's patches for RelStorage that then >>> feeds through into a stable release of Zope 2. >> >> >> I'm not familiar with Christians patches. If they are bug fixes, they >> could make it into 3.8. I plan to include Shane's patches in 3.9. >> I'm >> not sure when there will be a stable release of 3.9. > > My patches aren't bug fixes and the plan was never to include them to > ZODB 3.8. > > However, I was hoping for inclusion of at least the > `storage-iterator-branch` in 3.9 and I asked a few times over the past > months already for review but haven't gotten any responses at all so > far. This branch has been used in production for a few month already. I haven' t had time to review this yet. I'll get to it eventually. I'm sure I'll get to it before 3.9 is released. > In addition there's the `bushy-directory` branch which introduces a > new > blob directory structure to avoid scalability issues with filesystems > like ext2/3 that only accept limited numbers of entries in a > directory. Hm, this sounds like a bug fix if it prevents failures. > This branch is being used in production but needs a little which > should > happen in the next days. (The packing is reported to block.) Is the packing blockage unique to this branch? > At last there's a small `ctheune-betterimport` branch which fixes ZEXP > import for weakref objects and has been sitting around for almost a > year > now too. Is this a bug fix for 3.8? Or a feature for 3.9? Jim -- Jim Fulton Zope Corporation ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] what could cause this kind of cache corruption?
Hi, On Mon, 2008-08-11 at 09:37 -0400, Jim Fulton wrote: > On Aug 3, 2008, at 4:03 AM, Christian Theune wrote: > > > On Fri, 2008-08-01 at 09:21 -0400, Jim Fulton wrote: > >> On Jul 31, 2008, at 1:53 PM, Chris Withers wrote: > >>> What I'd *really* like is a stable zodb release with Christian's > >>> patches for zeoraid and Shane's patches for RelStorage that then > >>> feeds through into a stable release of Zope 2. > >> > >> > >> I'm not familiar with Christians patches. If they are bug fixes, they > >> could make it into 3.8. I plan to include Shane's patches in 3.9. > >> I'm > >> not sure when there will be a stable release of 3.9. > > > > My patches aren't bug fixes and the plan was never to include them to > > ZODB 3.8. > > > > However, I was hoping for inclusion of at least the > > `storage-iterator-branch` in 3.9 and I asked a few times over the past > > months already for review but haven't gotten any responses at all so > > far. This branch has been used in production for a few month already. > > I haven' t had time to review this yet. I'll get to it eventually. > I'm sure I'll get to it before 3.9 is released. \o/ > > In addition there's the `bushy-directory` branch which introduces a > > new > > blob directory structure to avoid scalability issues with filesystems > > like ext2/3 that only accept limited numbers of entries in a > > directory. > > Hm, this sounds like a bug fix if it prevents failures. It is. We ran into a failure on a production system that ran ext(2|3). > > This branch is being used in production but needs a little which > > should > > happen in the next days. (The packing is reported to block.) > > Is the packing blockage unique to this branch? Blocking currently happens on both trunk and 3.8. > > At last there's a small `ctheune-betterimport` branch which fixes ZEXP > > import for weakref objects and has been sitting around for almost a > > year > > now too. > > > Is this a bug fix for 3.8? Or a feature for 3.9? I can't remember when 3.8 came out. Back than it was a feature. OTOH you could call it a bugfix because you could create ZEXP files that could never be imported again. Christian -- Christian Theune · [EMAIL PROTECTED] gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany http://gocept.com · tel +49 345 1229889 7 · fax +49 345 1229889 1 Zope and Plone consulting and development ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] what could cause this kind of cache corruption?
On Aug 11, 2008, at 10:05 AM, Christian Theune wrote: > Hi, > > On Mon, 2008-08-11 at 09:37 -0400, Jim Fulton wrote: >> On Aug 3, 2008, at 4:03 AM, Christian Theune wrote: >> >>> On Fri, 2008-08-01 at 09:21 -0400, Jim Fulton wrote: On Jul 31, 2008, at 1:53 PM, Chris Withers wrote: > What I'd *really* like is a stable zodb release with Christian's > patches for zeoraid and Shane's patches for RelStorage that then > feeds through into a stable release of Zope 2. I'm not familiar with Christians patches. If they are bug fixes, they could make it into 3.8. I plan to include Shane's patches in 3.9. I'm not sure when there will be a stable release of 3.9. >>> >>> My patches aren't bug fixes and the plan was never to include them >>> to >>> ZODB 3.8. >>> >>> However, I was hoping for inclusion of at least the >>> `storage-iterator-branch` in 3.9 and I asked a few times over the >>> past >>> months already for review but haven't gotten any responses at all so >>> far. This branch has been used in production for a few month >>> already. >> >> I haven' t had time to review this yet. I'll get to it eventually. >> I'm sure I'll get to it before 3.9 is released. > > \o/ > >>> In addition there's the `bushy-directory` branch which introduces a >>> new >>> blob directory structure to avoid scalability issues with >>> filesystems >>> like ext2/3 that only accept limited numbers of entries in a >>> directory. >> >> Hm, this sounds like a bug fix if it prevents failures. > > It is. We ran into a failure on a production system that ran ext(2|3). It sounds like this (or some form of it) should go into 3.8.x. >>> This branch is being used in production but needs a little which >>> should >>> happen in the next days. (The packing is reported to block.) >> >> Is the packing blockage unique to this branch? > > Blocking currently happens on both trunk and 3.8. So this should get into a 3.8.x release. >>> At last there's a small `ctheune-betterimport` branch which fixes >>> ZEXP >>> import for weakref objects and has been sitting around for almost a >>> year >>> now too. >> >> >> Is this a bug fix for 3.8? Or a feature for 3.9? > > I can't remember when 3.8 came out. Back than it was a feature. OTOH > you > could call it a bugfix because you could create ZEXP files that could > never be imported again. So a candidate for a 3.8 release. Jim -- Jim Fulton Zope Corporation ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
