Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Shane Hathaway
On 03/01/2011 04:32 PM, Maurits van Rees wrote: > As a workaround for getting blobstorage to work reliably in a relstorage > setup without a shared blob dir: is there any way to store the blobs > completely in postgres and have no shared or cached blob dir in the zeo > clients? If that would work

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Maurits van Rees
Op 01-03-11 23:53, Hanno Schlichting schreef: > On Tue, Mar 1, 2011 at 11:50 PM, Shane Hathaway wrote: >> On 03/01/2011 02:47 PM, Maurits van Rees wrote: >>> - ZODB3 3.8.6-polling >>> >>> Blobs are stored in postgres with RelStorage. Layout of the blob cache >>> dir is 'zeocache'. > > I should ha

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Hanno Schlichting
On Tue, Mar 1, 2011 at 11:50 PM, Shane Hathaway wrote: > On 03/01/2011 02:47 PM, Maurits van Rees wrote: >> - ZODB3 3.8.6-polling >> >> Blobs are stored in postgres with RelStorage.  Layout of the blob cache >> dir is 'zeocache'. I should have spotted this earlier. The zeocache layout was only in

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Shane Hathaway
On 03/01/2011 02:47 PM, Maurits van Rees wrote: > That is pretty weird! I can understand a few duplicates because images > are saved in a few sizes, but this is too much. > > To reiterate some versions: > > - Plone 3.3.5 > - ZODB3 3.8.6-polling > - RelStorage 1.5.0b1 > - Zope2 2.10.12 > - plone.ap

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Maurits van Rees
Op 01-03-11 21:32, Shane Hathaway schreef: > On 03/01/2011 08:05 AM, Maurits van Rees wrote: >> No, I am still seeing it. I now see more clearly that the problem is >> that two files share the same blob name. I completely remove the blob >> cache and restart the zeo client. I visit image number

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Shane Hathaway
On 03/01/2011 08:05 AM, Maurits van Rees wrote: > No, I am still seeing it. I now see more clearly that the problem is > that two files share the same blob name. I completely remove the blob > cache and restart the zeo client. I visit image number 1 and get this > file in the var/blobcache: > 29

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Shane Hathaway
On 03/01/2011 01:10 PM, Jim Fulton wrote: > On Tue, Mar 1, 2011 at 2:47 PM, Shane Hathaway wrote: >>> Any idea where the error might be? Could this be in plone.app.blob? >>> Any chance that this is better in ZODB 3.9+? >> >> This appears to be a design bug in the "zeocache" blob layout: if a >> s

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Jim Fulton
On Tue, Mar 1, 2011 at 2:47 PM, Shane Hathaway wrote: >> Any idea where the error might be?  Could this be in plone.app.blob? >> Any chance that this is better in ZODB 3.9+? > > This appears to be a design bug in the "zeocache" blob layout: if a > single transaction stores multiple blobs, and the

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Shane Hathaway
On 03/01/2011 08:05 AM, Maurits van Rees wrote: > Op 01-03-11 13:54, Maurits van Rees schreef: >> Op 01-03-11 04:41, Shane Hathaway schreef: >>> On 02/28/2011 09:29 AM, Maurits van Rees wrote: This is now also happening for some images during normal operation, so after any blob migration

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Maurits van Rees
Op 01-03-11 13:54, Maurits van Rees schreef: > Op 01-03-11 04:41, Shane Hathaway schreef: >> On 02/28/2011 09:29 AM, Maurits van Rees wrote: >>> This is now also happening for some images during normal operation, so >>> after any blob migration has been run and existing blob caches have been >>> cl

Re: [ZODB-Dev] blobs missing with relstorage and small blob cache dir

2011-03-01 Thread Maurits van Rees
Op 01-03-11 09:17, Shane Hathaway schreef: > On 02/28/2011 07:37 PM, Shane Hathaway wrote: >> On 02/28/2011 08:19 AM, Maurits van Rees wrote: >>> I wonder if there is some code that mistakenly throws away the wrong >>> blob; it should throw away the oldest one I'd think, and not the one >>> that it

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Maurits van Rees
Op 01-03-11 04:41, Shane Hathaway schreef: > On 02/28/2011 09:29 AM, Maurits van Rees wrote: >> This is now also happening for some images during normal operation, so >> after any blob migration has been run and existing blob caches have been >> cleared. What happens is that somehow the file conte

Re: [ZODB-Dev] Pack complete: 80% of a 425GB database packed

2011-03-01 Thread Martijn Pieters
On Mon, Feb 28, 2011 at 22:12, Shane Hathaway wrote: >> And unless I am missing something, we don't >> need to worry about the transactions table either. The rest of >> RelStorage ignores transactions where the packed flag has been set to >> TRUE, so deleting the packed and empty transactions from

Re: [ZODB-Dev] blobs missing with relstorage and small blob cache dir

2011-03-01 Thread Shane Hathaway
On 02/28/2011 07:37 PM, Shane Hathaway wrote: > On 02/28/2011 08:19 AM, Maurits van Rees wrote: >> I wonder if there is some code that mistakenly throws away the wrong >> blob; it should throw away the oldest one I'd think, and not the one >> that it just loaded. >> >> The workaround is probably ju