Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-02 Thread Jim Fulton
On Tue, Mar 1, 2011 at 7:00 PM, Shane Hathaway sh...@hathawaymix.org wrote: On 03/01/2011 04:32 PM, Maurits van Rees wrote: As a workaround for getting blobstorage to work reliably in a relstorage setup without a shared blob dir: is there any way to store the blobs completely in postgres and

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-02 Thread Shane Hathaway
On 03/02/2011 07:38 AM, Jim Fulton wrote: BTW, my sense is that when blobs were first implemented, the emphasis was on shared blob directories and the non-shared blob implementation suffered from neglect, which I at least tried to rectify in ZODB 3.9. That evolutionary path is evident and I

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Maurits van Rees
Op 01-03-11 04:41, Shane Hathaway schreef: On 02/28/2011 09:29 AM, Maurits van Rees wrote: This is now also happening for some images during normal operation, so after any blob migration has been run and existing blob caches have been cleared. What happens is that somehow the file contents

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Maurits van Rees
Op 01-03-11 13:54, Maurits van Rees schreef: Op 01-03-11 04:41, Shane Hathaway schreef: On 02/28/2011 09:29 AM, Maurits van Rees wrote: This is now also happening for some images during normal operation, so after any blob migration has been run and existing blob caches have been cleared.

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Shane Hathaway
On 03/01/2011 08:05 AM, Maurits van Rees wrote: Op 01-03-11 13:54, Maurits van Rees schreef: Op 01-03-11 04:41, Shane Hathaway schreef: On 02/28/2011 09:29 AM, Maurits van Rees wrote: This is now also happening for some images during normal operation, so after any blob migration has been run

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Jim Fulton
On Tue, Mar 1, 2011 at 2:47 PM, Shane Hathaway sh...@hathawaymix.org wrote: Any idea where the error might be?  Could this be in plone.app.blob? Any chance that this is better in ZODB 3.9+? This appears to be a design bug in the zeocache blob layout: if a single transaction stores multiple

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Shane Hathaway
On 03/01/2011 01:10 PM, Jim Fulton wrote: On Tue, Mar 1, 2011 at 2:47 PM, Shane Hathawaysh...@hathawaymix.org wrote: Any idea where the error might be? Could this be in plone.app.blob? Any chance that this is better in ZODB 3.9+? This appears to be a design bug in the zeocache blob layout:

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Shane Hathaway
On 03/01/2011 08:05 AM, Maurits van Rees wrote: No, I am still seeing it. I now see more clearly that the problem is that two files share the same blob name. I completely remove the blob cache and restart the zeo client. I visit image number 1 and get this file in the var/blobcache:

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Maurits van Rees
Op 01-03-11 21:32, Shane Hathaway schreef: On 03/01/2011 08:05 AM, Maurits van Rees wrote: No, I am still seeing it. I now see more clearly that the problem is that two files share the same blob name. I completely remove the blob cache and restart the zeo client. I visit image number 1 and

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Shane Hathaway
On 03/01/2011 02:47 PM, Maurits van Rees wrote: That is pretty weird! I can understand a few duplicates because images are saved in a few sizes, but this is too much. To reiterate some versions: - Plone 3.3.5 - ZODB3 3.8.6-polling - RelStorage 1.5.0b1 - Zope2 2.10.12 - plone.app.blob

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Hanno Schlichting
On Tue, Mar 1, 2011 at 11:50 PM, Shane Hathaway sh...@hathawaymix.org wrote: On 03/01/2011 02:47 PM, Maurits van Rees wrote: - ZODB3 3.8.6-polling Blobs are stored in postgres with RelStorage.  Layout of the blob cache dir is 'zeocache'. I should have spotted this earlier. The zeocache

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Maurits van Rees
Op 01-03-11 23:53, Hanno Schlichting schreef: On Tue, Mar 1, 2011 at 11:50 PM, Shane Hathawaysh...@hathawaymix.org wrote: On 03/01/2011 02:47 PM, Maurits van Rees wrote: - ZODB3 3.8.6-polling Blobs are stored in postgres with RelStorage. Layout of the blob cache dir is 'zeocache'. I

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-03-01 Thread Shane Hathaway
On 03/01/2011 04:32 PM, Maurits van Rees wrote: As a workaround for getting blobstorage to work reliably in a relstorage setup without a shared blob dir: is there any way to store the blobs completely in postgres and have no shared or cached blob dir in the zeo clients? If that would work it

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-02-28 Thread Maurits van Rees
Op 18-02-11 15:34, Maurits van Rees schreef: Hi, I saw something strange today. I have two zeo clients using the same database. Both clients are on their own machine, and the database is also on a different one. When looking at an image, one client showed a completely different image than

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-02-28 Thread Shane Hathaway
On 02/28/2011 09:29 AM, Maurits van Rees wrote: This is now also happening for some images during normal operation, so after any blob migration has been run and existing blob caches have been cleared. What happens is that somehow the file contents for 0xblahblah.blob in the blob caches can

Re: [ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-02-28 Thread Shane Hathaway
On 02/28/2011 09:29 AM, Maurits van Rees wrote: This is now also happening for some images during normal operation, so after any blob migration has been run and existing blob caches have been cleared. What happens is that somehow the file contents for 0xblahblah.blob in the blob caches can

[ZODB-Dev] Wrong blob returned in one of the zeo clients

2011-02-18 Thread Maurits van Rees
Hi, I saw something strange today. I have two zeo clients using the same database. Both clients are on their own machine, and the database is also on a different one. When looking at an image, one client showed a completely different image than the other. This is with RelStorage 1.5.0b2