Re: [ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-15 Thread Hanno Schlichting
On Fri, Jul 15, 2011 at 3:36 PM, Jim Fulton wrote: >  I wonder if it would address the cases you've seen. It could - but I honestly don't know under what circumstances these issues occur. We only tend to find them much later when we are doing large content migration tasks of some sort and suddenl

Re: [ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-15 Thread Jim Fulton
On Fri, Jul 15, 2011 at 3:58 AM, Hanno Schlichting wrote: > On Thu, Jul 14, 2011 at 10:30 PM, Jim Fulton wrote: >> Is the symptom you're seeing POSKeyError? > > Yes, ... This is disturbing. It would be good to better understand the reasons. I've thought of checking committed records to make su

Re: [ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-15 Thread Hanno Schlichting
On Thu, Jul 14, 2011 at 10:30 PM, Jim Fulton wrote: > Is the symptom you're seeing POSKeyError? Yes, plus various other mismatched internal data structures. Hanno ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/

Re: [ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-14 Thread Jim Fulton
On Thu, Jul 14, 2011 at 3:58 PM, Hanno Schlichting wrote: > On Thu, Jul 14, 2011 at 9:40 PM, Jim Fulton wrote: >> On Thu, Jul 14, 2011 at 3:23 PM, Hanno Schlichting wrote: >>> At Jarn we've used that trick many times to repair broken internals in >>> the intid/keyreference data structures. >> >>

Re: [ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-14 Thread Hanno Schlichting
On Thu, Jul 14, 2011 at 9:40 PM, Jim Fulton wrote: > On Thu, Jul 14, 2011 at 3:23 PM, Hanno Schlichting wrote: >> At Jarn we've used that trick many times to repair broken internals in >> the intid/keyreference data structures. > > Do you have any theories why objects are going away for you? Not

Re: [ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-14 Thread Jim Fulton
On Thu, Jul 14, 2011 at 3:23 PM, Hanno Schlichting wrote: > On Thu, Jul 14, 2011 at 5:38 PM, Andreas Jung wrote: >> For the sake of completeness: I found this >> >> https://mail.zope.org/pipermail/zodb-dev/2008-February/011606.html >> >> and will try it out . > > There's also instructions in my p

Re: [ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-14 Thread Hanno Schlichting
On Thu, Jul 14, 2011 at 5:38 PM, Andreas Jung wrote: > For the sake of completeness: I found this > > https://mail.zope.org/pipermail/zodb-dev/2008-February/011606.html > > and will try it out . There's also instructions in my pastebin dump on how to do this - and quite a bit simpler than Chris v

Re: [ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-14 Thread Andreas Jung
Jim Fulton wrote: I wouldn't normally suggest what I'm about to suggest, but I think you have enough ZODB foo. :) I would try adding a new bucket with that oid. Maybe you can even stuff it in the connection cache to avoid committing it to the database. I'm not sure off hand what the steps re

Re: [ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-14 Thread Jim Fulton
On Thu, Jul 14, 2011 at 10:12 AM, Andreas Jung wrote: > > > Jim Fulton wrote: >>> >>> 2011-07-14 13:36:22 INFO Z2 Shutting down >> >> That error message seems rather weird. WTF SIGINT? > > Likely caused during the Zope shutdown amd unrelated). I find this a bit unlikely, unless there was also a s

Re: [ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-14 Thread Hanno Schlichting
On Thu, Jul 14, 2011 at 4:12 PM, Andreas Jung wrote: > I followed the documentation at > > http://pastebin.com/bL0CbBm2 Wow, looks like I didn't specify an expiration date for my paste ;) If anyone feels like putting that into a more permanent place, feel free to use it. Hanno _

Re: [ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-14 Thread Andreas Jung
Jim Fulton wrote: 2011-07-14 13:36:22 INFO Z2 Shutting down That error message seems rather weird. WTF SIGINT? Likely caused during the Zope shutdown amd unrelated). Use multi-zodb-check-refs with the -r option to get a database of reverse references. Use that do figure out what's refe

Re: [ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-14 Thread Jim Fulton
On Thu, Jul 14, 2011 at 7:54 AM, Andreas Jung wrote: > I have a customer site (Plone 3.0.6) causing an error during packing: > >  Module ZPublisher.Publish, line 119, in publish >  Module ZPublisher.mapply, line 88, in mapply >  Module ZPublisher.Publish, line 42, in call_object >  Module , line 3