[ZODB-Dev] RelStorage: Memcache clients throws errors on commit now and then

2010-09-14 Thread Anton Stonor
Hi there, Before debugging this deeper I was hoping someone might already have an idea why this is happening: We're running Plone 4 with RelStorage, Mysql and two Memcached instances. We're now seeing random exceptions from the memcache client package on commit, such as: Module ZPublisher.Publis

Re: [ZODB-Dev] RelStorage: Memcache clients throws errors on commit now and then

2010-09-14 Thread Anton Stonor
2010/9/14 Alan Runyan > you didnt specify version of relstorage or zodb you are using, nor > version of memcahe or python memcached lib version > Good point. python-memcached 1.45 ZODB 3.9.5 Zope 2.12.10 Relstorage 1.4.0c3 /Anton ___ For more inform

Re: [ZODB-Dev] RelStorage: Memcache clients throws errors on commit now and then

2010-09-15 Thread Anton Stonor
Hi Shane, 2010/9/15 Shane Hathaway > This is a bug in python-memcached. Under some circumstances, > _val_to_store_info() returns 0 (see line 713), yet set_multi(), line 643, is > not prepared to handle that return value. You would be doing a good service > if you reported this to the authors.

Re: [ZODB-Dev] Traceback with RelStorage 1.4.1 + Zope 2.12.12 + python_memcached 1.4.5

2010-10-22 Thread Anton Stonor
2010/10/22 Sylvain Viollon wrote: I have a Zope 2, using RelStorage and python_memcached. I use > python_memcached because I use it in some other extension. > > I got the following traceback on a commit (..) > TypeError: 'int' object is unsubscriptable > Shane answered that one last month:

[ZODB-Dev] RelStorage: Write on master, read from slave(s)?

2010-10-26 Thread Anton Stonor
Hi, In order to scale an application using RelStorage I was thinking about seperating reads and writes accross databases. Writes would go to a Mysql master and the app would read from one or more Mysql slaves. It looks like RelStorage already keeps seperate connections for read and write (even th

Re: [ZODB-Dev] RelStorage: Write on master, read from slave(s)?

2010-10-26 Thread Anton Stonor
Hi Shane, In order to scale an application using RelStorage I was thinking about >> seperating reads and writes accross databases. Writes would go to a >> Mysql master and the app would read from one or more Mysql slaves. >> > > If you mean that you intend to set up some clients to write to a ma

[ZODB-Dev] RelStorage and PosKey errors - is this a risky hotfix?

2011-01-24 Thread Anton Stonor
Hi there, We have recently experienced a couple of PosKey errors with a Plone 4 site running RelStorage 1.4.1 and Mysql 5.1. After digging down we found that the objects that were throwing PosKeyErrors actually existed in the object_state table with pickles etc, however not in the current_object

Re: [ZODB-Dev] RelStorage and PosKey errors - is this a risky hotfix?

2011-01-27 Thread Anton Stonor
Hi Shane, Thanks for pursuing this. I have lots of other ideas now, but I don't know which to pursue. I need a > lot more information. It would be helpful if you sent me your database to > analyze. Some possible causes: > > - Have you looked for filesystem-level corruption yet? I asked this b

[ZODB-Dev] Re: Mindnumbing POSkeyError

2006-04-02 Thread Anton Stonor
ce, but in this case mange_delObjects threw an poskeyerror. However calling billeder._delObject('image.2006-03-19.5540330656') instead did the trick. /Anton Stonor ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/

[ZODB-Dev] ZEO Client deadlocking in asyncore.poll - how to I debug

2008-04-07 Thread Anton Stonor
We have a setup with a ZEO server and 4 ZEO clients. During the last weeks we have seen almost daily deadlocks in some of the ZEO clients. I've tried to wait for up to 30 minutes before restarting a client. I could need an advice on how to debug this. With DeadlockDebugger I see the same pat

[ZODB-Dev] Re: ZEO Client deadlocking in asyncore.poll - how to I debug

2008-04-07 Thread Anton Stonor
Thanks for you suggestions, Alan, Roché and Dieter, I'll switch the zeo server logging to debug level even though the amount of data is scary -- and try to find a way to reduce the load on the ZEO server (Roché). I think you (Alan and Dieter) might be right that there could be a network issu

[ZODB-Dev] Re: Relstorage

2008-05-02 Thread Anton Stonor
Hi there, Ben Mason wrote: We've come across the following problem: When trying to revert to an old version of a page, we get a unicode error: Module Products.CMFEditions.ZVCStorageTool, line 505, in _encodeMetadata UnicodeDecodeError: 'ascii' codec can't decode byte 0x80 in position 0: ord

[ZODB-Dev] Note for the docs: RelStorage requires at least MySQLdb 1.2.2 to work with Mysql

2008-05-07 Thread Anton Stonor
Hi there, Just wanted to share that RelStorage does not work with the MySQLdb 1.2.1 adapter. 1.2.2 seems to work fine. The symptom is this error message while starting up Zope: cPickle.UnpicklingError: unpickling stack underflow The reason is that MySQLdb 1.2.1 tampers with the pickles whi

[ZODB-Dev] Re: Note for the docs: RelStorage requires at least MySQLdb 1.2.2 to work with Mysql

2008-05-07 Thread Anton Stonor
Hi Shane, Well, it's already in the docs. Look for "1.2.1" in README.txt. Doh - I was too fast. I'll accept suggestions on how to reorganize the documentation to make this more noticeable. Well, it's actually quite clear as is, I realize. But a trouble shooting section possible including

[ZODB-Dev] Re: ZEO Client deadlocking in asyncore.poll - how to I debug

2008-05-23 Thread Anton Stonor
Last month I ask for help about hanging zeo clients. I promised to follow up. Dieter Maurer wrote: Anton Stonor wrote at 2008-4-7 16:16 +0200: We have a setup with a ZEO server and 4 ZEO clients. During the last weeks we have seen almost daily deadlocks in some of the ZEO clients. I&#x

[ZODB-Dev] Relstorage: Slow packing with Mysql when GC is turned on

2008-05-25 Thread Anton Stonor
One for the RelStorage issue tracker. I've migrated a ~70Mb Data.fs to a Mysql backed RelStorage. Everything seems to work fine. Packing can be slow, though. With GC turned off, packing took a minute or two. With GC turned on, it took many hours to complete. While running the pack, the expe

[ZODB-Dev] Re: Relstorage: Slow packing with Mysql when GC is turned on

2008-05-27 Thread Anton Stonor
Hi Shane, The bug comments suggest wrapping the subquery in "select * from (...)" to materialize the subquery only once. I've attached a patch that does that. Let me know whether it helps or hurts. Note that this isn't the final form of the patch since the other supported databases don't ne