[ZODB-Dev] zodb-3.4.0 leaks ZEO.cache.Entry objects?

2005-08-03 Thread Chris Bainbridge
Hi there, After some time of running it seems that my process has a lot of ZEO.cache.Entry objects around... sys.getrefcount reports a huge number of references (155989 when I only have 625 object references!). I've run a memory profiler on my code which shows the number of objects of class ZEO.ca

Re: [ZODB-Dev] zodb-3.4.0 leaks ZEO.cache.Entry objects?

2005-08-04 Thread Chris Bainbridge
On 03/08/05, Tim Peters <[EMAIL PROTECTED]> wrote: > The refcount on Entry keeps growing. I suspect, but don't yet know, that > this is because FileCache._makeroom()'s > should have another line: > > if e is not None: > del self.key2entry[e.key] > sel

[ZODB-Dev] zodb-3.5.0 install : Syntax error on sampletests_i.py

2005-09-10 Thread Chris Bainbridge
Hi, I noticed the following error installing Gentoo / python 2.3.5: byte-compiling /var/tmp/portage/zodb-3.5.0/image/usr/lib/python2.3/site-packages/zope/testing/testrunner-ex/sample2/sampletests_f.py to sampletests_f.pyc byte-compiling /var/tmp/portage/zodb-3.5.0/image/usr/lib/python2.3/site-

[ZODB-Dev] invalidateTransaction bug

2006-03-05 Thread Chris Bainbridge
Hi, with zodb-3.6.0 I occasionally see the error: ERROR:ZEO.zrpc.Connection(C):(localhost:12345) Asynchronous call raised exception: Traceback (most recent call last): File "/usr/lib/python2.4/site-packages/ZEO/zrpc/connection.py", line 421, in handle_request

Re: [ZODB-Dev] ZEO cache bug? (again)

2006-06-02 Thread Chris Bainbridge
On 02/06/06, Chris Withers <[EMAIL PROTECTED]> wrote: Tim Peters wrote: > I have nothing new to say about this. As noted multiple times before, > assorted code and internal comments contradict each other about the > intent here. Truly resolving that still requires someone with > knowledge of ca

[ZODB-Dev] POSKeyError in zodb-3.6.0

2006-11-06 Thread Chris Bainbridge
Hi, This looks like a bug to me, but maybe I'm just doing something stupid (possibly it's not allowed to deepcopy a Persistent object and then re-sync the connection?). Try running several instances of the following code in parallel (3 is enough for me here). Seems to be some race condition; I qu

[ZODB-Dev] Re: POSKeyError in zodb-3.6.0

2006-11-06 Thread Chris Bainbridge
The bug I'm getting on the client side is two or more clients simultaneously reporting: Traceback (most recent call last): File "/home/chrb/test_bad.py", line 45, in ? i = g.index(random.choice(g)) File "/usr/lib/python2.4/UserList.py", line 78, in index def index(self, item, *args): retu

[ZODB-Dev] Re: POSKeyError in zodb-3.6.0

2006-11-08 Thread Chris Bainbridge
Hi, This issue results in a corrupted database. Can anyone confirm that they can reproduce this with the test case I provided, so that I can eliminate any potential problems with my setup as being the cause? Thanks, Chris ___ For more information about

[ZODB-Dev] Re: POSKeyError in zodb-3.6.0

2006-11-14 Thread Chris Bainbridge
Hi Alan, Thanks for the advice. I'm using multiple processes, one on each host in a cluster. The extra thread is only used to run the asyncore loop, which allows zodb to receive asynchronous notifications. I've been playing around with your suggestions, and found that if I don't run the extra asy

Re: [ZODB-Dev] Re: POSKeyError in zodb-3.6.0

2006-11-15 Thread Chris Bainbridge
Ok, I have the asyncore loop in, I've added explicit transaction begin and aborts, and cleaned up the test case a bit: import thread import asyncore import random from ZEO.ClientStorage import ClientStorage from ZODB import DB from persistent.list import PersistentList from ZODB.POSException impo

[ZODB-Dev] fsrefs.py shows invalid object references when everything is ok?

2006-11-16 Thread Chris Bainbridge
Whilst playing around with fsrefs.py I noticed that it always seems to claim the filestorage has errors, for example after a single commit through a zeo server it says: oid 0x0L persistent.mapping.PersistentMapping last updated: 2006-11-16 15:30:52.943036, tid=0x36994C2E1E3E9DDL refers to invalid

[ZODB-Dev] ZEO shutdown gives: Error in sys.excepthook

2007-11-08 Thread Chris Bainbridge
I have a ZEO application, occasionally on shutdown I see an intermittent error: Unhandled exception in thread started by Error in sys.excepthook: Original exception was: I've got a feeling I've seen this reported before on this mailing list, and it looks the same as the problem here http://osdir

[ZODB-Dev] zeopack requirements?

2007-12-17 Thread Chris Bainbridge
I have a ~9GB live ZEO database. Last night I tried to pack it, but got this error: 2007-12-17T01:27:08 (4179) Error raised in delayed method Traceback (most recent call last): File "/home/user/lib/python/ZODB3-3.7.2-py2.4-linux-i686.egg/ZEO/StorageServer.py", line 1016, in run result = sel

Re: [ZODB-Dev] zeopack requirements?

2007-12-17 Thread Chris Bainbridge
On 17/12/2007, Jim Fulton <[EMAIL PROTECTED]> wrote: > I doubt that taking the database offline would make much difference. > How much memory do you have on the machine? > > How much memory did the server process use before packing? Thanks for your answers (Alan too). The ZEO server is supposed to

[ZODB-Dev] possible race condition in ZODB/lock_file.py?

2007-12-22 Thread Chris Bainbridge
I have a number of processes running on hosts with a common NFS /home. I was using a file on this shared NFS as a ZODB database. I had thought that this wouldn't be a problem, since it would be impossible for any process to open the zodb file while another process has it locked, but the zodb file k

Re: [ZODB-Dev] ZEO Newbie Question

2008-02-19 Thread Chris Bainbridge
On 18/02/2008, Kenneth Miller <[EMAIL PROTECTED]> wrote: > So i've got my ZEO Server running with two zeo clients. One client is > pouring data into the DB, and the other is looking for it to do something > with it. The problem I'm having is that the second client can't see changes > to the DB afte

Re: [ZODB-Dev] ZODB design. Size and saving records

2008-06-22 Thread Chris Bainbridge
2008/6/22 tsmiller <[EMAIL PROTECTED]>: > > ZODB guys, > >record = {'title':"The Grapes of Wrath", 'author':"John > Steinbeck",'publisher':"Randomhouse"} This might be your problem, you need to use a PersistentDict object if you want each record to be an individual entry in the database. I

Re: [ZODB-Dev] difference between RAM and cache in ZODB

2009-03-31 Thread Chris Bainbridge
2009/3/31 Sandra > > For example, my computer have 1 GB RAM, could i have 2 GB objects loaded in > ZODB memory? I don´t well understand what is the cache in ZODB compared to > the RAM. A ZODB client has an in-memory cache in RAM, and an optional on-disk cache. The server stores lots of objects.

Re: [ZODB-Dev] zeodb limitation with zope 2.12

2009-05-14 Thread Chris Bainbridge
2009/5/14 Dganit David : > We are planning  a web application that saves the data of up to 1,000,000 > users. > > I would like to know the limitation of zodb. > > Currently we are using   ClientStorage with zeo, In my experience building a large scale application, ZEO did not scale with my applica

Re: [ZODB-Dev] URGENT: ZODB down - Important Software Application at CERN

2009-05-26 Thread Chris Bainbridge
2009/5/26 Pedro Ferreira : > In any case, it's not such a surprising number, since we have ~73141 > event objects and ~344484 contribution objects, plus ~492016  resource > objects, and then each one of these may contain authors, and fore sure > some associated objects that store different bits of