Re: [ZODB-Dev] ZODB memory problems (was: processing a Very Large file)

2005-05-29 Thread Christian Theune
Am Samstag, den 21.05.2005, 17:38 +0200 schrieb Christian Heimes: Grab the Zope2 sources and read lib/python/OFS/Image.py. Zope's OFS.Image.Image class (and also Zope3's implementation) is using a so called possible large data class (Pdata) that is a subclass of Persistent. Pdata is using

RE: [ZODB-Dev] ZODB memory problems (was: processing a Very Largefile)

2005-06-01 Thread Christian Theune
Am Dienstag, den 31.05.2005, 16:02 -0400 schrieb Chris McDonough: Christian, Can we pick a day next week to have a sprint via IRC? Would you be willing to help write some tests during that sprint? Does next week include saturday/sunday? We just acquired a new client and next week is very

[ZODB-Dev] ZODB blob mini-sprint

2005-06-11 Thread Christian Theune
Hi, I'm awake now and waiting for the U.S. citizens (especially chrism) that are interested in the ZODB blob stuff to get up later and come to IRC on #zodb-dev to discuss the tasks on hand, especially test cases to implement. Cheers, Christian -- gocept gmbh co. kg - schalaunische str. 6 -

[ZODB-Dev] ZODB Blob implementation

2005-06-11 Thread Christian Theune
Hi, I got you on a bad schedule last time. I just wanted to check if you're still interested in having a look at the new Blob implementation of ZODB. Jim especially would appreciate it if you would look at the commit semantics we went for. (If there is anything wrong around, it's my fault.)

RE: [ZODB-Dev] Race condition in basestorage commit locks?

2005-10-05 Thread Christian Theune
Hi Tim, Am Mittwoch, den 05.10.2005, 13:26 -0400 schrieb Tim Peters: I wouldn't call this a race, because nothing here appears to be timing-dependent. This is the code: Right. I mixed up terminology. Sorry. raises an exception. The code does seem to implicitly assume that neither of those

RE: [ZODB-Dev] Race condition in basestorage commit locks?

2005-10-07 Thread Christian Theune
Hi, Am Mittwoch, den 05.10.2005, 14:17 -0400 schrieb Tim Peters: Don't know enough to be sure, but you've seen that the commit-lock code _in_ ZODB is very simple: tpc_begin acquires it, tpc_{abort,finish} releases it, and that's it. I agree it's an error that tpc_abort may not release it if

RE: [ZODB-Dev] Race condition in basestorage commit locks?

2005-10-07 Thread Christian Theune
Am Freitag, den 07.10.2005, 14:44 -0400 schrieb Tim Peters: [Christian Theune] It looks like we have been bitten by a bug in a C-Module for MySQL access. Sometimes it led to a segfault, a halt, or the hang. We can't reproduce it after switching that C-Module anymore. Any theory for how

[ZODB-Dev] Getting all OIDs from a storage.

2006-04-24 Thread Christian Theune
Hi, we are using Zope 3 generations to update ZODBs. Sometimes the default tools that traverse the object tree are not covering all bases. I opened access to the FileStorage index of OIDs so we can iterate over those. (We are ignoring exceptions about POSKeyErrors at one point because we are

Re: [ZODB-Dev] Getting all OIDs from a storage.

2006-04-24 Thread Christian Theune
Am Montag, den 24.04.2006, 10:06 -0400 schrieb Jim Fulton: Christian Theune wrote: Hi, we are using Zope 3 generations to update ZODBs. Sometimes the default tools that traverse the object tree are not covering all bases. I opened access to the FileStorage index of OIDs so we can

Re: [ZODB-Dev] Getting all OIDs from a storage.

2006-04-24 Thread Christian Theune
Hi, Am Montag, den 24.04.2006, 10:48 -0400 schrieb Jim Fulton: Christian Theune wrote: Hmm. Sorry, but could you point out where the API is defined? I might not have looked hard enough. I only found internals to exploit. :( I wish I could. I'm almost certain that Chris McDonough

[ZODB-Dev] Re: [Zope3-dev] Re: ClientStorage vs DemoStorage broken in Zope 3.2?

2006-04-26 Thread Christian Theune
Hi, Am Dienstag, den 25.04.2006, 23:50 -0400 schrieb Tres Seaver: Smells like a fix didn't get forward-ported somehow -- that looks like the same error I helped Tim find and fix for Zope 2. CC'ing the ZODB list just in case anyone there has a better memory. Here is the NEWS.txt entry for

[ZODB-Dev] Re: [Zope3-dev] Re: ClientStorage vs DemoStorage broken in Zope 3.2?

2006-04-26 Thread Christian Theune
Hi again, Am Mittwoch, den 26.04.2006, 08:05 +0200 schrieb Christian Theune: I remembered there was a fix like that. Unfortunately that fix was ported to the 3.6 branch actually. I'm poking around myself a bit more. What I found right now is that BaseStorage accesses an attribute _oid

Re: [ZODB-Dev] Getting all OIDs from a storage.

2006-05-02 Thread Christian Theune
Am Montag, den 01.05.2006, 16:07 -0400 schrieb Stephan Richter: On Monday 01 May 2006 14:14, Jim Fulton wrote: I suggest that: - The storage should be required to return OIDs in the database at aproximately time the call was made. It should be acceptable to omit recent items.

Re: [ZODB-Dev] Clustering ZEO Server with drbd

2006-05-29 Thread Christian Theune
[EMAIL PROTECTED] wrote: Hi folks, I'm looking at making a scalable zope infrastructure, I can scale the ZEO clients and mysql, the only issue is the ZEO server. I have used drbd and heartbeat in the past to create a HA lamp stack. From a technical standpoint, is there any reason I could not

Re: [ZODB-Dev] Adopting ZODB

2006-07-13 Thread Christian Theune
Chris S wrote: I'm trying to adopt some code to use ZODB as its persistence level. I've read the Writing a Persistent Class article (http://www.zope.org/Wikis/ZODB/FrontPage/guide/node3.html#SECTION00035) but how do you persist a class that already inherits another class? Does

Re: [ZODB-Dev] Adopting ZODB

2006-07-13 Thread Christian Theune
Chris S wrote: On 7/13/06, Christian Theune [EMAIL PROTECTED] wrote: Chris S wrote: I'm trying to adopt some code to use ZODB as its persistence level. I've read the Writing a Persistent Class article (http://www.zope.org/Wikis/ZODB/FrontPage/guide/node3.html#SECTION00035

Re: [ZODB-Dev] Adopting ZODB

2006-07-13 Thread Christian Theune
David Binger wrote: On Jul 13, 2006, at 12:55 PM, Chris S wrote: You can always persist (almost) any object, even if it does not subclass from Persistent. However, any changes to the object will not be detected automatically and you would have to either a) reassign the object to the ZODB or

Re: [ZODB-Dev] Adopting ZODB

2006-07-14 Thread Christian Theune
Dieter Maurer wrote: Christian Theune wrote at 2006-7-13 17:13 +0200: ... Is there any ability in ZODB to retroactively wrap objects in a persistence mechanism instead of having to rewrite an entire library to use the Persistent class? You can always persist (almost) any object, even

Re: [ZODB-Dev] Calculating Physical Object Size

2006-08-11 Thread Christian Theune
Marius Gedminas wrote: On Tue, Aug 08, 2006 at 04:19:10PM -0400, Chris S wrote: Is there anyway to determine how much disk space a specific object (including child objects) occupies in filestorage? For argument's sake, I'm assuming farily simplistic structures with no circular references.

Re: [ZODB-Dev] HA Setup and zodb index file of FileStorage

2006-09-21 Thread Christian Theune
Hi, Patrick Gerken wrote: Hello, its funny, like Garth in may this year I am looking into making a HA system with ZEO for an ERP5 deployment. In my case I don't need to care for data replication, all is stored on a SAN considered HA by the customer already. So my data.fs and index and

Re: [ZODB-Dev] Different commit protocols

2006-09-22 Thread Christian Theune
Wolfgang Schnerring wrote: Hi, I'm working with Theuni on the BlobStorage, and am trying to understand the different 2-Phase-Commit protocols that are in use in ZODB at the same time. As I understand it, tpc_* is the old protocol, and prepare/commit is the new protocol. The sequence in

Re: [ZODB-Dev] Re: Anybody using ZODB with no calls to fsync in production?

2006-10-13 Thread Christian Theune
Hi, Lennart Regebro wrote: OK, cool. Anybody feel like implementing it? I might, but I will not have time before february, and people who know the ZODB.code already will probably make a faster and better job. Can you put it on line in some wiki? Maybe I have some time before February. ;)

Re: [ZODB-Dev] Experimental ZODB 3.7 release

2006-11-22 Thread Christian Theune
Hi, from the project management perspective: Does that mean we're on a feature freeze for 3.7? I still have to deal with one bug on windows (which is likely just a problem in the test itself that fails, not in the blob code) until I can merge into the trunk and I'd be very happy to commit this

[ZODB-Dev] ZODB 3.8 and Blobs

2006-11-29 Thread Christian Theune
Hi, it's been about 21 months since work on blobs for ZODB started. I finally sat down today and fixed the last broken test for blobs on windows and merged the branch to the trunk. Christian -- gocept gmbh co. kg - forsterstraße 29 - 06112 halle/saale - germany www.gocept.com - [EMAIL

Re: [ZODB-Dev] Re: ZODB 3.8 and Blobs

2006-11-29 Thread Christian Theune
Hi, Tres Seaver wrote: Christian Theune wrote: Christian Theune wrote: Hi, it's been about 21 months since work on blobs for ZODB started. I finally sat down today and fixed the last broken test for blobs on windows and merged the branch to the trunk. As always, I'm totally ignorant

Re: [ZODB-Dev] Decouple persistence, database, and cache

2006-11-29 Thread Christian Theune
Hi, Jim Fulton wrote: I've created a proposal: http://www.zope.org/Wikis/ZODB/DecouplePersistenceDatabaseAndCache I took some time reading it to day (and trying to spot the problem you mentioned, but I probably failed on that one.) Here are some lightweight questions just for

Re: [ZODB-Dev] trying to use zodb for standalone with python2.5 and windows

2006-12-05 Thread Christian Theune
Hi, bussiere maillist wrote: i've installed zodb, i'am under windows with python2.5 i've dl the source and done python setup.py install the main goal is to use only zodb instead of gadfly (no LIKE in gadfy) for a personnal application. but when it put this code : from ZODB import

[ZODB-Dev] Zope 3 Issue 107

2006-12-18 Thread Christian Theune
Hi, this issue was open since 2002. I have the feeling that we can safely close it for now. Is that feeling right? (See http://www.zope.org/Collectors/Zope3-dev/107) Christian -- gocept gmbh co. kg - forsterstraße 29 - 06112 halle/saale - germany www.gocept.com - [EMAIL PROTECTED] - phone

[ZODB-Dev] Update on 'Random ValueError' bug

2006-12-20 Thread Christian Theune
Hi, I've tried to analyse the situation for this a bit. Some annotations are in http://www.zope.org/Collectors/Zope/2151 and maybe this can trigger more input. Note: I was a bad boy and used ZODB trunk for the analysis and didn't remember that Chris was talking about 2.9.2 until I was done. I

Re: [ZODB-Dev] Update on 'Random ValueError' bug

2006-12-21 Thread Christian Theune
Hi, Chris Withers wrote: Christian Theune wrote: I've tried to analyse the situation for this a bit. Some annotations are in http://www.zope.org/Collectors/Zope/2151 and maybe this can trigger more input. Thanks for looking into this, any help is much appreciated! Note: I was a bad boy

Re: [ZODB-Dev] multiple ZEO db's ?

2007-01-11 Thread Christian Theune
Hi, Am Donnerstag, den 11.01.2007, 09:31 -0800 schrieb Simon Burton: On Thu, 11 Jan 2007 17:53:24 +0100 Andreas Jung [EMAIL PROTECTED] wrote: --On 11. Januar 2007 08:49:31 -0800 Simon Burton [EMAIL PROTECTED] wrote: Do I have any hope of distributing my Persistent objects

Re: [ZODB-Dev] On ZODB for discardable data

2007-01-22 Thread Christian Theune
Am Montag, den 22.01.2007, 22:58 -0500 schrieb Manuel Vázquez Acosta: Hi all, I would like some advice on ZODB for an specific scenario. We're working on a Product that will collect the contents of web pages and find similar ones, and make summaries of its contents. This process involves

Re: [ZODB-Dev] btree.minKey

2007-01-24 Thread Christian Theune
Am Dienstag, den 23.01.2007, 13:30 -0800 schrieb Simon Burton: btree.minKey(t) is documented* to return the smallest key at least as big as t. It seems that if there is no such element it returns the maximum key. So if my set is [1,2] and I do minKey(3) i get 2? Christian -- gocept gmbh

Re: [ZODB-Dev] btree.minKey

2007-01-24 Thread Christian Theune
Am Mittwoch, den 24.01.2007, 10:59 +0100 schrieb Christian Theune: Am Dienstag, den 23.01.2007, 13:30 -0800 schrieb Simon Burton: btree.minKey(t) is documented* to return the smallest key at least as big as t. It seems that if there is no such element it returns the maximum key. So

Re: [ZODB-Dev] Notification in client app when object changed?

2007-01-25 Thread Christian Theune
Am Donnerstag, den 25.01.2007, 09:05 +1000 schrieb David Gould: Hi, I'm working on a system where several client apps connect to a ZEO server. When an object is changed (via commit) I'd like all the clients to be notified so that their gui's can be updated automatically. A callback or

Re: [ZODB-Dev] Making use of the zodb transaction framework outside of zodb?

2007-02-14 Thread Christian Theune
Hi, Am Mittwoch, den 14.02.2007, 23:05 +0100 schrieb Dieter Maurer: Petra Chong wrote at 2007-2-13 18:27 -: ... In the docs I have read that it is possible for non-zodb apps to plug into the transaction framework. However, I am unable to find any specifics as to how to do this. What

Re: [ZODB-Dev] ZODB Birds of a Feather Meeting at PyCon 2007

2007-02-19 Thread Christian Theune
Am Sonntag, den 18.02.2007, 12:05 -0500 schrieb Jim Fulton: I'd like to have a get together at PyCon on Saturday night at 8pm: http://us.pycon.org/TX2007/ZopeObjectDatabaseBoF If you are interested please add your name to the BoF page. /me packs a feathery costume to attend all those

Re: [ZODB-Dev] ZODB load/save tracing

2007-02-24 Thread Christian Theune
Hi, I'm pretty sure there are no hooks around that do what you need. The methods you want to tap into would be store() load*() on the storages. You might want to look into how the BlobStorage was created to make yourself a tracing storage that can be wrapped around an existing storage to

Re: Re[2]: [ZODB-Dev] ZODB load/save tracing

2007-02-25 Thread Christian Theune
Hi, Am Sonntag, den 25.02.2007, 10:17 +0100 schrieb Groszer Adam: Hello Christian, Gosh, that looks simple. A simple decorator pattern on the storage. Well. The storage API isn't as cleanly defined as it could be, but in general the answer is yes. ;) So I shall create a branch, something

[ZODB-Dev] PyPI-Entry

2007-02-28 Thread Christian Theune
Hi, at the sprint we've discovered that the PyPI entry points to the wiki page of ZODB. This seems to be a bad idea in two aspects: - The wiki is pretty slow and buildout trying to find newer versions for ZODB takes a looong time - The wiki is editable by anonymous users and we rely on it to

Re: [ZODB-Dev] PyPI-Entry

2007-02-28 Thread Christian Theune
Am Mittwoch, den 28.02.2007, 09:19 -0600 schrieb Jim Fulton: On Feb 28, 2007, at 8:55 AM, Christian Theune wrote: Hi, at the sprint we've discovered that the PyPI entry points to the wiki page of ZODB. This seems to be a bad idea in two aspects: - The wiki is pretty slow

Re: [ZODB-Dev] PyPI-Entry

2007-02-28 Thread Christian Theune
Hi, Am Mittwoch, den 28.02.2007, 09:19 -0600 schrieb Jim Fulton: On Feb 28, 2007, at 8:55 AM, Christian Theune wrote: Hi, at the sprint we've discovered that the PyPI entry points to the wiki page of ZODB. This seems to be a bad idea in two aspects: - The wiki is pretty slow

[ZODB-Dev] Re: PyPI-Entry

2007-03-01 Thread Christian Theune
Ok, thanks. I've updated the setup.py of ZODB/trunk to refer to this URL and have re-registered it with PyPI. Am Donnerstag, den 01.03.2007, 11:51 -0500 schrieb Jim Fulton: Thanks for doing this. As I mentioned in my note to Christian, I'd like to phase out use of this area for ZODB.

[ZODB-Dev] Re: PyPI-Entry

2007-03-01 Thread Christian Theune
Am Donnerstag, den 01.03.2007, 13:29 -0500 schrieb Jim Fulton: On Mar 1, 2007, at 1:08 PM, Christian Theune wrote: Ok, thanks. I've updated the setup.py of ZODB/trunk to refer to this URL and have re-registered it with PyPI. Am Donnerstag, den 01.03.2007, 11:51 -0500 schrieb Jim

Re: [ZODB-Dev] zeo client patch in connection.py

2007-03-07 Thread Christian Theune
Hi, could you send this again as a patch produced using `diff` against your original sources OR tell us which version of Zope/ZODB you used as the starting point for this patch. Thanks, Christian Am Mittwoch, den 07.03.2007, 08:52 -0600 schrieb Paul Williams: Hi Everyone, We were

[ZODB-Dev] Proposal for optimized blob handling in ZODB

2007-03-07 Thread Christian Theune
I wrote a proposal on optimizing the blob handling even further because I found a couple of issues that are no-gos for a customer that I think I have found reasonable solutions for. See http://wiki.zope.org/ZODB/BlobsZeroCopy I'll start implementing this on a branch waiting for some feedback.

Re: [ZODB-Dev] Proposal for optimized blob handling in ZODB

2007-03-08 Thread Christian Theune
Hi, Am Mittwoch, den 07.03.2007, 21:32 +0100 schrieb Christian Theune: I wrote a proposal on optimizing the blob handling even further because I found a couple of issues that are no-gos for a customer that I think I have found reasonable solutions for. See http://wiki.zope.org/ZODB

Re: [ZODB-Dev] Launchpad project for ZODB

2007-03-16 Thread Christian Theune
Responding to myself ... Am Freitag, den 16.03.2007, 07:52 +0100 schrieb Christian Theune: Am Mittwoch, den 14.03.2007, 14:29 -0400 schrieb Jim Fulton: I've set up a launchpad project for ZODB: https://launchpad.net/zodb/ Please use that to report bugs and propose features

Re: [ZODB-Dev] KeyError / POSKeyError

2007-03-23 Thread Christian Theune
Hi, Can you tell whether you get a KeyError or a POSKeyError? If you get a KeyError, it's likely that the app (Plone) is broken, e.g. during the migration you mentioned. A POSKeyError would (very likely) not talk about a a key like 'fammed-old', so I suspect you don't have a corruption in your

Re: [ZODB-Dev] Re: [Zope3-dev] Re: Community opinion about search+filter

2007-03-25 Thread Christian Theune
Google does somehow also the batching hellfast. Google is a bad partner to compare with when talking about DBMS efficiency. Google allows sloppy and wrong results in trade of for speed. (E.g. they update their indexes distributetly and do allow different results to be returned for your search

Re: [ZODB-Dev] Blob test failure on FreeBSD

2007-03-27 Thread Christian Theune
Thanks for the notice, I'll look into it. Might take a while to get a FreeBSD installed as a sandbox somewhere ... Am Dienstag, den 27.03.2007, 09:11 -0400 schrieb Benji York: A test failure from the Zope 3 buildbot (Python 2.4 on FreeBSD):

Re: [ZODB-Dev] Blob test failure on FreeBSD

2007-03-27 Thread Christian Theune
Yup. Thought about that too. Who's the owner of the machine? Can he verify that it's a 64 bit machine? Am Dienstag, den 27.03.2007, 11:07 -0400 schrieb Benji York: Gary Poster wrote: FWIW, It smells more like a 64 bit vs. 32 bit machine/OS question, but that's just on the basis of

Re: [ZODB-Dev] Blob test failure on FreeBSD

2007-03-27 Thread Christian Theune
Am Dienstag, den 27.03.2007, 12:44 -0400 schrieb Benji York: Christian Theune wrote: Who's the owner of the machine? You might know him. A guy by the name of Thomas Lotze. :) Nope. That's the buildbot that has been offline for ages. ;) The failing one is 'tmiddleton'. :) -- gocept gmbh

Re: [ZODB-Dev] Blob test failure on FreeBSD

2007-03-27 Thread Christian Theune
Ok, I'll try to figure out whether this happens on 64bit linux tomorrow. After that I can try 32bit Freebsd, otherwise I have to guess. Christian Am Dienstag, den 27.03.2007, 14:16 -0400 schrieb Benji York: Christian Theune wrote: Am Dienstag, den 27.03.2007, 12:44 -0400 schrieb Benji York

Re: [ZODB-Dev] Blob test failure on FreeBSD

2007-03-28 Thread Christian Theune
Ok, it was just a 64-bit int/longint issue. I've fixed the test, the buildbot is passing again. Christian Am Mittwoch, den 28.03.2007, 01:06 +0200 schrieb Christian Theune: Ok, I'll try to figure out whether this happens on 64bit linux tomorrow. After that I can try 32bit Freebsd

Re: [ZODB-Dev] zeo cache hang?

2007-04-02 Thread Christian Theune
Is your disk ok? The cache reads from the file, the other thread is in asyncore. I can imagine the read from the file to block because of some IO problems ... I don't exactly see that the second thread hangs as well. Christian -- gocept gmbh co. kg - forsterstraße 29 - 06112 halle/saale -

Re: [ZODB-Dev] Cleaning up storage interfaces

2007-04-24 Thread Christian Theune
Hi, Am Dienstag, den 24.04.2007, 13:16 -0400 schrieb Jim Fulton: I'm finally trying to clean up the storage interfaces. I have a question. I'll probably have more later, but I'm going to deal with them one by one rather than trying to save them up. Does anyone know if getSerial is

Re: [ZODB-Dev] another reason to stop supporting versions

2007-04-25 Thread Christian Theune
Hi, Am Dienstag, den 24.04.2007, 17:01 -0400 schrieb Jim Fulton: I'm 99.9% sure that version commit and abort are broken in ZODB.DB. The commit methods in CommitVersion, and AbortVersion (and TransactionalUndo) call invalidate on the databse too soon -- before the transaction has

Re: [ZODB-Dev] Implementing Storage Decorators

2007-05-05 Thread Christian Theune
Am Freitag, den 04.05.2007, 23:54 -0400 schrieb Jim Fulton: All of the examples I mentioned can be handled very well with a decorator model. Yup. My experience with using the proxy approach for is good as well (I worked on the BlobStorage). I'm kind of leaning towards using a proxy approach

Re: [ZODB-Dev] Heads up on some clean ups

2007-05-06 Thread Christian Theune
Am Samstag, den 05.05.2007, 16:50 -0400 schrieb Jim Fulton: I'm getting rid of the DB and Connection synch and mvcc options in open(). These were a bit silly (be stupid options) and complicated the code. AFAICT, they are only used by tests and I've re-factored the the relevant tests to

[ZODB-Dev] Failing tests of ZODB on Linux 64-bit

2007-05-09 Thread Christian Theune
Hey, my new buildbot just discovered this: Failure in test test32 (BTrees.tests.testBTrees.FamilyTest) Traceback (most recent call last): File /usr/lib64/python2.4/unittest.py, line 260, in run testMethod() File /data/buildbot/slave/ZODB/build/src/BTrees/tests/testBTrees.py, line 1712,

[ZODB-Dev] blob todos

2007-06-08 Thread Christian Theune
Hi, (this goes mostly to Jim) I just noticed that the blob.py has a todo list at the end of it. We shouldn't let it stay there. Here are some comments about the various entries: # To do: # # Production # # - Ensure we detect and replay a failed txn involving blobs forward or #

Re: [ZODB-Dev] blob todos

2007-06-08 Thread Christian Theune
Hi, Am Freitag, den 08.06.2007, 13:13 -0400 schrieb Jim Fulton: FileStorage doesn't play anything forward on startup. It does throw away partial or uncommitted transactions. I don't see any significant harm in leaving extra blob files around and they would eventually be removed

[ZODB-Dev] Large egg vs small egg

2007-07-25 Thread Christian Theune
Hi, while wading through some zope.* eggs I found that the ZODB is referenced in a couple of places that triggers pulling in: 1. The whole of ZODB, although only a small part is needed 2. A bit of dependencies (if I read zope.interface, zope.proxy, ZConfig, zdaemon) although the parts that

[ZODB-Dev] Import/Export code

2007-08-15 Thread Christian Theune
Hi, unfortunately the history in SVN doesn't go back far enough to answer my question. I stumbled over a problem while importing a ZEXP file and found this code in ExportImport.py, around line 177/178: pfile = StringIO(data) unpickler = Unpickler(pfile)

Re: [ZODB-Dev] [Persistent] STICKY mechanism unsafe

2007-08-20 Thread Christian Theune
Hi, just for my understanding: we don't get bitten by this because Zope uses the ThreadTransactionManager which keeps objects within one thread (at one time)? Christian ___ For more information about ZODB, see the ZODB Wiki:

Re: [ZODB-Dev] [Persistent] STICKY mechanism unsafe

2007-08-20 Thread Christian Theune
Am Montag, den 20.08.2007, 10:45 -0400 schrieb Jim Fulton: On Aug 20, 2007, at 2:25 AM, Christian Theune wrote: Hi, just for my understanding: we don't get bitten by this because Zope uses the ThreadTransactionManager which keeps objects within one thread (at one time)? Dieter

[ZODB-Dev] Proposal for better object cache

2007-08-20 Thread Christian Theune
Hi, Jim pointed out an idea for a better object cache when he was in Potsdam (at least IIRC). I've picked that idea up and converted it into a proposal at http://wiki.zope.org/ZODB/ClassifyingObjectCache I'd be happy to work on that when I have some rd time.

[ZODB-Dev] 2 bugs that block 3.8 + 6 undecided bugs

2007-08-29 Thread Christian Theune
Hi, there are two bugs that are marked high priority and 6 bugs that are new and have an undecided priority. I can fix the blob-related bug of the blockers if someone agrees on my plans. Today I reviewed a few others and put them on medium or low. Can someone please help: - review the

[ZODB-Dev] Re: 2 bugs that block 3.8 + 6 undecided bugs

2007-08-29 Thread Christian Theune
Hi, Am Mittwoch, den 29.08.2007, 21:21 -0400 schrieb Tres Seaver: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Christian Theune wrote: Hi, there are two bugs that are marked high priority and 6 bugs that are new and have an undecided priority. I can fix the blob-related bug

Re: AW: [ZODB-Dev] diploma thesis: ZODB Indexing

2007-09-05 Thread Christian Theune
Am Mittwoch, den 05.09.2007, 09:24 -0400 schrieb Jim Fulton: I'd like to see a generic framework for defining collections and indexes in Python and querying them efficiently. No ZODB expertise should be needed, I have the feeling you already pondered this a bit and have some more specific

Re: AW: [ZODB-Dev] diploma thesis: ZODB Indexing

2007-09-05 Thread Christian Theune
both on the list and in our office, I'll try to find a better mode. Hints and tips are welcome. Am Mittwoch, den 05.09.2007, 09:55 -0400 schrieb Jim Fulton: On Sep 5, 2007, at 9:39 AM, Christian Theune wrote: Am Mittwoch, den 05.09.2007, 09:24 -0400 schrieb Jim Fulton: I'd like to see

Re: [ZODB-Dev] Re: AW: diploma thesis: ZODB Indexing

2007-09-05 Thread Christian Theune
Hi, Am Mittwoch, den 05.09.2007, 21:47 +0100 schrieb Laurence Rowe: Make sure you take a look at SQLAlchemy's implementation of this, sqlalchemy.orm.query. Thanks for the tip. RDBMS do not get fast querying for free... They just revert to a complete record scan when they do not have an

Re: [ZODB-Dev] Get physical path by oid

2007-10-10 Thread Christian Theune
Am Mittwoch, den 10.10.2007, 13:33 +0400 schrieb Andrew Ermakov: Hi to all! I have problem with ZODB at Zope3. The task is to get physical path of object by its oid 0x011d. It was getPhysicalPath at Zope2... But there is not at Zope3. How can I resolve this problem with zope3 running in

[ZODB-Dev] Found reason for long-standing __getstate__ issue with ZEO

2007-10-10 Thread Christian Theune
See: https://bugs.edge.launchpad.net/zodb/3.9/+bug/98275 -- gocept gmbh co. kg - forsterstrasse 29 - 06112 halle/saale - germany www.gocept.com - [EMAIL PROTECTED] - phone +49 345 122 9889 7 - fax +49 345 122 9889 1 - zope and plone consulting and development signature.asc Description: Dies

Re: [ZODB-Dev] Re: ZODB Benchmarks

2007-11-02 Thread Christian Theune
Hi, Am Freitag, den 02.11.2007, 09:56 -0400 schrieb David Binger: On Nov 2, 2007, at 8:39 AM, Lennart Regebro wrote: On 11/2/07, Matt Hamilton [EMAIL PROTECTED] wrote: That may just end up causing delays periodically in transactions... ie delays that the user sees, as opposed to

Re: [ZODB-Dev] Bugs reviewed

2007-11-06 Thread Christian Theune
Hi, Am Mittwoch, den 07.11.2007, 01:29 -0500 schrieb Stephan Richter: Hi, Jim asked, if someone could review the open bugs that need to be addressed before a final ZODB 3.8 release. Here is what I have found: [...] I'm on a cleanup sprint for Friday to Sunday and am planning to spend my

[ZODB-Dev] Decide about `after commit hooks` regarding abort

2007-11-09 Thread Christian Theune
Hi, this bug https://bugs.edge.launchpad.net/zodb/+bug/137739 needs a decision whether: - we want after commit hooks to be called on abort (interface documentation and tests contradict each other) - we want to backport this from the trunk to 3.8 Christian -- gocept gmbh co. kg -

[ZODB-Dev] transaction egg refactoring breaks zodb trunk

2007-11-10 Thread Christian Theune
The ZODB trunk is broken after the transaction package was moved: Error in test checkFailingSavepointSticks (ZODB.tests.testZODB.ZODBTests) Traceback (most recent call last): File /home/ctheune/local/python2.4/lib/python2.4/unittest.py, line 260, in run testMethod() File

Re: [ZODB-Dev] Running ZODB on x64 system

2007-12-01 Thread Christian Theune
Am Samstag, den 01.12.2007, 10:09 -0500 schrieb Jim Fulton: On Nov 30, 2007, at 8:04 PM, Matt Feifarek wrote: I submitted this bug: https://bugs.launchpad.net/ubuntu/+source/zodb/+bug/165287 But was not able to compile the package after the recommended patch from esteve. He did

Re: [ZODB-Dev] Running ZODB on x64 system

2007-12-04 Thread Christian Theune
Am Montag, den 03.12.2007, 14:37 -0500 schrieb Jim Fulton: Gah, I misspoke. 3.7 does claim to support Python 2.5 Interesting. The README doesn't state that on the 3.7 branch. Where is this claimed? I'll port the 64-bit fixes if we really do support Python 2.5 in ZODB 3.7. Christian --

Re: [ZODB-Dev] Running ZODB on x64 system

2007-12-05 Thread Christian Theune
Am Mittwoch, den 05.12.2007, 09:30 -0500 schrieb Jim Fulton: On Dec 5, 2007, at 2:30 AM, Christian Theune wrote: Am Montag, den 03.12.2007, 14:37 -0500 schrieb Jim Fulton: Gah, I misspoke. 3.7 does claim to support Python 2.5 Interesting. The README doesn't state that on the 3.7

Re: [ZODB-Dev] adding mount points

2007-12-18 Thread Christian Theune
Hi, Am Dienstag, den 18.12.2007, 01:42 -0800 schrieb Tarek Ziadé: Hi, I am working on a project that needs to do mass hosting of zope sites. I would like to have several site per zope instance, and to make a zodb mount point for each new site created to ease their maintenance. Is there

Re: [ZODB-Dev] ConflictError vs Doom

2008-01-07 Thread Christian Theune
Hi, Am Montag, den 07.01.2008, 07:29 -0500 schrieb Jim Fulton: On Jan 7, 2008, at 5:58 AM, Christian Theune wrote: Hi, I was wondering whether it might be reasonabl to let a ConflictError always doom a transaction. It already does afaik, Hmm. It doesn't seem to, but at least

[ZODB-Dev] Spurious test failures

2008-01-15 Thread Christian Theune
Hi, Thomas and I fixed a ClientCache bug earlier and when running tests (with --all as supposed) we noticed two different tests failing. One of them was checkConcurrentUpdates2Storages (ZEO / FileStorageConnectionTests) the other we can't remember because we lost it in our terminals buffer.

Re: [ZODB-Dev] The write skew issue

2008-01-30 Thread Christian Theune
Hi, Dieter Maurer schrieb: Christian Theune wrote at 2008-1-29 16:32 +0100: ... When I looked up the definitions in Wikipedia about isolation and serializability again I didn't find any hint about the conditions how to decide which ordering is preferred. From Wikipedia (http

Re: [ZODB-Dev] IStorageIteration

2008-02-11 Thread Christian Theune
Hi, On Feb 11, 2008, at 4:19 PM, Christian Theune wrote: Context could be given as a reference date that is opaque to the client and can differ from storage to storage, a file pointer could serve this purpose. The API still might include the `length` of the data returned to minimize round

Re: [ZODB-Dev] IStorageIteration

2008-02-11 Thread Christian Theune
Jim Fulton schrieb: On Feb 11, 2008, at 1:25 PM, Christian Theune wrote: Hi, Jim Fulton schrieb: On Feb 11, 2008, at 1:19 PM, Christian Theune wrote: ... Also, this code isn't ZEO-compatible (apart from the fact that ClientStorage doesn't implement the interface). How so? As far

Re: [ZODB-Dev] IStorageIteration

2008-02-11 Thread Christian Theune
Hi, Jim Fulton schrieb: On Feb 11, 2008, at 1:19 PM, Christian Theune wrote: ... Also, this code isn't ZEO-compatible (apart from the fact that ClientStorage doesn't implement the interface). How so? As far as I understand, ZEO can't pass iterators around directly but needs to provide

[ZODB-Dev] IStorageIteration

2008-02-11 Thread Christian Theune
Hi, the interface IStorageIteration says: class IStorageIteration(Interface): API for iterating over the contents of a storage Note that this is a future API. Some storages now provide an approximation of this. [...] ZODB.FileStorage.FileStorage is the only class in

Re: [ZODB-Dev] Fixing POSKeyErrors :-)

2008-02-14 Thread Christian Theune
Binger David schrieb: On Feb 13, 2008, at 11:28 PM, Paul Winkler wrote: (Jim wrote) Catalogs and session data change much faster than content. It makes sense to pack these more frequently. On large system, it provides the ability to spread load over multiple servers, if necessary.

Re: [ZODB-Dev] Fixing POSKeyErrors :-)

2008-02-18 Thread Christian Theune
Chris Withers schrieb: Jim Fulton wrote: It's a shame ZODB doesn't turn POSKeyErrors into proper Broken objects as it does when the class can no longer be imported. The problem with POSKeyErrors is that they prevent you accessing *any object that refers to the broken object* not just the

Re: [ZODB-Dev] Fixing POSKeyErrors :-)

2008-02-18 Thread Christian Theune
Hi, Chris Withers schrieb: Jim Fulton wrote: If someone can make something like this work without modifying ZODB, I won't object. The only thing I'd like is to be able to: - specify in policy that cross storage references should result in the target object being copied to the storage I

Re: [ZODB-Dev] Removing ThreadedAsync from ZODB

2008-02-18 Thread Christian Theune
Jim Fulton schrieb: ZODB no-longer really uses or needs ThreadedAsync since ZEO added a private asyncore loop for client communication. Therefore, I'm removing ThreadedAsync from ZODB. Does anyone think this will affect them? Not me/us. -- gocept gmbh co. kg - forsterstrasse 29 -

[ZODB-Dev] FileIterator: Unused/wrong edge case

2008-02-18 Thread Christian Theune
Hi, we're working on the last item on our to-do list regarding storage iteration: having iterators pick up transactions that were written after the iteration started. In the `FileIterator` class there exists the following code: if pos + h.tlen + 8 self._file_size: # Hm, the data

Re: [ZODB-Dev] FileIterator: Unused/wrong edge case

2008-02-18 Thread Christian Theune
Note: The specification of storage iteration is gonna change so it explicitly states that it's going to represent the set of transactions as seen from the point where iteration started. Christian Theune schrieb: Hi, we're working on the last item on our to-do list regarding storage

Re: [ZODB-Dev] Fixing POSKeyErrors :-)

2008-02-18 Thread Christian Theune
Chris Withers schrieb: Christian Theune wrote: Okay, so I count two issues: - packing and multiple mounted storages - POSKeyErrors resulting in failure to load referring object rather than creation of a broken referred object Where would you like me to file these bug reports? How

[ZODB-Dev] restore versus invalidation

2008-02-22 Thread Christian Theune
Hi, I'm working on getting `restore` working for ClientStorage. I'm not sure how invalidation should integrate here. The existing invalidation framework looks like it is only intended to invalidate current records, but not records that have an end_tid given already. This seems the core of

Re: [ZODB-Dev] Re: become a ZODB mentor in the Google Summer of Code!

2008-03-04 Thread Christian Theune
Martijn Faassen schrieb: Hey, Martijn Faassen wrote: It would be great if we put our community's secret gem, the ZODB, into the limelight more, and the Google Summer of Code would be a great opportunity. We need mentors, and fast, so if you want to mentor someone, please sign up in this

Re: [ZODB-Dev] Zeo Server as a single point of failure

2008-03-10 Thread Christian Theune
Hi, On Mon, Mar 10, 2008 at 05:34:59PM -0500, Kenneth Miller wrote: Hello all, I'm currently developing my application ontop of zodb/zeo, and the idea of having the Zeo server the only single point of failure still bothers me. My question is, has anyone thought of any solutions for

  1   2   3   >