Re: [ZODB-Dev] 8-byte oids

2009-08-13 Thread Christian Theune
ids are 8 bytes. I'm tempted to say that >> oids must be 8-byte strings. > > +1. The simplified standard promotes interoperability. The difference to the spec before would be that previously strings with less than 8 bytes were allowed? - -- Christian Theune · c...@gocept.co

Re: [ZODB-Dev] 8-byte oids

2009-08-13 Thread Christian Theune
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 08/14/2009 08:36 AM, Christian Theune wrote: > On 08/13/2009 10:42 PM, Shane Hathaway wrote: >> Jim Fulton wrote: >>> IPersistent specifies OIDs to be non-empty strings and reserves the >>> 8-byte OID consisting of 8 nul

Re: [ZODB-Dev] Utility to strip version records from storages

2009-08-15 Thread Christian Theune
ped but the associated blob files will be left. This is > so unlikely that I don't intend to spend time dealing with this > possibility. Hmm. I guess that those would vanish automatically after packing that database... - -- Christian Theune · c...@gocept.com gocept gmbh & co.

Re: [ZODB-Dev] CRC check failed when running repozo

2009-09-14 Thread Christian Theune
, in _read > self._read_eof() >File "/usr/local/lib/python2.4/gzip.py", line 309, in _read_eof > raise IOError, "CRC check failed" > IOError: CRC check failed > > Zope 2.9.8... Hmm. Haven't seen that. My guess would be some low-level data c

[ZODB-Dev] Why is CHANGES.txt in src/?

2009-09-15 Thread Christian Theune
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi, is there a reason why ZODB's "CHANGES.txt" lives in ZODB/src/ instead of ZODB/ as in other packages? I keep tripping over this and wonder whether it's accidental or intentional. Christian - -- Christian Theune · c...@go

Re: [ZODB-Dev] Why is CHANGES.txt in src/?

2009-09-15 Thread Christian Theune
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 09/15/2009 01:12 PM, Jim Fulton wrote: > On Tue, Sep 15, 2009 at 7:03 AM, Christian Theune wrote: >> is there a reason why ZODB's "CHANGES.txt" lives in ZODB/src/ instead of >> ZODB/ as in other packages? > &g

Re: [ZODB-Dev] zodb 3.8.3 strip_versions missing some versions?

2009-11-02 Thread Christian Theune
e's a size argument following the version which probably is not being passed as a keyword argument so it looks like a slight API incompatibility. I wonder whether ZEORaid should hack around that or whether the caller should be changed. Christian -- Christian Theune · c...@gocept.com gocept gm

Re: [ZODB-Dev] ZODB 3.9.3 history call causing problems for storages that still accept version parameters

2009-11-02 Thread Christian Theune
On 11/02/2009 10:47 AM, Chris Withers wrote: > Christian Theune wrote: >> There's a size argument following the version which probably is not >> being passed as a keyword argument so it looks like a slight API >> incompatibility. I wonder whether ZEORaid should hack aro

Re: [ZODB-Dev] Test time on 3.9 branch - windows?

2009-11-02 Thread Christian Theune
t;> >> Feel my windows pain. > > Do the tests take much less time to run on Linux? > If so, any idea as to why? I remember running them in less than 20 minutes. -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany h

[ZODB-Dev] ZEORaid discussions

2009-11-09 Thread Christian Theune
Hi, we're currently discussing some issues in ZEORaid on a separate list and we're actually wondering whether it would be ok to fold that into the zodb-dev list - it's pretty low volume overall but triggers some interesting general ZODB questions here and there. Cheers, Christian

[ZODB-Dev] Fwd: Packing and GC versus packtime

2009-11-09 Thread Christian Theune
Posted to the wrong list initially. Sorry. Original Message Subject: Packing and GC versus packtime Date: Mon, 09 Nov 2009 13:22:04 +0100 From: Christian Theune To: zope-...@zope.org Newsgroups: gmane.comp.web.zope.devel Hi, I'm wondering: Scenario 1: I pack a storage

[ZODB-Dev] StorageServer's waiting list

2009-11-09 Thread Christian Theune
to be merely an optimization (which I can disable by just letting tpc_transaction return None all the time). Why is the waiting list necessary? And why does it work alright in a ZEO fan-out scenario? Christian -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06

Re: [ZODB-Dev] StorageServer's waiting list

2009-11-09 Thread Christian Theune
Hi, On 11/09/2009 05:01 PM, Jim Fulton wrote: > On Mon, Nov 9, 2009 at 9:25 AM, Christian Theune wrote: > ... >> Reading the code talking to tpc_transaction I found that this seems to >> be merely an optimization (which I can disable by just letting >> tpc_transaction

Re: [ZODB-Dev] StorageServer's waiting list

2009-11-12 Thread Christian Theune
other calls in parallel over its connection as it's put in the waiting list on S. What I'm trying to point out in my above scenario is that ZEO2 will block all calls as it's not in the waiting list of ZEO2 but on ZEO. Christian -- Chris

[ZODB-Dev] Using a storage that is also handled by StorageServer

2009-11-12 Thread Christian Theune
ed from code that doesn't need to know that a storage is being wrapped in such a way. If you think we can go down that route in general, then I'll prepare a more detailed proposal including making a draft implementation. Christian -- Christian Theune · c...@gocept.com gocept gmbh &

Re: [ZODB-Dev] [OT] NoSQL

2009-11-13 Thread Christian Theune
DB. The applications we write are intended to run consistently without having application-level (or even user-based) reconciliation work to do if a transaction came through. Apart from the stores being hip ... what problems are you trying to solve? Christian -- Christian Theune · c...@gocept.co

Re: [ZODB-Dev] blobs for noobs

2009-11-16 Thread Christian Theune
mples. Yes, same here. Actually it even has readable documentation about the various options in there already. -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany http://gocept.com · tel +49 345 1229889 0 · fax +49 345 1229889 1 Zope and Plon

Re: [ZODB-Dev] repozo uses md5 lib, which is deprecated in python 2.6

2009-11-18 Thread Christian Theune
only targeted at Python 2.5 and above, right? Not sure about that. Most people I see that need to support 2.4 and 2.6 tend to provide a wrapper-function combined with a conditional import. > - Does repozo have any tests? If so, how do I run them. Looking around I found this: scripts/manual_tes

Re: [ZODB-Dev] ZODB 3.9.3 history call causing problems for storages that still accept version parameters

2009-11-19 Thread Christian Theune
> assert version is '' > > There is no ZEOStorage instance involved in this as far as I can tell. > What am I missing? Check the "setup_delegation" method: the history method is patched through directly so your traceback doesn't see the ZEOStorage anymore. --

Re: [ZODB-Dev] 3.9.4 release?

2009-11-20 Thread Christian Theune
lost confidence. I think I just found a way to fix this particular issue on the ZODB-level for good. I re-opened https://bugs.edge.launchpad.net/zodb/+bug/240381 and assigned it to myself. I'll see if I can do something over the weekend. Christian -- Christian Theune · c...@gocept.com goc

[ZODB-Dev] Priorities?

2009-11-21 Thread Christian Theune
plete". I find those thoughts to be relatively obvious, but I'd rather not keep "contributing" in my spare time with things that aren't of "priority" to the project. And again: asides from the (to me) obvious cleaning of the bug database. What are the prioriti

Re: [ZODB-Dev] newbie ZEO first try. ConflictError.

2009-11-26 Thread Christian Theune
actor for the sleep (e.g. between 0.2 and 0.3) then you'll have a lesser chance of subsequent conflicts in your example because all your transactions are very similar. In real life transactions would be distinct enough to cause different offsets in runtime. Hope this h

Re: [ZODB-Dev] newbie ZEO first try. ConflictError.

2009-11-26 Thread Christian Theune
usually handled by re-trying the *whole* transaction once more. E.g. in Zope it means: - abort the transaction - start a new transaction - process the request as it was again If it fails for three times then Zope gives up and hands the conflict error to the user. Christian -- Christian Theu

Re: [ZODB-Dev] Repozo tests -- not

2009-12-02 Thread Christian Theune
ce "non-crap". Two thoughts: 1. The ZODB as a project probably needs someone who fulfills a multiplier role like Martijn Faassen does in many instances. 2. There seems to be the (hidden) assumption around that Jim should be doing that. I think this causes a good amount of the

Re: [ZODB-Dev] Data.fs size grows non-stop

2009-12-07 Thread Christian Theune
pool comes from some replica and WRITE is to the master. > I'm unsure this pattern would work for ZODB. I know Malthe was thinking > about this but unsure if he had anything concrete. My guess: have a ZEO fan-out setup and configure the read pool ZEO servers as read-only. Any transac

Re: [ZODB-Dev] Repozo tests -- not

2009-12-08 Thread Christian Theune
till hard to deal with except if you have really good block-level de-duplication in your filesystem. (Uhmm. I guess ZFS probably has all of that. It also probably serves my dinner.) Christian -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) ·

Re: [ZODB-Dev] Repozo tests -- not

2009-12-08 Thread Christian Theune
On 12/09/2009 02:25 AM, Shane Hathaway wrote: > Christian Theune wrote: >> Not exactly: it's still a good idea to store away deltas as single large >> files are still hard to deal with except if you have really good >> block-level de-duplication in your filesystem. (Uhm

Re: [ZODB-Dev] Data.fs size grows non-stop

2009-12-09 Thread Christian Theune
On 12/09/2009 04:58 PM, Pedro Ferreira wrote: > >> OOBTrees are complex? >> > No, I meant something list-like, rather than key-value. zc.blist implements a BTree-based list. -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle

Re: [ZODB-Dev] zodbupdate branch sylvain-persistent-load

2010-02-02 Thread Christian Theune
old version is happily there in SVN. IIRC you hadn't updated all unit tests last time, did you catch up with that yet? Otherwise, feel free to merge and release. Christian -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany http://gocept

Re: [ZODB-Dev] zodbupdate branch sylvain-persistent-load

2010-02-02 Thread Christian Theune
On 02/02/2010 11:17 AM, Sylvain Viollon wrote: > On Tuesday 02 February 2010 09:08:42 Christian Theune wrote: >> Hi, >> >> > > Hello, > >> I think I'm fine with your approach in general by now. I don't have the >> time to review anyth

Re: [ZODB-Dev] zodbupdate branch sylvain-persistent-load

2010-02-02 Thread Christian Theune
On 02/02/2010 03:58 PM, Sylvain Viollon wrote: > On Tue, 02 Feb 2010 11:30:41 +0100 > Christian Theune wrote: > > > Hello, > >> Meh. That looks quirky in the history. If there are no changes, then >> the merge will be straight-forward. >> > > I m

Re: [ZODB-Dev] zodbupdate branch sylvain-persistent-load

2010-02-02 Thread Christian Theune
On 02/02/2010 05:00 PM, Sylvain Viollon wrote: > On Tue, 02 Feb 2010 16:44:19 +0100 > Christian Theune wrote: > >> On 02/02/2010 03:58 PM, Sylvain Viollon wrote: >>> On Tue, 02 Feb 2010 11:30:41 +0100 >>> Christian Theune wrote: >>> >>>

Re: [ZODB-Dev] ZODB 3.10.0a1 released

2010-02-08 Thread Christian Theune
a change to the way that file-storage > indexes are saved leading to make improvements in save and load times > and a 30% reduction in index file size. That's good news. Thanks for all the work! -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle

Re: [ZODB-Dev] zeoraid + plone 3.3.4

2010-02-17 Thread Christian Theune
AIDStorage -> other backends (typically the second row of ZEO servers) The correct ZODB versions are: Zope Server = ZODB 3.6+ ZEO Servers w/ and w/o ZEORAID = ZODB 3.9 If you have those configurations and they don't work, then a specific error report would help. Christian -- Christian Th

Re: [ZODB-Dev] zeoraid + plone 3.3.4

2010-02-18 Thread Christian Theune
On 02/18/2010 03:22 PM, Diego Acevedo wrote: > On Wed, Feb 17, 2010 at 5:20 PM, Christian Theune <mailto:c...@gocept.com>> wrote: > > On 02/17/2010 06:15 PM, Diego Acevedo wrote: > > Hello everybody. I have a problem with zeoraid + plone (I ask for the >

Re: [ZODB-Dev] zeoraid + plone 3.3.4

2010-02-18 Thread Christian Theune
On 02/18/2010 03:42 PM, Diego Acevedo wrote: > > > On Thu, Feb 18, 2010 at 11:25 AM, Christian Theune <mailto:c...@gocept.com>> wrote: > > On 02/18/2010 03:22 PM, Diego Acevedo wrote: > > On Wed, Feb 17, 2010 at 5:20 PM, Christian Theune <mailto:c

Re: [ZODB-Dev] Get rid of zope.proxy dependency

2010-03-05 Thread Christian Theune
till need the proxy-based implementation class? If we do, then > I plan to at least switch to using a simple pure-python proxying > mechanism. If no one speaks up in favor of keeping the proxying > support, I'll probably just drop it. +1 from here, too. -- Christian Theune · c...@gocept.com

Re: [ZODB-Dev] Testing gocept.zeoraid

2010-03-22 Thread Christian Theune
p (that would be too easy). > > Done in the correct order that seems to work fine. But I need to do > more testing. Yeah, sounds like a bug. Do you mind reporting that into launchpad? Christian -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße

Re: [ZODB-Dev] ConflictErrors

2010-03-24 Thread Christian Theune
re running something that turns read-requests into write-requests which is a bad idea. I remember old Plone version to have issues with that. The Plone people have figured this out in general and there's probably nothing wrong with the ZODB in your case. I suggest asking some Plone people

Re: [ZODB-Dev] Using zodb and blobs

2010-04-13 Thread Christian Theune
told him he'll receive some good for that then I'd rather stick with compliant transactions. > I am almost tempted to do > > os.fsync = lambda fd: 0 > > and rely on yesterday's backup. 0.49 j/k. j/k? -- Christian Theune · c...@gocept.com gocept gmbh & co

Re: [ZODB-Dev] Using zodb and blobs

2010-04-13 Thread Christian Theune
terfered with by other applications writing to the disk. It's a notebook w/ Intel P9600, Seagate 7.2k SATA drive, 4GB RAM, Ubuntu 10.04, linux 2.6.32, ext4 Christian -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany htt

Re: [ZODB-Dev] Using zodb and blobs

2010-04-15 Thread Christian Theune
goes hardly over a 1000. Well, sounds like a broken fsync then. :/ -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany http://gocept.com · tel +49 345 1229889 0 · fax +49 345 1229889 1 Zope and Plone consulting and

Re: [ZODB-Dev] RFC: compatibility of ZEO clients and servers running different Python versions

2010-04-20 Thread Christian Theune
cally aim running ZEO servers and clients at the same Python version. For upgrading purposes it would be nice to have your conclusion available to developers/admins so they can figure out (or we can tell them) a reasonable upgrade path. Christian -- Christian Theune · c...@gocept.co

Re: [ZODB-Dev] ZEO monitor server

2010-05-04 Thread Christian Theune
anyone object > if it went away, to be replaced by a server method on the standard > ZEO protocol? I keep meaning to use it and I think I'd do that sooner if it became part of the standard protocol. -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 ·

Re: [ZODB-Dev] repozo full backup and index files

2010-05-14 Thread Christian Theune
this? Hmm. If the full backup is just a regular FS file then you could start with the naive approach and just open/close it once after performing a backup as that would create the index file. -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saa

Re: [ZODB-Dev] Passing thought: It would be interesting at the application level to have a measure of database record size

2010-05-14 Thread Christian Theune
ttribute as an indicator for the size-based cache? -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany http://gocept.com · tel +49 345 1229889 0 · fax +49 345 1229889 1 Zope and Plone consulti

Re: [ZODB-Dev] Multiple independant ZODB

2010-05-14 Thread Christian Theune
nsaction manager and thus get different transactions with as many databases as you like. Christian -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany http://gocept.com · tel +49 345 1229889 0 · fax +49 345 1229889

Re: [ZODB-Dev] Storage iterators and IndexError

2010-05-15 Thread Christian Theune
thought was backwards compatibility to something and the docstring of the StorageStopIteration says so but doesn't tall for what. Sounds like support for old clients but I can't say for which use case. Christian -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · f

Re: [ZODB-Dev] Notes on using wrapper storages for record transformation

2010-05-18 Thread Christian Theune
hose the later because it was more flexible. I think I > would have run into the same issues without a wrapper storage. > > Soon I expect to release a wrapper storage implementation that > provides record compression. Cool! :) -- Christian Theune · c...@gocept.com gocept gmbh &

Re: [ZODB-Dev] ZEORaid was Re: Restoring from repozo and reusing an index file?

2010-06-11 Thread Christian Theune
us bug WRT oid generation that I hope to hunt down in August. Christian -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany http://gocept.com · tel +49 345 1229889 0 · fax +49 345 1229889 1

Re: [ZODB-Dev] ZEORaid was Re: Restoring from repozo and reusing an index file?

2010-06-12 Thread Christian Theune
On 06/12/2010 09:47 AM, Chris Withers wrote: > Christian Theune wrote: >> On 06/11/2010 05:50 PM, Alan Runyan wrote: >>>>> I suppose you could look at zeoraid. >>>> Hadn't thought of that, will look at it, thanks! >>> Anyone using ZEORaid in produ

Re: [ZODB-Dev] ZEORaid was Re: Restoring from repozo and reusing an index file?

2010-06-20 Thread Christian Theune
On 06/18/2010 01:17 PM, Chris Withers wrote: > Christian Theune wrote: >>>>>> and a >>>>>> mysterious bug WRT oid generation >>>>> This one's new to me, where can I find out more? >>>> >>>> The one you reported qu

Re: [ZODB-Dev] I released 3.10.0b2 this morning

2010-07-13 Thread Christian Theune
Morning, On 07/13/2010 09:11 PM, Jim Fulton wrote: > I need to get back to finishing 3.10. :) Heh. Are any particular bugs you'd like to get solved? Today is a bug day and I might look at one or two. Christian -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · fors

[ZODB-Dev] ZEO in v3.10 with older clients and older Python

2010-07-29 Thread Christian Theune
Hi, ZEO in version 3.10 is supposed to work with older clients. Is it also intended to work with older clients running Python 2.4? The server needs to run on Python 2.5 due to the with statement. Christian -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 0

Re: [ZODB-Dev] ZEO in v3.10 with older clients and older Python

2010-07-29 Thread Christian Theune
On 07/29/2010 02:42 PM, Hanno Schlichting wrote: > On Thu, Jul 29, 2010 at 1:20 PM, Christian Theune wrote: >> ZEO in version 3.10 is supposed to work with older clients. Is it also >> intended to work with older clients running Python 2.4? The server needs >> to run on Pytho

Re: [ZODB-Dev] ZEO in v3.10 with older clients and older Python

2010-07-29 Thread Christian Theune
On 07/29/2010 02:55 PM, Hanno Schlichting wrote: > On Thu, Jul 29, 2010 at 2:49 PM, Christian Theune wrote: >> On 07/29/2010 02:42 PM, Hanno Schlichting wrote: >>> The docs explicitly state that Python 2.4 is no longer supported at all. >>> >>> Go with

Re: [ZODB-Dev] ZEO in v3.10 with older clients and older Python

2010-07-29 Thread Christian Theune
On 07/29/2010 03:03 PM, Hanno Schlichting wrote: > On Thu, Jul 29, 2010 at 2:57 PM, Christian Theune wrote: >> Thanks for digging this out. I'll try to find the discussion and refresh my >> memory. > > See for example your response here > https://mail.zope.org/piperma

Re: [ZODB-Dev] ZEO in v3.10 with older clients and older Python

2010-07-29 Thread Christian Theune
On 07/29/2010 03:02 PM, Jim Fulton wrote: > On Thu, Jul 29, 2010 at 7:20 AM, Christian Theune wrote: >> ZEO in version 3.10 is supposed to work with older clients. Is it also >> intended to work with older clients running Python 2.4? > > No, see: > > https://mail.zope.

Re: [ZODB-Dev] 3.10 final?

2010-08-31 Thread Christian Theune
any issues that > need to be dealt with before the final release. The community could help > by gardening the tracker -- especially since the tracker recently > got a bunch of old issues from the Zope 2 tracker. :) Sounds like a job I'd like for the upcoming sprint after the co

Re: [ZODB-Dev] Storage API change: Checking for reading out-of-date data

2010-08-31 Thread Christian Theune
al with those situations properly. (Although I'd rather see code like above not getting written at all on the application level.) Christian -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · german

Re: [ZODB-Dev] 3.10.0b6 traceback

2010-09-12 Thread Christian Theune
e beta! I hope we're > getting close to a final release, and, of course, testing the betas is > very helpful. :) Did the tracebacks make it into the bug database? If yes, can someone provide references to them in the mailing list FTR? Christian -- Christian Theune · c...@gocept.com goce

Re: [ZODB-Dev] ZODB 3.10.0 released

2010-10-08 Thread Christian Theune
On 10/08/2010 08:56 PM, Jim Fulton wrote: > ZODB 3.10.0 is available: W00t! -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany http://gocept.com · tel +49 345 1229889 0 · fax +49 345 1229889 1 Zope and Plone consulting and deve

Re: [ZODB-Dev] zodb 3.9.6 performance tuning?

2010-10-12 Thread Christian Theune
cess, according to top, but even > that's only 30% of the CPU load... Has ZEORaid been in place before the update, too? Christian -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany

Re: [ZODB-Dev] zodb monitor port / tailing a .fs

2010-10-14 Thread Christian Theune
) > > I wonder how hard it'd be to add some kind of start-at-the-end feature > to fstail? With the new iterators that start scanning from the back that shouldn't be too hard. -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale)

Re: [ZODB-Dev] tid vs. serial

2010-10-18 Thread Christian Theune
difference >> between them. > > I wonder what he meant. Me too, I still had a distinction in my head back from the 2005 sprint that they are somewhat similar but different. Looks like I never got the signal that we actually consider them to be the same. At least that's cle

Re: [ZODB-Dev] Status of gocept.zeoraid

2010-10-20 Thread Christian Theune
gular ZODB) is a managed area like the data in your Data.fs. (You wouldn't go editing that data with your editor, would you?) Christian -- Christian Theune · c...@gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany http://gocept.com · tel +49 345 1229889 0 · fax

Re: [ZODB-Dev] Status of gocept.zeoraid

2010-10-20 Thread Christian Theune
On 10/20/2010 09:46 PM, Christian Theune wrote: > On 10/20/2010 07:11 PM, Chris Withers wrote: >> On 20/10/2010 17:03, Sylvain Viollon wrote: >>> One of my customers would like to use gocept.zeoraid in production. >>> So him, and I have some questions: >>

Re: [ZODB-Dev] ZODB memory problems (was: processing a Very Large file)

2005-05-29 Thread Christian Theune
Am Samstag, den 21.05.2005, 17:38 +0200 schrieb Christian Heimes: > Grab the Zope2 sources and read lib/python/OFS/Image.py. Zope's > OFS.Image.Image class (and also Zope3's implementation) is using a so > called possible large data class (Pdata) that is a subclass of Persistent. > > Pdata is us

Re: [ZODB-Dev] ZODB memory problems (was: processing a Very Large file)

2005-05-30 Thread Christian Theune
Am Sonntag, den 29.05.2005, 10:37 +0200 schrieb Tino Wildenhain: > > > Actually Pdata has some drawbacks. When the blobsupport branch gets > > > declared stable (I think it's not gonna happen in 3.4, but nobody told > > > me otherwise) we'll have really good blob support without this black > > > ma

Re: [ZODB-Dev] ZODB memory problems (was: processing a Very Large file)

2005-05-31 Thread Christian Theune
Am Montag, den 30.05.2005, 23:59 -0400 schrieb Paul Winkler: > On Mon, May 30, 2005 at 11:11:52AM +0200, Christian Theune wrote: > > * Blocking during large streams is solved by a protocol extension for > > streaming blobs. Additionally you can make the ZEO-Clients share the >

RE: [ZODB-Dev] ZODB memory problems (was: processing a Very Largefile)

2005-05-31 Thread Christian Theune
Am Dienstag, den 31.05.2005, 11:21 -0400 schrieb Tim Peters: > I hope there's action before September -- that would be half a year after > the branch was created, and merging gets harder over time. Maybe we could > do a virtual sprint via zodb-dev <0.9 wink>. Ok. There is not much todo except of

RE: [ZODB-Dev] ZODB memory problems (was: processing a Very Largefile)

2005-06-01 Thread Christian Theune
Am Dienstag, den 31.05.2005, 16:02 -0400 schrieb Chris McDonough: > Christian, > > Can we pick a day next week to have a sprint via IRC? Would you be > willing to help write some tests during that sprint? Does "next week" include saturday/sunday? We just acquired a new client and next week is ve

RE: [ZODB-Dev] ZODB memory problems (was: processing a Very Largefile)

2005-06-01 Thread Christian Theune
Am Mittwoch, den 01.06.2005, 12:59 -0400 schrieb Chris McDonough: > How's Sat June 11? I'll just mark that on my calendar as a day to write > some blob tests and I'll catch you (and whoever else might want to > contribute) on irc.freenode.net between then and now to talk about what > needs to be t

[ZODB-Dev] ZODB blob mini-sprint

2005-06-11 Thread Christian Theune
Hi, I'm awake now and waiting for the U.S. citizens (especially chrism) that are interested in the ZODB blob stuff to get up later and come to IRC on #zodb-dev to discuss the tasks on hand, especially test cases to implement. Cheers, Christian -- gocept gmbh & co. kg - schalaunische str. 6 - 06

[ZODB-Dev] ZODB Blob implementation

2005-06-11 Thread Christian Theune
Hi, I got you on a bad schedule last time. I just wanted to check if you're still interested in having a look at the new Blob implementation of ZODB. Jim especially would appreciate it if you would look at the commit semantics we went for. (If there is anything wrong around, it's my fault.) You

[ZODB-Dev] Race condition in basestorage commit locks?

2005-10-05 Thread Christian Theune
Hi, this is nasty. We detected a couple of hangs with a Zope 2.7.7 final and (using the DeadlockDebugger) we found this situation in every of the four threads: (See attached file for complete listing of all threads) Threads traceback dump at 2005-10-05 14:14:07 Thread 16386 (GET /psdsite/psd/ni

RE: [ZODB-Dev] Race condition in basestorage commit locks?

2005-10-05 Thread Christian Theune
Hi Tim, Am Mittwoch, den 05.10.2005, 13:26 -0400 schrieb Tim Peters: > I wouldn't call this "a race", because nothing here appears to be > timing-dependent. This is the code: Right. I mixed up terminology. Sorry. > raises an exception. The code does seem to implicitly assume that neither > of

RE: [ZODB-Dev] Race condition in basestorage commit locks?

2005-10-07 Thread Christian Theune
Hi, Am Mittwoch, den 05.10.2005, 14:17 -0400 schrieb Tim Peters: > Don't know enough to be sure, but you've seen that the commit-lock code _in_ > ZODB is very simple: tpc_begin acquires it, tpc_{abort,finish} releases it, > and that's it. I agree it's an error that tpc_abort may not release it

RE: [ZODB-Dev] Race condition in basestorage commit locks?

2005-10-07 Thread Christian Theune
Am Freitag, den 07.10.2005, 14:44 -0400 schrieb Tim Peters: > [Christian Theune] > > It looks like we have been bitten by a bug in a C-Module for MySQL > > access. Sometimes it led to a segfault, a halt, or the hang. We can't > > reproduce it after switching that C-Modul

RE: [ZODB-Dev] RE: RE: RE: PersistentMapping

2005-11-20 Thread Christian Theune
Am Freitag, den 18.11.2005, 11:25 -0500 schrieb Tim Peters: > It's more likely due to people fiddling with zpkg. "setup.py build" _had_ > worked fine for running the tests for years, and I know it still worked fine > a few months ago. But I don't normally do that, so didn't notice when it > broke

Re: [ZODB-Dev] ZODB Blobs Status

2005-11-25 Thread Christian Theune
Hi, Am Freitag, den 25.11.2005, 13:46 + schrieb Michael Kerrin: > I have being looking into using the ZODB Blobs. I really like the idea and > I > think it should help me in my current project which is just a big archive of > cataloged documents. But after going through the mailing list a

Re: [ZODB-Dev] ZODB Blobs Status

2005-11-28 Thread Christian Theune
Am Sonntag, den 27.11.2005, 21:31 -0500 schrieb Chris McDonough: > I'm also interested in finishing this work before 2.10/3.3 go out the > door. I *think* that will be in April, so PyCon in February fits in > perfectly here (I think I'm going...) Nice. Additionally we might have a project in

[ZODB-Dev] Getting all OIDs from a storage.

2006-04-24 Thread Christian Theune
Hi, we are using Zope 3 generations to update ZODBs. Sometimes the default tools that traverse the object tree are not covering all bases. I opened access to the FileStorage index of OIDs so we can iterate over those. (We are ignoring exceptions about POSKeyErrors at one point because we are like

Re: [ZODB-Dev] Getting all OIDs from a storage.

2006-04-24 Thread Christian Theune
Am Montag, den 24.04.2006, 10:06 -0400 schrieb Jim Fulton: > Christian Theune wrote: > > Hi, > > > > we are using Zope 3 generations to update ZODBs. Sometimes the default > > tools that traverse the object tree are not covering all bases. > > > > I opened

Re: [ZODB-Dev] Getting all OIDs from a storage.

2006-04-24 Thread Christian Theune
Hi, Am Montag, den 24.04.2006, 10:48 -0400 schrieb Jim Fulton: > Christian Theune wrote: > > > > Hmm. Sorry, but could you point out where the API is defined? I might > > not have looked hard enough. I only found internals to exploit. :( > > I wish I could. I&

[ZODB-Dev] Re: [Zope3-dev] Re: ClientStorage vs DemoStorage broken in Zope 3.2?

2006-04-25 Thread Christian Theune
Hi, Am Dienstag, den 25.04.2006, 23:50 -0400 schrieb Tres Seaver: > > Smells like a fix didn't get forward-ported somehow -- that looks like > the same error I helped Tim find and fix for Zope 2. > > CC'ing the ZODB list just in case anyone there has a better memory. > Here is the NEWS.txt entry

[ZODB-Dev] Re: [Zope3-dev] Re: ClientStorage vs DemoStorage broken in Zope 3.2?

2006-04-25 Thread Christian Theune
Hi again, Am Mittwoch, den 26.04.2006, 08:05 +0200 schrieb Christian Theune: > I remembered there was a fix like that. Unfortunately that fix was > ported to the 3.6 branch actually. I'm poking around myself a bit more. > > What I found right now is that BaseStorage accesses a

Re: [ZODB-Dev] Getting all OIDs from a storage.

2006-05-02 Thread Christian Theune
Am Montag, den 01.05.2006, 16:07 -0400 schrieb Stephan Richter: > On Monday 01 May 2006 14:14, Jim Fulton wrote: > > I suggest that: > > > > - The storage should be required to return OIDs in the > >database at aproximately time the call was made. It should > >be acceptable to omit recent

Re: [ZODB-Dev] Version thoughts

2006-05-16 Thread Christian Theune
Hi, Jim Fulton wrote: I've been thinking about various ways to clean up ZODB. For a while I've threatened to get rid of versions. I've been convinced by various arguments by various people that it is less work to keep them, at least for the foreseeable future. This is because there are certai

Re: [ZODB-Dev] Re: [Zope-Annce] Technical Preview of Blob support in ZODB

2006-05-19 Thread Christian Theune
Gary Poster wrote: On Apr 29, 2006, at 6:08 AM, Christian Theune wrote: Hi everybody, the ZODB team is proud to announce a technical preview of a Blob implementation for ZODB. Hey. This seems like there's no way that it will make it into the next ZODB release, right? Right. I a

Re: [ZODB-Dev] Clustering ZEO Server with drbd

2006-05-29 Thread Christian Theune
[EMAIL PROTECTED] wrote: Hi folks, I'm looking at making a scalable zope infrastructure, I can scale the ZEO clients and mysql, the only issue is the ZEO server. I have used drbd and heartbeat in the past to create a HA lamp stack. From a technical standpoint, is there any reason I could not us

Re: [ZODB-Dev] Clustering ZEO Server with drbd

2006-05-29 Thread Christian Theune
[EMAIL PROTECTED] wrote: If you setup drbd and heartbeat , the spare will take over the floating ip from the zeo server and restart the service. drbd is simply doing a block level replication of the zeo server file system where the zeo data is stored. The question is what files needs to be repl

Re: [ZODB-Dev] Adopting ZODB

2006-07-13 Thread Christian Theune
Chris S wrote: I'm trying to adopt some code to use ZODB as its persistence level. I've read the "Writing a Persistent Class" article (http://www.zope.org/Wikis/ZODB/FrontPage/guide/node3.html#SECTION00035) but how do you persist a class that already inherits another class? Doe

Re: [ZODB-Dev] Adopting ZODB

2006-07-13 Thread Christian Theune
Chris S wrote: On 7/13/06, Christian Theune <[EMAIL PROTECTED]> wrote: Chris S wrote: > I'm trying to adopt some code to use ZODB as its persistence level. > I've read the "Writing a Persistent Class" article > (http://www.zope.org/Wi

Re: [ZODB-Dev] Adopting ZODB

2006-07-13 Thread Christian Theune
David Binger wrote: On Jul 13, 2006, at 12:55 PM, Chris S wrote: You can always persist (almost) any object, even if it does not subclass from Persistent. However, any changes to the object will not be detected automatically and you would have to either a) reassign the object to the ZODB or b

Re: [ZODB-Dev] Adopting ZODB

2006-07-13 Thread Christian Theune
Dieter Maurer wrote: Christian Theune wrote at 2006-7-13 17:13 +0200: ... Is there any ability in ZODB to retroactively wrap objects in a persistence mechanism instead of having to rewrite an entire library to use the Persistent class? You can always persist (almost) any object, even if it

Re: [ZODB-Dev] Calculating Physical Object Size

2006-08-11 Thread Christian Theune
Marius Gedminas wrote: On Tue, Aug 08, 2006 at 04:19:10PM -0400, Chris S wrote: Is there anyway to determine how much disk space a specific object (including child objects) occupies in filestorage? For argument's sake, I'm assuming farily simplistic structures with no circular references. Ther

Re: [ZODB-Dev] Re: [Zope-Annce] Technical Preview of Blob support in ZODB

2006-08-21 Thread Christian Theune
David Pratt wrote: Can you advise whether blobs will make it the trunk any time soon. I see an extfile package now for z3 but would rather see filesystem storage dealt with at the backend than in the app itself. Many thanks. Chris McDonough and I have this on our schedule. It's not much to do

Re: [ZODB-Dev] HA Setup and zodb index file of FileStorage

2006-09-21 Thread Christian Theune
Hi, Patrick Gerken wrote: > Hello, > > its funny, like Garth in may this year I am looking into making a HA > system with ZEO for an ERP5 deployment. In my case I don't need to > care for data replication, all is stored on a SAN considered HA by the > customer already. > > So my data.fs and inde

Re: [ZODB-Dev] Different commit protocols

2006-09-22 Thread Christian Theune
Wolfgang Schnerring wrote: > Hi, > > I'm working with Theuni on the BlobStorage, and am trying to understand the > different 2-Phase-Commit protocols that are in use in ZODB at the same time. > As I understand it, tpc_* is the old protocol, and prepare/commit is the new > protocol. > > The sequ

  1   2   3   >