Re: [ZODB-Dev] ZODB 3.9/3.8 incompatibility (was Re: Data.fs size grows non-stop)

2009-12-10 Thread Chris Withers
Marius Gedminas wrote: > * In ZODB 3.8, the 'version' argument of ClientStorage.history (as well > as other kinds of storages, I suppose) is mandatory. In ZODB 3.9 > it's gone. > > Solved by peeking into the method signature with inspect.getargspec() > and supplying a version on

Re: [ZODB-Dev] Making ZODB / ZEO faster

2009-12-04 Thread Chris Withers
Jim Fulton wrote: > On Fri, Dec 4, 2009 at 11:31 AM, Erik Dahl wrote: > ... >> I haven't dove into the relstorage yet but have heard it will perform >> better. > > It doesn't. See: > > https://mail.zope.org/pipermail/zodb-dev/2009-October/012758.html Jim, That's a little sweeping and some m

Re: [ZODB-Dev] Repozo tests -- not

2009-12-02 Thread Chris Withers
Jeff Shell wrote: > I'm not sure whose expectations you're satisfying as the items in > ZODB.scripts are a wild and inconsistent mess. It's been trial and error just > to find ones that seem to work, outside of repozo. Oh the irony of the one script that Jim is looking to remove, because someon

Re: [ZODB-Dev] Repozo tests -- not

2009-12-02 Thread Chris Withers
Jim Fulton wrote: > If you take the database down, Right, that was what I was hoping you didn't mean ;-) That's useless then. > Repozo gives you, for FileStorage: > > - Online backups -- you can back up a database while it is running > - Incremental backups > > Of course, it isn't being activel

Re: [ZODB-Dev] Repozo tests -- not

2009-12-02 Thread Chris Withers
Jim Fulton wrote: > BTW, offline back ups if file-storage even with Blobs is > straightforward without repozo. I couldn't parse this, could you restate particularly wrt to what ou mean by offline? If there's a way other than repozo, then it would be great to know what it was... Chris -- Simpl

Re: [ZODB-Dev] Repozo tests -- not

2009-12-01 Thread Chris Withers
Martin Aspeli wrote: > - there were no tests for the existing code There are tests, they're just manual and spew a lot of output even when passing, but they do (as best I could tell) exercise the backup and restore cycle quite heavily. I ran these before and after to verify they didn't fail b

Re: [ZODB-Dev] Repozo tests -- not

2009-12-01 Thread Chris Withers
Jim Fulton wrote: > Well, not really fair enough. I just looked at the change that Chris > made. It has a bug > that would be caught by your test if anyone tried to port repozo to > Python 3. Which alternate reality are you talking about here? ;-) > I'm going to back out these changes. Wow.

[ZODB-Dev] client cache bugs when a client switches from one zeo server to another

2009-11-24 Thread Chris Withers
Hi All, So, I got the following errors when using a setup I'll describe shortly: o Module Products.ZCatalog.CatalogBrains, line 86, in getObject o Module OFS.Traversable, line 250, in restrictedTraverse o Module OFS.Traversable, line 226, in unrestrictedTraverse __traceback_info__: ([], 'tvi-1

Re: [ZODB-Dev] errors logged at info in ZEO's connection

2009-11-20 Thread Chris Withers
Jim Fulton wrote: >> It seems a bit bizarre that exceptions are logged at INFO rather than >> ERROR... > > Agreed. A simple fix and test on a branch would be appreciated. Done: http://svn.zope.org/ZODB/branches/chrisw-error_logging/ It would be great if this, too, could make it in a 3.9.4 rele

[ZODB-Dev] errors logged at info in ZEO's connection

2009-11-20 Thread Chris Withers
Hi All (although I guess predominantly Jim), ZEO/zprc/connection.py contains this rather odd piece of code: raise except Exception, msg: if not isinstance(msg, self.unlogged_exception_types): self.log("%s() raised exception: %s" % (name, msg),

Re: [ZODB-Dev] blobs

2009-11-20 Thread Chris Withers
Jeff Shell wrote: > On Nov 20, 2009, at 11:52 AM, Jim Fulton wrote: >>> If configured, sure. >> I would not trust repozo + blob backups. > > I don't trust Blobs. A year ago, I reverted all of the code I had for our CMS > that supported Blobs as it was impossible to copy their data in a basic Zope

Re: [ZODB-Dev] Zope 2.12 and blobs

2009-11-20 Thread Chris Withers
Jim Fulton wrote: > No, we should tell them they should use a mostly untested tool to do backups > that doesn't work with blobs. That should inspire confidence. > > Does Zope 2.12 use Blobs? Not by default, no. Chris -- Simplistix - Content Management, Batch Processing & Python Consulting

Re: [ZODB-Dev] 3.9.4 release?

2009-11-20 Thread Chris Withers
Jim Fulton wrote: >> +class RepozoTests(unittest.TestCase): >> + >> +def test_importability(self): >> +from ZODB.scripts import repozo >> + > > I appreciate your dedication to quality. > > That test passes under ZODB 3.9.3 with Python 2.6. ...but it will emit a deprecation warning, w

Re: [ZODB-Dev] repozo, neither official nor supported, apparently...

2009-11-20 Thread Chris Withers
Jeff Shell wrote: > For what it's worth, I've dealt with broken / unloved / > mildly-out-of-date ZODB scripts by making a new package that my > little company uses internally. I don't agree with this because it's fragmenting a tiny development group even further, no to mention creating private fo

Re: [ZODB-Dev] repozo, neither official nor supported, apparently...

2009-11-20 Thread Chris Withers
Jim Fulton wrote: > On Fri, Nov 20, 2009 at 9:32 AM, Chris Withers wrote: > ... >> I'm not sure how much love repozo needs. It works, and it won't need >> changing until FileStorage's format changes, which I don't see happening any >> time soon. >

Re: [ZODB-Dev] 3.9.4 release?

2009-11-20 Thread Chris Withers
Tim Peters wrote: > That's what he said -- and you made him repeat it several times by now. Yes, I find it hard to believe that someone would deliberately break something that someone else has taken the trouble to fix (and run the tests for!)... >> I've learned my lesson, I won't try and contri

Re: [ZODB-Dev] 3.9.4 release?

2009-11-20 Thread Chris Withers
Jim Fulton wrote: > I need to review the changes before the release. I'll probably reject the > repozo change without an automated test. Are you serious? You'd rather have a broken tool than one that isn't broken on the basis that the existing tests aren't part of the test suite that gets run by

Re: [ZODB-Dev] repozo, neither official nor supported, apparently...

2009-11-20 Thread Chris Withers
Jim Fulton wrote: > On Thu, Nov 19, 2009 at 7:01 PM, Chris Withers wrote: >> Jim Fulton wrote: >>> There's nothing official or supported about a backup solution without >>> automated tests. >>> >>> So I guess there isn't one. >> Right,

[ZODB-Dev] 3.9.4 release?

2009-11-20 Thread Chris Withers
Hi Jim, It would be great if the two recent fixes I committed could make it into a 3.9.4 release some time soon... What can I do to help this happen? Assuming I do anything necessary, when could you do this release? (or give Christian permission to do it :-) ) cheers, Chris -- Simplistix - C

Re: [ZODB-Dev] ZODB 3.9.3 history call causing problems for storages that still accept version parameters

2009-11-20 Thread Chris Withers
Christian Theune wrote: >> Traceback (most recent call last): >> File "ZODB3-3.9.3-py2.6-linux-i686.egg/ZEO/zrpc/connection.py", line >> 581, in handle_request >> ret = meth(*args) >> File "gocept.zeoraid-1.0b6-py2.6.egg/gocept/zeoraid/storage.py", line >> 219, in history >> ass

Re: [ZODB-Dev] ZODB 3.9.3 history call causing problems for storages that still accept version parameters

2009-11-19 Thread Chris Withers
Jim Fulton wrote: > On Thu, Nov 19, 2009 at 6:07 PM, Chris Withers wrote: >> Jim Fulton wrote: >>> So why not add a history method to ZEOStorage that passes size as a >>> keyword argument? >> I don't know what "ZEOStorage" is... > > Then we s

Re: [ZODB-Dev] repozo, neither official nor supported, apparently...

2009-11-19 Thread Chris Withers
Jim Fulton wrote: > There's nothing official or supported about a backup solution without > automated tests. > > So I guess there isn't one. Right, so what does Zope Corp use? Chris -- Simplistix - Content Management, Batch Processing & Python Consulting - http://www.simplistix.co.

Re: [ZODB-Dev] ZODB 3.9.3 history call causing problems for storages that still accept version parameters

2009-11-19 Thread Chris Withers
Jim Fulton wrote: > So why not add a history method to ZEOStorage that passes size as a > keyword argument? I don't know what "ZEOStorage" is... zrpc.connection.Connection appears to despatch direct to the storage, please correct me if I'm wrong. In this case, that's a RAIDStorage. It doesn't h

Re: [ZODB-Dev] repozo uses md5 lib, which is deprecated in python 2.6

2009-11-19 Thread Chris Withers
Jim Fulton wrote: >> Also feels like a bit of an ask for fixing a deprecation warning bug ;-) > > I don't follow that. Isn't that what you did? No, I ran an existing test script with two versions of python and verified that it worked as expected in both cases, with no deprecation warning being

Re: [ZODB-Dev] ZODB 3.9.3 history call causing problems for storages that still accept version parameters

2009-11-19 Thread Chris Withers
Jim Fulton wrote: > What's wrong with the original idea of having the server pass the size > as a keyword parameter? The ZEO protocol is irrelevant. Okay, from the top: >> So, a ZODB 3.9.3 ClientStorage calls the ServerStub's history method, this >> does an rpc call: >> >> self.rpc.call('history'

Re: [ZODB-Dev] repozo uses md5 lib, which is deprecated in python 2.6

2009-11-19 Thread Chris Withers
Jim Fulton wrote: >>> It's easy to handle this with a test on sys.version_info. >> OK, this is all done on trunk and 3.9 branch, I ran the test script with >> Python 2.4 and 2.6, no errors. > > Cool, but can we please get an automated test? I don't run the manual > tests. I never will. :) I'm afr

Re: [ZODB-Dev] ZODB 3.9.3 history call causing problems for storages that still accept version parameters

2009-11-19 Thread Chris Withers
Chris Withers wrote: > Jim Fulton wrote: >> I'm fine with change the storage server to pass the history size >> argument as a keyword parameter. > > Okay, but where is the Z309 equivalent of ZEOStorage308Adapter's history > method? Ug, the answer is much l

Re: [ZODB-Dev] repozo uses md5 lib, which is deprecated in python 2.6

2009-11-19 Thread Chris Withers
Jim Fulton wrote: > On Wed, Nov 18, 2009 at 12:00 PM, Chris Withers > wrote: >> - Anyone know what to replace md5 with? The warning suggests hashlib, > > Yes > >> which landed in 2.5. I assume it's okay to just use hashlib rather than >> worry about cond

Re: [ZODB-Dev] repozo uses md5 lib, which is deprecated in python 2.6

2009-11-18 Thread Chris Withers
Christian Theune wrote: >> - Anyone know what to replace md5 with? The warning suggests hashlib, >> which landed in 2.5. I assume it's okay to just use hashlib rather than >> worry about conditionally import md5 or hashlib, given that trunk ZODB >> and 3.9 branch are only targeted at Python 2.5 and

[ZODB-Dev] repozo uses md5 lib, which is deprecated in python 2.6

2009-11-18 Thread Chris Withers
Hi All, ZODB's repozo script uses the md5 library, which is deprecated in python 2.6, resulting in annoying emails from cron jobs. A few questions: - Where's the tracker for ZODB nowadays to report this issue? - Anyone know what to replace md5 with? The warning suggests hashlib, which landed

Re: [ZODB-Dev] help with pinning zeo plone zodb3 to 3.8.1

2009-11-12 Thread Chris Withers
rafael wrote: > I am experiencing the following problem: i need to pin zodb3 = 3.8.1 > so I can pack (cross reference issue). I use the following mini buildout to get 3.8.1 on its own. In my case it was to run the strip_versions script, but if you run it, you'll see you have a bin/runzeo and

[ZODB-Dev] zeoraid backends dropping out

2009-11-11 Thread Chris Withers
Hi All, Since this is the first post to this list on the issue, the setup I have is: zeoraid1 and zeoraid2 are zeoraid servers zeo1 and zeo2 are normal storage servers serving two file storages: packed and unpacked. zeoraid1 and zeo1 are on one box, zeoraid2 and zeo2 are on the other both. A v

Re: [ZODB-Dev] ValueError: corrupted record when calling GetObject

2009-11-02 Thread Chris Withers
Izak Burger wrote: > A restart "fixes" the problem. Its running version 3.7.1 of ZEO/ZODB. I have a feeling some problems in this area were fixed recently. Can you try ZODB 3.8 or 3.9? cheers, Chris -- Simplistix - Content Management, Batch Processing & Python Consulting - http://w

Re: [ZODB-Dev] Test time on 3.9 branch - windows?

2009-11-02 Thread Chris Withers
Jim Fulton wrote: Should I really expect the tests to take an hour to run on Windows? >>> Yes. >> Erk. Is there a subset I can look to run when looking to patch the >> ZEOStorage308Adapter? > > Feel my windows pain. Do the tests take much less time to run on Linux? If so, any idea as to why?

Re: [ZODB-Dev] ZODB 3.9.3 history call causing problems for storages that still accept version parameters

2009-11-02 Thread Chris Withers
Jim Fulton wrote: > I'm fine with change the storage server to pass the history size > argument as a keyword parameter. Okay, but where is the Z309 equivalent of ZEOStorage308Adapter's history method? cheers, Chris -- Simplistix - Content Management, Batch Processing & Python Consulting

Re: [ZODB-Dev] Test time on 3.9 branch

2009-11-02 Thread Chris Withers
Jim Fulton wrote: >> Should I really expect the tests to take an hour to run on Windows? > > Yes. Erk. Is there a subset I can look to run when looking to patch the ZEOStorage308Adapter? >> However, there were >> some error-ish messages interspersed in the test output. Is this to be >> expected

[ZODB-Dev] Test time on 3.9 branch

2009-11-02 Thread Chris Withers
Hi All, Should I really expect the tests to take an hour to run on Windows? Total: 3825 tests, 0 failures, 0 errors in 56 minutes 49.469 seconds. As you can see, no errors or failures were reported. However, there were some error-ish messages interspersed in the test output. Is this to be expe

Re: [ZODB-Dev] ZODB 3.9.3 history call causing problems for storages that still accept version parameters

2009-11-02 Thread Chris Withers
Christian Theune wrote: >> Would anyone object if I wrote a test and fixed this on the 3.9 branch >> of ZODB? I'm not really sure what to do about the trunk... > > I think that's the best idea. It's not exactly part of the policy of > supporting old protocols but if we want to support and encourag

Re: [ZODB-Dev] ZODB 3.9.3 history call causing problems for storages that still accept version parameters

2009-11-02 Thread Chris Withers
Christian Theune wrote: > There's a size argument following the version which probably is not > being passed as a keyword argument so it looks like a slight API > incompatibility. I wonder whether ZEORaid should hack around that or > whether the caller should be changed. Hmm... looking more closel

[ZODB-Dev] zodb 3.8.3 strip_versions missing some versions?

2009-11-02 Thread Chris Withers
Hi All, I'm upgrading a Zope 2.9.8 project to Zope 2.12 + zeoraid. As I've done with previous projects, I run the .fs files through zodb 3.8.3's strip_versions script. For both the storages in this project, the script found no version records. As a first step, I'm currently running the 2.9.8 a

Re: [ZODB-Dev] why use zc.recipe.filestorage?

2009-10-30 Thread Chris Withers
Jim Fulton wrote: >> [zeo] >> recipe = zc.zodbrecipes:server >> zeo.conf = >> >> path ${buildout:directory}/databases/Data.fs >> >> >> I feel like I'm missing something... > > You aren't missing anything. The benefit is very small. Excellent. I shall not feel guilty about not using

[ZODB-Dev] why use zc.recipe.filestorage?

2009-10-30 Thread Chris Withers
Hi All, I'm wondering what the point of this recipe is? Why use: [storage] recipe = zc.recipe.filestorage [zeo] recipe = zc.zodbrecipes:server zeo.conf = path ${storage:path} ...when you could just use: [zeo] recipe = zc.zodbrecipes:server zeo.conf = path ${buildou

Re: [ZODB-Dev] ZODB 3.9.3 released

2009-10-26 Thread Chris Withers
Jim Fulton wrote: > situations when deleting items. I recommend that people running 3.9 > update to the new release as soon as reasonable. (If you're using ZEO, > this only applies to ZEO clients, but servers. Just wanted to check this last sentence: what needs updating? clients, servers or both?

Re: [ZODB-Dev] "tid to old for invq" in zeo server logs?

2009-10-20 Thread Chris Withers
Jim Fulton wrote: > It means that the server wasn't able to provide "quick" invalidations > because a client was disconnected too long. The message isn't very > well worded, even aside from the misspelling. Has that been fixed in the latest zodb? If not, if I get a chance, I'm happy to patch...

[ZODB-Dev] "tid to old for invq" in zeo server logs?

2009-10-19 Thread Chris Withers
Hi All, I saw a few entries like these in the event log of a storage server that stopped responding for a couple of minutes: INFO ZEO.StorageServer (30332) tid to old for invq 252618838173181593 < 252618856850589832 -- INFO ZEO.StorageServer (30332) tid to old for invq 252618838177204172 <

Re: [ZODB-Dev] Cleaning up a ZODB storage from 'versions'

2009-09-30 Thread Chris Withers
Jim Fulton wrote: >> Is there a way for cleaning up a storage and removing the related >> versions in some way? > > Yes. Use the ZODB 3.8 strip_versions script. I used this buildout to get this script available in isolation: [buildout] parts = fixer versions = versions [versions] ZODB3 = 3.8

[ZODB-Dev] tools for analysing the tail of a filestorage?

2009-09-21 Thread Chris Withers
Hi All, I have a filestorage being used by Zope 2 that is mysteriously growing. I don't have confidence in the Undo tab, since this setup has two storages, once mounted into the other. I tried fstail.py, and while it tells me the same info as the Undo tab (except with more certainty that it's

Re: [ZODB-Dev] Problems packing Zope 2.9.8 storage

2009-09-18 Thread Chris Withers
Shane Hathaway wrote: > Look at this chart in particular, which suggests that RelStorage with > PostgreSQL or MySQL is several times faster than ZEO for heavy read loads: Cool, now all I need is something like zeoraid for postgres (or, at a push, mysql)... Chris -- Simplistix - Content Manage

Re: [ZODB-Dev] Problems packing Zope 2.9.8 storage

2009-09-14 Thread Chris Withers
Shane Hathaway wrote: > Chris Withers wrote: >> I thought RelStorage was slow at packing? > > Not anymore. I optimized packing last December/January and it has been > plenty fast ever since, AFAIK. Interesting. Got any metrics on its speed compared to FileStorage, includin

Re: [ZODB-Dev] Problems packing Zope 2.9.8 storage

2009-09-14 Thread Chris Withers
Shane Hathaway wrote: >> There is a .old file there, but it was last modified over a week ago. > > The analysis phase of packing can take a long time. A week is too much, > though. :-) Yeah, this is off the back of an automated pack/backup/unpack/verify to keep two storages in sync on two data

[ZODB-Dev] Problems packing Zope 2.9.8 storage

2009-09-14 Thread Chris Withers
Hi All, I've got a ZODB that's ballooned and I'm now having problems packing with zeopack. I tried with zeopack, which appeared to just hang (still in top, but no cpu usage for an hour or two), so I ctrl-c'ed it. Now when I try, I just get the text "Already packing" back. There is a .old file

Re: [ZODB-Dev] How do I find out the size of a subtree of the object graph?

2009-09-14 Thread Chris Withers
Jens Vagelpohl wrote: > >> Sadly, when you're trying to figure out which folder is using all the >> space on a disk that's running out of space, that's not practical... > > How about simply writing a script that crawls the ZODB and gives you > paths and sizes? Indeed, and what's the magic incan

Re: [ZODB-Dev] How do I find out the size of a subtree of the object graph?

2009-09-14 Thread Chris Withers
Jim Fulton wrote: > ZODB doesn't provide any direct support because it has no notion of tree. Does it have any notion of object size on disk for a given object? > In Zope 2, you could export the folder and look at the size of the export. Sadly, when you're trying to figure out which folder is us

Re: [ZODB-Dev] CRC check failed when running repozo

2009-09-14 Thread Chris Withers
Adam GROSZER wrote: > Hello, > > +1 on that. Sometimes copy operations (over the network) screw up some > bits. Happens rarely but then it hits hard. > > Monday, September 14, 2009, 10:13:39 AM, you wrote: > > CT> Hmm. Haven't seen that. My guess would be some low-level data corruption. > > CT>

[ZODB-Dev] How do I find out the size of a subtree of the object graph?

2009-09-14 Thread Chris Withers
Hi All, As the subject line says with the following definitions: - size = size on disk, in Mb - subtee = Zope folderish type things, in this case... cheers, Chris -- Simplistix - Content Management, Batch Processing & Python Consulting - http://www.simplistix.co.uk __

[ZODB-Dev] CRC check failed when running repozo

2009-09-14 Thread Chris Withers
Hi All, Anyone ever see this? Traceback (most recent call last): File "/opt/Zope-2.9//bin/repozo.py", line 517, in ? main() File "/opt/Zope-2.9//bin/repozo.py", line 510, in main do_backup(options) File "/opt/Zope-2.9//bin/repozo.py", line 450, in do_backup reposz, reposum

Re: [ZODB-Dev] ZODB 3.9.0 released

2009-09-09 Thread Chris Withers
Jim Fulton wrote: >> There are some typos in this list: >> >> - should probably be `with` when describing the with statement > > I don't know what you mean. Databases have a new method, transaction, that can be used with the Python (2.5 and later) with statement: -> Databases have a new method

Re: [ZODB-Dev] ZODB 3.9.0 released

2009-09-08 Thread Chris Withers
Jim Fulton wrote: > The changes from ZODB 3.8: > > http://pypi.python.org/pypi/ZODB3/3.9.0#id1 There are some typos in this list: - should probably be `with` when describing the with statement - "If control exists the block" I'm guessing should be "If control exits the block" - effecient ->

Re: [ZODB-Dev] instrumenting a ZEO server?

2009-08-26 Thread Chris Withers
Alan Runyan wrote: > What version of ZODB are you using? Whatever ships with Zope 2.9.8 > If you have zeo on in debugging What does this mean? > How many clients are waiting: > You should be able to see this in zeo log files Not currently... maybe this relates to your mystical "zeo on in deb

[ZODB-Dev] instrumenting a ZEO server?

2009-08-26 Thread Chris Withers
Hi All, I'm wondering if there's any way to get a ZEO server to log about how it's performing? (eg: how many connections, how many clients are waiting, where they're waiting, etc) I'm trying to debug a problem where app servers are being dropped out of a load balancer pool for being unresponsi

Re: [ZODB-Dev] ZODB 3.8.3b1

2009-08-25 Thread Chris Withers
Jim Fulton wrote: > Yup, where I assume you mean using the in-use storage as input. The > script makes a new copy. After making the copy, you can change the > server to use that. Of course, changes made after copying won't be in > the copy, but if you just want to try the script out, you can just

Re: [ZODB-Dev] ZODB 3.8.3b1

2009-08-15 Thread Chris Withers
Jim Fulton wrote: > $ bin/strip_versions -h > usage: strip_versions input output > > Remove version records by copying input to output, stripping any > version records seen in input. > > The input and output arguments are file-storage file names. If the -c > option is used, then the input and ou

Re: [ZODB-Dev] ZODB 3.8.3b1

2009-08-15 Thread Chris Withers
Jim Fulton wrote: > If you install ZODB3 3.8.3b1 normally, you'll get a strip_versions > script in your bin directory. I'm not familar with the Zope 2 buildout > or whether you can use ZODB 3.8 with Zope 2.12. Hmm, okay, I'll play it safe then... If I have a normal source install of Zope 2.9.10,

Re: [ZODB-Dev] ZODB 3.8.3b1

2009-08-15 Thread Chris Withers
Jim Fulton wrote: > On Sat, Aug 15, 2009 at 8:04 AM, Chris Withers wrote: >> Jim Fulton wrote: >>> It would be great if people who have databases with version data would >>> try the utility out. >> Where's tfm for the utility? :-) > > Use the -h opt

Re: [ZODB-Dev] ZODB 3.8.3b1

2009-08-15 Thread Chris Withers
Jim Fulton wrote: > It would be great if people who have databases with version data would > try the utility out. Where's tfm for the utility? :-) Chris -- Simplistix - Content Management, Batch Processing & Python Consulting - http://www.simplistix.co.uk ___

[ZODB-Dev] what could cause slowness checking if databases are alive?

2009-08-12 Thread Chris Withers
Hi All, This is all on Zope 2.9.8 for both the ZEO server and the app server clients. I have a customer with 2 app servers behind a hardware loadbalancer. The load balancer uses a hash of a url on each app server to determine if the app server is alive. Likewise, if the app server doesn't resp

Re: [ZODB-Dev] CVE-2009-0668 and CVE-2009-0669: Releases to fix ZODB ZEO server vulnerabilities

2009-08-06 Thread Chris Withers
Hi Jim, Jim Fulton wrote: > CVE-2009-0668 Arbitrary Python code execution in ZODB ZEO storage servers > CVE-2009-0669 Authentication bypass in ZODB ZEO storage servers Where are the actual CVE entries for these? http://cve.mitre.org doesn't seem to know much about either of them... > The vu

Re: [ZODB-Dev] Temporary files not closed

2009-06-25 Thread Chris Withers
Jim Fulton wrote: > I haven't seen this and, looking at the code on the trunk, I see no > reason why many savepoint temporary storages or ZEO transaction > buffers would be kept open. Savepoint temporary storages are closed > after use I wonder if Izak inadvertently has lots of savepoints

Re: [ZODB-Dev] Temporary files not closed

2009-06-25 Thread Chris Withers
Izak Burger wrote: > Before I dive into the code and attempt to find the problem, I thought > I'd post first, partly to report the problem, but at the same time to > find out if anyone has seen this and if perhaps a fix is already available. Never experienced this myself, what storage(s) are you

Re: [ZODB-Dev] Multi-database garbage collection and database verification

2009-06-12 Thread Chris Withers
Jim Fulton wrote: >> A couple of questions: >> >> - How do I know if my databases use 64-bit object ids? > > You have to ask the storage author. All of the databases included > with ZODB do. Well, all the DB I want to use this on are FileStorage, so that should be good to go, right? Chris -

Re: [ZODB-Dev] Multi-database garbage collection and database verification

2009-06-12 Thread Chris Withers
Jim Fulton wrote: > As threatened, I've created a multi-database garbage collector: > >http://pypi.python.org/pypi/zc.zodbdgc > > Bonus: I've also included a multi-database verification script. This looks great :-) A couple of questions: - How do I know if my databases use 64-bit object id

Re: [ZODB-Dev] URGENT: ZODB down - Important Software Application at CERN

2009-05-27 Thread Chris Withers
Hanno Schlichting wrote: >>> Hanno Schlichting recently posted a nice graph showing the persistent >>> structure of a Plone Page object and it's 9 (!) sub-objects. >>> http://blog.hannosch.eu/2009/05/visualizing-persistent-structure-of.html >> That graph isn't quite correct ;-) >> >> workflow_his

Re: [ZODB-Dev] URGENT: ZODB down - Important Software Application at CERN

2009-05-26 Thread Chris Withers
Laurence Rowe wrote: > Jim Fulton wrote: >> Well said. A feature I'd like to add is the ability to have persistent >> objects that don't get their own database records, so that you can get >> the benefit of having them track their changes without incuring the >> expense of a separate database

[ZODB-Dev] ZopeUndo.Prefix import problem

2009-04-20 Thread Chris Withers
Hi All, Trying to go to the Undo tab in the ZMI for Zope 2.12.0a3 for one database I have gives the following on the storage server: ERROR ZEO.zrpc (6397) can't decode message: '(K\x05K\x00U\x08undoInfo(K\x00K\x14}U\x0bdescription(cZ...' -- ZEO.zrpc.Connection(S) (127.0.0.1:49396) Error cau

[ZODB-Dev] ValueError: database_name already in databases

2009-04-20 Thread Chris Withers
Hi All, Is this a bug in ZODBMountPoint or ZODB? In any case, what's the correct tracker to report this in? Failed to mount database. (database_name 'packed' already in databases) Traceback (most recent call last): File "/Zope2-2.12.0a3-py2.5-linux-i686.egg/Products/ZODBMountPoint/MountedOb

Re: [ZODB-Dev] TypeError: ('argument list must be a tuple') when trying load object from old zodb in Zope 2.12.0a1

2009-04-16 Thread Chris Withers
Sadly, doesn't look like this is isolated on ParsedXML :-S Chris Withers wrote: > This is ZODB 3.9.0a11 on Python 2.5.1. > > The problem only occurs for certain ParsedXML documents, the two I've > found so far were created in 2004-2005, which I guess would have been >

Re: [ZODB-Dev] "Non-zeo version length" but ZMI says "There are no non-empty versions."

2009-04-14 Thread Chris Withers
Alan Runyan wrote: > reported, https://bugs.launchpad.net/zodb/+bug/361184 > maybe chris can take a stab at it *wink* That'll be a "no" I'm afraid ;-) (I simply don't have the knowledge :-S) Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.c

[ZODB-Dev] "Non-zeo version length" but ZMI says "There are no non-empty versions."

2009-04-13 Thread Chris Withers
Hi All, I get the following error when trying to open a filestorage .fs file with ZODB3-3.9.0a11: File "/ZODB3-3.9.0a11-py2.5-linux-i686.egg/ZODB/config.py", line 154, in open **options) File "/ZODB3-3.9.0a11-py2.5-linux-i686.egg/ZODB/FileStorage/FileStorage.py", line 185, in __ini

[ZODB-Dev] TypeError: ('argument list must be a tuple') when trying load object from old zodb in Zope 2.12.0a1

2009-04-13 Thread Chris Withers
Forwarding this here in case it's related. This is ZODB 3.9.0a11 on Python 2.5.1. The problem only occurs for certain ParsedXML documents, the two I've found so far were created in 2004-2005, which I guess would have been Zope 2.7ish on Python 2.4. Any ideas what this means or where it's comin

Re: [ZODB-Dev] ZODB 3.9

2009-04-11 Thread Chris Withers
Hanno Schlichting wrote: > Just be aware that ZODB 3.9 is not compatible with any stable Zope 2.x > release. It only works and is required for Zope 2.12. It can be made to > work with prior versions of Zope2 but that is a mild pain. What are the problems with using ZODB 3.9 in Zope <2.12? Chris

Re: [ZODB-Dev] SAN/RHCS use for ZEO server?

2009-04-03 Thread Chris Withers
Andrew Sawyers wrote: >> I'm particularly interested in how you'll move the SAN from the primary >> to the secondary node in the even of primary node failure, > This won't be done by me; it's handled by another team. Will it be done by software on the nodes or something else completely? >> and ho

Re: [ZODB-Dev] error installing ZODB 3.9.0a12 with Python 2.6 on Windows

2009-04-03 Thread Chris Withers
Jim Fulton wrote: > >> Andreas tells me Python 2.6 is the target for Zope 2.12. >> What kind of problems are there in this specific combination? > > The tests crash when built with the free ms compiler. > > If you want to help, you can debug this. Sadly, easier to install on Linux. Blame vmware

Re: [ZODB-Dev] error installing ZODB 3.9.0a12 with Python 2.6 on Windows

2009-04-03 Thread Chris Withers
Jim Fulton wrote: > ZODB doesn't work with Python 2.6 yet on Windows. Andreas tells me Python 2.6 is the target for Zope 2.12. What kind of problems are there in this specific combination? Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.

Re: [ZODB-Dev] SAN/RHCS use for ZEO server?

2009-04-03 Thread Chris Withers
Wichert Akkerman wrote: > On 4/3/09 3:43 PM, Chris Withers wrote: >> I'm particularly interested in how you'll move the SAN from the primary >> to the secondary node in the even of primary node failure, and how >> you'll bring the secondary's zeo server u

Re: [ZODB-Dev] SAN/RHCS use for ZEO server?

2009-04-03 Thread Chris Withers
Andrew Sawyers wrote: > I'll let you know shortly; I'm waiting on the test hardware for exactly > this. I will be using an EMC SAN and SRDF replication. I'm particularly interested in how you'll move the SAN from the primary to the secondary node in the even of primary node failure, and how yo

Re: [ZODB-Dev] error installing ZODB 3.9.0a12 with Python 2.6 on Windows

2009-04-03 Thread Chris Withers
Adam GROSZER wrote: > Hello Chris, > > You have a c compiler working on the machine? Yep, mingw I think... But that doesn't look like the normal "you don't have a compile" whine... Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk ___

Re: [ZODB-Dev] error installing ZODB 3.9.0a12 with Python 2.6 on Windows

2009-04-03 Thread Chris Withers
Wichert Akkerman wrote: >> Any ideas? >> > > buildout hides all compile errors unless you run it with -v (or -vv). buildout -vv didn't exactly provide much more help ;-) C:\Python26\python.exe "-c" ""from setuptools.command.easy_install import main; main()"" "-mUNxd" ""C:\buildout-eggs\tmpc

[ZODB-Dev] error installing ZODB 3.9.0a12 with Python 2.6 on Windows

2009-04-03 Thread Chris Withers
buildout said easy_install barfed: Installing zeoinstance. Getting distribution for 'ZODB3'. error: Setup script exited with error: None An error occured when trying to install ZODB3 3.9.0a12.Look above this message f or any errors thatwere output by easy_install. While: Installing zeoinstance

[ZODB-Dev] SAN/RHCS use for ZEO server?

2009-04-03 Thread Chris Withers
Hi All, I was just wondering if anyone had deployed any high availability solutions for ZEO storage servers using a SAN for the filestore used by the storage server (and any associated BLOB files)? If so, how and how's it panned out? Likewise, anyone uses Red Hat Cluster Suite to implement par

Re: [ZODB-Dev] ZODB.lock_file.LockError error

2008-11-12 Thread Chris Withers
Izak Burger wrote: > Because we use in zope.conf to mail us errors, it means > that every restart creates a couple of hundred emails. If you use mailinglogger then you can filter these out: http://www.simplistix.co.uk/software/python/mailinglogger cheers, Chris -- Simplistix - Content Manag

Re: [ZODB-Dev] RFC: External Garbage Collection

2008-11-07 Thread Chris Withers
Jim Fulton wrote: > I've posted a new proposal: > >http://wiki.zope.org/ZODB/ExternalGC > > That addresses multi-database garbage collection and can also be > useful in other situations. > > Comments are welcome. I assume this would fix the following bug: http://bugs.launchpad.net/zodb/

Re: [ZODB-Dev] NotImplementedError when attempting to undo transactions

2008-10-24 Thread Chris Withers
Carlos de la Guardia wrote: > That's happened to me before. As Jim says, this error is not the > culprit. If you check the error log on the ZMI you will find the *real* > error. This *was* the error that showed up in the ZMI... Chris -- Simplistix - Content Management, Zope & Python Consultin

Re: [ZODB-Dev] Blobs, Copies, and Exports (Zope 3)

2008-10-24 Thread Chris Withers
Christian Theune wrote: > On Fri, 2008-10-24 at 15:06 +0100, Chris Withers wrote: >> Christian Theune wrote: >>> On Fri, 2008-10-24 at 09:51 -0400, Jim Fulton wrote: >>>> 2. I doubt that blobs have been factored into ZODB exports. This is, >>>> obviousl

Re: [ZODB-Dev] Blobs, Copies, and Exports (Zope 3)

2008-10-24 Thread Chris Withers
Christian Theune wrote: > On Fri, 2008-10-24 at 09:51 -0400, Jim Fulton wrote: >> 2. I doubt that blobs have been factored into ZODB exports. This is, >> obviously, an oversight. > > They were factored in and we have tests. However, the initial pickle > will empty them: copying blobs this way in

Re: [ZODB-Dev] NotImplementedError when attempting to undo transactions

2008-10-24 Thread Chris Withers
Jim Fulton wrote: >> File "/opt/Zope-2.11/lib/python/ZODB/DB.py", line 809, in abort >> raise NotImplementedError >> NotImplementedError > > You can ignore this error. It has no consequence. What does it mean? (It prevented my undo, which was a bit of a bummer :-S > There's a bunch of stuf

[ZODB-Dev] NotImplementedError when attempting to undo transactions

2008-10-21 Thread Chris Withers
This is a little disconcerting: Failed to abort object: TransactionalUndo oid= Traceback (most recent call last): File "/opt/Zope-2.11/lib/python/transaction/_transaction.py", line 549, in abort self.manager.abort(o, txn) File "/opt/Zope-2.11/lib/python/ZODB/DB.py", line 809, in abort

Re: [ZODB-Dev] Backing up Data.fs and blob directory

2008-09-08 Thread Chris Withers
Sidnei da Silva wrote: > Keep in mind rsync is not erm, trivial to get going on Windows. Really? I've never had problems with cygwin... cheers, Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk _

Re: [ZODB-Dev] what could cause this kind of cache corruption?

2008-08-11 Thread Chris Withers
Christian Theune wrote: However, I was hoping for inclusion of at least the `storage-iterator-branch` in 3.9 and I asked a few times over the past months already for review but haven't gotten any responses at all so far. This branch has been used in production for a few month already. In additio

Re: [ZODB-Dev] what could cause this kind of cache corruption?

2008-08-02 Thread Chris Withers
Jim Fulton wrote: On Jul 31, 2008, at 1:53 PM, Chris Withers wrote: What I'd *really* like is a stable zodb release with Christian's patches for zeoraid and Shane's patches for RelStorage that then feeds through into a stable release of Zope 2. I'm not familiar wit

Re: [ZODB-Dev] what could cause this kind of cache corruption?

2008-08-01 Thread Chris Withers
Fred Drake wrote: On Thu, Jul 31, 2008 at 2:15 PM, Andreas Jung <[EMAIL PROTECTED]> wrote: They aren't part of the ZODB 3.8 but part of the trunk/3.9 - right? These are bug fixes, and will be included in ZODB 3.8.1. Are you referring to Christian and Shane's patches here? cheers, Chris -

<    1   2   3   4   5   >