[ZODB-Dev] No ZODB 3.8.2 tag

2009-08-13 Thread Andreas Jung
Hi Jim, there is a ZODB 3.8.2 release but there is no SVN tag for 3.8.2. Also the 3.8 branch does not contain the information from the release notes that are present on PyPI. You missed to commit your local SVN changes? Andreas -- ZOPYX Ltd. & Co KG \ ZOPYX & Friends Charlottenstr.

Re: [ZODB-Dev] qx.io2.HttpRequest urlencoded problem POST 8.2

2009-09-03 Thread Andreas Jung
And what has this to do with ZODB? -aj On 04.09.09 05:54, tsmiller wrote: > Hello, > > I am POSTing from qooxdoo using the io2.HttpRequest and somewhere in the > transport my data is getting messed up. My data leaving the client is a > valid stringified dictionary (data = qx.util.Json.stringify(

Re: [ZODB-Dev] How do I find out the size of a subtree of the object graph?

2009-09-14 Thread Andreas Jung
On 14.09.09 13:27, Chris Withers wrote: > Jens Vagelpohl wrote: > >> >>> Sadly, when you're trying to figure out which folder is using all the >>> space on a disk that's running out of space, that's not practical... >>> >> How about simply writing a script that crawls the ZODB and gi

Re: [ZODB-Dev] Traceback with ZODB 3.9.0

2009-09-25 Thread Andreas Jung
Am 25.09.09 16:54, schrieb Pedro Ferreira: > Hello, > I was trying to migrate a machine from 3.8.1 to 3.9.0, but I'm getting > the following error: > > """ > 2009-09-25T16:34:35 (2606) new connection ('137.138.4.155', 45551): > > 2009-09-25T16:34:35 (137.138.4.155:45551) received handshake 'Z309

[ZODB-Dev] Cleaning up a ZODB storage from 'versions'

2009-09-29 Thread Andreas Jung
Hi there, we are in the situation that we are running Zope 2.11 with heavily patched ZODB 3.8 with this extension: https://blueprints.launchpad.net/zodb/+spec/dm-pack-optimization While packing a storage we figured out that this extension is not compatible with the ZODB "versions" feature - mean

Re: [ZODB-Dev] Cleaning up a ZODB storage from 'versions'

2009-09-30 Thread Andreas Jung
Am 30.09.09 15:03, schrieb Chris Withers: > > PS: Andreas, I could have taken your usual approach and just shouted > at you to use Google since Jim already helped me through this about a > month ago ;-) The usual approach is: looking at the sources..but this script does not seem to be part of the

Re: [ZODB-Dev] cache-size-bytes usable?

2009-11-07 Thread Andreas Jung
Am 07.11.09 18:25, schrieb Hanno Schlichting: > Hi. > > I've been playing around with the new "cache-size-bytes" setting to > limit the ZODB cache sizes. > > My ZODB 3.9.3 (Zope 2.12 / Plone) config had a setting of > cache-size-bytes to 128mb and a cache-size of one million (to > effectively disab

Re: [ZODB-Dev] [OT] NoSQL

2009-11-14 Thread Andreas Jung
ound it pretty amazing, fast and reliable. Especially the replication support looks good and the sharding functionality (although still alpha or beta) appears promising. But the speed has its price: only atomicity for single document entities. Andreas Andreas Jung mailto:i...@zopyx.com&g

Re: [ZODB-Dev] Making ZODB / ZEO faster

2009-12-04 Thread Andreas Jung
The project - at least enterprise-level projects - requires are careful choice of the tools and backends. The ZODB is the golden bullet for all and everything. Depending on the data model and the project needs you have to look at relational database or NOSQL databases as alternatives. And as you w

Re: [ZODB-Dev] Data.fs size grows non-stop

2009-12-09 Thread Andreas Jung
Am 09.12.09 16:54, schrieb Pedro Ferreira: > We could use an OOBTree instead... but something less > complex would suffice... any suggestions? OOBTrees are complex? -aj <>___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/

Re: [ZODB-Dev] undo (and storage interface) brokenness

2009-12-23 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Martin Aspeli wrote: > Hanno Schlichting wrote: > >>> What is zc.beforestorage? >> Look at its PyPi page >> http://pypi.python.org/pypi/zc.beforestorage > > Thanks for the pointer! There is also dm.historical when you need to deal with earlier versions

Re: [ZODB-Dev] RFC: Drop Python 2.4 support in ZODB 3.10

2009-12-24 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jim Fulton wrote: > I propose to drop Python 2.4 support in ZODB 3.10, mainly so I can use > the with statement to clean up the code. > > Any objections? No objections from the Zope 2 side. Andreas -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10

[ZODB-Dev] Splitting a large ZODB file storage - any light-weight approach?

2009-12-29 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi there, we have some huge ZODB file storage (60-80 GB each) and we want to split the storage into a number of smaller storage (easier to handle for backup and packing). The storages themselves only contain a few (Zope 2) folders - let's say folders

[ZODB-Dev] [ZEO] Dealing with long startup times with out-dated index files/Index snapshots?

2010-02-03 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi there, we had in the past several issues with hour-long outages of our ZEO servers. The reasons are pretty easy: with have several big storages (60-80GB) and in case of a cluster failures we were not able to shutdown the ZEO servers in a clean way.

Re: [ZODB-Dev] [ZEO] Dealing with long startup times with out-dated index files/Index snapshots?

2010-02-03 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jim Fulton wrote: > On Wed, Feb 3, 2010 at 3:39 AM, Andreas Jung > wrote: >> we had in the past several issues with hour-long outages of our >> ZEO servers. The reasons are pretty easy: with have several big >> storages (6

Re: [ZODB-Dev] [ZEO] Dealing with long startup times with out-dated index files/Index snapshots?

2010-02-04 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jim Fulton wrote: > >>> Another issue is that, as things are now, while an index is being >>> saved, no transactions can be committed. This is less serious now >>> that saving indexes is much faster, however, saving a large index >>> may still take se

[ZODB-Dev] [fsrefs] KeyError: 'n'

2010-02-15 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi there, I am trying to check a Data.fs as used under Zope 2.10 for Poskey errors. Running fsrefs gives me the following: pl...@diaweb06:/data/zeo_buildout$ bin/zopepy ./parts/zope2/utilities/ZODBTools/fsrefs.py labor.fs.kaputt Traceback (most rece

Re: [ZODB-Dev] [fsrefs] KeyError: 'n'

2010-02-15 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jim Fulton wrote: > On Mon, Feb 15, 2010 at 11:20 AM, Sidnei da Silva > wrote: >> Hi Andreas, >> >> Your error looks quite similar to: >> >> http://www.mail-archive.com/zodb-dev@zope.org/msg02207.html >> >> Maybe it's the same issue? > > Ah, good poin

Re: [ZODB-Dev] [fsrefs] KeyError: 'n'

2010-02-16 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jim Fulton wrote: > On Mon, Feb 15, 2010 at 11:47 AM, Andreas Jung > wrote: >> -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 >> >> Jim Fulton wrote: >>> On Mon, Feb 15, 2010 at 11:20 AM, Sidnei da Silva >>&g

[ZODB-Dev] [ZODB 3.10] Benefits of dedicated processes per ZEO client

2010-04-07 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 According to the ZODB 3.10 release notes we will have dedicated processes on the ZEO server side for each client connection. What will be the major benefits of this change? Our typical scenario is like this: we run 5-6 ZEO servers where each server ma

Re: [ZODB-Dev] [ZODB 3.10] Benefits of dedicated processes per ZEO client

2010-04-07 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jim Fulton wrote: > On Wed, Apr 7, 2010 at 1:39 PM, Andreas Jung wrote: >> -BEGIN PGP SIGNED MESSAGE- >> Hash: SHA1 >> >> According to the ZODB 3.10 release notes we will have dedicated >> processes on th

[ZODB-Dev] [ZODB 3.8/Blob] Error in rename_or_copy_blob()

2010-04-26 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi there, a customer site is running Plone 3.3 w/ plone.app.blob. While creating a 'File' instance we get the following error: 2010-04-26T13:17:07 ERROR Zope.SiteErrorLog 1272277027.360.157502129415 http://www.deisa.eu/test-project/conversions/@@gen

Re: [ZODB-Dev] [ZODB 3.8/Blob] Error in rename_or_copy_blob()

2010-04-27 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Could this be related to https://bugs.launchpad.net/zodb/+bug/224169 ? Andreas Jim Fulton wrote: > On Mon, Apr 26, 2010 at 6:34 AM, Andreas Jung wrote: >> -BEGIN PGP SIGNED MESSAGE- >> Hash: SHA1 >> >> Hi ther

Re: [ZODB-Dev] [ZODB 3.8/Blob] Error in rename_or_copy_blob()

2010-04-27 Thread Andreas Jung
ons of the target file before actually trying to write it back. Andreas Andreas Jung wrote: > Could this be related to > > https://bugs.launchpad.net/zodb/+bug/224169 > > ? > > Andreas > > Jim Fulton wrote: >> On Mon, Apr 26, 2010 at 6:34 AM, Andreas Jun

[ZODB-Dev] [Blobs] Rsyncing Data.fs/Blob files updated/replace upon object changes?

2010-05-06 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 The current backup strategy for backing up a Data.fs with blob storage seems to be using repozo for the Data.fs and rsync for the blob storage. Rsyncing the blob storage makes only sense when it would be possible to restore a particular blob file for

Re: [ZODB-Dev] Some interesting (to some:) numbers

2010-05-11 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Adam GROSZER wrote: > Hello Jim, > > > > Tuesday, May 11, 2010, 4:46:46 PM, you wrote: > > JF> On Tue, May 11, 2010 at 7:47 AM, Adam GROSZER wrote: >>> Hello Jim, >>> >>> Tuesday, May 11, 2010, 1:37:19 PM, you wrote: >>> >>> JF> On Tue, May 11, 20

Re: [ZODB-Dev] Practical experience - ZEO-Server & limited size of file descriptors

2010-07-19 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jim Fulton wrote: > On Mon, Jul 19, 2010 at 9:40 AM, Andreas Gabriel > wrote: >> Hello, >> >> we are hosting a big ZEO based zope site and encountered a problem with a >> limited size of file descriptors (FDs) of the ZEO server. >> >> Scenario >> >>

Re: [ZODB-Dev] Practical experience - ZEO-Server & limited size of file descriptors

2010-07-19 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jim Fulton wrote: > On Mon, Jul 19, 2010 at 11:11 AM, Andreas Jung wrote: >> -BEGIN PGP SIGNED MESSAGE- >> Hash: SHA1 >> >> Jim Fulton wrote: >>> On Mon, Jul 19, 2010 at 9:40 AM, Andreas Gabriel >

Re: [ZODB-Dev] Random POSKeyErrors

2010-07-21 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Pedro Ferreira wrote: > Hello, > > We are receiving occasional error messages such as: > > """ > Traceback (most recent call last): >File > "/usr/lib/python2.4/site-packages/cds_indico-0.97_rc1-py2.4.egg/MaKaC/webinterface/rh/base.py", > > lin

Re: [ZODB-Dev] Random POSKeyErrors

2010-07-21 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Pedro Ferreira wrote: > >> http://www.zopyx.de/blog/checking-your-zodb-storages-for-poskey-errors >> >> > > Thanks a lot. Unfortunately, it seems like this script only works for 64 > bit oids... which doesn't seem to be the case. > huh? works

Re: [ZODB-Dev] ZODB: invalidations out of order

2010-09-20 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jim Fulton wrote: > On Mon, Sep 20, 2010 at 1:06 PM, Hanno Schlichting wrote: >> On Mon, Sep 20, 2010 at 6:00 PM, Jim Fulton wrote: >>> Do you know that Zope 2.10 won't work with ZODB 3.9? If so, I'm >>> curious why? >> Zope 2.10 includes ZODB 3.7 by

[ZODB-Dev] ZODB replication and high-availability across data centers

2010-10-21 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi there, we are currently investigating options for a large-scale solution where the machines (ZEO clients and ZEO server) should be separated across two data centers. Incoming traffic should be balanced between both data centers. Automatic failover

Re: [ZODB-Dev] Plone in P2P using Zope over DHT

2011-01-03 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Aran Dunkley wrote: > I'm > wondering what you guys, the core developers, think of the > practicalities of Plone in P2P, for example could ZODB use a DHT as its > storage layer? what kind of querying is required on the DHT? No idea what "P2P" means to

Re: [ZODB-Dev] Plone in P2P using Zope over DHT

2011-01-03 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Aran Dunkley wrote: > I mean P2P as in using a DHT (distributed hash table) for its storage > layer so that it can run in a network composed only of the client users > with no web-server, the same way that the file-sharing programs such as > azzureus a

Re: [ZODB-Dev] Plone in P2P using Zope over DHT

2011-01-03 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Marc Villemade wrote: > Hey Andreas, > > I think it makes sense if the storage backend is hosted on-premise (hence > private cloud), and i think that's what Aran is thinking about. > They could have Plone->ZODB->Storage backend in the same datacenter

Re: [ZODB-Dev] Plone in P2P using Zope over DHT

2011-01-03 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Marc Villemade wrote: > Hey Andreas, > > I don't know much about Aran's project, so you are right to wonder the > necessity to have yet another storage backend. > Maybe he has needs and requirements that can't be fulfilled by the current > backends.

Re: [ZODB-Dev] Plone in P2P using Zope over DHT

2011-01-06 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Aran Dunkley wrote: > Hi guys, > > It's looking like Plone/ZODB would need too much modification and > testing at the current time to move in to P2P. Neither Plone nor ZODB require modifications. You need a cloud-aware storage suitable to be used as

Re: [ZODB-Dev] How can I append Persistent mechanism to OrderedDict class ?

2011-01-30 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Stéphane Klein schrieb: > Hi, > > I would like to use a Persistent Ordered dict. > I use OrderedDict (http://pypi.python.org/pypi/ordereddict). > How can I append Persistent mechanism to this OrderedDict class ? What is the particular problem? As loo

[ZODB-Dev] Occasional startup errors in serialize.py/_reconstructor

2011-05-09 Thread Andreas Jung
Running Plone 4.0.5, Zope 2.12, ZODB 3.9.5. Occasionally I receive the following error after starting my instance after the first request. There is no way to recover out other than restarting the instance...then everything is fine. I don't know why this happens from time to time...any clue? Andre

Re: [ZODB-Dev] Occasional startup errors in serialize.py/_reconstructor

2011-05-09 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hanno Schlichting wrote: > > What does the code of the dgho...UserDataSchemaProvider class look > like? I'm assuming it's similar to the one from plone.app.users that > looks like: > > class UserDataSchemaProvider(object): > implements(IUserData

Re: [ZODB-Dev] Occasional startup errors in serialize.py/_reconstructor

2011-05-09 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hanno Schlichting wrote: > On Mon, May 9, 2011 at 2:08 PM, Andreas Jung wrote: >> Jup - basically a stripped down version of >> >> http://svn.plone.org/svn/collective/collective.examples.userdata/trunk/collective/examples/use

Re: [ZODB-Dev] Occasional startup errors in serialize.py/_reconstructor

2011-05-09 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hanno Schlichting wrote: > On Mon, May 9, 2011 at 2:34 PM, Andreas Jung wrote: >> The question is more why this error is happening from time to time after >> the startup after the first request - this scares me a bit. I also >>

[ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-14 Thread Andreas Jung
I have a customer site (Plone 3.0.6) causing an error during packing: Module ZPublisher.Publish, line 119, in publish Module ZPublisher.mapply, line 88, in mapply Module ZPublisher.Publish, line 42, in call_object Module , line 3, in _facade Module AccessControl.requestmethod, line 64,

Re: [ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-14 Thread Andreas Jung
Jim Fulton wrote: 2011-07-14 13:36:22 INFO Z2 Shutting down That error message seems rather weird. WTF SIGINT? Likely caused during the Zope shutdown amd unrelated). Use multi-zodb-check-refs with the -r option to get a database of reverse references. Use that do figure out what's refe

Re: [ZODB-Dev] How to fix "CorruptedDataError: Error reading unknown oid. Found '' at 81036527"?

2011-07-14 Thread Andreas Jung
Jim Fulton wrote: I wouldn't normally suggest what I'm about to suggest, but I think you have enough ZODB foo. :) I would try adding a new bucket with that oid. Maybe you can even stuff it in the connection cache to avoid committing it to the database. I'm not sure off hand what the steps re

[ZODB-Dev] Yet another Poskey error...

2011-07-21 Thread Andreas Jung
Hi there, this month is Poskey-error fixing month - so I can across a different problem with another site. Environment: Zope 2.12.18, Plone ZODB 3.9.5, Plone 4.0.7 Plone gives us the following error: Traceback (innermost last): Module ZPublisher.Publish, line 127, in publish Module ZPublish

Re: [ZODB-Dev] Is there any convenient way to reduce the storage file size after delete something in database?

2011-09-27 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 The ZODB basically does only append to the database file (Data.fs). Only packing (e.g. through zeopack) will write a new (and smaller) Data.fs file containing the referenced "life" objects. - -aj 刘一新 wrote: > I found that the size of the storage file

Re: [ZODB-Dev] Persisting Python objects in MongoDB

2011-11-08 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Very cool and excellent work. Andreas Stephan Richter wrote: > Hi everyone, > > as you might have seen from my checkins on Friday, I released > mongopersist. In short, it implements a persistence backend in > MongoDB (that, with a little bit of effo

Re: [ZODB-Dev] Error when running zeopack (zeopack.py) from command line ("ImportError: No module named ZEO.ClientStorage")

2012-02-17 Thread Andreas Jung
PYTHONPATH=/soft/Plone/Zope-2.10.9-final-py2.4/lib/python/ZEO This is wrong. You must not include the package itself into the PATH (that's why it is call path). /lib/python is good enough -aj Ricardo Dias Marques wrote: > Hi all, > > I'm getting an error when trying to run zeopack (zeopack.

[ZODB-Dev] ValueError: Non-zero version length. Versions aren't supported.

2012-04-24 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I am receiving the following weird error with a fresh Plone 4.2b2 sandbox during development tests. At least the "Versions" error message confuses me since the installation including ZODB Data.fs file is usually fresh. Andreas File "/home/ajung/.bu

Re: [ZODB-Dev] ValueError: Non-zero version length. Versions aren't supported.

2012-04-24 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 The issue was possibly caused by a regression with the sauna.reload add-on for Plone...now checking a new version of sauna.reload. - -aj Andreas Jung wrote: > I am receiving the following weird error with a fresh Plone 4.2b2 > sandbox

Re: [ZODB-Dev] ValueError: Non-zero version length. Versions aren't supported.

2012-04-25 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Mikko Ohtamaa wrote: > sauna.reload increases your changes of corruption Data.fs as it > forcefully restarts Zope instance very often and makes other bad things > happen. I would say that the sauna.reload 0.4.1+2 versions were the primary reason fo

[ZODB-Dev] ZEO invalidation message transaction-inbound or outbound

2012-11-29 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi there, a customer made the observation that that ZEO clients became inconsistent after some time (large CMF-based application running on Zope 2.12 afaik). Customer made some investigation and noticed that the ZEO invalidations have been queued (in

Re: [ZODB-Dev] ZEO invalidation message transaction-inbound or outbound

2012-12-01 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jim Fulton wrote: > On Fri, Nov 30, 2012 at 1:37 AM, Andreas Jung > wrote: >> a customer made the observation that that ZEO clients became >> inconsistent after some time (large CMF-based application running >> on Zope 2.

[ZODB-Dev] Blobstorage shrinks only after the second pack operation - bug or feature?

2012-12-30 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I noticed a strange behavior with packing a storage having lots of data in a blob storage (Plone 4.2, Zope 2.13). I had a large Plone site (5 GB of data in blobstorage) in a dedicated storage. I removed the Plone Site object and packed the storage thr

Re: [ZODB-Dev] Blobstorage shrinks only after the second pack operation - bug or feature?

2012-12-30 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jim Fulton wrote: > On Sun, Dec 30, 2012 at 3:50 AM, Andreas Jung > wrote: >> -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 >> >> I noticed a strange behavior with packing a storage having lots of >> data in a blob

Re: [ZODB-Dev] Blobstorage shrinks only after the second pack operation - bug or feature?

2012-12-30 Thread Andreas Jung
Jim Fulton wrote: > On Sun, Dec 30, 2012 at 12:22 PM, Andreas Jung wrote: >> -BEGIN PGP SIGNED MESSAGE- >> Hash: SHA1 >> >> >> >> Jim Fulton wrote: >>> On Sun, Dec 30, 2012 at 3:50 AM, Andreas Jung >>> wrote: >>>>

[ZODB-Dev] Massive LockError: Couldn't lock....check_size.lock messages

2014-04-15 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi there, we have a Plone 4.2 setup running ZEO with 3 application servers and a non-shared blob setup, ZODB3-3.10.5-py2.7-linux-i686 We see massive amounts of the following error message on every application server. The application servers are confi

Re: [ZODB-Dev] Massive LockError: Couldn't lock....check_size.lock messages

2014-04-15 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jim Fulton wrote: > On Tue, Apr 15, 2014 at 9:28 AM, Andreas Jung > wrote: Hi there, > > we have a Plone 4.2 setup running ZEO with 3 application servers and > a non-shared blob setup, ZODB3-3.10.5-py2.7-linux-i686 > > We see m

Re: [ZODB-Dev] Iterate through all objects from ZODB

2014-09-22 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Carlos Sanchez wrote: > Hi, > > I was wondering if there is an official API and/or a way to iterate > through all objects in a ZODB database. I found an implementation at > https://mail.zope.org/pipermail/zodb-dev/2002-October/003483.html, > but I w

Re: [ZODB-Dev] ZODB memory problems (was: processing a Very Large file)

2005-05-29 Thread Andreas Jung
--On 29. Mai 2005 11:29:06 +0200 Christian Theune <[EMAIL PROTECTED]> wrote: Am Samstag, den 21.05.2005, 17:38 +0200 schrieb Christian Heimes: Grab the Zope2 sources and read lib/python/OFS/Image.py. Zope's OFS.Image.Image class (and also Zope3's implementation) is using a so called possible

RE: [ZODB-Dev] TmpStore missing loadBefore

2005-06-27 Thread Andreas Jung
--On 27. Juni 2005 11:56:13 -0400 Tim Peters <[EMAIL PROTECTED]> wrote: [Sidnei da Silva] I would expect a 2.8.1 soon, as in no longer than 3 weeks from now tops. There's this bug which I would consider 'serious' and another issue with the last-minute inclusion of BTreeFolder2 breaking CMF 1.

[ZODB-Dev] Re: Zope 2.8.1 (was RE: TmpStore missing loadBefore)

2005-06-29 Thread Andreas Jung
--On 29. Juni 2005 10:38:27 -0400 Tim Peters <[EMAIL PROTECTED]> wrote: [Andreas Jung] The Plone guys asked about a 2.8.1 release for end of July/start of August which should not be a problem. Since they are working on making Plone 2.1 work with Zope 2.8 there is a good chance that f

Re: [ZODB-Dev] Change ZODB to PostgreSQL database

2005-09-21 Thread Andreas Jung
--On 21. September 2005 12:33:47 +0200 Tóth Zoltán <[EMAIL PROTECTED]> wrote: Hello! Can I change Zope Object Database to PostgeSQL database? Why do you want to do that? As far as I know there is no dedicated storage for available for Postgres except using frameworks like Ape or SQLStora

Re: [ZODB-Dev] Change ZODB to PostgreSQL database

2005-09-21 Thread Andreas Jung
place, practicaly in postgesql in another server. thanx Zoli - Original Message - From: "Andreas Jung" <[EMAIL PROTECTED]> To: "Tóth Zoltán" <[EMAIL PROTECTED]>; Sent: Wednesday, September 21, 2005 12:53 PM Subject: Re: [ZODB-Dev] Change ZODB to PostgreSQL data

Re: [ZODB-Dev] Multi-Threading Transactions

2005-10-12 Thread Andreas Jung
--On 13. Oktober 2005 00:52:02 -0400 Chris Spencer <[EMAIL PROTECTED]> wrote: If one thread writes to an object on one connection, and another thread does the same on another connection, then one calls transaction.commit(), will the all the changes in both connections be commited? Is there a

Re: [ZODB-Dev] Fixing Broken Objects?

2005-10-12 Thread Andreas Jung
--On 13. Oktober 2005 01:45:30 -0400 Chris Spencer <[EMAIL PROTECTED]> wrote: I noticed that if a ZEOServer client doesn't have the definition for an object's class, it loads it as a broken object. Is there any way to fix the broken object by obtaining the class source from the server? Yo

Re: [ZODB-Dev] Re: Multi-Threading Transactions

2005-10-12 Thread Andreas Jung
--On 13. Oktober 2005 01:33:14 -0400 Chris Spencer <[EMAIL PROTECTED]> wrote: Andreas Jung wrote: --On 13. Oktober 2005 00:52:02 -0400 Chris Spencer <[EMAIL PROTECTED]> wrote: If one thread writes to an object on one connection, and another thread does the same on anothe

Re: [ZODB-Dev] Re: Multi-Threading Transactions

2005-10-12 Thread Andreas Jung
--On 13. Oktober 2005 02:44:34 -0400 Chris Spencer <[EMAIL PROTECTED]> wrote: I understand that, but my point was when you call transaction.commit(), you don't necessarily know what you're committing. One thread may be ready to commit. Another may not be. If one thread calls transaction.abo

Re: [ZODB-Dev] Re: Fixing Broken Objects?

2005-10-13 Thread Andreas Jung
--On 13. Oktober 2005 02:54:51 -0400 Chris Spencer <[EMAIL PROTECTED]> wrote: But what if the client doesn't know what sources it's supposed to have? What if it only has a limited understanding of the objects, and needs to load certain objects on the server from scratch. Is this really a n

Re: [ZODB-Dev] Fixing Broken Objects?

2005-10-13 Thread Andreas Jung
--On 13. Oktober 2005 09:51:22 +0200 Tino Wildenhain <[EMAIL PROTECTED]> wrote: While it would certainly be nice if the ZEO server could deliver codeobjects too. In Theory and with much much bad hackery (overwriting __import__ and friends) it could be possible. Jim? This would especially b

Re: [ZODB-Dev] Fixing Broken Objects?

2005-10-13 Thread Andreas Jung
--On 13. Oktober 2005 09:46:43 +0100 Chris Withers <[EMAIL PROTECTED]> wrote: Andreas Jung wrote: Sounds like a total insane idea to me to use ZEO to distribute code :-) Yeah, 'cos ZODB-based Script (Python)'s and ZPT's aren't "code" :-P We ar

[ZODB-Dev] Summertime -> Wintertime harmful?

2005-10-29 Thread Andreas Jung
Possibly a stupid question: Last night the European clocks switched back to winter-time. So the ZODB might see multiple timestamps (and unordered transaction) from transactions happened between 2am and 3am...just for curiosity: is there a risk getting an inconsistent ZODB? Andreas pgp2eIOfcTL

RE: [ZODB-Dev] Summertime -> Wintertime harmful?

2005-10-30 Thread Andreas Jung
--On 30. Oktober 2005 22:17:44 -0500 Tim Peters <[EMAIL PROTECTED]> wrote: Second, time-stamp skew doesn't lead to inconsistency. Fleshing out a bit, ZODB uses time.gmtime() as a starting point, not necessarily as its final timestamp. When generating a new tid, if time.gmtime() is <= the l

Re: [ZODB-Dev] Searching for Objects

2005-12-04 Thread Andreas Jung
--On 4. Dezember 2005 16:32:50 -0500 Chris Spencer <[EMAIL PROTECTED]> wrote: Is there an existing way to search for objects in ZODB based on criteria? For example, how could I retrieve all instances of a particular class, or all objects with a __dict__ key equal to "value"? You mean ZCat

Re: [ZODB-Dev] lazy BTreeItems

2005-12-08 Thread Andreas Jung
--On 9. Dezember 2005 12:05:23 +0500 Victor Safronovich <[EMAIL PROTECTED]> wrote: Hello zodb-dev! Is this a correct behaviour? from BTrees.IIBTree import IIBTree t = IIBTree(map(None,range(5),range(5))) list(t.keys()) [0, 1, 2, 3, 4] k = t.keys() list(k) [0, 1, 2, 3, 4] del t[0] list(

Re: Re[2]: [ZODB-Dev] lazy BTreeItems

2005-12-09 Thread Andreas Jung
--On 9. Dezember 2005 12:53:25 +0500 Victor Safronovich <[EMAIL PROTECTED]> wrote: Hello Andreas Jung, Friday, December 9, 2005, 12:17:36 PM, you wrote: AJ> That's different from my instance (Zope HEAD): You are right :), i use ZODB 3.1.5. Ok, i try on ZODB 3.4.0 this

Re: [ZODB-Dev] Searching/wo/Zope

2006-01-04 Thread Andreas Jung
--On 4. Januar 2006 14:38:13 -0500 Tamas Hegedus <[EMAIL PROTECTED]> wrote: Hi! You have released the ZODB/ZEO as a stand alone package. But there is no stand alone searching possibility. Why? This just does not make any sense. Yous suggested and I tried Kevin Dangoor's stand alone ZCatalo

Re: [ZODB-Dev] Searching/wo/Zope

2006-01-04 Thread Andreas Jung
--On 4. Januar 2006 15:11:37 -0500 Tamas Hegedus <[EMAIL PROTECTED]> wrote: I am not a programmer. This is the source of all my problems. I just did not have the patient (and knowledge) to learn to develop zope applications. But I want to stick with Python and I need a transparent (object) dat

[ZODB-Dev] Re: zLOG module deprecated

2006-01-09 Thread Andreas Jung
--On 9. Januar 2006 16:35:31 +0100 Florent Guillaume <[EMAIL PROTECTED]> wrote: If that is the case then I intend to: 1. move the definitions of zope's specific levels (trace and blather) into a more prominent place (ZODB also defines these levels, but it has to be an independent package),

[ZODB-Dev] Re: [Zope-dev] Re: zLOG module deprecated

2006-01-09 Thread Andreas Jung
--On 9. Januar 2006 10:55:21 -0500 Fred Drake <[EMAIL PROTECTED]> wrote: On 1/9/06, Andreas Jung <[EMAIL PROTECTED]> wrote: ZODB defines these levels but I can not see any code in the ZODB package that actually uses these levels. Nobody should be using the zLOG levels with

[ZODB-Dev] Re: [Zope-dev] Re: zLOG module deprecated

2006-01-09 Thread Andreas Jung
--On 9. Januar 2006 17:06:25 +0100 Florent Guillaume <[EMAIL PROTECTED]> wrote: My point is that the python logging levels are insufficiently fine grained. Sufficently enough for me. BLATHER & TRACE can be merged to DEBUG and PROBLEM to either WARN|ERROR. This should be even enough for Zope.

[ZODB-Dev] Re: [Zope-dev] Re: zLOG module deprecated

2006-01-09 Thread Andreas Jung
--On 9. Januar 2006 17:40:26 +0100 Florent Guillaume <[EMAIL PROTECTED]> wrote: On 9 Jan 2006, at 17:25, Andreas Jung wrote: --On 9. Januar 2006 17:06:25 +0100 Florent Guillaume <[EMAIL PROTECTED]> wrote: My point is that the python logging levels are insufficiently

Re: [ZODB-Dev] Re: [Zope-dev] Re: zLOG module deprecated

2006-01-10 Thread Andreas Jung
--On 10. Januar 2006 10:51:04 +0100 Lennart Regebro <[EMAIL PROTECTED]> wrote: I find all this fairly self-evident and highly useful, and se absolutely zero reason for removing them, when they are so useful. This decision was made for Zope 2.8 (according to zLOG/__init__.py). We're now wor

Re: [ZODB-Dev] Re: [Zope-dev] Re: zLOG module deprecated

2006-01-10 Thread Andreas Jung
--On 10. Januar 2006 11:09:32 +0100 Lennart Regebro <[EMAIL PROTECTED]> wrote: On 1/10/06, Andreas Jung <[EMAIL PROTECTED]> wrote: This decision was made for Zope 2.8 (according to zLOG/__init__.py). How do you mean? As far as I can see, all the levels are still there in

Re: [ZODB-Dev] Re: [Zope-dev] Re: zLOG module deprecated

2006-01-10 Thread Andreas Jung
--On 10. Januar 2006 11:44:31 +0100 Lennart Regebro <[EMAIL PROTECTED]> wrote: I don't have an opinion on solution yet. What I want is something easy to use wher you can just import a log method or object and make a function. I don't want to set things up, because if we need to set things up

Re: [ZODB-Dev] Re: [Zope-dev] Re: zLOG module deprecated

2006-01-10 Thread Andreas Jung
--On 10. Januar 2006 12:20:14 +0100 Lennart Regebro <[EMAIL PROTECTED]> wrote: On 1/10/06, Andreas Jung <[EMAIL PROTECTED]> wrote: This means basically keeping zLOG since it is only a very thin logging module wrapper. So why did we deprecate zLOG? :-) Did we? It was impl

[ZODB-Dev] Trouble with 'transaction' module

2006-01-31 Thread Andreas Jung
Hi, I have the following code in side a Plone app. The intent of this method is to perform a logging of changed Archetype fields. This code basically works but under some unknown circumstances I get error below where the transaction module seems to be None?! There is no product refreshing en

Re: [ZODB-Dev] ZEO Authentication

2006-05-26 Thread Andreas Jung
--On 26. Mai 2006 01:46:26 -0300 David Pratt <[EMAIL PROTECTED]> wrote: I am curious how folks are handling authentication for ZEO in a general way (client against the server). Is is common to attempt to use user/passwords from acl in zope as a means of creating a lists for authenticating agai

Re: [ZODB-Dev] ZEO Authentication

2006-05-26 Thread Andreas Jung
--On 26. Mai 2006 16:47:41 +0100 Jens Vagelpohl <[EMAIL PROTECTED]> wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 26 May 2006, at 16:43, Benji York wrote: Andreas Jung wrote: You could use a firewall to allow incoming ZEO connection only from authorized IP address...shou

Re: [ZODB-Dev] Advice needed

2006-06-23 Thread Andreas Jung
--On 23. Juni 2006 14:27:52 +0200 Adam Groszer <[EMAIL PROTECTED]> wrote: Hi there, I know it is not easy, but I need some advices to keep our bosses happy at the planning stage of our application. The application we are planning is a document management application which follows documents i

Re: Re[2]: [ZODB-Dev] Advice needed

2006-06-23 Thread Andreas Jung
--On 23. Juni 2006 16:05:49 +0200 Adam Groszer <[EMAIL PROTECTED]> wrote: AJ> We run a CMS with several ZEO storages using FileStorage with up 300k AJ> different objects per storage. May you mention some or some sites on the internet that run Zope/ZODB to have some examples? Since ZODB is

Re: [ZODB-Dev] Re: What makes the ZODB slow?

2006-06-23 Thread Andreas Jung
--On 23. Juni 2006 17:51:35 +0200 Florent Guillaume <[EMAIL PROTECTED]> wrote: BTrees perform best when keys' prefixes are randomly distributed. So if your application generates keys like 'foo001', 'foo002',... you'll get lots of conflicts. Same for consecutive integers in IOBTree. hm..

Re: [ZODB-Dev] Advice needed

2006-06-24 Thread Andreas Jung
--On 24. Juni 2006 08:53:43 +0200 Roché Compaan <[EMAIL PROTECTED]> wrote: I am curious what other strategies besides QueueCatalog you employ? Do you ever use multiple backends for your apps? How do you decide that this data belongs in a relational backend? How structured must the data be, o

Re: [ZODB-Dev] Advice needed

2006-06-24 Thread Andreas Jung
--On 24. Juni 2006 21:08:03 +0200 Dieter Maurer <[EMAIL PROTECTED]> wrote: Andreas Jung wrote at 2006-6-24 09:24 +0200: ... One particular app that I have been working on uses very complex queries with lots of join etcit would be hard model to implement such queries on top of th

Re: [ZODB-Dev] Advice needed

2006-06-25 Thread Andreas Jung
--On 25. Juni 2006 21:33:21 +0200 Dieter Maurer <[EMAIL PROTECTED]> wrote: Andreas Jung wrote at 2006-6-24 22:36 +0200: ... The ZODB model (object data stored in a storage with behaviour coded in the clients) is powerful enough to simply implement the relational databas

Re: [ZODB-Dev] Re: What makes the ZODB slow?

2006-06-26 Thread Andreas Jung
--On 26. Juni 2006 14:02:20 +0100 Chris Withers <[EMAIL PROTECTED]> wrote: Florent Guillaume wrote: BTrees perform best when keys' prefixes are randomly distributed. So if your application generates keys like 'foo001', 'foo002',... you'll get lots of conflicts. Same for consecutive integer

Re: Re[2]: [ZODB-Dev] Commit Progress Indictor

2006-08-16 Thread Andreas Jung
--On 16. August 2006 10:52:51 +0200 Adam Groszer <[EMAIL PROTECTED]> wrote: Hello Dieter, Do you think that's possible? This is not the question. With some effort you can develop almost everything...you just have to find a volunteer and a budget :-) -aj pgpsTnNtwrvDx.pgp Description: PGP

Re: [ZODB-Dev] Can Leo use zodb as a file system?

2006-09-11 Thread Andreas Jung
--On 11. September 2006 16:20:31 -0500 "Edward K. Ream" <[EMAIL PROTECTED]> wrote: Several of Leo's users have suggested that Leo could use the zodb instead of reading and writing files. Leo? -aj pgpYVlVr2dugO.pgp Description: PGP signature ___

Re: [ZODB-Dev] Trouble with importing...

2006-11-17 Thread Andreas Jung
--On 17. November 2006 20:23:07 -0800 Mark Bartlett <[EMAIL PROTECTED]> wrote: Hi All! This is a great list! I have been having trouble importing a custom XML Article that I have previously Exported and have been getting this error: IndexError: list index out of range The traceback: *

  1   2   >