Re: [ZODB-Dev] Changing namespace - best strategy

2013-07-16 Thread Pedro Ferreira
Hello, Thanks for your answer. 1. Make sure all the classes are still importable from the old location ('from newmodule import MyPersistentSomething # BBB') So, I assume this is based on the classFactory hook/dictionary solution? Or am I misunderstanding it? Cheers, Pedro -- Pedro

[ZODB-Dev] Changing namespace - best strategy

2013-07-15 Thread Pedro Ferreira
in some servers, including my organization's. -- Pedro Ferreira http://pferreir.github.com ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] Server-side caching

2012-02-13 Thread Pedro Ferreira
Dear Jim, Thanks for your answer. The OS' file-system cache acts as a storage server cache. The storage server does (essentially) no processing to data read from disk, so an application-level cache would add nothing over the disk cache provided by the storage server. I see, then I guess it

Re: [ZODB-Dev] Server-side caching

2012-02-13 Thread Pedro Ferreira
between processes, which doesn't make them very useful , in which we very useful *for our setup* -- José Pedro Ferreira Software Developer, Indico Project http://indico-software.org +---+ + '``'--- `+ CERN - European Organization for Nuclear Research + |CERN| / + 1211 Geneve

Re: [ZODB-Dev] Server-side caching

2012-02-13 Thread Pedro Ferreira
different kinds of work to different workers. I will be at the conference, will for sure attend :) Cheers, Pedro -- José Pedro Ferreira Software Developer, Indico Project http://indico-software.org +---+ + '``'--- `+ CERN - European Organization for Nuclear Research + |CERN| / + 1211

[ZODB-Dev] Server-side caching

2012-02-10 Thread Pedro Ferreira
to happen. I know there are client-side caches, but in a multiple client/server context I wonder if it's not faster to ask the DB for an oid that is already in memory instead of retrieving it from the client cache? Thanks in advance, Pedro -- José Pedro Ferreira Software Developer, Indico Project

Re: [ZODB-Dev] Persisting Python objects in MongoDB

2011-11-08 Thread Pedro Ferreira
development! Pedro -- José Pedro Ferreira Software Developer, Indico Project http://indico-software.org +---+ + '``'--- `+ CERN - European Organization for Nuclear Research + |CERN| / + 1211 Geneve 23, Switzerland + ..__. \. + IT-CIS-AVC + \\___.\ + Office: 513-1-005

Re: [ZODB-Dev] Call for volunteers: help w finishing Python BTrees

2011-10-24 Thread Pedro Ferreira
Can you explain the rationale for dropping the use of '_marker' in favor of 'None'? As far as I can remember some tests in ZODB explicitly pass (None, None) when iterating over the whole structure, bit I will give it a better look later. -- José Pedro Ferreira Software Developer, Indico

Re: [ZODB-Dev] zeo.memcache

2011-10-06 Thread Pedro Ferreira
So accesses from different processes (or even different instances of the cache connector) will modify it without synchronisation. Supporting such setup requires using the test-and-set memcached operation, plus some sugar. I just don't think this was intended to be supported in the original

Re: [ZODB-Dev] notes re trying to run ZODB on PyPy

2011-10-04 Thread Pedro Ferreira
: http://talk.quintagroup.com/blogs/myroslav/zope-at-gae Does anyone know if any code has been made available? Best regards, Pedro -- José Pedro Ferreira Software Developer, Indico Project http://indico-software.org +---+ + '``'--- `+ CERN - European Organization for Nuclear Research

Re: [ZODB-Dev] I would like to know if api exists nowadays to get list of all objects which where modified in a transaction ?

2011-07-29 Thread Pedro Ferreira
for debugging? I hope it helps. Cheers, Pedro -- José Pedro Ferreira Software Developer, Indico Project http://indico-software.org +---+ + '``'--- `+ CERN - European Organization for Nuclear Research + |CERN| / + 1211 Geneve 23, Switzerland + ..__. \. + IT-UDS-AVC + \\___.\ + Office

Re: [ZODB-Dev] Corrupted OOTreeSet - strange behavior

2011-07-18 Thread Pedro Ferreira
. Thanks, Pedro -- José Pedro Ferreira Software Developer, Indico Project http://indico-software.org +---+ + '``'--- `+ CERN - European Organization for Nuclear Research + |CERN| / + 1211 Geneve 23, Switzerland + ..__. \. + IT-UDS-AVC + \\___.\ + Office: 513-1-005

Re: [ZODB-Dev] I would like append an indexer with uuid key at root of my ZODB, how can I append an function to commit event to update this uuid catalog ?

2011-06-28 Thread Pedro Ferreira
. Cheers, Pedro -- José Pedro Ferreira Software Developer, Indico Project http://indico-software.org +---+ + '``'--- `+ CERN - European Organization for Nuclear Research + |CERN| / + 1211 Geneve 23, Switzerland + ..__. \. + IT-UDS-AVC + \\___.\ + Office: 513-1-005

Re: [ZODB-Dev] I would like append an indexer with uuid key at root of my ZODB, how can I append an function to commit event to update this uuid catalog ?

2011-06-28 Thread Pedro Ferreira
It's the same doc that I send in my previous mail. Oh sorry... anyway, why don't you store this UIID in the object itself? Then you can just retrieve the UUIDs of any result set in O(n). Cheers, Pedro -- José Pedro Ferreira Software Developer, Indico Project http://indico-software.org

Re: [ZODB-Dev] Speeding up ZODB (was redis cache for RelStorage)

2011-05-06 Thread Pedro Ferreira
values of network usage oscillating between 100 and 200 KB/s. But I guess that if I were loading an excessive amount of data, this value would be higher, no? Thanks a lot for your answers. Pedro -- José Pedro Ferreira Software Developer, Indico Project http://indico-software.org

Re: [ZODB-Dev] Speeding up ZODB (was redis cache for RelStorage)

2011-05-06 Thread Pedro Ferreira
history. It slightly increases during DB packing, but otherwise stays around 1. Thanks a lot for your answers. Cheers, Pedro -- José Pedro Ferreira Software Developer, Indico Project http://indico-software.org +---+ + '``'--- `+ CERN - European Organization for Nuclear Research

Re: [ZODB-Dev] Speeding up ZODB (was redis cache for RelStorage)

2011-05-06 Thread Pedro Ferreira
It would be cool if you could give a hint to ZEO somehow to prefetch a certain set of objects along with their subobjects and then return everything in one batch. This way you avoid all the round-trips when you discover you want to retrieve a suboject. +1 But I guess that could be tricky,

[ZODB-Dev] Speeding up ZODB (was redis cache for RelStorage)

2011-05-05 Thread Pedro Ferreira
improve performance? Thanks, Pedro -- José Pedro Ferreira Software Developer, Indico Project http://indico-software.org +---+ + '``'--- `+ CERN - European Organization for Nuclear Research + |CERN| / + 1211 Geneve 23, Switzerland + ..__. \. + IT-UDS-AVC + \\___.\ + Office: 513-R

[ZODB-Dev] Commit one connection

2011-03-15 Thread Pedro Ferreira
in advance, Pedro -- José Pedro Ferreira Software Developer, Indico Project http://indico-software.org +---+ + '``'--- `+ CERN - European Organization for Nuclear Research + |CERN| / + 1211 Geneve 23, Switzerland + ..__. \. + IT-UDS-AVC + \\___.\ + Office: 513-R-0042

[ZODB-Dev] Storing ordered elements

2010-11-02 Thread Pedro Ferreira
to avoid conflicts as much as possible, as this structure will be accessed very frequently from different ZEO clients. Can anybody think of a better solution for this? Thanks in advance, Best regards, Pedro Ferreira -- José Pedro Ferreira Indico Team IT-UDS-AVC 513-R-0042 CERN, Geneva

Re: [ZODB-Dev] Storing ordered elements

2010-11-02 Thread Pedro Ferreira
-- José Pedro Ferreira Indico Team IT-UDS-AVC 513-R-0042 CERN, Geneva, Switzerland ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman

Re: [ZODB-Dev] Default comparison considered harmful in BTrees.

2010-10-26 Thread Pedro Ferreira
Or perhaps make it emit DeprecationWarnings, but continue working. Then make it a fatal error in the next minor/major release. +1 Pedro -- José Pedro Ferreira Indico Team IT-UDS-AVC 513-R-0042 CERN, Geneva, Switzerland ___ For more

Re: [ZODB-Dev] Weird KeyError with OOBTree

2010-08-16 Thread Pedro Ferreira
and implement a __cmp__ function for it... Thanks a lot! Pedro -- José Pedro Ferreira Indico Team IT-UDS-AVC 513-R-0042 CERN, Geneva, Switzerland ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing

Re: [ZODB-Dev] Weird KeyError with OOBTree

2010-08-16 Thread Pedro Ferreira
, security... well, I guess they're not that large. I will give it a look, maybe I'll use it. Thanks a lot! Pedro -- José Pedro Ferreira Indico Team IT-UDS-AVC 513-R-0042 CERN, Geneva, Switzerland ___ For more information about ZODB, see the ZODB Wiki

Re: [ZODB-Dev] Weird KeyError with OOBTree

2010-08-16 Thread Pedro Ferreira
libraries that I'm currently including: location, component, security... libraries that I'm currently *NOT* including of course :) -- José Pedro Ferreira Indico Team IT-UDS-AVC 513-R-0042 CERN, Geneva, Switzerland ___ For more information

Re: [ZODB-Dev] Random POSKeyErrors

2010-07-22 Thread Pedro Ferreira
for this particular oid. The strange thing is that the DB is 12GB large. Cheers, Pedro -- José Pedro Ferreira Indico Team IT-UDS-AVC 513-R-0042 CERN, Geneva, Switzerland ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org

[ZODB-Dev] Random POSKeyErrors

2010-07-21 Thread Pedro Ferreira
mean our FileStorage is corrupted, but I find it strange that it only happens occasionally. Any clue on what can be causing this? Thanks in advance, Pedro -- José Pedro Ferreira Indico Team IT-UDS-AVC 513-R-0042 CERN, Geneva, Switzerland ___ For more

Re: [ZODB-Dev] Indexing and dates/times

2010-07-13 Thread Pedro Ferreira
where items can be queried by date, and range queries can be performed efficiently, an IOBTree will do the job? As I mention above, my only concern is the number of sets that will have to be joined. Thanks, once again, Pedro -- José Pedro Ferreira Indico Team IT-UDS-AVC 513-R-0042 CERN

Re: [ZODB-Dev] Indexing and dates/times

2010-07-13 Thread Pedro Ferreira
range. If you tell me it will be OK, I won't hesitate :). Regards, Pedro -- José Pedro Ferreira Indico Team IT-UDS-AVC 513-R-0042 CERN, Geneva, Switzerland ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB

[ZODB-Dev] Indexing and dates/times

2010-07-12 Thread Pedro Ferreira
object and comparing it with the provided range (even worse); Maybe there is some other way to do it? Any suggestions? Thanks in advance, Regards, Pedro -- José Pedro Ferreira Indico Team IT-UDS-AVC 513-R-0042 CERN, Geneva, Switzerland

Re: [ZODB-Dev] BTrees and id mapping (was Re: Data.fs size grows non-stop)

2009-12-14 Thread Pedro Ferreira
David Glick wrote: Pedro Ferreira wrote: Hello all, So, I've been experimenting with a new structure for our date indexes, and I was considering using an IOBTree that would map integer timestamps to BTree-based sets. As for the sets, I considered two options: Be careful

[ZODB-Dev] BTrees and id mapping (was Re: Data.fs size grows non-stop)

2009-12-11 Thread Pedro Ferreira
Hello all, So, I've been experimenting with a new structure for our date indexes, and I was considering using an IOBTree that would map integer timestamps to BTree-based sets. As for the sets, I considered two options: 1. An IITreeSet based on the OID and an additional IOBTree that maps back

Re: [ZODB-Dev] Data.fs size grows non-stop

2009-12-10 Thread Pedro Ferreira
Jim Fulton wrote: On Wed, Dec 9, 2009 at 10:54 AM, Pedro Ferreira jose.pedro.ferre...@cern.ch wrote: ... Well, at least we won't have to rewrite the whole bucket... but still, it would be much nicer to fragment the list in smaller chunks. We could use an OOBTree instead... but something

Re: [ZODB-Dev] Data.fs size grows non-stop

2009-12-10 Thread Pedro Ferreira
zope.app has no global securitypolicy') weird... Marius Gedminas wrote: On Wed, Dec 09, 2009 at 06:09:36PM +0200, Marius Gedminas wrote: On Wed, Dec 09, 2009 at 02:42:58PM +0100, Pedro Ferreira wrote: Hello, Just zodbbrowser with no prefix: http://pypi.python.org/pypi

Re: [ZODB-Dev] Data.fs size grows non-stop

2009-12-10 Thread Pedro Ferreira
If you need performance, take a look at the z3c.indexer package which offers a much faster indexing concept. I implemented this package because my app coudn't handle the implicit default indexing handling. The README.txt explains what is different and how to use it. It defently needs some

Re: [ZODB-Dev] Data.fs size grows non-stop

2009-12-10 Thread Pedro Ferreira
Hello, Are the values in your BTree implemented as persistent lists or some other subclass of Persistent? That makes a big difference in the size of each commit to the BTree. Yes, that is exactly the problem. We are using simple Python lists, and that implies rewriting the whole bucket.

Re: [ZODB-Dev] Data.fs size grows non-stop

2009-12-09 Thread Pedro Ferreira
Hello, In the case of BTrees, yes. I assume your OOBuckets are used within OOBTrees. (?) Yes. I was not sure whether OOBTrees behaved exactly like a BTree. So, since we are adding very large lists as values, the tree remains unbalanced, No, they trees tend to stay fairly well

Re: [ZODB-Dev] Data.fs size grows non-stop

2009-12-09 Thread Pedro Ferreira
OOBTrees are complex? No, I meant something list-like, rather than key-value. ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org

Re: [ZODB-Dev] Data.fs size grows non-stop

2009-12-07 Thread Pedro Ferreira
Hello all, Since some time ago (not sure since when) our database has passed from 15GB to 65GB so fast, and it keeps growing little by little (2 to 5 GB per day). It is clear that something is not correct in it. I'd just like to add that there's some changes that can be related to this: -

[ZODB-Dev] Traceback with ZODB 3.9.0

2009-09-25 Thread Pedro Ferreira
Hello, I was trying to migrate a machine from 3.8.1 to 3.9.0, but I'm getting the following error: 2009-09-25T16:34:35 (2606) new connection ('137.138.4.155', 45551): ManagedServerConnection ('137.138.4.155', 45551) 2009-09-25T16:34:35 (137.138.4.155:45551) received handshake 'Z309'

Re: [ZODB-Dev] CRC check failed when running repozo

2009-09-14 Thread Pedro Ferreira
I've sent a mail to this list on 05/26/09 reporting a similar issue. Regards, Pedro Christian Theune wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 09/14/2009 10:06 AM, Chris Withers wrote: Hi All, Anyone ever see this? Traceback (most recent call last): File

[ZODB-Dev] ZEO and fork()

2009-07-01 Thread Pedro Ferreira
the child process hangs. But if we import ClientStorage only inside the process, it seems to work OK. Is this supposed to happen? Is there a workaround? Regards, Pedro -- José Pedro Ferreira (Software Developer, Indico Project) IT-UDS-AVC CERN Geneva, Switzerland Office 513-R-042 Tel. +41

[ZODB-Dev] Transaction blocked waiting for storage

2009-06-22 Thread Pedro Ferreira
Pedro Ferreira (Software Developer, Indico Project) IT-UDS-AVC CERN Geneva, Switzerland Office 513-R-042 Tel. +41 22 76 77159 ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev

Re: [ZODB-Dev] URGENT: ZODB down - Important Software Application at CERN

2009-06-11 Thread Pedro Ferreira
was pretty easy. I just checked it in and the fix will be in the next 3.9 release. Jim -- Jim Fulton Zope Corporation -- José Pedro Ferreira (Software Developer, Indico Project) IT-UDS-AVC CERN Geneva, Switzerland Office 513-R-042 Tel. +41 22 76 77159

Re: [ZODB-Dev] ZODB.__version__

2009-06-09 Thread Pedro Ferreira
Why do you want to? If ZODB is installed using setuptools (e.g. buildout), then you can use pkg_resources to find out what version is installed. Fair enough :). I guess I'll use it then. Thanks, Regards, Pedro -- José Pedro Ferreira (Software Developer, Indico Project) IT-UDS

[ZODB-Dev] ZODB.__version__

2009-06-08 Thread Pedro Ferreira
-- José Pedro Ferreira (Software Developer, Indico Project) IT-UDS-AVC CERN Geneva, Switzerland Office 513-R-042 Tel. +41 22 76 77159 ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB

Re: [ZODB-Dev] URGENT: ZODB down - Important Software Application at CERN

2009-05-26 Thread Pedro Ferreira
Tres Seaver wrote: Pedro Ferreira wrote: Thanks a lot for your help. In fact, it was a matter of increasing the maximum recursion limit. There's still an unsolved issue, though. Each time we try to recover a backup using repozo, we get a CRC error. Is this normal? Has it happened

Re: [ZODB-Dev] URGENT: ZODB down - Important Software Application at CERN

2009-05-26 Thread Pedro Ferreira
Jim Fulton wrote: On May 25, 2009, at 9:23 AM, Pedro Ferreira wrote: Dear Andreas, Marius, This means that you're using ZEO, right? Have you tried to use strace to see what it's doing? Is it using any CPU time? Yes, we're using ZEO. It's doing a lot of lseek() and read() calls, i.e

[ZODB-Dev] URGENT: ZODB down - Important Software Application at CERN

2009-05-25 Thread Pedro Ferreira
help us out, since this is becoming a big issue here at CERN (a lot of people's work depends on this). Thank you very much in advance, Best regards, Pedro Ferreira -- José Pedro Ferreira (Software Developer, Indico Project) IT-UDS-AVC CERN Geneva, Switzerland Office 513-R-042 Tel. +41 22 76

Re: [ZODB-Dev] URGENT: ZODB down - Important Software Application at CERN

2009-05-25 Thread Pedro Ferreira
___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev -- José Pedro Ferreira (Software Developer, Indico Project) IT-UDS-AVC CERN Geneva, Switzerland

Re: [ZODB-Dev] URGENT: ZODB down - Important Software Application at CERN

2009-05-25 Thread Pedro Ferreira
ways of lightening up the DB. Any recommendations regarding this point? Thanks in advance, and, once again, thanks a lot for the precious help, Best regards, Pedro Pedro Ferreira wrote: Dear Andreas, Marius, This means that you're using ZEO, right? Have you tried to use strace to see

[ZODB-Dev] DisconnectedError

2007-05-04 Thread José Pedro Ferreira
Hello. I am experiencing a problem with ZODB-3.6.0 / Python 2.5, under Linux. Each time I initialize a database, i get a DisconnectedError exception in the client, with the following traceback: quote File /home/pferreir/workspace/indico/code/code/MaKaC/common/db.py, line 50, in __init__

Re: [ZODB-Dev] DisconnectedError

2007-05-04 Thread José Pedro Ferreira
Gary Poster wrote: Hi. ZODB does not currently work with Py2.5. Gary OK, thanks. However, I was able to make it work, running this simple script, and then running the application again. quote #!/usr/bin/python import ZODB from ZODB import FileStorage, DB import transaction storage =

Re: [ZODB-Dev] DisconnectedError

2007-05-04 Thread José Pedro Ferreira
in the last mail (weird...). Best regards, Pedro Ferreira ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] DisconnectedError

2007-05-04 Thread José Pedro Ferreira
Yes, the DB did not exist. And yes, it's not a hack, it's only opening and closing the database... but it unexpectedly works after doing it. Cheers, Pedro On May 4, 2007, at 11:25 AM, José Pedro Ferreira wrote: Jim Fulton wrote: I don't know why the client is being disconnected