[ZODB-Dev] ZEO Cache inconsistency

2009-10-20 Thread Vincent Pelletier
at the end of the transaction (the last invalidation number will have been long forgotten by Zeo) - it might slow down transaction to add an exchange at storage join (if there is none at the moment, which I don't know) -- Vincent Pelletier ___ F

Re: [ZODB-Dev] ZEO Cache inconsistency

2009-10-29 Thread Vincent Pelletier
o this, thanks a lot. -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] undo (and storage interface) brokenness

2009-12-24 Thread Vincent Pelletier
w who used that "undo" tab are actually interested in undoing transactions modifying context, not transaction done on context (so they actually want to use the efficient "history" tab, the one using FileStorage object version back-pointers). -- Vincent Pelletier __

[ZODB-Dev] NEO High Performance Distributed Fault Tolerant ZODB Storage

2010-03-31 Thread Vincent Pelletier
terprise-High.Performance.Zope/view Regards, -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] Notes on using wrapper storages for record transformation

2010-05-19 Thread Vincent Pelletier
ld help here, not sure if it's worth the overhead. Why not defining some kind of callbacks in Storage API, which would allow to plug such mechanisms in a storage rather than wrapping around it ? -- Vincent Pelletier ___ For more information

Re: [ZODB-Dev] Notes on using wrapper storages for record transformation

2010-05-21 Thread Vincent Pelletier
probably be disabled by default before integration. -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

[ZODB-Dev] "Advanced ZODB for Python Programmers" article: volatile example

2010-05-24 Thread Vincent Pelletier
ve written about it earlier. [1] http://zodb.org/documentation/articles/ZODB2.html -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] "Advanced ZODB for Python Programmers" article: volatile example

2010-05-24 Thread Vincent Pelletier
Le lundi 24 mai 2010 12:02:40, Wichert Akkerman a écrit : > which prevents the exception overhead. Right, thought this is a tradeoff question: writing as exception handling is faster for "volatile is present" case, but slower for "volatile is missing" case.

Re: [ZODB-Dev] Notes on using wrapper storages for record transformation

2010-05-24 Thread Vincent Pelletier
infer that it is already standard for this to happen. > As with NEO, zc.zodbdgc was motivated by multiple databases where a single > database doesn't have enough information to perform garbage collection. Thanks for pointing this package out, I didn't know it. -- Vincent Pelle

Re: [ZODB-Dev] Conflict resolution (was Re: Notes on using wrapper storages for record transformation)

2010-05-24 Thread Vincent Pelletier
lock at the end of the > first phase. The lock is held while conflict resolution is > performed. Oops, I didn't realise that ZEO was postponing Storage.store calls until tpc_vote call. I now realise that this is required to not interleave stores from different tran

Re: [ZODB-Dev] Conflict resolution (was Re: Notes on using wrapper storages for record transformation)

2010-05-31 Thread Vincent Pelletier
updated version (esp. with the achieved/targetted isolation level). -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listi

Re: [ZODB-Dev] Storage API change: Checking for reading out-of-date data

2010-08-31 Thread Vincent Pelletier
ed by ZODB itself, especially for higher level use-casess. -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

[ZODB-Dev] Bug (?) in zope/publisher/publish.py:unwrapMethod

2011-01-25 Thread Vincent Pelletier
ng to fix in zope.publisher ? If so, I'll open a bug. [1] http://svn.zope.org/zope.publisher/trunk/src/zope/publisher/publish.py?view=markup Regards, -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zop

Re: [ZODB-Dev] How can I append Persistent mechanism to OrderedDict class ?

2011-01-30 Thread Vincent Pelletier
g.py?rev=113734&view=markup -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

[ZODB-Dev] [RFC] ZEO: Allow non-packaged products

2011-04-29 Thread Vincent Pelletier
n self.options.products + Products.__path__: +if d not in L: +L.append(d) +Products.__path__[:] = L self.setup_default_logging() self.check_socket() self.clear_socket() -- Vincent Pelletier ___ F

Re: [ZODB-Dev] [RFC] ZEO: Allow non-packaged products

2011-04-29 Thread Vincent Pelletier
was feeling late on this. I had a need for such option 4 years ago, but didn't have the knowledge to implement it back then. > Especially since there's an easy workaround like described above Indeed. Regards, -- Vincent Pelletier ___ Fo

Re: [ZODB-Dev] RelStorage breaks History tab

2011-09-02 Thread Vincent Pelletier
he rest looks standard API to me (or at least, Connection-level API, not storage- level). ...at least, we could get it to work in NEO ;) (easier than undo from performance point of view, but that's another story). -- Vincent Pelletier ___ For more inf

Re: [ZODB-Dev] Is there any convenient way to reduce the storage file size after delete something in database?

2011-09-27 Thread Vincent Pelletier
or packing) object revisions are deleted - garbage collection: unreachable objects are deleted As you noticed, with FileStorage this actually happens by copying every kept objects and transactions to a new data.fs, and swapping it with original data.fs - which gets renamed as *.old. Re

Re: [ZODB-Dev] the difference between normal class object and the ZODB Persistent subclass object

2011-09-27 Thread Vincent Pelletier
t class changed, the ghost will be of the wrong class. I think this bug was originally noticed by Julien (so CC'ed). -- Vincent Pelletier ERP5 - open source ERP/CRM for flexible enterprises ___ For more information about ZODB, see http://zodb.org/ ZOD

Re: [ZODB-Dev] RFC: oodb namespace package

2011-10-04 Thread Vincent Pelletier
O - FileStorage (would it still be inside ZODB ?) - DemoStorage - zlibstorage - ...other Storage interface implementations (NEO, RelStorage, etc) -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing l

Re: [ZODB-Dev] zeo.memcache

2011-10-06 Thread Vincent Pelletier
fix. Jim: Beware, it's GPL'ed ;) . /ducks Regards, -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] zeo.memcache

2011-10-06 Thread Vincent Pelletier
yboard - and a slow one, because it's late) and a pylint run. Regards, /me falls asleep on keyboard -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] zeo.memcache

2011-10-07 Thread Vincent Pelletier
ctually I'm not sure how this should be properly tested: testing this requires reproducing race conditions, and I think one cannot reproduce all possible race conditions in test cases, even knowing the code... Ideas ? Of course, I (as an exercise) stay focused on a stand-alone usage,

Re: [ZODB-Dev] zeo.memcache

2011-10-07 Thread Vincent Pelletier
ries. In current state my code should fit the needs of code outside transaction management, such as zeo.memcache . Regards, -- Vincent Pelletier ERP5 - open source ERP/CRM for flexible enterprises ___ For more information about ZODB, see http://zodb.o

Re: [ZODB-Dev] zeo.memcache

2011-10-12 Thread Vincent Pelletier
Le vendredi 7 octobre 2011 15:02:44, Vincent Pelletier a écrit : > Le vendredi 7 octobre 2011 14:16:42, Andreas Gabriel a écrit : > > However, is your implementation thread safe? Maybe I am blind ;). That > > was the reason I used lovely.memcached as memcached connector. Each >

Re: [ZODB-Dev] zeo.memcache

2011-10-12 Thread Vincent Pelletier
Le mercredi 12 octobre 2011 11:55:43, Vincent Pelletier a écrit : > "distributed" Woops. Networked lock server. Not distributed. -- Vincent Pelletier ERP5 - open source ERP/CRM for flexible enterprises ___ For more information about Z

Re: [ZODB-Dev] [RFC] Allow serial to be returned as late as tpc_finish.

2012-02-07 Thread Vincent Pelletier
None, so serial was not set) I verified there is no regression in "setup.py test", but I get 2 failures (both with an without my changes), one on ZEO/tests/zeo-fan-out.test and another on ZEO.tests.testZEO.client_has_newer_data_than_server . Regards, -- Vincent Pelletier ERP5 - open s

Re: [ZODB-Dev] How to update an object in a multithreading application?

2012-03-19 Thread Vincent Pelletier
ODB, that is. -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] How to update an object in a multithreading application?

2012-03-20 Thread Vincent Pelletier
are likely to alter the same object you will have poor performance, and difficult decisions to take to get out of it (if constrained by backward compatibility). When you must have a hot spot, design so that solving its conflicts: - is feasible (ie, there is one answer to enough conflict c

Re: [ZODB-Dev] How to update an object in a multithreading application?

2012-03-20 Thread Vincent Pelletier
ough to solve the issue wherever inter-database dependencies are one-way. -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] database conflict fail

2012-03-22 Thread Vincent Pelletier
you will keep the latest in commit order, not in transaction-begin order. -- Vincent Pelletier ERP5 - open source ERP/CRM for flexible enterprises ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org ht

Re: [ZODB-Dev] database conflict fail

2012-03-22 Thread Vincent Pelletier
starts: guess where in the object tree that object is. If you have varied classes, and significant data on your persistent instances, it will be easy. Ragards, -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev ma

Re: [ZODB-Dev] How to update an object in a multithreading application?

2012-03-22 Thread Vincent Pelletier
processing duration) might turn out to be better, and also readily available with any ZODB back-end. If ran on a big-enough (compared to available RAM and disk speed) ZODB, it will start causing problems, though. Regards, -- Vincent Pelletier __

Re: [ZODB-Dev] database conflict fail

2012-03-22 Thread Vincent Pelletier
is unsubscriptable This is the actual error, which will go away if you provide a string. -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] Is any function called when an object is loaded from the database?

2012-06-19 Thread Vincent Pelletier
have to have the code all over, and it won't be obviously > separated. Maybe a @property taking care of creating the actual PersistentDict if not present, then ? -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.or

Re: [ZODB-Dev] Is any function called when an object is loaded from the database?

2012-06-19 Thread Vincent Pelletier
etstate__, and I've been bitten by it when moving from Zope 2.8 to 2.12 (maybe 2.11 too ?) as 2.8 PythonScript objects were modified on load on the new version (adding a trailing \n IIRC), which broke "History" ZMI tab: one cannot alter a non-current object rev

[ZODB-Dev] [announce] NEO 1.0 - scalable and redundant storage for ZODB

2012-08-27 Thread Vincent Pelletier
org/gitweb/neoppod.git/blob/HEAD:/CHANGES NEO is published on pypi as "neoppod": http://pypi.python.org/pypi/neoppod Regards, -- Vincent Pelletier ERP5 - open source ERP/CRM for flexible enterprises ___ For more information about ZODB, see http:/

Re: [ZODB-Dev] [announce] NEO 1.0 - scalable and redundant storage for ZODB

2012-08-28 Thread Vincent Pelletier
On Mon, 27 Aug 2012 14:37:37 +0200, Vincent Pelletier wrote : > Under the hood, it relies on simple features of SQL databases To make things maybe a bit clearer, from the feedback I get: You can forget about SQL presence. NEO usage of SQL is as a relational as a handful of python dicts

Re: [ZODB-Dev] [announce] NEO 1.0 - scalable and redundant storage for ZODB

2012-08-28 Thread Vincent Pelletier
e general idea, we don't have much experience with blob handling ourselves (which is why we preferred to leave it asides rather than providing an unrealistic - and hence unusable - implementation). [1]http://git.erp5.org/gitweb/neoppod.git/blob/75d83690bd4a34cfe5ed83c949e4a32c7dec7c82:/neo/st

Re: [ZODB-Dev] documentation on the various caching options

2013-01-10 Thread Vincent Pelletier
just modified objects. Otherwise, it needs to flush the whole cache. I don't think there are other options on zeo side. I encourage you to read the code to be sure (no need to read all of it, but there are helpful docs, comments & docstrigns all over ZODB code). Check http://www.zodb.org

Re: [ZODB-Dev] Cache warm up time

2013-03-09 Thread Vincent Pelletier
ootprint. Any thought/comment ? -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] Cache warm up time

2013-03-11 Thread Vincent Pelletier
e committing to try to find points at which databases are globally consistent. It does its job so far, but beware: it won't resist malicious usage (trivial to DoS). [1] https://pypi.python.org/pypi/Products.TIDStorage -- Vincent Pelletier ERP5 - open source ERP/CRM for fle

Re: [ZODB-Dev] RFC: database ids

2013-08-14 Thread Vincent Pelletier
suits this better), but at least to use (db_id, _p_oid) as a cache key. -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] grab zodb dict keys by search term

2013-12-11 Thread Vincent Pelletier
t would be wondefull. BTrees have a very nice API, which allow scanning only a subset of keys by providing min and max boundaries: for key, value in some_btree.items( min='aa', max='b', excludemax=True): # Do stuff should do what you want. http://pythonhosted.org/B

Re: [ZODB-Dev] New ZODB Mailing list

2014-02-24 Thread Vincent Pelletier
oups.com , and reply to confirmation mail keeping subject intact. You should then receive subscription confirmation. -- Vincent Pelletier ERP5 - open source ERP/CRM for flexible enterprises ___ For more information about ZODB, see http://zodb.org/ ZODB-De

[ZODB-Dev] Shared/DC/ZRDB/TM.py:_register

2008-05-13 Thread Vincent Pelletier
all to TM._register "only" causes the instance to be commited at next transaction using it. Is there any reason why TM._register is hiding exceptions ? -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http:/

Re: [ZODB-Dev] Shared/DC/ZRDB/TM.py:_register

2008-05-13 Thread Vincent Pelletier
e bugtracker about this problem, because it's a separate issue from the TM.py problem: https://bugs.launchpad.net/bugs/229863 -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] Shared/DC/ZRDB/TM.py:_register

2008-05-22 Thread Vincent Pelletier
ion class inheritance scheme is not so good, and that it would be needed to create more abstract exceptions classes to inherit from. For example, an exception class which would instruct publisher to retry transaction and another to instruct it to give up (

Re: [ZODB-Dev] Shared/DC/ZRDB/TM.py:_register

2008-05-22 Thread Vincent Pelletier
revented (they currently are when exception happened during TPC). I'm not sure about the case where exception was raised before TPC: should commits be prevented in this case too ? Maybe it's the coder's responsibility not to call commit in the error hook. -- Vincent Pelletier