Re: [ZODB-Dev] New ZODB Mailing list

2014-02-24 Thread Vincent Pelletier
, and reply to confirmation mail keeping subject intact. You should then receive subscription confirmation. -- Vincent Pelletier ERP5 - open source ERP/CRM for flexible enterprises ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev

Re: [ZODB-Dev] grab zodb dict keys by search term

2013-12-11 Thread Vincent Pelletier
be wondefull. BTrees have a very nice API, which allow scanning only a subset of keys by providing min and max boundaries: for key, value in some_btree.items( min='aa', max='b', excludemax=True): # Do stuff should do what you want. http://pythonhosted.org/BTrees/ -- Vincent

Re: [ZODB-Dev] RFC: database ids

2013-08-14 Thread Vincent Pelletier
this better), but at least to use (db_id, _p_oid) as a cache key. -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] Cache warm up time

2013-03-11 Thread Vincent Pelletier
transactions are committing to try to find points at which databases are globally consistent. It does its job so far, but beware: it won't resist malicious usage (trivial to DoS). [1] https://pypi.python.org/pypi/Products.TIDStorage -- Vincent Pelletier ERP5 - open source ERP/CRM for flexible enterprises

Re: [ZODB-Dev] Cache warm up time

2013-03-09 Thread Vincent Pelletier
/comment ? -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] documentation on the various caching options

2013-01-10 Thread Vincent Pelletier
side. I encourage you to read the code to be sure (no need to read all of it, but there are helpful docs, comments docstrigns all over ZODB code). Check http://www.zodb.org too. -- Vincent Pelletier ___ For more information about ZODB, see http

Re: [ZODB-Dev] [announce] NEO 1.0 - scalable and redundant storage for ZODB

2012-08-28 Thread Vincent Pelletier
On Mon, 27 Aug 2012 14:37:37 +0200, Vincent Pelletier vinc...@nexedi.com wrote : Under the hood, it relies on simple features of SQL databases To make things maybe a bit clearer, from the feedback I get: You can forget about SQL presence. NEO usage of SQL is as a relational as a handful

Re: [ZODB-Dev] [announce] NEO 1.0 - scalable and redundant storage for ZODB

2012-08-28 Thread Vincent Pelletier
experience with blob handling ourselves (which is why we preferred to leave it asides rather than providing an unrealistic - and hence unusable - implementation). [1]http://git.erp5.org/gitweb/neoppod.git/blob/75d83690bd4a34cfe5ed83c949e4a32c7dec7c82:/neo/storage/database/btree.py Regards, -- Vincent

[ZODB-Dev] [announce] NEO 1.0 - scalable and redundant storage for ZODB

2012-08-27 Thread Vincent Pelletier
/neoppod.git/blob/HEAD:/CHANGES NEO is published on pypi as neoppod: http://pypi.python.org/pypi/neoppod Regards, -- Vincent Pelletier ERP5 - open source ERP/CRM for flexible enterprises ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev

Re: [ZODB-Dev] Is any function called when an object is loaded from the database?

2012-06-19 Thread Vincent Pelletier
be obviously separated. Maybe a @property taking care of creating the actual PersistentDict if not present, then ? -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https

Re: [ZODB-Dev] Is any function called when an object is loaded from the database?

2012-06-19 Thread Vincent Pelletier
, and I've been bitten by it when moving from Zope 2.8 to 2.12 (maybe 2.11 too ?) as 2.8 PythonScript objects were modified on load on the new version (adding a trailing \n IIRC), which broke History ZMI tab: one cannot alter a non-current object revision. -- Vincent Pelletier

Re: [ZODB-Dev] database conflict fail

2012-03-22 Thread Vincent Pelletier
in the object tree that object is. If you have varied classes, and significant data on your persistent instances, it will be easy. Ragards, -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev

Re: [ZODB-Dev] How to update an object in a multithreading application?

2012-03-22 Thread Vincent Pelletier
ZODB back-end. If ran on a big-enough (compared to available RAM and disk speed) ZODB, it will start causing problems, though. Regards, -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev

Re: [ZODB-Dev] database conflict fail

2012-03-22 Thread Vincent Pelletier
a string. -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] How to update an object in a multithreading application?

2012-03-20 Thread Vincent Pelletier
of it (if constrained by backward compatibility). When you must have a hot spot, design so that solving its conflicts: - is feasible (ie, there is one answer to enough conflict cases to be actually useful) - can be done without accessing any other object Regards, -- Vincent Pelletier PS: I

Re: [ZODB-Dev] How to update an object in a multithreading application?

2012-03-20 Thread Vincent Pelletier
inter-database dependencies are one-way. -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] How to update an object in a multithreading application?

2012-03-19 Thread Vincent Pelletier
, that is. -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] zeo.memcache

2011-10-12 Thread Vincent Pelletier
Le mercredi 12 octobre 2011 11:55:43, Vincent Pelletier a écrit : distributed Woops. Networked lock server. Not distributed. -- Vincent Pelletier ERP5 - open source ERP/CRM for flexible enterprises ___ For more information about ZODB, see http

Re: [ZODB-Dev] zeo.memcache

2011-10-07 Thread Vincent Pelletier
possible race conditions in test cases, even knowing the code... Ideas ? Of course, I (as an exercise) stay focused on a stand-alone usage, where no ZODB conflict resolution would help recover from a bug. -- Vincent Pelletier ERP5 - open source ERP/CRM for flexible enterprises

Re: [ZODB-Dev] zeo.memcache

2011-10-07 Thread Vincent Pelletier
should fit the needs of code outside transaction management, such as zeo.memcache . Regards, -- Vincent Pelletier ERP5 - open source ERP/CRM for flexible enterprises ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list

Re: [ZODB-Dev] zeo.memcache

2011-10-06 Thread Vincent Pelletier
;) . /ducks Regards, -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] zeo.memcache

2011-10-06 Thread Vincent Pelletier
-- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] RFC: oodb namespace package

2011-10-04 Thread Vincent Pelletier
be inside ZODB ?) - DemoStorage - zlibstorage - ...other Storage interface implementations (NEO, RelStorage, etc) -- Vincent Pelletier ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org

Re: [ZODB-Dev] Is there any convenient way to reduce the storage file size after delete something in database?

2011-09-27 Thread Vincent Pelletier
revisions are deleted - garbage collection: unreachable objects are deleted As you noticed, with FileStorage this actually happens by copying every kept objects and transactions to a new data.fs, and swapping it with original data.fs - which gets renamed as *.old. Regards, -- Vincent Pelletier ERP5

Re: [ZODB-Dev] the difference between normal class object and the ZODB Persistent subclass object

2011-09-27 Thread Vincent Pelletier
. I think this bug was originally noticed by Julien (so CC'ed). -- Vincent Pelletier ERP5 - open source ERP/CRM for flexible enterprises ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https

Re: [ZODB-Dev] RelStorage breaks History tab

2011-09-02 Thread Vincent Pelletier
API to me (or at least, Connection-level API, not storage- level). ...at least, we could get it to work in NEO ;) (easier than undo from performance point of view, but that's another story). -- Vincent Pelletier ___ For more information about ZODB, see

[ZODB-Dev] [RFC] ZEO: Allow non-packaged products

2011-04-29 Thread Vincent Pelletier
= [] +for d in self.options.products + Products.__path__: +if d not in L: +L.append(d) +Products.__path__[:] = L self.setup_default_logging() self.check_socket() self.clear_socket() -- Vincent Pelletier

Re: [ZODB-Dev] [RFC] ZEO: Allow non-packaged products

2011-04-29 Thread Vincent Pelletier
, but didn't have the knowledge to implement it back then. Especially since there's an easy workaround like described above Indeed. Regards, -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB

Re: [ZODB-Dev] How can I append Persistent mechanism to OrderedDict class ?

2011-01-30 Thread Vincent Pelletier
=113734view=markup -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

[ZODB-Dev] Bug (?) in zope/publisher/publish.py:unwrapMethod

2011-01-25 Thread Vincent Pelletier
, I'll open a bug. [1] http://svn.zope.org/zope.publisher/trunk/src/zope/publisher/publish.py?view=markup Regards, -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB

Re: [ZODB-Dev] Storage API change: Checking for reading out-of-date data

2010-08-31 Thread Vincent Pelletier
for higher level use-casess. -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] Conflict resolution (was Re: Notes on using wrapper storages for record transformation)

2010-05-31 Thread Vincent Pelletier
(esp. with the achieved/targetted isolation level). -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

[ZODB-Dev] Advanced ZODB for Python Programmers article: volatile example

2010-05-24 Thread Vincent Pelletier
://zodb.org/documentation/articles/ZODB2.html -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] Advanced ZODB for Python Programmers article: volatile example

2010-05-24 Thread Vincent Pelletier
Le lundi 24 mai 2010 12:02:40, Wichert Akkerman a écrit : which prevents the exception overhead. Right, thought this is a tradeoff question: writing as exception handling is faster for volatile is present case, but slower for volatile is missing case. -- Vincent Pelletier

Re: [ZODB-Dev] Notes on using wrapper storages for record transformation

2010-05-24 Thread Vincent Pelletier
a single database doesn't have enough information to perform garbage collection. Thanks for pointing this package out, I didn't know it. -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev

Re: [ZODB-Dev] Conflict resolution (was Re: Notes on using wrapper storages for record transformation)

2010-05-24 Thread Vincent Pelletier
is held while conflict resolution is performed. Oops, I didn't realise that ZEO was postponing Storage.store calls until tpc_vote call. I now realise that this is required to not interleave stores from different transactions in underlying storage. -- Vincent Pelletier

Re: [ZODB-Dev] Notes on using wrapper storages for record transformation

2010-05-21 Thread Vincent Pelletier
before integration. -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] Notes on using wrapper storages for record transformation

2010-05-19 Thread Vincent Pelletier
the overhead. Why not defining some kind of callbacks in Storage API, which would allow to plug such mechanisms in a storage rather than wrapping around it ? -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http

[ZODB-Dev] NEO High Performance Distributed Fault Tolerant ZODB Storage

2010-03-31 Thread Vincent Pelletier
-High.Performance.Zope/view Regards, -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

Re: [ZODB-Dev] undo (and storage interface) brokenness

2009-12-24 Thread Vincent Pelletier
interested in undoing transactions modifying context, not transaction done on context (so they actually want to use the efficient history tab, the one using FileStorage object version back-pointers). -- Vincent Pelletier ___ For more information about

Re: [ZODB-Dev] ZEO Cache inconsistency

2009-10-29 Thread Vincent Pelletier
. -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev

[ZODB-Dev] ZEO Cache inconsistency

2009-10-20 Thread Vincent Pelletier
invalidation number will have been long forgotten by Zeo) - it might slow down transaction to add an exchange at storage join (if there is none at the moment, which I don't know) -- Vincent Pelletier ___ For more information about ZODB, see the ZODB

Re: [ZODB-Dev] Shared/DC/ZRDB/TM.py:_register

2008-05-22 Thread Vincent Pelletier
class which would instruct publisher to retry transaction and another to instruct it to give up (...and of course abort transaction) as fast as possible. I have no idea about the needed amount of work. -- Vincent Pelletier ___ For more information about

[ZODB-Dev] Shared/DC/ZRDB/TM.py:_register

2008-05-13 Thread Vincent Pelletier
transaction using it. Is there any reason why TM._register is hiding exceptions ? -- Vincent Pelletier ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org