that can survive a restart. The
first prize would be if it's possible to share the cache between zeo
clients.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
On Fri, Mar 8, 2013 at 7:50 PM, Laurence Rowe l...@lrowe.co.uk wrote:
On 8 March 2013 09:38, Claudiu
persistent caches can
improve cache warm up time and if persistent caches are usable or not,
given that at various times in the past, it was recommended that one
try and avoid them.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
at it myself. Loading objects from a persistent cache
will still cause IO so to me it seems that it would be a big win to
keep the cache in memory even while restarting.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
On Thu, Mar 7, 2013 at 9:35 PM, Leonardo
not on reads though so I think it is
worthwhile to check out.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list
,
especially in a limited bandwith environment.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev
and load times
and a 30% reduction in index file size.
Jim
This is excellent news! Thank you very much for your time and effort too
make these improvements.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
On Sun, 2009-11-15 at 00:31 -0700, Shane Hathaway wrote:
Roché Compaan wrote:
On Sat, 2009-11-14 at 14:23 -0700, Shane Hathaway wrote:
I think proper construction of horizontally scalable databases must be
done partly at application level, since a lot of the issues to be solved
On Sat, 2009-11-14 at 14:23 -0700, Shane Hathaway wrote:
Roché Compaan wrote:
On Fri, 2009-11-13 at 13:33 -0700, Shane Hathaway wrote:
Stephan Richter wrote:
http://svn.zope.org/z3c.sharding/trunk
Great stuff! This approaches scaling a large data set at application
level though
to more than a 100 million members. We implemented a data
partitioning strategy at application level. If I had another shot at it,
I would try and develop a distributed ZODB storage, because it would be
a lot simpler compared to what we had to do at application level.
--
Roché Compaan
Upfront
On Fri, 2009-11-13 at 13:33 -0700, Shane Hathaway wrote:
Stephan Richter wrote:
On Friday 13 November 2009, Roché Compaan wrote:
We had such an opportunity about 2 years ago and although the client
never reached (and probably will never) reach the membership they
dreamed about, they did
If an object is modified on one ZEO client, will this always lead to a
__setstate__ call on this object on another ZEO client?
If not, is there any event or method that I can hook into to determine
if an object was modifed by another ZEO client?
--
Roché Compaan
Upfront Systems
Hi Alan
Thanks for the notice. We'll give this a go and report back.
Do you know how exactly it is decided what stays in the cache?
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
On Wed, 2008-09-17 at 10:26 -0500, Alan Runyan wrote:
There was a recent
On Sun, 2008-08-24 at 08:13 +0200, Dieter Maurer wrote:
Roché Compaan wrote at 2008-8-23 19:31 +0200:
On Sat, 2008-08-23 at 14:09 +0200, Dieter Maurer wrote:
Roché Compaan wrote at 2008-8-22 14:49 +0200:
I've been doing some benchmarks on Plone and got some surprising stats
on the pickle
This is the fsdump output for a single IOBTree:
data #00032 oid=1bac size=5435 class=BTrees._IOBTree.IOBTree
What is persisted as part of the 5435 bytes? References to containing
buckets? What else?
--
Roché Compaan
Upfront Systems http
On Sat, 2008-08-23 at 14:09 +0200, Dieter Maurer wrote:
Roché Compaan wrote at 2008-8-22 14:49 +0200:
I've been doing some benchmarks on Plone and got some surprising stats
on the pickle size of btrees and their buckets that are persisted with
each transaction. Surprising in the sense
On Sat, 2008-08-23 at 19:31 +0200, Roché Compaan wrote:
I am curious to know if you can explain why the proportion of actual
to total transaction size is so small?
Sorry that sentence isn't clear, I meant to say the proportion of
actual data on the document to the total transaction size
#10099,BTrees._IIBTree.IISet,65,182708
#10099,Products.Archetypes.BaseUnit.BaseUnit,3,767
#10099,BTrees._OOBTree.OOBucket,16,8088
#10099,BTrees._IIBTree.IITreeSet,2,122
Does it look normal?
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
On Fri, 2008-08-22 at 16:37 -0300, Sidnei da Silva wrote:
On Fri, Aug 22, 2008 at 9:49 AM, Roché Compaan
[EMAIL PROTECTED] wrot Transaction detail for txn #00099
(first document):
Txn id,Classname,Object count,Size (bytes)
#00099,BTrees._IIBTree.IIBTree,3,286
#00099,OFS.Folder.Folder
objects are being loaded.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
On Mon, 2008-04-07 at 16:16 +0200, Anton Stonor wrote:
We have a setup with a ZEO server and 4 ZEO clients.
During the last weeks we have seen almost daily deadlocks in some of the
ZEO
with the indexing and searching of objects.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev
resource is the mailing list. Unfortunately nobody has
documented their experience elsewhere before.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
___
For more information about ZODB, see the ZODB Wiki:
http
level in your application?
Yes.
The most valuable resource is the mailing list. Unfortunately
nobody
has
documented their experience elsewhere before.
Well, if I go with zeo/zodb and python, I'll be sure to document the
entire thing.
Cool! We really need that!
--
Roché Compaan
inside the customer and
line items in the order:
Customers
|
+--- Customer
|
+- Order
|
+--- Line item
Products
|
+ Product
Hope that helps.
--
Roché Compaan
Upfront Systems http
On Sat, 2008-03-22 at 04:55 -0400, Sean Allen wrote:
On Mar 22, 2008, at 3:50 AM, Roché Compaan wrote:
On Fri, 2008-03-21 at 22:49 -0400, Sean Allen wrote:
And we want to change the the description of Widget B and have that
change appear for everything, how do I do that?
basically, I
On Tue, 2008-03-04 at 13:27 -0700, Shane Hathaway wrote:
Roché Compaan wrote:
On Mon, 2008-02-25 at 07:36 +0200, Roché Compaan wrote:
I'll update my blog post with the final stats and let you know when it
is ready.
I'll have to keep running these tests because the more I run them
operations like insertion and lookup. They might be more *relevant* if
one performs the same tests using ZEO.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
___
For more information about ZODB, see the ZODB Wiki:
http
/
One question, if you run the test with concurrent threads, do each
thread insert a 100 objects (or a 1 for the second test)?
Is this test available in SVN somewhere?
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb
On Thu, 2008-02-07 at 20:26 +0100, Dieter Maurer wrote:
Roché Compaan wrote at 2008-2-7 21:21 +0200:
...
So if I asked you to build a data structure for the ZODB that can do
insertions at a rate comparable to Postgres on high volumes, do you
think that it can be done?
If you need a high
on high volumes, do you
think that it can be done? If so, would it not be worth investing time
and money into this? If not, why not?
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
___
For more information about ZODB
On Tue, 2008-02-05 at 19:17 +0100, Dieter Maurer wrote:
Roché Compaan wrote at 2008-2-4 20:54 +0200:
...
I don't follow? There are 2 insertions and there are 1338046 calls
to persistent_id. Doesn't this suggest that there are 66 objects
persisted per insertion? This seems way to high
.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
On Sat, 2008-02-02 at 22:10 +0100, Dieter Maurer wrote:
Roché Compaan wrote at 2008-2-1 21:17 +0200:
I have completed my first round of benchmarks on the ZODB and welcome
any criticism and advise. I summarised our earlier discussion and
additional findings in this blog entry:
http
I have completed my first round of benchmarks on the ZODB and welcome
any criticism and advise. I summarised our earlier discussion and
additional findings in this blog entry:
http://www.upfrontsystems.co.za/Members/roche/where-im-calling-from/zodb-benchmarks
--
Roché Compaan
Upfront Systems
this out with ZODB to see if it makes much
difference. If it does, then that would provide extra motivation for
me to add the missing test.
Roché Compaan said he would try it out, but I just realized that he
might have been waiting for me.
Sorry for not responding earlier. I actually
that there was about 1.3 million calls to persistent_id while
only 2 objects were persisted. So if it is being called for each
object I would expect a figure closer to 2, not 1.3 million. What am
I missing?
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
it a go as part of my benchmarks that I'm running and report
back.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing
this off.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman
On Wed, 2007-10-31 at 10:47 -0400, David Binger wrote:
On Oct 31, 2007, at 7:35 AM, Roché Compaan wrote:
Thanks for the explanation.
The actual insertion is very fast. Your benchmark is dominated by
the time to serialize the changes due to an insertion.
You should usually have just 2
database. Telling a ZODB programmer to use a relational database is an
insult ;-)
One of the tests that I want to try out next is to insert records
concurrently into different B-Trees.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
Tue Oct 30 20:28:04 2007/tmp
, compared to running
ZODB with a call to fsync.
I'm tempted to deploy ZODB without fsync on some production FileStorage
instances. Will I regret it?
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
___
For more information
On Fri, 2006-07-14 at 08:58 +0200, Joachim Schmitz wrote:
Roché Compaan schrieb:
If you have common add/edit methods in your app used by all of your
classes, you could do application level replication between Zopes. We
have written a small replication module for on of our apps that copes
On Fri, 2006-06-23 at 21:02 +0200, Dieter Maurer wrote:
Roché Compaan wrote at 2006-6-22 21:53 +0200:
...
What overhead does undo add to performance?
Very few -- apart from a fast growing storage file.
However, the log behaviour of FileStorage means that
you get a very different notion
data is highly structured (fixed schema), but this doesn't
make me choose an RDMBS - the frequency of writes, concurrency and
record volume does.
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
___
For more information
On Sat, 2006-06-24 at 09:24 +0200, Andreas Jung wrote:
--On 24. Juni 2006 08:53:43 +0200 Roché Compaan
[EMAIL PROTECTED] wrote:
I am curious what other strategies besides QueueCatalog you employ? Do
you ever use multiple backends for your apps? How do you decide that
this data belongs
differences become
clear. Maybe the fundamental difference is that pickles of objects have
a bigger footprint and yield to more disk IO, or most of the ZODB is
implemented in Python. I don't know, and I'm still curious.
--
Roché Compaan
Upfront Systems http
, or is it just Zope and Plone or grand object
frameworks built on top it that make it appear slow? (In all my
benchmarks this is shown to be mostly true)
--
Roché Compaan
Upfront Systems http://www.upfrontsystems.co.za
___
For more information
47 matches
Mail list logo
