Hi Chris,I am no ZODB expert. But I see a few thins that are wrong with the code. Others should be able to comment at length: - You cant just catch ConflictError and pass - I think you can catch a ReadConflictError and *retry* that is ok.
- But a ConflictError needs to be *retried* manually in
Hi guys.
Got this on, http://paste.plone.org/13772
The entire zope comes to a halt.
any ideas?
cheers
alan
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
Hi guys.
Running Zope 2.9.6 with ZODB 3.6.2 on Python 2.4
Having lots of lockups. Have approximately 12 zeo clients on 2
machines connecting to a single zeo server. All on local network.
Disks and network is monitored by competent hosting company. All
looks healthy except zeo communication.
How does data get into the ZEO storage then?
We have 10 ZEO clients that are for public consumption READ ONLY.
We have a separate ZEO client that is writing that is on a separate box.
The website got slashdoted this morning and we had 4 zeo clients go
out. Basically waiting for the zeo server
I'ev not had anything but bad experiences with pound myself, lvs seems a
much more preferable alternative...
We have not had such negative experiences with pound.
data = self.socket.recv(buffer_size)
error: (113, 'No route to host')
That *is* very odd, anything other than pound being
Aborts: 2
Loads: 95941
Stores: 523
Conflicts: 0
Conflicts resolved: 20
Storage: 2
Server started: Wed Apr 11 10:56:50 2007
Clients: 8
Clients verifying: 0
Active transactions: 0
Commits: 9
Aborts: 0
Loads: 40836
Stores: 714
Conflicts: 0
Conflicts resolved: 167
--
Alan Runyan
Enfold Systems, Inc
Storage: 1
Server started: Wed Apr 11 10:56:50 2007
Clients: 10
Clients verifying: 0
Active transactions: -1
Huh? You're owing the system a transaction. However, by looking at the
code briefly, this might happen if tpc_abort() and _abort() kind of
overlap. And you did have two aborts at
the machine down as much as possible.
Thanks again guys!
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB
+1 for removing versions. they have been considered bad practice for
over 3 years.
I believe 100% its ok to remove them.
alan
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list -
I just checked out DirectoryStorage and grepped for getSerial - no occurances.
+1 for cleaning up the storage interfaces.. was looking at it over
xmas holidays to see if I could implement a sqlite version that was
undoless. I didnt get far ;(
alan
, the following error occurred while
attempting to render the standard error message, please see the event
log for full details: already have current data for oid)
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
snip...
line 96, in
__setstate__
Persistent.__setstate__(self, state)
MemoryError
means you have run out of memory. check your jail or how much memory
you have allocated.
you can call cache minimize after a threshold.. maybe every 100 iterations.
there are finer grain mechanisms to do
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http
for the past few weeks.
But how i'm going to find this other than seeing if the folder allows me
to iterate over the items is not throwing POSKeyError. Does that sound
like a decent litmus test?
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax
-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
___
For more information about ZODB, see the ZODB
the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
Makes sense.
Is zc.FileStorage an alternative packing strategy? Does it
use less memory?
http://svn.zope.org/zc.FileStorage/dev/src/zc/FileStorage/
cheers
alan
On Dec 17, 2007 8:29 AM, Jim Fulton [EMAIL PROTECTED] wrote:
On Dec 17, 2007, at 9:14 AM, Alan Runyan wrote:
...
not believe
Jim,
What would you consider a large active database?
curiously,
alan
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
Andreas,
Could you try to mount the catalog separately? My understanding is
the catalog is what makes storages a misery.
CMF/portal_catalog mounted as Filestorage
and CMF could be mounted as PGStorage.
I presume you would see much more reasonable performance?
cheers
--
Alan Runyan
Enfold
with it. Something like:
each record in a catalog may have an object for each index/metadata attribute
you are capturing. and possibly a few others. Each catalog entries contain
ts of object per object being indexed.That is my understanding.
--
Alan Runyan
Enfold Systems, Inc.
http
Kenneth,
I believe you will want to look into 'conflict resolution'.
Possible source of inspiration:
http://www.zope.org/Documentation/Articles/ZODB2
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis
in that vein, DirectoryStorage-behind-ZEO has worked perfectly for
years... but this new stuff is very interesting!
wishing we could get DirectoryStorage into svn.zope.org
~alan
___
For more information about ZODB, see the ZODB Wiki:
persistent.Persistent directly? Then
you can instrument the MyMixin with the logging?
Another GSOC idea: Best Practices of ZODB Programming.
cheers
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
instead of mixin persistent.Persistent directly? Then
you can instrument the MyMixin with the logging?
Another GSOC idea: Best Practices of ZODB Programming.
cheers
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
--
Alan
for sessioning
/temporarystorage
--
Anton
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Enfold
the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
. you will probably get more help moving
this to the zope mailing list. check out DeadlockDebugger:
http://highspeedrails.com/Support/Howto/deadlockDebuggerHowto
cheers
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
Chris,
Are you seeing this error?
https://bugs.launchpad.net/zodb/+bug/114814
If so maybe Jim's latest changes fixed this in ZODB3.8.1b65
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com
/239086
- better import branch
http://svn.zope.org/ZODB/branches/ctheune-betterimport/
cheers
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
___
For more information about ZODB, see
- ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
___
For more information about ZODB, see the ZODB Wiki:
http
. You are not using Blob
as intended?
cheers,
alan runyan
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone: +1.713.942.2377x111
fax: +1.832.201.8856
___
For more information about ZODB, see
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Enfold Systems, Inc.
http://www.enfoldsystems.com/
phone
+ Oracle 10i.
Thanks in advance
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - zodb-...@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Enfold Systems, Inc
. Zope Stephan Richter
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - zodb-...@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Enfold Systems, Inc.
http
Hi.
I was just reviewing what is pending for ZODB 3.9.
https://bugs.launchpad.net/zodb/3.9/+bugs
Looks like all of the bugs listed for 3.9 are fixed or fixes are known
and pending.
Is a ZODB 3.9 beta around the corner?
According to changes.txt the first alpha of 3.9 was cut almost 1/2 year ago
. no guarantees need to figure out how we could schedule them to
run at night as to not interfere with our other builds
On Tue, Apr 7, 2009 at 5:17 PM, Jim Fulton j...@zope.com wrote:
On Apr 7, 2009, at 6:05 PM, Alan Runyan wrote:
I was just reviewing what is pending for ZODB 3.9.
https
has an unused import of sha which is triggered loads of dep warnings
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
Zope Corporation
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - zodb-...@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Enfold Systems, Inc.
http
In ZODB 3.9, you can pack without doing garbage collection. This
should at least buy you time, if not solve your problem (depending on
how much garbage your application creates.
What about zc.FileStorage? Does this support packing w/o GC?
And does that work on versions of ZODB 3.9?
.
alan runyan
analyze.py
Description: Binary data
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev
Would it be useful to have a document that starts detailing sections that are
missing in ZODB/ZEO programming guide?
i.e.
- Blobs are not mentioned.
- ZEO/Persistent disk cache not mentioned
- xdb reference safetybelt
- Documentation of various backend storages
- Relstorage,
On Tue, May 26, 2009 at 1:58 PM, Shane Hathaway sh...@hathawaymix.org wrote:
Jim Fulton wrote:
FileStorage indexes can't be saved after they reach a certain size,
where size roughly based on the number of objects.
I need to find a way to fix this.
It might be interesting to use SQLite for
On Mon, Jun 22, 2009 at 10:06 AM, Andreas Jungli...@zopyx.com wrote:
On 22.06.09 16:56, Pedro Ferreira wrote:
Hello all,
We occasionally get some messages like this in the logs:
2009-06-22T14:12:42 (30651/137.138.128.213:35787) Transaction blocked
waiting for storage. Clients waiting: 1.
On Thu, Jun 25, 2009 at 7:19 AM, Izak Burgeri...@upfrontsystems.co.za wrote:
Benji York wrote:
Have you looked at the contents of the files? Once you have an idea of
what is being written you might be able to determine what is doing the
writing.
The big 6.3GB one contains pickles. Lots and
On Wed, Aug 26, 2009 at 8:08 AM, Chris Withersch...@simplistix.co.uk wrote:
Hi All,
I'm wondering if there's any way to get a ZEO server to log about how
it's performing?
(eg: how many connections, how many clients are waiting, where they're
waiting, etc)
I'm trying to debug a problem
I am very intrigued now to setup an EC2 cluster and install a z3c.sharding
based solution demonstrating 100M users with some data. Mmmh...
That is the great thing about EC2. You can do massive experiments on the cheap.
Actually one of our interns is doing some work on ZODB. He is doing
I'd just like to add that there's some changes that can be related to this:
- we had some classes inheriting from Persistent that now inherit from
something else as well (but no extra arguments are being added, AFAIK);
- we added some zope.interface definitions to some Persistent classes;
we have some huge ZODB file storage (60-80 GB each) and we want
to split the storage into a number of smaller storage (easier
to handle for backup and packing). The storages themselves only
contain a few (Zope 2) folders - let's say folders A, B, C -
within the root and we want to create
Hello,
So far I know Hanno fixed that.
Any chance to get it released as 3.9.5?
Absolutely, it will be released in 3.9.5.
This will likely happen in 2 or 3 weeks.
Good to hear.
There are a few issues that seem to have patches, will those make it?
-
I think a ZODB book would be a wonderful edition to Packt's NoSQL
library. I really believe the ZODB book should *not* talk about any
web framework integration. There is plenty of information to convey
about ZODB without talking about integrating it into external
projects. It would be great if
So, the best place to call those would be during my commit break (whenever I
decide to take it? [which would be less often if I could be sure of no
crashing]). Are there any other problems with the way I was using ZODB in
my code? I really like it, but I recognize that it's a lot more
On Tue, May 18, 2010 at 1:14 PM, Ryan Noon rmn...@gmail.com wrote:
Hi All,
I converted my code to use LOBTrees holding LLTreeSets and it sticks to the
memory bounds and performs admirably throughout the whole process.
Unfortunately opening the database afterwards seems to be really really
Does RelStorage handle concurrent writes correctly? This is probably
so obvious as to ask if the sky is blue, but I couldn't tell from the
documentation if I could setup multiple Zope (Plone in my case)
instances all using RelStorage to talk to the same database without
incident.
relstorage
I suppose you could look at zeoraid.
Hadn't thought of that, will look at it, thanks!
Anyone using ZEORaid in production?
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list -
when we start accepting contributions.
cheers
alan runyan
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
https://mail.zope.org/mailman/listinfo/zodb-dev
How to sign up as a volunteer?
I have you signed up to volunteer- thanks!
alan
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
Greate idea! Just, what happens if the goal isn't met?
Plus, I'd really like to see docs on DirectoryStorage.
If I can not get enough contributions for an initial
advance for Carlos to begin work -- the project
will be aborted.
As we start getting contributions there will be more
activity on
http://zodbdocs.blogspot.com/
Unfortunately we could not get a 501c3 organization to accept
donations for the project in a timely manner. Enfold Systems has
wired up is paypal account and will take donations on behalf of the
ZODB book. Once we get the 2k in donations; we will transfer the
money
Mixing meta data into names is a bad idea. You don't want to change
the name of something just because some of its meta data changes.
Your right. It's just that sometimes people may have a package name
that is not agreeable to the broader community.
The namespace could be, zodb.
No it
://zodbdocs.blogspot.com/ - ZODB Book Project
cheers,
alan runyan
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/
ZODB-Dev mailing list - ZODB-Dev@zope.org
https://mail.zope.org/mailman/listinfo/zodb-dev
For anyone who cares. ZODB trunk builds win32 and amd64 have been
passing tests for almost a week without failures. Thanks Jim for
getting ZODB tests working reliably on Windows!
cheers
alan
p.s. let us know if you need py2.7 builders and what to test. you can
find all the builders at
I'm wondering if some of my issues might be alleviated by persistent
client caches.
anything is possible.
Now, I have the impression that these were unreliable and buggy and had
been so for some time.
they appear to be more stable now. we use them on several customer's
in very specific
I went for the following in the end:
...
cache-size 200Mb
client app
wait on
/zeoclient
mount-point /
cache-size 5
cache-size-bytes 500Mb
Any obvious issues with that?
No.
each zeoclient needs a name in your conf. required
so the .zec
we are currently investigating options for a large-scale solution
where the machines (ZEO clients and ZEO server) should be separated
across two data centers. Incoming traffic should be balanced between
both data centers. Automatic failover and online-replication are
desirable -
I'm starting to dig into the code, but perhaps this can
be answered quickly: can RelStorage be used in place of
FileStorage for ZEO storage?
My understanding is Yes. Try it. IIRC you can even use
a ZEO storage in place of a FileStorage. You may want
to specify what version of python, zodb
is interested in contributing;
maybe starting a recipe-style section for the book. We can get you
account and you can start contributing on github (svn is supported).
cheers
alan runyan
___
For more information about ZODB, see the ZODB Wiki:
http
Thanks to Carlos and Jens we have the ZODB book being updated
daily on zodb.org, http://www.zodb.org/zodbbook/ -- also have
disqus integrated into sphinx html output. People can read the
first three chapters and provide feedback at the bottom of each page.
Posting comments is a pain. I have
I have read that there is a problem to implement MS-SQL adapter for
Relstorage because the “Two phase commit” feature is not exposed by
MS-SQL server .
unsure about that. probably depends on the client access library.
Is there solution to overcome this problem, Without introducing too many
Right, but, even if the MySQL server is 64-bit, if the clients are
32-bit, they won't have this problem, will they?
if your running a 64bit python - you will see substantial
memory growth.
___
For more information about ZODB, see the ZODB Wiki:
We've been successfully running Plone 3.3 + Zope 2.10 + Relstorage + MySql
for a couple of years now. We're running low on memory on our existing
server (which has numerous other services on it) and will soon need to deploy
an additional Plone 4.1 + Zope 2.13 + Relstorage + Mysql
On Thu, Oct 20, 2011 at 12:39 PM, Tamer Higazi th9...@googlemail.com wrote:
Hi!
I am interisted getting ZODB to run on ironpython. Is that at the moment
possible?!
As I red, all python modules could be loaded on .NET without any
problems as long they wouldn't need any compiled modules. Is
I am updating an item in a separated thread but when it finishes the new
value is not updated in the same object in the main thread.
You need to call sync() on the connection object to see changes from
another thread.
http://zodb.readthedocs.org/en/latest/api.html#connections
In the example
may have to add some smarts the mssql storage)
I would love to see this support added.
--
Alan Runyan
Skype/Twitter:: runyaga
Office:: 713.942.2377 ext 111
http://ploud.com/ Plone site in less than 10 seconds
___
For more information about ZODB, see
?
dont know your application but it is doubtful that ZODB is your bottleneck.
--
Alan Runyan
Skype/Twitter:: runyaga
Office:: 713.942.2377 ext 111
http://ploud.com/ Plone site in less than 10 seconds
___
For more information about ZODB, see http://zodb.org
the drop rather than verify feature get verified when
connecting to a new replica? Should it?
--
Alan Runyan
Skype/Twitter:: runyaga
Office:: 713.942.2377 ext 111
http://ploud.com/ Plone site in less than 10 seconds
___
For more information about ZODB
Thanks for your response , i check the imports and seems to be ok but
still not working.
print sys.path from inside flask app and from the console script you run
which *does* work. then compare both of these sys.path listings.
--
Alan Runyan
Skype/Twitter:: runyaga
Office:: 713.942.2377 ext
ZODB, see http://zodb.org/
ZODB-Dev mailing list - ZODB-Dev@zope.org
https://mail.zope.org/mailman/**listinfo/zodb-devhttps://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Skype/Twitter:: runyaga
Office:: 713.942.2377 ext 111
http://ploud.com/ Plone site in less than 10 seconds
-Dev@zope.org
https://mail.zope.org/mailman/listinfo/zodb-dev
--
Alan Runyan
Skype/Twitter:: runyaga
Office:: 713.942.2377 ext 111
http://ploud.com/ Plone site in less than 10 seconds
___
For more information about ZODB, see http://zodb.org/
ZODB
82 matches
Mail list logo
