Rudá Porto Filgueiras wrote:
> (...)
> Module relstorage.adapters.mysql, line 506, in start_commit
> Module relstorage.adapters.mysql, line 672, in _hold_commit_lock
> StorageError: Unable to acquire commit lock
>
> I solve the problem restarting all instances, and the site became
> operationa
Rudá Porto Filgueiras wrote:
> Yes, it was closed in the midle of transaction, but if you are sure
> there is nothing to do with RelStorage and there is no possible or
> workaround to the RelStoratge MySQL adapter to lead with MySQL bugs or
> resistent do to network failures and recover from this "
Jürgen Herrmann wrote:
> i want RadosStorage to implement IMVCCStorage. so my understanding
> is that i remeber last_polled_tid (from invalidation polling and
> instead of loading the latest revision of an object, the storage
> always returns state as of the transaction with last_polled_tid,
> is t
Jürgen Herrmann wrote:
> is there a strict requirement for oids to be increasing?
No, but obviously there is a strict requirement that new_oid() return
unique OIDs.
> if RadosStorage could pre-allocate oids in batches of thousands, that
> would probably give me a big performance win, or to put i
Jim Fulton wrote:
> IPersistent specifies OIDs to be non-empty strings and reserves the
> 8-byte OID consisting of 8 null characters. Lots of ZODB
> infrastructure assumes that oids are 8 bytes. I'm tempted to say that
> oids must be 8-byte strings.
+1. The simplified standard promotes interope
Jürgen Herrmann wrote:
> what tests do i have to run in order to ensure full working
> state of a mvcc storage? how do i run these tests? i have
> lates zodb 3.9 beta in a virtualenv here.
I imagine you have taken a look at the RelStorage test suite, which is
based on the standard ZODB tests. It
Jim Fulton wrote:
> ZODB 3.9.0 is available at:
>
> http://pypi.python.org/pypi/ZODB3/3.9.0
>
> The changes from ZODB 3.8:
>
> http://pypi.python.org/pypi/ZODB3/3.9.0#id1
That's great news! Thanks for all the hard work.
Shane
___
For more inform
Chris Withers wrote:
> I've got a ZODB that's ballooned and I'm now having problems packing
> with zeopack.
>
> I tried with zeopack, which appeared to just hang (still in top, but no
> cpu usage for an hour or two), so I ctrl-c'ed it.
>
> Now when I try, I just get the text "Already packing" b
Chris Withers wrote:
> I thought RelStorage was slow at packing?
Not anymore. I optimized packing last December/January and it has been
plenty fast ever since, AFAIK.
Shane
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/W
Chris Withers wrote:
> Shane Hathaway wrote:
>> Chris Withers wrote:
>>> I thought RelStorage was slow at packing?
>> Not anymore. I optimized packing last December/January and it has been
>> plenty fast ever since, AFAIK.
>
> Interesting. Got any metrics
Benji York wrote:
> On Mon, Sep 14, 2009 at 2:44 PM, Shane Hathaway wrote:
>> People have been looking at these performance charts for quite a while:
>
> Are the benchmarks publicly available? I looked through the blog posts
> and svn.zope.org but couldn't find the
Chris Withers wrote:
> Shane Hathaway wrote:
>> Look at this chart in particular, which suggests that RelStorage with
>> PostgreSQL or MySQL is several times faster than ZEO for heavy read loads:
>
> Cool, now all I need is something like zeoraid for postgres (or, at a
>
kiorky wrote:
> diff -ur --exclude=.svn 3.7.orig/setup.py 3.8/setup.py |grep script
FWIW, the "|grep script" part trimmed too much and made the patch
unreadable.
Shane
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/
kiorky wrote:
> Any status on this issue ?
If your goal is to use RelStorage, it is not clear why you need the
scripts in ZODB.scripts. If you need zodbconvert, RelStorage currently
provides that.
Shane
___
For more information about ZODB, see the Z
kiorky wrote:
> I need repozo and all scripts to be generated, no matter that i use relstorage
> or not.
> When i install the ZODB egg, i want its maintenance scripts too.
> Out of the scope of relstorage, it's a 3.7 packaging isssue as the scripts
> arent
> there but they must be.
Well, it's not
Jim Fulton wrote:
> These benchmarks make ZEO+FS look pretty good relative to
> MySQLAdapter. The overall performance assuming even moderate;y
> effective ZEO pr object caches is significantly better for ZEO.
This is an excellent analysis. It pointed out some rough edges in
RelStorage performan
Laurence Rowe wrote:
> Shane's earlier benchmarks show MySQL to be the fastest RelStorage backend:
> http://shane.willowrise.com/archives/relstorage-10-and-measurements/
Yep, despite my efforts to put PostgreSQL on top. :-) It seems that
PostgreSQL has more predictable performance and behavior,
Ross J. Reedstrom wrote:
> For my druthers, I just _trust_ PostgreSQL a lot more: the one MySQL DB
> I have that I use on an on-going basis is my MythTV media-pc. Once a
> month or so I have to repair a table. I've used PostgreSQL in
> professional high load production for years and never had a cor
Jim Fulton wrote:
> The most complicated logic in the ZEO cache, which would be just as
> complicated with another cache storage implementation and more
> complicated with a shared cache storage is making sure the cache
> doesn't have stale state. I probably need to look at memcache again,
> but e
Jim Fulton wrote:
> On Wed, Oct 14, 2009 at 2:48 PM, Shane Hathaway wrote:
>> When ZODB is unpickling the state of an object, it often has to pull in
>> several objects, one at a time.
>
> Several object references.
Ah yes, and the class info for those object references
Shane Hathaway wrote:
> RelStorage currently uses memcached in a very simple way: it puts (tid,
> state) in the cache for each oid. When RelStorage reads from the cache,
> if it gets a state for a different transaction than the transaction ID
> last polled by the storage instance
Encolpe Degoute wrote:
> Is there someone in the ZODB development team following this:
> http://www.rackspacecloud.com/blog/2009/11/09/nosql-ecosystem/
It is possible that ZODB unfortunately occupies the same space as SQL in
the CAP triangle:
http://camelcase.blogspot.com/2007/08/cap-theorem.htm
Stephan Richter wrote:
> On Friday 13 November 2009, Roché Compaan wrote:
>> We had such an opportunity about 2 years ago and although the client
>> never reached (and probably will never) reach the membership they
>> dreamed about, they did pay us to develop a storage for members that
>> could sca
Roché Compaan wrote:
> On Fri, 2009-11-13 at 13:33 -0700, Shane Hathaway wrote:
>> Stephan Richter wrote:
>>> http://svn.zope.org/z3c.sharding/trunk
>
> Great stuff! This approaches scaling a large data set at application
> level though. Don't you think a ZODB
Wichert Akkerman wrote:
> On 11/13/09 21:33 , Shane Hathaway wrote:
>> I've been studying how to build an enormous database based on what I
>> know. There are an incredible number of distributed databases these
>> days, but all of them concern me in one way or another.
Roché Compaan wrote:
> On Sat, 2009-11-14 at 14:23 -0700, Shane Hathaway wrote:
>> I think proper construction of horizontally scalable databases must be
>> done partly at application level, since a lot of the issues to be solved
>> are specific to the application.
>
James Bergstra wrote:
> I'm surprised by the complete silence... was this post sent to the
> wrong list? What would be a better one?
This is the right list. I don't know why you didn't get an answer earlier.
>> Where can I find information on using BLOBs outside of plone? I use
>> ZODB directl
Adam GROSZER wrote:
> This is some tinkering about whether/how it is possible to make a ZODB
> storage that uses a simple kev-value database (KVDB) (e.g. tokyo tyrant).
> A KVDB that is persistent on disk or even replicated should not be
> less fault tolerant as MySQL.
I don't quite understand. W
Jim Fulton wrote:
> On Fri, Dec 4, 2009 at 11:31 AM, Erik Dahl wrote:
> ...
>> I haven't dove into the relstorage yet but have heard it will perform
>> better.
>
> It doesn't. See:
>
> https://mail.zope.org/pipermail/zodb-dev/2009-October/012758.html
Since you posted those numbers, I have wo
Erik Dahl wrote:
> I haven't dove into the relstorage yet but have heard it will perform
> better. Not sure I understand why though. Isn't it just putting
> pickles into a single table with an index on the oid? (or oid / serial).
Yes. In theory, ZEO should be about the same speed, but all t
Jim Fulton wrote:
> On Fri, Dec 4, 2009 at 3:07 PM, Shane Hathaway wrote:
>> http://shane.willowrise.com/archives/relstorage-1-4-0b1-and-zodbshootout/
>
> I won't take the time now to analyze the new test, although I will ask
> a couple of questions:
>
> First, i
Jim Fulton wrote:
> I find this a bit confusing. For the warm numbers, It looks like ZEO didn't
> utilize a persistent cache, which explains why the ZEO numbers are the
> same for hot and cold. Is that right?
Yes. It is currently difficult to set up ZEO caches, which I consider
an issue with th
Jose Benito Gonzalez Lopez wrote:
> Dear ZODB developers,
>
> Since some time ago (not sure since when) our database
> has passed from 15GB to 65GB so fast, and it keeps growing
> little by little (2 to 5 GB per day). It is clear that something is not
> correct in it.
>
> We would like to check w
Daniel Kraft wrote:
> Jim Fulton wrote:
>> On Tue, Dec 8, 2009 at 1:49 PM, Benji York wrote:
>>> Any incomplete writes that are in progress at the time of the copy will
>>> simply be ignored when the resulting backup is opened later.
>> Note that this assumes that you are using a straightforward l
Christian Theune wrote:
> Not exactly: it's still a good idea to store away deltas as single large
> files are still hard to deal with except if you have really good
> block-level de-duplication in your filesystem. (Uhmm. I guess ZFS
> probably has all of that. It also probably serves my dinner.
Marius Gedminas wrote:
> I'd like to implement the following feature for zodbbrowser: given a
> persistent object X, find all other persistent objects that have
> references to it.
RelStorage has this functionality, but I don't know how we ought to
expose it. Start a pack to update the graph, th
Damien Farrell wrote:
> Does the port argument in MySQLAdapter for relstorage actually have any
> effect? It doesn't seem to make any difference no matter what port I supply.
MySQL treats the host name "localhost" specially. When the host name
given to MySQL is localhost, MySQL connects through
Rudá Porto Filgueiras wrote:
> How can I repair or verify a RelStorage database?
> I´m using MySQL Adapter, there is any script like fsrecover.py
>
> Follow the failure when RelStorage try to load some objects:
>
> 2010-01-30T04:25:14 ERROR ZODB.Connection Couldn't load state for 0x04ef0f59
> Tra
Jim Fulton wrote:
> (BTW, speaking of SSD, we did a test recently using a combination of
> SSD and magnetic disk. The database was around 1TB in size, with
> around 900GB being blob data. We stored the non-blob data on an SSD
> and blob data on a 14-spindle ISCSI magenetic storage systems. The
>
Santi Camps wrote:
> * Module relstorage.cache, line 294, in after_tpc_finish
> * Module memcache, line 360, in incr
> * Module memcache, line 384, in _incrdecr
>
> ValueError: invalid literal for int(): NOT_FOUND
This means that in some circumstances, the memcache module you chose
r
Rudá Porto Filgueiras wrote:
> But if I'm correct, pylibmc (0.9) required by RelStorage don't run with
> Python 2.4.x or I'm doing something wrong.
Did you try pylibmc with Python 2.4? It might just work.
Shane
___
For more information about ZODB, see
Darryl Dixon - Winterhouse Consulting wrote:
> We have a client with an existing Oracle RAC infrastructure (4 node RAC).
> We are going to using RelStorage + cx_Oracle to connect to this from
> RedHat Linux servers, running Plone 3.3.x. This note is to say "we're
> here" and to provide some technic
On 04/15/2010 06:21 PM, Noe Misael Nieto Arroyo wrote:
> Hi everybody,
>
> I'm working on a Plone 3.3.5 site with RelStorage and File System
> Storage (for some custom content types). However, I am not able to start
> Plone and I get a traceback:
>
>
> $ bin/instance
> Traceback (most recent call l
On 04/15/2010 06:21 PM, Noe Misael Nieto Arroyo wrote:
>> $ bin/instance
>> Traceback (most recent call last):
>> ...
>> from ZODB.config import ZODBDatabase
>> File
>> "/app/buildout/eggs/ZODB3-3.10.0a1-py2.4-linux-x86_64.egg/ZODB/__init__.py",
Oh, I see... your buildout is using ZO
On 04/15/2010 07:04 PM, Noe Misael Nieto Arroyo wrote:
> Thanks Shane, Now it's working!!
>
> Just curious, What are the 3.8.x-polling releases for?
If you want blob support, you need ZODB 3.8+. Plone 3 does not use
blobs by default.
Shane
___
For mor
On 05/06/2010 10:26 PM, Andreas Jung wrote:
> So: assuming that a persistent object is managed as a blob...what will
> happen on the filesystem level with the blob file upon a change to this
> object? Will the ZODB create a new blob file with the changed content or
> will it override/update the exi
On 05/18/2010 01:40 PM, Zack Spencer wrote:
> I'm completely new to Zope, but from what I've been able to find it
> looks like ConflictErrors are simply a side effect of optimistic
> concurrency control, not unlike conditional PUTs in HTTP. This is
> exactly the behavior I would expect.
Exactly.
On 06/14/2010 01:43 AM, Jens Vagelpohl wrote:
> My question: Is there any risk associated with ignoring the failure
> during packing? The latest object versions for the persistent objects in
> question do not have the problematic attribute anymore, so the latest
> records are "safe" and will not ca
On 06/28/2010 04:44 AM, Nitro wrote:
> I do not like the current packaging approach as I discussed in length in a
> recent message to this list [1]. Until this changes I am not going to
> spend time creating random packages.
Around here, Python packages are how we communicate code. Think of a
re
Matthias,
You are conflating two conversations, and as a result you are reacting
to the non-stated suggestion that the packaging system provides
sufficient stability information to consumers. That suggestion would
obviously be false, since anyone, including people with hostile
intentions, can
On 06/28/2010 07:29 PM, Nitro wrote:
> P.S.: This will be my last lengthy mail about this topic. I'll rather
> spend time writing blog entries for the docs project.
That sounds fine.
Shane
___
For more information about ZODB, see the ZODB Wiki:
http://w
On 07/26/2010 09:14 AM, Christian Zagrodnick wrote:
> for monitoring if a storage has been packed it would be handy if it
> remembered the date of its last pack. An easy solution for file storage
> would be to create a Data.fs.packed file.
FWIW, with RelStorage, a simple query of the "transaction"
On 08/30/2010 03:36 PM, Jim Fulton wrote:
> The tricky thing about this is the last paragraph. If the method
> doesn't raise an error, then there can't be updates to the object
> until after the transaction commits. For most current
> implementations, this implies that the storage lock is help wh
On 09/14/2010 04:25 AM, Anton Stonor wrote:
>Module relstorage.cache, line 258, in send_queue
>Module memcache, line 643, in set_multi
> TypeError: 'int' object is unsubscriptable
>
>
> I happens what appears to be randomly on content creation, file upload,
> indexing, but not in a consiste
On 09/15/2010 03:54 AM, Anton Stonor wrote:
> Thanks alot! Will move to pylibmc. I actually thought I was choosing
> stability over speed by going with python-memcached instead of a wrapper
> around a C-library (fear of potential issues with concurrency and memory
> leaks).
That is certainly a val
On 09/24/2010 07:03 AM, Jim Fulton wrote:
> On Fri, Sep 24, 2010 at 4:17 AM, César Muñoz wrote:
>> Hello Marius,
>>
>> thank you so much for your quick answer! I'll give it a try implementing
>> these methods and will get back to you with the result.
>> But anyway, the Chatroom class is inheriting
After nearly a year of testing and refinement, RelStorage 1.4.0 is
finally finished. Thanks to the various companies and individuals who
contributed, I think this is the best-tested release yet. For anyone
who has not been following along, here are some of the new features in
RelStorage 1.4:
On 10/06/2010 02:52 AM, Chris Withers wrote:
> Hi All,
>
> I'm trying to fix this bug:
> https://bugs.launchpad.net/zope2/+bug/649605
>
> ...and I'm struggling to find documentation on the semantics of _v_
> attributes.
>
> In particular, surely this code:
>
> base._p_activate()
On 10/13/2010 04:04 AM, Chris Withers wrote:
> Does RelStorage 1.4 work with ZODB 3.10?
> (In particular, the Undo changes and the tightened storage API..)
>
> I see the mention of 3.10.0b7, but just wanted to check that means
> you're okay with 3.10 final ;-)
Yes.
Shane
_
On 10/14/2010 02:48 AM, Chris Withers wrote:
> Hi Shane,
>
> For all of these, if there are docs, please point me in their direction.
> I've been working from:
>
> http://pypi.python.org/pypi/RelStorage
>
> In my case, I'm looking at ZODB 3.9.6, Zope 2.12.7 onto MySQL 5.1
> provided as a two machin
On 10/14/2010 04:53 AM, Chris Withers wrote:
> Is RelStorage suitable for a temporary storage?
For a temporary storage, turn off keep-history. You still have to pack it.
Multiple clients can share the same storage, regardless of keep-history.
Also, configure the database server (MySQL or Postgr
On 10/15/2010 05:35 AM, Michael Schriefel wrote:
> According to http://pypi.python.org/pypi/RelStorage, RelStorage does not
> support Oracle 11g, at least not officially. What about inofficially -- can
> anybody share his experiences?
I will be testing RelStorage with 11g next week. I will share
On 10/14/2010 01:00 PM, Leonardo Santagada wrote:
> In this blog post:
>
> http://www.martinaspeli.net/articles/tools-for-a-successful-plone-project
>
> He talks about using beaker and memcached for storing sessions. Seems
> better suited than ZODB for this.
FWIW, I agree that Beaker is a better i
On 10/15/2010 10:47 AM, Jim Fulton wrote:
> On Fri, Oct 15, 2010 at 12:34 PM, McCuaig, Scott (MGS)
>> We plan to introduce plone.app.blob very shortly. However, we charge a small
>> fee to the clusters which we divide amongst them based on how much space
>> they're using and I'm having trouble unde
On 10/18/2010 11:05 PM, Noe Misael Nieto Arroyo wrote:
> Hi all,
>
> I am moving a site to another server and took the oportunity to upgrade
> to Plone 3.3.5 and RelStorage 1.4.0. PostgreSQL is 8.3. I'm writing a
> couple of scripts to automate maintenance and backup of the ZODB.
>
> PostgreSQL do
On 10/21/2010 09:44 AM, Andreas Jung wrote:
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA1
>
> Hi there,
>
> we are currently investigating options for a large-scale solution
> where the machines (ZEO clients and ZEO server) should be separated
> across two data centers. Incoming traffic should
On 10/23/2010 01:29 AM, Chris Withers wrote:
> Hi Shane,
>
> With the server I'm testing on, when coming back to test after a couple
> of days working on something else, I get the following logged at Warning:
>
> Reconnecting load_conn: (2006, 'MySQL server has gone away')
>
> Does this mean the re
On 10/25/2010 07:40 PM, David Carmean wrote:
> I'm starting to dig into the code, but perhaps this can
> be answered quickly: can RelStorage be used in place of
> FileStorage for ZEO storage?
It should work if a single ZEO server is the only client of RelStorage.
> I work with a product that has
On 10/26/2010 04:04 AM, Anton Stonor wrote:
> In order to scale an application using RelStorage I was thinking about
> seperating reads and writes accross databases. Writes would go to a
> Mysql master and the app would read from one or more Mysql slaves.
If you mean that you intend to set up some
On 11/04/2010 06:28 AM, Chris Withers wrote:
> I was having trouble starting a relstorage 1.4.0-backed Zope instance
> this morning. The symptoms were that it would get going fine, until the
> point it tried to open the storages, at which point it would simply
> restart with no logging as to why.
>
On 11/04/2010 06:32 AM, Chris Withers wrote:
> Hi Shane,
>
> I have the following config for the temp_folders of my ZODB instances:
>
>
>
>
> host dr2.private
> user zope
> ..
>
> keep-history false
>
> mount-point /temp_folder
>
On 11/17/2010 08:29 AM, Sachin Tekale wrote:
> Hi all,
> I have read that there is a problem to implement MS-SQL adapter for
> Relstorage because the “Two phase commit” feature is not exposed by
> MS-SQL server .
No, RelStorage does not require two phase commit support from the
database. It turn
On 11/17/2010 11:12 AM, Shane Hathaway wrote:
> On 11/17/2010 08:29 AM, Sachin Tekale wrote:
>> Hi all,
>> I have read that there is a problem to implement MS-SQL adapter for
>> Relstorage because the “Two phase commit” feature is not exposed by
>> MS-SQL server .
On 11/18/2010 09:54 AM, Chris Withers wrote:
> On 18/11/2010 16:48, Hanno Schlichting wrote:
>> On Thu, Nov 18, 2010 at 5:19 PM, Leonardo Santagada
>> wrote:
>>> On Thu, Nov 18, 2010 at 1:47 PM, Chris Withers
>>> wrote:
On 18/11/2010 15:39, Marius Gedminas wrote:
> About the only not
On 11/19/2010 10:39 AM, Sachin Tekale wrote:
> On 2010-11-17 18:12, Shane Hathaway wrote:
>>
>> No, RelStorage does not require two phase commit support from the
>> database. It turns out that a simple commit lock, which is
>> sufficient for preventing deadlocks and
On 11/24/2010 05:17 AM, Santi Camps wrote:
> Hi all
>
> I'm using relstorage for a long time with very good results. Until
> know, I also use database adapters like ZPsycopgDA to connect the same
> SQL database and store information in other application tables. I was
> thinking to create a Relst
On 11/29/2010 12:55 PM, Leonardo Santagada wrote:
> On Mon, Nov 29, 2010 at 5:17 PM, Chris Withers wrote:
>> Wouldn't this require zero replication lag?
No.
>> Even if the read replicas had only a second or two delay (or spike
>> delays caused by large writes?), would there not potentially be qu
On 12/02/2010 03:25 PM, Darryl Dixon - Winterhouse Consulting wrote:
>> [...snip...]
>> We have added a new schema to our Oracle RAC database and mount
>> point inside Zope, attempted to add a Plone site, and get the following
>> error. If everything else remains the same, but the ZODB Mount in the
On 12/08/2010 02:26 PM, Dylan Jay wrote:
> I was working with a high volume site recently where 70% of requests
> called a back end API that could take up to 4sec. For better or worse
> this was in zope. The best solution to scaling this was to increase
> the number of threads since this process wa
On 01/03/2011 10:23 PM, Aran Dunkley wrote:
> Hi, I'm part of a development team who are helping an organisation to
> architect a CMS based project that they want to work in a P2P network
> rather than using a centralised web-server. We'd prefer to use an
> existing popular CMS as a starting point
On 01/06/2011 03:35 PM, Maurits van Rees wrote:
> davidb started a branch of RelStorage in July 2010 and I wonder if that
> can be merged. It does two interesting things in the zodbconvert code:
>
> - It adds a --single-transaction command line option. From the readme:
> "Import into the dest
On 01/07/2011 10:34 AM, Maurits van Rees wrote:
> Op 07-01-11 05:51, Shane Hathaway schreef:
>> I looked at that branch before, but I felt like the changes were
>> complicated enough to require a comparison with simpler solutions first.
>> In particular, Postgres has an op
On 01/10/2011 03:58 PM, Maurits van Rees wrote:
> Starting with RelStorage 1.5.0a1 (or trunk) there is support for blobs
> in RelStorage. You have the option to either store the blobs on the
> file system (var/blobstorage) or store them in the relational database.
To clarify, blob support was in
On 01/11/2011 07:06 AM, David Blewett wrote:
> On Thu, Jan 6, 2011 at 11:51 PM, Shane Hathaway wrote:
>>> I am no zodb or relstorage expert, but the changes for the
>>> --single-transaction code look good to me.
>>
>> I looked at that branch before, but I felt lik
On 01/21/2011 10:46 AM, Chris Withers wrote:
> I'm wondering what the recommended maintenance for these two types of
> storage are that I use:
>
> - keep-history=true, never want to lose any revisions
>
> My guess is zodbpack with pack-gc as true, but what do I specify for the
> number of days in o
On 01/21/2011 03:38 PM, Chris Withers wrote:
> On 21/01/2011 22:09, Laurence Rowe wrote:
>> On 21 January 2011 20:57, Shane Hathaway wrote:
>>> On 01/21/2011 10:46 AM, Chris Withers wrote:
>>>> I'm wondering what the recommended maintenance for these two t
On 01/24/2011 02:02 PM, Anton Stonor wrote:
> Hi there,
>
> We have recently experienced a couple of PosKey errors with a Plone 4
> site running RelStorage 1.4.1 and Mysql 5.1.
>
> After digging down we found that the objects that were throwing
> PosKeyErrors actually existed in the object_state t
On 01/24/2011 06:32 PM, Laurence Rowe wrote:
> Must this imply a failure to maintain a foreign key constraint? While
> there are FK constraints on current_object (zoid, tid) -> object_state
> (zoid, tid) there is no foreign key that might prevent a
> current_object row from being incorrectly delet
On 01/26/2011 05:29 AM, Jürgen Herrmann wrote:
> _readCurrent
> is obviously reused and not cleared at transaction boundaries, is that
> expected?):
No! Thanks for the great analysis. This insight is key.
RelStorage has a monkey patch of the Connection.sync() method, which has
not change
On 01/26/2011 11:52 AM, Chris Withers wrote:
> On 26/01/2011 14:08, Shane Hathaway wrote:
>> I've checked in a fix in Subversion. Please try it out. I need to look
>> at the possible pack issue recently reported before we make a release.
>
> Where is this pack issue
On 01/26/2011 03:21 PM, Chris Withers wrote:
>> Well, my case matches that case pretty exactly...
>>
>> MySQL 5.1, RelStorage 1.4.0...
>> Anton, were you using a history-free storage?
>
> My guess is not.
>
> Shane, I went to try your suggestion:
>> If you're sure you have found all of the corrupti
On 01/26/2011 04:07 PM, Chris Withers wrote:
> On 26/01/2011 22:38, Shane Hathaway wrote:
>> The odd thing is I have seen no reports of pack issues for a long time.
>> Why two at once? I still wonder if there might be no bug at all.
>
> I'm afraid my wondering is on the o
On 01/24/2011 02:02 PM, Anton Stonor wrote:
> Now, I wonder why these pointers were deleted from the current_object
> table in the first place. My money is on packing -- and it might fit
> with the fact that we recently ran a pack that removed an unusual large
> amount of transactions in a single p
On 01/27/2011 03:32 AM, Chris Withers wrote:
> On 27/01/2011 03:15, Shane Hathaway wrote:
>>> Okay, so I'll do:
>>>
>>> - e2fsck -f
>
> Hmm, how do I e2fsck a mounted filesystem?
You don't. Don't even try. :-)
> The MySQL filesystem cou
On 01/27/2011 03:59 AM, Jürgen Herrmann wrote:
>
> hi there!
>
> i wrongly posted a bug to the zodb bugtracker on tuesday:
> https://bugs.launchpad.net/zodb/+bug/707332
>
> as it turns out, that bug report was moot. it didn't fix my
> problem. out of curiosity, why is the exception raised
On 01/27/2011 03:57 AM, Chris Withers wrote:
> It would also be *really* handy if zodbpack could run off a normal
> zope.conf for both logging and storage config (although, in my case, I'd
> then need to be able to specify which storage to pack, I want to avoid
> packing one of them!)
Please note
On 01/28/2011 02:21 AM, Chris Withers wrote:
> Okay, so next up I restored the backup.
> This time I set the batch running and *then* started the pack.
> This eventually caused the POSKeyErrors to begin again.
>
> I'm going to have a go at knocking up a small batch script that you can
> run to repr
On 01/28/2011 05:34 AM, Chris Withers wrote:
> bin/generate --zap --folder_depth 3
>
> Leave it running for a minute or two, and then in another do:
>
> bin/zodbpack pack.conf
Thanks to this test, I found a serious flaw in the history-free variant
of packing. Currently, the history-free and hist
On 01/31/2011 06:02 PM, Chris Withers wrote:
> On 28/01/2011 21:58, Jürgen Herrmann wrote:
>>Afaics you use zodbpack's default of "days=0". This is known to produce
>>POSKeyErrors if the database is written to while packing.
>
> Where is this documented?
It is not known to me. :-)
> I'll
On 01/31/2011 06:30 PM, Chris Withers wrote:
> Hi Shane,
>
> I got the following error when trying to run zodbconvert against a
> clustered MySQL environment running RHCS:
>
> File
> "/var/buildout-eggs/MySQL_python-1.2.3-py2.6-linux-i686.egg/MySQLdb/connections.py",
> line 36, in defaulterrorh
1 - 100 of 320 matches
Mail list logo
