Re: [ZODB-Dev] SpatialIndex

2010-06-29 Thread Nitro
Am 28.06.2010, 23:42 Uhr, schrieb Laurence Rowe l...@lrowe.co.uk: On 28 June 2010 21:27, Nitro ni...@dr-code.org wrote: ZODB is a general python object database with a much wider audience than just plone. It suits desktop applications just as well as applications you'd normally use twisted

Re: [ZODB-Dev] SpatialIndex

2010-06-28 Thread Nitro
Am 28.06.2010, 08:21 Uhr, schrieb Thomas Lotze tho...@thomas-lotze.de: Nitro wrote: packaging: I don't plan to create a package for this as I don't see much point in adding yet another package to the clutter of packages surrounding zodb. Just a quick remark: Without being available

Re: [ZODB-Dev] SpatialIndex

2010-06-28 Thread Nitro
Am 28.06.2010, 14:10 Uhr, schrieb Dylan Jay d...@pretaweb.com: I don't use a lot of other indexes other than what comes with plone but I can see the value of what your suggesting in having an installable tested collection of indexes. I can also see that this is a really big itch for you

Re: [ZODB-Dev] SpatialIndex

2010-06-28 Thread Nitro
Am 28.06.2010, 16:52 Uhr, schrieb Laurence Rowe l...@lrowe.co.uk: So why don't we all work on the same packages? The main reason is one of legacy. Plone is built on Zope2 and ZCatalog. It works, but it is not without it's issues - we can't have queries that join from that catalog to a

Re: [ZODB-Dev] SpatialIndex

2010-06-28 Thread Nitro
Am 28.06.2010, 17:52 Uhr, schrieb Alan Runyan runy...@gmail.com: I have similar feelings as Matthias. - We could use something similar to the Apache incubation process. Yes. I think in general the library should be rather flexible. I.e. (minor) things can be deprecated and removed rather

Re: [ZODB-Dev] SpatialIndex

2010-06-28 Thread Nitro
Am 28.06.2010, 18:23 Uhr, schrieb Leonardo Santagada santag...@gmail.com: Although I think this sounds like an optimal solution, I think it isn't necessary. I wish only that there was a complements in ZODB wiki with a simple list of best of breed package for each task and maybe a list of

Re: [ZODB-Dev] SpatialIndex

2010-06-28 Thread Nitro
Am 28.06.2010, 20:31 Uhr, schrieb Shane Hathaway sh...@hathawaymix.org: Around here, Python packages are how we communicate code. Think of a released package as a well-refined email. If you choose not to release packages, you are really choosing not to communicate through the

Re: [ZODB-Dev] SpatialIndex

2010-06-28 Thread Nitro
Am 28.06.2010, 23:30 Uhr, schrieb Shane Hathaway sh...@hathawaymix.org: Matthias, You are conflating two conversations, and as a result you are reacting to the non-stated suggestion that the packaging system provides sufficient stability information to consumers. I've experienced the

[ZODB-Dev] transactions, data manager order

2010-06-22 Thread Nitro
Hello, I'm writing a custom data manager. The data manager should execute before the connection's data manager. So I provided the sortKey method. This works fine for the usual commit(). Once savepoints are involved however this fails, the connection's savepoint/rollback is executed before

[ZODB-Dev] SpatialIndex

2010-06-22 Thread Nitro
Tada, the first version of SpatialIndex is ready! Where to get it? - See attachment. It's still a very rough alpha version, don't use in production. The attached test case works only in my own testing environment, but you can see how the spatial index can be used. What

[ZODB-Dev] _p_invalidate

2010-06-21 Thread Nitro
Hello, The simple code below gives me a POSKeyError. Is this to be expected? -Matthias class MyObj(Persistent): def __init__(self, settings): Persistent.__init__(self) self.settings = settings def _p_invalidate(self): print 'INVALIDATE', self.settings

Re: [ZODB-Dev] _p_invalidate

2010-06-21 Thread Nitro
Am 21.06.2010, 11:55 Uhr, schrieb Nitro ni...@dr-code.org: Hello, The simple code below gives me a POSKeyError. Is this to be expected? Searched the bugtracker, it looks pretty much like this issue: https://bugs.launchpad.net/zodb/+bug/143560 https://mail.zope.org/pipermail/zodb-dev/2005

[ZODB-Dev] Spatial indices

2010-06-16 Thread Nitro
Hello, I tried to find a spatial index which integrates seamlessly into the ZODB. Unfortunately I did not find a satisfying solution anywhere. So I came up with three solutions how this could be implemented: 1) Write a native r-tree package, just like the current BTrees. Would likely have

Re: [ZODB-Dev] Spatial indices / zodb standard library

2010-06-16 Thread Nitro
Am 16.06.2010, 17:55 Uhr, schrieb Jim Fulton j...@zope.com: On Wed, Jun 16, 2010 at 11:45 AM, Nitro ni...@dr-code.org wrote: ... Would it make sense to add a default spatial index to ZODB? No. Which isn't to say that a spatial wouldn't be a good idea. It just doesn't need to be part

Re: [ZODB-Dev] Spatial indices

2010-06-16 Thread Nitro
Thanks for your answer Laurence. Am 16.06.2010, 19:23 Uhr, schrieb Laurence Rowe l...@lrowe.co.uk: It really depends on what you are trying to achieve. The simplest solution would probably be to use a geohash string within an OOBTree. I need spatial indexing/querying for paging large 3d

Re: [ZODB-Dev] ZEO authentication

2010-06-14 Thread Nitro
Am 14.06.2010, 15:50 Uhr, schrieb Jim Fulton j...@zope.com: On Sat, Jun 12, 2010 at 9:17 PM, Nitro ni...@dr-code.org wrote: Hello, I am using ZEO authentication. When I try to login with the proper credentials (everything works just fine. If I try to login with the wrong credentials, I

[ZODB-Dev] ZEO authentication

2010-06-12 Thread Nitro
Hello, I am using ZEO authentication. When I try to login with the proper credentials (everything works just fine. If I try to login with the wrong credentials, I get a traceback like shown below. However, the code trying to establish the connection (in my case databaseFromConfig) never

Re: [ZODB-Dev] ZEO and access permissions

2010-05-25 Thread Nitro
Am 23.05.2010, 17:53 Uhr, schrieb Jim Fulton j...@zope.com: Does it make sense at all or is it still better to restrict access on the application level? I would do it at the storage level, not in the application nor in ZEO. It is probably possible with some sort of wrapper storage. There

[ZODB-Dev] ZEO and access permissions

2010-05-22 Thread Nitro
Hello, ZEO already supports authenticated logins. Based on the login I'd like people to be able to access some objects and deny access to others. First I thought I'd do the access restrictions on the application level. This doesn't seem to be too easy though, because a user might have access

Re: [ZODB-Dev] ZEO and access permissions

2010-05-22 Thread Nitro
Am 22.05.2010, 14:17 Uhr, schrieb Nitro ni...@dr-code.org: Each object and each user would have something like a permission_id attribute. Could also be a mapping oid - permission id. -Matthias ___ For more information about ZODB, see the ZODB Wiki

Re: [ZODB-Dev] Automating retry management

2010-05-11 Thread Nitro
I'm already using custom transaction/savepoint context managers in my code. I use them like with TransactionContext(): db.root['sp_test'] = 'init' with SavepointContext(): db.root['sp_test'] = 'saved' On of the context managers: class TransactionContext(object): def

Re: [ZODB-Dev] Some interesting (to some:) numbers

2010-05-11 Thread Nitro
Am 11.05.2010, 13:47 Uhr, schrieb Adam GROSZER agros...@gmail.com: Hello Jim, Tuesday, May 11, 2010, 1:37:19 PM, you wrote: JF On Tue, May 11, 2010 at 7:13 AM, Adam GROSZER agros...@gmail.com wrote: Hello Jim, Tuesday, May 11, 2010, 12:33:04 PM, you wrote: JF On Tue, May 11, 2010 at

Re: [ZODB-Dev] Automating retry management

2010-05-11 Thread Nitro
def __exit__(self, t, v, tb): if t is not None: self.txn.abort() else: for i in range(self.retryCount): Oops, bug here. It should read range(1 + self.retryCount). It should probably have unittests anyway :-) -Matthias

Re: [ZODB-Dev] Automating retry management

2010-05-11 Thread Nitro
Am 11.05.2010, 16:01 Uhr, schrieb Jim Fulton j...@zope.com: This wouldn't work. You would need to re-execute the suite for each retry. It's not enough to just keep committing the same transaction. (There are other details wrong with the code above, but they are fixable.) Python doesn't

Re: [ZODB-Dev] Automating retry management

2010-05-11 Thread Nitro
Am 11.05.2010, 17:08 Uhr, schrieb Nitro ni...@dr-code.org: Am 11.05.2010, 16:01 Uhr, schrieb Jim Fulton j...@zope.com: This wouldn't work. You would need to re-execute the suite for each retry. It's not enough to just keep committing the same transaction. (There are other details wrong

Re: [ZODB-Dev] Using zodb and blobs

2010-04-14 Thread Nitro
Am 14.04.2010, 09:24 Uhr, schrieb Christian Theune c...@gocept.com: What I don't really get is why you should never use None on windows. As far as I can judge from the various transaction rates in the thread Tim mentioned, fsync is just a no-op on linux anyways (depending on the specific

Re: [ZODB-Dev] Using zodb and blobs

2010-04-14 Thread Nitro
Am 14.04.2010, 14:45 Uhr, schrieb Hanno Schlichting ha...@hannosch.eu: Usually you will only loose the last transaction and not a days of work. The Data.fs is an append-only file, with one transaction appended after another. If there's a garbled or incomplete write, you'll typically loose the

Re: [ZODB-Dev] Using zodb and blobs

2010-04-13 Thread Nitro
Hello Tres, thanks for your detailed answers! Am 12.04.2010, 22:42 Uhr, schrieb Tres Seaver tsea...@palladion.com: Additionally I made some quick performance tests. I committed 1kb sized objects and I can do about 40 transaction/s if one object is changed per transaction. For 100kb objects

Re: [ZODB-Dev] Using zodb and blobs

2010-04-13 Thread Nitro
40 tps sounds low: are you pushing blob content over the wire somehow? I have seen the ZEO storage committing transactions at least an order of magnitude faster than that (e.g., when processing incoming newswire feeds). I would guess that there could have been some other latencies involved in

Re: [ZODB-Dev] Using zodb and blobs

2010-04-13 Thread Nitro
Am 14.04.2010, 04:08 Uhr, schrieb Laurence Rowe l...@lrowe.co.uk: Running your test script on my small amazon EC2 instance on linux takes between 0.0 and 0.04 seconds (I had to remove the divide by total to avoid a zero division error). 0.02 is 5000/s. Thanks for running the test. Intrigued

Re: [ZODB-Dev] Using zodb and blobs

2010-04-13 Thread Nitro
For the record, with import os os.fsync = lambda fd: 0 at the top of the test app I get ~3700 tx/s. -Matthias ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org

Re: [ZODB-Dev] Using zodb and blobs

2010-04-11 Thread Nitro
After lots of googling and browsing the source I can answer some of my questions: - What's the difference between storing bigger objects as blobs and as plain large strings? Plain large strings cannot be streamed for instance. Products like Zope chop up their file uploads into 64kb chunks

[ZODB-Dev] Using zodb and blobs

2010-04-09 Thread Nitro
Hello, I'm evaluating ZODB for a new project and wondering how to use it in the optimum way. First off, there will be rather frequent writes to the storage (up to 10 per second). Almost all writes will not produce any conflict. Most of the frequent writes will write small objects (1kb).

Re: [ZODB-Dev] example for the following?

2009-01-22 Thread Nitro
Am 22.01.2009, 17:46 Uhr, schrieb Jamie McQuay ja...@scimatic.com: Hi, I'm using ZODB in a desktop app (i.e. not using zope). I have class A which contains a list of instances for class B. I can persist class A when the list of class B is empty. When i add an instance of class B to the

[ZODB-Dev] ZODB binaries on windows and python 2.5?

2007-02-16 Thread Nitro
Hello, I downloaded ZODB 3.7.3b today. My aim is to get ZODB running under Python 2.5. When I do easy_install . the installer complains that Python was built with Visual Studio 2003. Unfortunately I only have 2005 running here. Obviously 2003 and 2005 binaries are not compatible and that's why