Re: [ZODB-Dev] RelStorage and BLOBs
Wichert Akkerman wrote: For some of us a the main reason for using RelStorage is to be able to satisfy the 'all data must be stored in our oracle cluster' requirement from enterprise customers. That means we can not use NFS mounts to store blobs. You have a point, and I know how stubborn enterprises can be. Here's an approach that will probably work: keep blob handling completely separate from other database operations and open a different database connection for each thread. Maintain pseudo-file-handle state completely outside the database. This design could be independent of RelStorage. We could create a wrapper much like the current but put the blobs in the database instead. Shane ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] RelStorage and BLOBs
On Wed, May 07, 2008 at 08:33:34AM -0300, David Pratt wrote: > Hi Christian. Curious, what were you using for postgres replication? > Many thanks. The only solution that I know of is slony (which is also sold in a commerical wrapping by EnterpriseDB) which is very awkward. I'm not aware of other solutions although people say they exist. -- gocept gmbh & co. kg - forsterstrasse 29 - 06112 halle (saale) - germany www.gocept.com - [EMAIL PROTECTED] - phone +49 345 122 9889 7 - fax +49 345 122 9889 1 - zope and plone consulting and development ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] RelStorage and BLOBs
Hi Christian. Curious, what were you using for postgres replication? Many thanks. David Christian Theune wrote: I'm kind of curious what a match of RelStorage and ZEORaid may give. FWIW my experiences with Postgresql replication aren't that good so you could still go that route using two RelStorages with one (or more) ZEORaids in front. Christian ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] RelStorage and BLOBs
Christian Theune wrote: On Tue, May 06, 2008 at 01:47:45PM -0600, Shane Hathaway wrote: David Durham, Jr. wrote: My questions is whether or not RelStorage supports BLOBs. My situation is that I have a Plone site with user uploaded images and other files, that should presumably be stored as BLOBs with RelStorage. I'm open to placing BLOBs outside of RelStorage if that's reasonably accomplished. I think an NFS mount is still a better place for BLOBs than a relational database. If we put BLOBs in a relational database, we'd have to carefully dance with inter-thread connections and simulated file handles that may stay open for a long time. With NFS those concerns are already taken care of. The normal way to set up BLOB storage in zope.conf is to create a wrapper around a storage configuration. That might just work with RelStorage, but I haven't tried it yet. At leasts its a scenario that is intended to work. I'd be happy about feedback of people who use it. For some of us a the main reason for using RelStorage is to be able to satisfy the 'all data must be stored in our oracle cluster' requirement from enterprise customers. That means we can not use NFS mounts to store blobs. Wichert. -- Wichert Akkerman <[EMAIL PROTECTED]> It is simple to make things. http://www.wiggy.net/ It is hard to make things simple. ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] RelStorage and BLOBs
On Tue, May 06, 2008 at 01:47:45PM -0600, Shane Hathaway wrote: > David Durham, Jr. wrote: >> My questions is whether or not RelStorage supports BLOBs. My >> situation is that I have a Plone site with user uploaded images and >> other files, that should presumably be stored as BLOBs with >> RelStorage. I'm open to placing BLOBs outside of RelStorage if that's >> reasonably accomplished. > > I think an NFS mount is still a better place for BLOBs than a relational > database. If we put BLOBs in a relational database, we'd have to > carefully dance with inter-thread connections and simulated file handles > that may stay open for a long time. With NFS those concerns are already > taken care of. > > The normal way to set up BLOB storage in zope.conf is to create a > wrapper around a storage configuration. That might just > work with RelStorage, but I haven't tried it yet. At leasts its a scenario that is intended to work. I'd be happy about feedback of people who use it. >> The whole point of using RelStorage, for me, is reliability since I >> can use Oracle features to improve failure scenarios. I realize that >> Zope sells a replication product, but I will not be able to obtain >> funding for this. I'm also curious if something like ZeoRAID would be >> more appropriate for my usage scenario. > > Well, I think RelStorage is up to the task, though the capability has > not yet been proven. I'm kind of curious what a match of RelStorage and ZEORaid may give. FWIW my experiences with Postgresql replication aren't that good so you could still go that route using two RelStorages with one (or more) ZEORaids in front. Christian -- gocept gmbh & co. kg - forsterstrasse 29 - 06112 halle (saale) - germany www.gocept.com - [EMAIL PROTECTED] - phone +49 345 122 9889 7 - fax +49 345 122 9889 1 - zope and plone consulting and development ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] RelStorage and BLOBs
David Durham, Jr. wrote: My questions is whether or not RelStorage supports BLOBs. My situation is that I have a Plone site with user uploaded images and other files, that should presumably be stored as BLOBs with RelStorage. I'm open to placing BLOBs outside of RelStorage if that's reasonably accomplished. I think an NFS mount is still a better place for BLOBs than a relational database. If we put BLOBs in a relational database, we'd have to carefully dance with inter-thread connections and simulated file handles that may stay open for a long time. With NFS those concerns are already taken care of. The normal way to set up BLOB storage in zope.conf is to create a wrapper around a storage configuration. That might just work with RelStorage, but I haven't tried it yet. The whole point of using RelStorage, for me, is reliability since I can use Oracle features to improve failure scenarios. I realize that Zope sells a replication product, but I will not be able to obtain funding for this. I'm also curious if something like ZeoRAID would be more appropriate for my usage scenario. Well, I think RelStorage is up to the task, though the capability has not yet been proven. Shane ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
[ZODB-Dev] RelStorage and BLOBs
Hi all, Apologies if this is an oft-asked question. I didn't see a search feature for this list's archives. My questions is whether or not RelStorage supports BLOBs. My situation is that I have a Plone site with user uploaded images and other files, that should presumably be stored as BLOBs with RelStorage. I'm open to placing BLOBs outside of RelStorage if that's reasonably accomplished. The whole point of using RelStorage, for me, is reliability since I can use Oracle features to improve failure scenarios. I realize that Zope sells a replication product, but I will not be able to obtain funding for this. I'm also curious if something like ZeoRAID would be more appropriate for my usage scenario. Thanks in advance, Dave ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
