Re: [Zope-dev] OracleStorage Used in a Production Environment
Eric Roby wrote: >Mathew > >Thanks for the quick response. My previous Zope project worked out great. >I feel very comfortable with the speed and stability of ZODB. However, I >was only managing 40,000+ objects. My new project has the potential of >exceeding a million objects. That plus the fact that they (the customer) >have already invested in 9i and an Oracle DB administrator. So I am >compelled to explore this as an alternative to ZODB. > >Are there any implications to using OracleStorage with regard to ZCatalog >and acessing other Oracle tables via Z SQL Methods ? > >Again ... Thanks > >Eric > Well, OracleStorage works just like a FileStorage, except that it saves pickled objects in Oracle rather than in a big disk file. So, ZCatalog doesn't have any bearing on it -- most ZCatalog objects are actually quite small -- about 500 or so bytes. You also can still continue to have Zope clients access Oracle directly, even though the same oracle instance is serving them via ZEO and OracleStorage. Generally, the only advantage to OracleStorage is psychological; some people get a better feeling if their data is stored "in Oracle". Is it better? That's a judgement call. Oracle can do certain things for you that FileStorage can't (remote replication etc) but in practice people are looking for the answer to "what's the best bucket for me to carry around data in?" Certainly you can make the case that FileStorage is simpler, and arguably easier to back up. I would only advocate OracleStorage if FileStorage is inadequate. 40,000 objects is not a lot of objects for FileStorage. A million objects? Well, the risk factor is making sure your large file support works :) A good backup utility for Oracle may be able to back up data incrementally -- most filesystem backup utilites back up whole files on update, rather than backing up just the changed portions of a file -- so a huge database might be easier to back up to tape with Oracle than with FileStorage. The inappropriate thing to do is allow a system with 1,000,000 objects to touch all of the objects in a single operation (like "Find" from the ZMI tab). Also, keep in mind that this is still ZODB -- just a different storage. Most of the time, ZODB and FileStorage are used interchangably, but they aren't identical. ZODB is more of an API specification that a storage must meet, so FileStorage is a specific implementation (as is OracleStorage.) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] OracleStorage Used in a Production Environment
Mathew Thanks for the quick response. My previous Zope project worked out great. I feel very comfortable with the speed and stability of ZODB. However, I was only managing 40,000+ objects. My new project has the potential of exceeding a million objects. That plus the fact that they (the customer) have already invested in 9i and an Oracle DB administrator. So I am compelled to explore this as an alternative to ZODB. Are there any implications to using OracleStorage with regard to ZCatalog and acessing other Oracle tables via Z SQL Methods ? Again ... Thanks Eric ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] OracleStorage Used in a Production Environment
Eric Roby wrote: >Is anyone successfully using OracleStorage in a production system or >(better yet) as a storage server in a ZEO configuration ? It doesn't >appear that any work has been done on it for nearly 18 months. Will >OracleStorage work with the DCOracle2 product in support of 9i ? > >Thanks in advance > >Eric > > >__ > Hi Eric, There's a modified version of OracleStorage in DCOracle2 -- thats why you don't see any activity on the other module. I've loaded an extremely large data set into it in in-house testing, and there are one or two clients out there using it, but I cannot identify them to you. With a well-tuned Oracle, I find that Oracle Storage is about 5 times slower than File Storage -- which is actually fantastic, given that its a lot easier to append onto the end of a file than it it to update tables in a RDBMS, so that a factor of 5x is really quite good! I actually think you can do better than 5x, but it requires having a very IO-balanced system -- the one I tested on was Oracle 9i using 3 drives to separate out data areas. However, keep in mind that Oracle Storage still stores pickled data into Oracle -- it doesn't do any object-relational mapping for you or anything like that; so you can't do operations on Zope data easily from within Oracle (although it's notionally possible to integrate a de-pickler as a PL/SQL loadable module so that you could actually inspect a pickle from inside PL/SQL.) I have used this in a ZEO envrionment; it works as you would expect (you pop out the ZEO server's FileStorage and replace it with an OracleStorage). Because the ZEO clients will cache objects if they have the ZEO_CLIENT environment variable set, I normally focus on write speed as being the dominant storage limiting factor, not read speed. And of course, as the obligatory plug: Zope Corporation is always willing to undertake specific support engagements should you have the requirement to have on-call support. Our web page with an overview of this is http://www.zope.com/Services/SupportContracts should you have an interest. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] OracleStorage Used in a Production Environment
Is anyone successfully using OracleStorage in a production system or (better yet) as a storage server in a ZEO configuration ? It doesn't appear that any work has been done on it for nearly 18 months. Will OracleStorage work with the DCOracle2 product in support of 9i ? Thanks in advance Eric ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )