Re: [Zope-dev] OracleStorage Used in a Production Environment

2002-01-30 Thread Matthew T. Kromer

Eric Roby wrote:

>Mathew
>
>Thanks for the quick response.  My previous Zope project worked out great.
>I feel very comfortable with the speed and stability of ZODB.  However, I
>was only managing 40,000+ objects.  My new project has the potential of
>exceeding a million objects.  That plus the fact that they (the customer)
>have already invested in 9i and an Oracle DB administrator.  So I am
>compelled to explore this as an alternative to ZODB.
>
>Are there any implications to using OracleStorage with regard to ZCatalog
>and acessing other Oracle tables via Z SQL Methods ?
>
>Again ... Thanks
>
>Eric
>


Well, OracleStorage works just like a FileStorage, except that it saves 
pickled objects in Oracle rather than in a big disk file.  So, ZCatalog 
doesn't have any bearing on it -- most ZCatalog objects are actually 
quite small -- about 500 or so bytes.  You also can still continue to 
have Zope clients access Oracle directly, even though the same oracle 
instance is serving them via ZEO and OracleStorage.

Generally, the only advantage to OracleStorage is psychological; some 
people get a better feeling if their data is stored "in Oracle".  Is it 
better?  That's a judgement call.  Oracle can do certain things for you 
that FileStorage can't (remote replication etc) but in practice people 
are looking for the answer to "what's the best bucket for me to carry 
around data in?"  Certainly you can make the case that FileStorage is 
simpler, and arguably easier to back up.  I would only advocate 
OracleStorage if FileStorage is inadequate.   40,000 objects is not a 
lot of objects for FileStorage.  A million objects?  Well, the risk 
factor is making sure your large file support works :)  A good backup 
utility for Oracle may be able to back up data incrementally -- most 
filesystem backup utilites back up whole files on update, rather than 
backing up just the changed portions of a file -- so a huge database 
might be easier to back up to tape with Oracle than with FileStorage.

The inappropriate thing to do is allow a system with 1,000,000 objects 
to touch  all of the objects in a single operation (like "Find" from the 
ZMI tab).

Also, keep in mind that this is still ZODB -- just a different storage. 
 Most of the time, ZODB and FileStorage are used interchangably, but 
they aren't identical.  ZODB is more of an API specification that a 
storage must meet, so FileStorage is a specific implementation (as is 
OracleStorage.)


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] OracleStorage Used in a Production Environment

2002-01-30 Thread Eric Roby

Mathew

Thanks for the quick response.  My previous Zope project worked out great.
I feel very comfortable with the speed and stability of ZODB.  However, I
was only managing 40,000+ objects.  My new project has the potential of
exceeding a million objects.  That plus the fact that they (the customer)
have already invested in 9i and an Oracle DB administrator.  So I am
compelled to explore this as an alternative to ZODB.

Are there any implications to using OracleStorage with regard to ZCatalog
and acessing other Oracle tables via Z SQL Methods ?

Again ... Thanks

Eric




___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] OracleStorage Used in a Production Environment

2002-01-30 Thread Matthew T. Kromer

Eric Roby wrote:

>Is anyone successfully using OracleStorage in a production system or
>(better yet) as a storage server in a ZEO configuration ?  It doesn't
>appear that any work has been done on it for nearly 18 months.  Will
>OracleStorage work with the DCOracle2 product in support of 9i ?
>
>Thanks in advance
>
>Eric
>
>
>__
>


Hi Eric,

There's a modified version of OracleStorage in DCOracle2 -- thats why 
you don't see any activity on the other module.

I've loaded an extremely large data set into it in in-house testing, and 
there are one or two clients out there using it, but I cannot identify 
them to you.

With a well-tuned Oracle, I find that Oracle Storage is about 5 times 
slower than File Storage -- which is actually fantastic, given that its 
a lot easier to append onto the end of a file than it it to update 
tables in a RDBMS, so that a factor of 5x is really quite good!  I 
actually think you can do better than 5x, but it requires having a very 
IO-balanced system -- the one I tested on was Oracle 9i using 3 drives 
to separate out data areas.

However, keep in mind that Oracle Storage still stores pickled data into 
Oracle -- it doesn't do any object-relational mapping for you or 
anything like that; so you can't do operations on Zope data easily from 
within Oracle (although it's notionally possible to integrate a 
de-pickler as a PL/SQL loadable module so that you could actually 
inspect a pickle from inside PL/SQL.)

I have used this in a ZEO envrionment; it works as you would expect (you 
pop out the ZEO server's FileStorage and replace it with an 
OracleStorage).  Because the ZEO clients will cache objects if they have 
the ZEO_CLIENT environment variable set, I normally focus on write speed 
as being the dominant storage limiting factor, not read speed.

And of course, as the obligatory plug: Zope Corporation is always 
willing to undertake specific support engagements should you have the 
requirement to have on-call support.  Our web page with an overview of 
this is http://www.zope.com/Services/SupportContracts should you have an 
interest.


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



[Zope-dev] OracleStorage Used in a Production Environment

2002-01-30 Thread Eric Roby

Is anyone successfully using OracleStorage in a production system or
(better yet) as a storage server in a ZEO configuration ?  It doesn't
appear that any work has been done on it for nearly 18 months.  Will
OracleStorage work with the DCOracle2 product in support of 9i ?

Thanks in advance

Eric


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )