Re: [ZODB-Dev] On ZODB for discardable data
Hi Manuel, On Mon, 2007-01-22 at 22:58 -0500, Manuel Vázquez Acosta wrote: Hi all, I would like some advice on ZODB for an specific scenario. We're working on a Product that will collect the contents of web pages and find similar ones, and make summaries of its contents. This process involves downloading the webpages and create the VSM for those documents so we can run the clustering and summarizing algorithms. However by the very nature of our application, everytime we run the entire process we should discard the old result, keeping the used space nearly constant. A while back we developed a ZODB based wxPython application where part of the data was imported whenever it had changed. We had a separate ZODB for this data which allowed us to just delete the old database file as part of the refresh step. The refresh step closed the database, deleted it, created a new one, added the catalog and indexes and imported the data. All the other data was safely in the separate ZODB file. Not sure if your problem lends itself to this simple solution. Paul My question is if ZODB can be used in that way. If not, which are the options (should I make my own storage?) Best regards, Manuel. ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] On ZODB for discardable data
Am Montag, den 22.01.2007, 22:58 -0500 schrieb Manuel Vázquez Acosta: Hi all, I would like some advice on ZODB for an specific scenario. We're working on a Product that will collect the contents of web pages and find similar ones, and make summaries of its contents. This process involves downloading the webpages and create the VSM for those documents so we can run the clustering and summarizing algorithms. However by the very nature of our application, everytime we run the entire process we should discard the old result, keeping the used space nearly constant. My question is if ZODB can be used in that way. If not, which are the options (should I make my own storage?) There are existing storages that support this scenario. FileStorage does not. I thought that DirectoryStorage supports this scenario, but the online docs are a little vague on that. Christian -- gocept gmbh co. kg - forsterstraße 29 - 06112 halle/saale - germany www.gocept.com - [EMAIL PROTECTED] - phone +49 345 122 9889 7 - fax +49 345 122 9889 1 - zope and plone consulting and development signature.asc Description: Dies ist ein digital signierter Nachrichtenteil ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] On ZODB for discardable data
--On 23. Januar 2007 07:59:55 +0100 Christian Theune [EMAIL PROTECTED] wrote: However by the very nature of our application, everytime we run the entire process we should discard the old result, keeping the used space nearly constant. There are existing storages that support this scenario. FileStorage does not. I thought that DirectoryStorage supports this scenario, but the online docs are a little vague on that. Filestorages must be packed regularly in order to get rid of obsolete data older than N days. -aj pgpKd4iFlhCVO.pgp Description: PGP signature ___ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org http://mail.zope.org/mailman/listinfo/zodb-dev
