Re: [Zope-dev] ZCatalog hackery

2001-03-05 Thread Dieter Maurer
R. David Murray writes: > ... > The issue is that parts of the database get updated periodically from an > external source. That is, the author and book tables get replaced > wholesale. But the Book and Author objects are cataloged using > ZCatalog, doing a full text index on a combination

Re: [Zope-dev] ZCatalog hackery

2001-03-03 Thread Chris McDonough
> Will the new data be 'made ready for indexing' before it is compared to the > existing data? That is, will ZCatalog have to compute the data in some > way before it compares it to what is already stored? Yes. > I'm wondering because it would be significant overhead to 'make a data field > of

Re: [Zope-dev] ZCatalog hackery

2001-03-03 Thread Chris McDonough
> Cool. Now, in the examples I've seen for interfacing ZCatalog and > ZPatterns, the 'object updated' code does an unindex of the object > and then an index of the object. I copied that pattern for my > "the tables have been updated, reindex everything" code. > So what I should do instead is jus

Re: [Zope-dev] ZCatalog hackery

2001-03-03 Thread R. David Murray
On Sat, 3 Mar 2001, Chris McDonough wrote: > Has the physical path of the object changed? If not, the newer (2.3.0 + ) Nope. > catalog stuff should be smart enough to figure out whether anything inside > the object has changed during catalog_object. If nothing has changed, none > of the indexe

Re: [Zope-dev] ZCatalog hackery

2001-03-03 Thread Morten W. Petersen
[Chris McDonough] | Note that the algoritm is simple - for each index, compare the what exists | in the index to what is to be put in. If they're the same, do nothing. If | they're different, reindex. I wasn't able to understand completely from | your description whether the object method your

Re: [Zope-dev] ZCatalog hackery

2001-03-03 Thread Chris McDonough
stic tests. - Original Message - From: "R. David Murray " <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Sent: Saturday, March 03, 2001 2:29 PM Subject: Re: [Zope-dev] ZCatalog hackery > I've got an analogous but different problem with ZCatalog udpates. I'd >

Re: [Zope-dev] ZCatalog hackery

2001-03-03 Thread R. David Murray
I've got an analogous but different problem with ZCatalog udpates. I'd like to ask for ideas about the best way to handle this. I've got a ZPatterns based ap that is pulling data from a postgresql database. But associated with the object created out of the database are signficant chunks of html

Re: [Zope-dev] ZCatalog hackery

2001-03-01 Thread Casey Duncan
Casey Duncan wrote: > > "Morten W. Petersen" wrote: > > > > Hi guys, > > > > I've got a problem with ZCatalog. I've got plenty of large > > objects, ranging from 100KB to 100MB in size. Needless to > > say, these take up a lot of processor time when indexed by > > the ZCatalog. > > > > Now, the

Re: [Zope-dev] ZCatalog hackery

2001-03-01 Thread Morten W. Petersen
[Casey Duncan] | Actually what I wrote assumes you are passing a Catalog not a ZCatalog. | So you will need to change it for a ZCatalog to: I figured that out. :-) There is one problem, the uids stored in the Catalog are based on the path of the object, so I guess I'll have to make a copy of t

Re: [Zope-dev] ZCatalog hackery

2001-03-01 Thread Casey Duncan
"Morten W. Petersen" wrote: > > Hi guys, > > I've got a problem with ZCatalog. I've got plenty of large > objects, ranging from 100KB to 100MB in size. Needless to > say, these take up a lot of processor time when indexed by > the ZCatalog. > > Now, these object have to be moved from time to