Jason, You shouldn't need to reindex your collections on a weekly basis.
Adding/Updating/deleting a key in your collection should be done at the time that the data is updated. The insert/update to verity takes very little time. Deleting a key takes a little more time, but not significantly so. Its always worth providing an option to kick off a one time full re-index of the data/collection, for those times when something becomes corrupt, but this doesn't occur that often. BTW : 15 minutes for 290k records is pretty quick... Selecting the records from a DB won't take too long (long enough though), but think about how many words have to be indexed for 290K records... 15 minutes is going some (333 records a second!) Regards Stephen ----- Original Message ----- From: "Dowdell, Jason G" <[EMAIL PROTECTED]> To: "CF-Talk" <[EMAIL PROTECTED]> Sent: Friday, November 15, 2002 2:23 PM Subject: RE: Verity index of a query > Very interesting. I'll make sure to rebuild the query when > there is no load as well. I appreciate your feedback. > > ~Jason > > -----Original Message----- > From: Everett, Al [mailto:AEverett@;askallied.com] > Sent: Friday, November 15, 2002 9:00 AM > To: CF-Talk > Subject: RE: Verity index of a query > > > Response time is okay. It would be better if we could get all the > information back that we need in one swell foop, but due to some unique data > needs we simply use the collection to return product IDs that we then use in > a subsequent DB query. For that fact, mostly, we're looking to go to > Oracle's full-text searching instead. > > It does take upwards of fifteen minutes to refresh each collection, and it > pretty much pegs the CPU gauge while we're doing it, which is why we only do > it weekly, and in the wee hours of Saturday morning when we have no load. > > > -----Original Message----- > > From: Dowdell, Jason G [mailto:DowdelJG@;usano.ksc.nasa.gov] > > Sent: Friday, November 15, 2002 8:49 AM > > To: CF-Talk > > Subject: RE: Verity index of a query > > > > > > What kind of query response time are you experiencing > > under heavy load? I'm just now getting into the verity > > side of things because I am building a search engine > > for a client and am curious as to how much of an increase > > in speed the collection makes over just making a query > > that hits the sqlserver db. I know it's better but I > > don't know how much. > > > > If you have any pointers or pitfalls to avoid I'd > > appreciate that as well. > > > > Thanks, > > Jason > > > > -----Original Message----- > > From: Everett, Al [mailto:AEverett@;askallied.com] > > Sent: Friday, November 15, 2002 8:36 AM > > To: CF-Talk > > Subject: RE: Verity index of a query > > > > > > Yeppers. CF4.5 before that. > > > > > -----Original Message----- > > > From: Dowdell, Jason G [mailto:DowdelJG@;usano.ksc.nasa.gov] > > > Sent: Friday, November 15, 2002 8:35 AM > > > To: CF-Talk > > > Subject: RE: Verity index of a query > > > > > > > > > I'm assuming you're running CF5 with the out of the box > > > Verity engine? Just curious. > > > > > > Thanks for the feedback, > > > Jason > > > > > > -----Original Message----- > > > From: Everett, Al [mailto:AEverett@;askallied.com] > > > Sent: Thursday, November 14, 2002 3:58 PM > > > To: CF-Talk > > > Subject: RE: Verity index of a query > > > > > > > > > Heck no. We reindex a database of 290,000 products weekly. > > > The collection is > > > stored on disk. > > > > > > > -----Original Message----- > > > > From: Angel Stewart [mailto:gel@;silkcotton.com] > > > > Sent: Thursday, November 14, 2002 3:39 PM > > > > To: CF-Talk > > > > Subject: RE: Verity index of a query > > > > > > > > > > > > I believe it is stored in coldfusion/verity/collections on > > > the server. > > > > > > > > I don't think you are required to re-index a database verity > > > > collection > > > > everytime you reboot your server... > > > > > > > > -Gel > > > > > > > > > > > > -----Original Message----- > > > > From: Dowdell, Jason G [mailto:DowdelJG@;usano.ksc.nasa.gov] > > > > > > > > Does anyone know how/where a Verity index of a query > > > > is stored on the box? I'm wondering if the server is > > > > restarted whether > > > > or not the indexed query will remain or if it's stored in the > > > > CFServer's > > > > memory until that box shuts down... At which point the index > > > > would need > > > > to be recreated. > > > > > > > > Points to note: I am calling a query that gets stored by > > verity an > > > > "index". I'm not sure if I should use the word "collection" > > > > here since > > > > it's not a "collection" of docs. When I say "index" I'm not > > > > referring to > > > > the primary or foreign key nature of the database. (just wanted to > > > > clarify) > > > > > > > > Thanks, > > > > Jason > > > > > > > > > > > > > > > > > > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribe&forumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Structure your ColdFusion code with Fusebox. Get the official book at http://www.fusionauthority.com/bkinfo.cfm
