My application is basically a search engine. So whenever new sites are added I'm assuming that I won't have to recreate or update the verity index since it's based on a query... I just want to make sure that when they search the index they're getting everything back from the db as it currently stands.
Let me know if I'm off base here. Thanks, Jason -----Original Message----- From: Stephen Moretti [mailto:stephen@;cfmaster.co.uk] Sent: Friday, November 15, 2002 9:43 AM To: CF-Talk Subject: Re: Verity index of a query Jason, You shouldn't need to reindex your collections on a weekly basis. Adding/Updating/deleting a key in your collection should be done at the time that the data is updated. The insert/update to verity takes very little time. Deleting a key takes a little more time, but not significantly so. Its always worth providing an option to kick off a one time full re-index of the data/collection, for those times when something becomes corrupt, but this doesn't occur that often. BTW : 15 minutes for 290k records is pretty quick... Selecting the records from a DB won't take too long (long enough though), but think about how many words have to be indexed for 290K records... 15 minutes is going some (333 records a second!) Regards Stephen ----- Original Message ----- From: "Dowdell, Jason G" <[EMAIL PROTECTED]> To: "CF-Talk" <[EMAIL PROTECTED]> Sent: Friday, November 15, 2002 2:23 PM Subject: RE: Verity index of a query > Very interesting. I'll make sure to rebuild the query when > there is no load as well. I appreciate your feedback. > > ~Jason > > -----Original Message----- > From: Everett, Al [mailto:AEverett@;askallied.com] > Sent: Friday, November 15, 2002 9:00 AM > To: CF-Talk > Subject: RE: Verity index of a query > > > Response time is okay. It would be better if we could get all the > information back that we need in one swell foop, but due to some unique data > needs we simply use the collection to return product IDs that we then use in > a subsequent DB query. For that fact, mostly, we're looking to go to > Oracle's full-text searching instead. > > It does take upwards of fifteen minutes to refresh each collection, and it > pretty much pegs the CPU gauge while we're doing it, which is why we only do > it weekly, and in the wee hours of Saturday morning when we have no load. > > > -----Original Message----- > > From: Dowdell, Jason G [mailto:DowdelJG@;usano.ksc.nasa.gov] > > Sent: Friday, November 15, 2002 8:49 AM > > To: CF-Talk > > Subject: RE: Verity index of a query > > > > > > What kind of query response time are you experiencing > > under heavy load? I'm just now getting into the verity > > side of things because I am building a search engine > > for a client and am curious as to how much of an increase > > in speed the collection makes over just making a query > > that hits the sqlserver db. I know it's better but I > > don't know how much. > > > > If you have any pointers or pitfalls to avoid I'd > > appreciate that as well. > > > > Thanks, > > Jason > > > > -----Original Message----- > > From: Everett, Al [mailto:AEverett@;askallied.com] > > Sent: Friday, November 15, 2002 8:36 AM > > To: CF-Talk > > Subject: RE: Verity index of a query > > > > > > Yeppers. CF4.5 before that. > > > > > -----Original Message----- > > > From: Dowdell, Jason G [mailto:DowdelJG@;usano.ksc.nasa.gov] > > > Sent: Friday, November 15, 2002 8:35 AM > > > To: CF-Talk > > > Subject: RE: Verity index of a query > > > > > > > > > I'm assuming you're running CF5 with the out of the box > > > Verity engine? Just curious. > > > > > > Thanks for the feedback, > > > Jason > > > > > > -----Original Message----- > > > From: Everett, Al [mailto:AEverett@;askallied.com] > > > Sent: Thursday, November 14, 2002 3:58 PM > > > To: CF-Talk > > > Subject: RE: Verity index of a query > > > > > > > > > Heck no. We reindex a database of 290,000 products weekly. > > > The collection is > > > stored on disk. > > > > > > > -----Original Message----- > > > > From: Angel Stewart [mailto:gel@;silkcotton.com] > > > > Sent: Thursday, November 14, 2002 3:39 PM > > > > To: CF-Talk > > > > Subject: RE: Verity index of a query > > > > > > > > > > > > I believe it is stored in coldfusion/verity/collections on > > > the server. > > > > > > > > I don't think you are required to re-index a database verity > > > > collection > > > > everytime you reboot your server... > > > > > > > > -Gel > > > > > > > > > > > > -----Original Message----- > > > > From: Dowdell, Jason G [mailto:DowdelJG@;usano.ksc.nasa.gov] > > > > > > > > Does anyone know how/where a Verity index of a query > > > > is stored on the box? I'm wondering if the server is > > > > restarted whether > > > > or not the indexed query will remain or if it's stored in the > > > > CFServer's > > > > memory until that box shuts down... At which point the index > > > > would need > > > > to be recreated. > > > > > > > > Points to note: I am calling a query that gets stored by > > verity an > > > > "index". I'm not sure if I should use the word "collection" > > > > here since > > > > it's not a "collection" of docs. When I say "index" I'm not > > > > referring to > > > > the primary or foreign key nature of the database. (just wanted to > > > > clarify) > > > > > > > > Thanks, > > > > Jason > > > > > > > > > > > > > > > > > > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribe&forumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Signup for the Fusion Authority news alert and keep up with the latest news in ColdFusion and related topics. http://www.fusionauthority.com/signup.cfm
