True enough. In our case, we get data imported from a legacy system and it isn't feasible to do incremental adding/updating/deleting. I wish we COULD do without the bulk insert, but this application rides the small bus to school.
> -----Original Message----- > From: Stephen Moretti [mailto:stephen@;cfmaster.co.uk] > Sent: Friday, November 15, 2002 9:43 AM > To: CF-Talk > Subject: Re: Verity index of a query > > > Jason, > > You shouldn't need to reindex your collections on a weekly basis. > > Adding/Updating/deleting a key in your collection should be > done at the time > that the data is updated. The insert/update to verity takes > very little > time. Deleting a key takes a little more time, but not > significantly so. > > Its always worth providing an option to kick off a one time > full re-index of > the data/collection, for those times when something becomes > corrupt, but > this doesn't occur that often. > > BTW : 15 minutes for 290k records is pretty quick... > Selecting the records > from a DB won't take too long (long enough though), but think > about how many > words have to be indexed for 290K records... 15 minutes is > going some (333 > records a second!) > > Regards > > Stephen > > ----- Original Message ----- > From: "Dowdell, Jason G" <[EMAIL PROTECTED]> > To: "CF-Talk" <[EMAIL PROTECTED]> > Sent: Friday, November 15, 2002 2:23 PM > Subject: RE: Verity index of a query > > > > Very interesting. I'll make sure to rebuild the query when > > there is no load as well. I appreciate your feedback. > > > > ~Jason > > > > -----Original Message----- > > From: Everett, Al [mailto:AEverett@;askallied.com] > > Sent: Friday, November 15, 2002 9:00 AM > > To: CF-Talk > > Subject: RE: Verity index of a query > > > > > > Response time is okay. It would be better if we could get all the > > information back that we need in one swell foop, but due to > some unique > data > > needs we simply use the collection to return product IDs > that we then use > in > > a subsequent DB query. For that fact, mostly, we're looking to go to > > Oracle's full-text searching instead. > > > > It does take upwards of fifteen minutes to refresh each > collection, and it > > pretty much pegs the CPU gauge while we're doing it, which > is why we only > do > > it weekly, and in the wee hours of Saturday morning when we > have no load. > > > > > -----Original Message----- > > > From: Dowdell, Jason G [mailto:DowdelJG@;usano.ksc.nasa.gov] > > > Sent: Friday, November 15, 2002 8:49 AM > > > To: CF-Talk > > > Subject: RE: Verity index of a query > > > > > > > > > What kind of query response time are you experiencing > > > under heavy load? I'm just now getting into the verity > > > side of things because I am building a search engine > > > for a client and am curious as to how much of an increase > > > in speed the collection makes over just making a query > > > that hits the sqlserver db. I know it's better but I > > > don't know how much. > > > > > > If you have any pointers or pitfalls to avoid I'd > > > appreciate that as well. > > > > > > Thanks, > > > Jason > > > > > > -----Original Message----- > > > From: Everett, Al [mailto:AEverett@;askallied.com] > > > Sent: Friday, November 15, 2002 8:36 AM > > > To: CF-Talk > > > Subject: RE: Verity index of a query > > > > > > > > > Yeppers. CF4.5 before that. > > > > > > > -----Original Message----- > > > > From: Dowdell, Jason G [mailto:DowdelJG@;usano.ksc.nasa.gov] > > > > Sent: Friday, November 15, 2002 8:35 AM > > > > To: CF-Talk > > > > Subject: RE: Verity index of a query > > > > > > > > > > > > I'm assuming you're running CF5 with the out of the box > > > > Verity engine? Just curious. > > > > > > > > Thanks for the feedback, > > > > Jason > > > > > > > > -----Original Message----- > > > > From: Everett, Al [mailto:AEverett@;askallied.com] > > > > Sent: Thursday, November 14, 2002 3:58 PM > > > > To: CF-Talk > > > > Subject: RE: Verity index of a query > > > > > > > > > > > > Heck no. We reindex a database of 290,000 products weekly. > > > > The collection is > > > > stored on disk. > > > > > > > > > -----Original Message----- > > > > > From: Angel Stewart [mailto:gel@;silkcotton.com] > > > > > Sent: Thursday, November 14, 2002 3:39 PM > > > > > To: CF-Talk > > > > > Subject: RE: Verity index of a query > > > > > > > > > > > > > > > I believe it is stored in coldfusion/verity/collections on > > > > the server. > > > > > > > > > > I don't think you are required to re-index a database verity > > > > > collection > > > > > everytime you reboot your server... > > > > > > > > > > -Gel > > > > > > > > > > > > > > > -----Original Message----- > > > > > From: Dowdell, Jason G [mailto:DowdelJG@;usano.ksc.nasa.gov] > > > > > > > > > > Does anyone know how/where a Verity index of a query > > > > > is stored on the box? I'm wondering if the server is > > > > > restarted whether > > > > > or not the indexed query will remain or if it's stored in the > > > > > CFServer's > > > > > memory until that box shuts down... At which point the index > > > > > would need > > > > > to be recreated. > > > > > > > > > > Points to note: I am calling a query that gets stored by > > > verity an > > > > > "index". I'm not sure if I should use the word "collection" > > > > > here since > > > > > it's not a "collection" of docs. When I say "index" I'm not > > > > > referring to > > > > > the primary or foreign key nature of the database. > (just wanted to > > > > > clarify) > > > > > > > > > > Thanks, > > > > > Jason > > > > > > > > > > > > > > > > > > > > > > > > > > > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribe&forumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq This list and all House of Fusion resources hosted by CFHosting.com. The place for dependable ColdFusion Hosting.
