On Fri, Apr 16, 2004 at 12:05:32PM +1200, Sidney Markowitz wrote: > Daniel Quinlan wrote: > >There are other slow rules. Language guessing, for example. > > Yes, language guessing is slow and I've yet to find a way to speed it up > after the first optimization I did on it. It's a Bayesian calculation > much like the Bayes classifier. But are there any others? Also, do we > get good enough results from the language classifier for it to be > worthwhile? > > I'm under the impression that Bayes is in a class by itself in terms of > how slow and how useful it is.
It's the only rule that requires significant IO. That certainly puts it in a different class. Saving CPU cycles is worth the effort but we'll see alot more return from profiled IO. In terms of Bayes SQL we'll keep on working with Michael and Sidney on performance enhancements. The latest SQL code is a huge improvement over the last but I think there is still room for improvement. For what it's worth, tuned innodb tables seem to be faster than myisam. -- Kelsey Cummings - [EMAIL PROTECTED] sonic.net, inc. System Administrator 2260 Apollo Way 707.522.1000 (Voice) Santa Rosa, CA 95407 707.547.2199 (Fax) http://www.sonic.net/ Fingerprint = D5F9 667F 5D32 7347 0B79 8DB7 2B42 86B6 4E2C 3896
