I'm mostly just venting, but I have 2 machines trying to do the scoregen run, so I need to share the Bayes DB, and chose SQL. In total across those machines, I'm currently only seeing ~25 msgs/min or 0.5 messages/sec. So for my ~215k messages, that's 430k seconds, or 5 days of processing. Set 1 would take ~12h for this same set of messages, so bayes adds a 10x time penalty?
Am I missing something? MySQL w/ InnoDB + and BayesStore::MySQL, MySQL 4.1. Granted, I haven't timed this against SDBM or DBM, but I'll take any hints for MySQL tuning. An upside of using the mass-check client/server code is the ability to stop the clients, change MySQL configs, and restart the clients, and not lose the previous work. :) -- Randomly Selected Tagline: "The very powerful and the very stupid have one thing in common. Instead of altering their views to fit the facts, they alter the facts to fit their views ... which can be very uncomfortable if you happen to be one of the facts that needs altering." - Doctor Who, "Face of Evil"
pgp4qqC2BkfAG.pgp
Description: PGP signature
