On Fri, Mar 12, 2004 at 02:05:05AM +1300, Sidney Markowitz wrote:I think performance will not be acceptable if each message requires reading on the order of 7 or 8 megabytes from disk.
All of this is exactly the argument for using a modern RDBMS. You trust that they have all of the smarts built in to manage your tables and indexes. In some cases you pay experts to help tune and manage your databases.
This sounds like a "Don't worry your pretty little head about it, the experts know what they are doing" argument.
Ok, I'll wait to see what the performance is like when someone, presumably Kelsey, is able to try a large scale test using SQL Bayes. If its good I'll rejoice.
If its bad I'll start asking what those fancy high paid DBAs would do to get some locality of reference so all bayes data of one user can be slurped up when it is needed during processing of one message. And I'll suggest that we reduce the size of the data fields. And I'll ask if the MySQL documentation is correct when it says that VARCHAR elements in MyISAM tables hurt performance. Etc.
But I'll shut up now until we see some numbers.
-- sidney
