Re: Migrating bayes to mysql fails with parsing errors

2011-06-21 Thread Benny Pedersen
On Tue, 21 Jun 2011 23:13:58 -0400, Dave Wreski wrote: Use of uninitialized value $db_ver in concatenation (.) or string at /usr/share/perl5/Mail/SpamAssassin/BayesStore/SQL.pm line 142. using sql.pm not MySQL.pm, try the later one

Re: Migrating bayes to mysql fails with parsing errors

2011-06-21 Thread Dave Wreski
Hi, since so many have problems i share my mysql shemas :=) please note that i expire som data not default done in current spamassassin Your schema did not work for me. I deleted the existing database and recreated it, then created the tables using your schema. When starting to restore, a n

Re: Migrating bayes to mysql fails with parsing errors

2011-06-21 Thread Benny Pedersen
On Tue, 21 Jun 2011 21:03:25 -0230, Lawrence @ Rogers wrote: What other option does he have? iconv?? if it can yes, but my mysql setup does not need iconv or my.cnf changes,

Re: Migrating bayes to mysql fails with parsing errors

2011-06-21 Thread Lawrence @ Rogers
On 21/06/2011 8:47 PM, Benny Pedersen wrote: On Tue, 21 Jun 2011 22:16:05 +0300, Panagiotis Christias wrote: After commenting out the utf8 definitions and reverting back to latin1 "sa-learn --restore" worked fine. thanks for this report, but imho this should NOT be fixed in my.cnf What oth

Re: Migrating bayes to mysql fails with parsing errors

2011-06-21 Thread Benny Pedersen
On Tue, 21 Jun 2011 17:18:30 -0400, Dave Wreski wrote: I'll try the suggested my.cnf changes and restart the process. since so many have problems i share my mysql shemas :=) please note that i expire som data not default done in current spamassassin -- phpMyAdmin SQL Dump -- version 3.4.1

Re: Migrating bayes to mysql fails with parsing errors

2011-06-21 Thread Benny Pedersen
On Tue, 21 Jun 2011 22:16:05 +0300, Panagiotis Christias wrote: After commenting out the utf8 definitions and reverting back to latin1 "sa-learn --restore" worked fine. thanks for this report, but imho this should NOT be fixed in my.cnf

Re: Migrating bayes to mysql fails with parsing errors

2011-06-21 Thread Lawrence @ Rogers
On 21/06/2011 7:01 PM, Dave Wreski wrote: Hi, It looks like that may be my problem too. This is the result with your patch: dbg: bayes: database connection established dbg: bayes: found bayes db version 3 dbg: bayes: Using userid: 2 dbg: bayes: database connection established dbg: bayes: found

Re: Migrating bayes to mysql fails with parsing errors

2011-06-21 Thread Lawrence @ Rogers
On 21/06/2011 7:01 PM, Dave Wreski wrote: Hi, It looks like that may be my problem too. This is the result with your patch: dbg: bayes: database connection established dbg: bayes: found bayes db version 3 dbg: bayes: Using userid: 2 dbg: bayes: database connection established dbg: bayes: found

rules: failed to run BAYES_99 test, skipping

2011-06-21 Thread Marc Perkel
Weird error. Interesting part is that BAYES_00 seems to work. What's going on? -- Marc Perkel - Sales/Support supp...@junkemailfilter.com http://www.junkemailfilter.com Junk Email Filter dot com 415-992-3400

Re: Migrating bayes to mysql fails with parsing errors

2011-06-21 Thread Dave Wreski
Hi, It looks like that may be my problem too. This is the result with your patch: dbg: bayes: database connection established dbg: bayes: found bayes db version 3 dbg: bayes: Using userid: 2 dbg: bayes: database connection established dbg: bayes: found bayes db version 3 dbg: bayes: using useri

Re: Migrating bayes to mysql fails with parsing errors

2011-06-21 Thread Dave Wreski
Hi, dbg: bayes: error inserting token for line: t 1 0 1308114254 4fd2b3f2f0 dbg: bayes: _put_token: Updated an unexpected number of rows. [repeats ...] Which version of MySQL? Did you remember to replace TYPE=MyISAM with TYPE=InnoDB in the schema (according to README.bayes) if you are u

Re: High Performance Bayes Database Configuration?

2011-06-21 Thread David F. Skoll
Sorry for the second reply... On Tue, 21 Jun 2011 20:03:57 +0100 Dominic Benson wrote: > ...the database is shipped out to customers as part of an update service Actually yes, we do ship out a largish Bayes database as part of our update service. But we don't ship it out as a CDB file. It goe

Re: High Performance Bayes Database Configuration?

2011-06-21 Thread David F. Skoll
On Tue, 21 Jun 2011 20:03:57 +0100 Dominic Benson wrote: > To be fair to MySQL, these days it is pretty solid. There are > potentially dangerous configuration options, but there are in > Postgres too, and you can turn them off. Have you had a bad > experience with a recent version? No, not reall

Re: Migrating bayes to mysql fails with parsing errors

2011-06-21 Thread Panagiotis Christias
On Tue, Jun 21, 2011 at 5:47 PM, Mark Martinec wrote: > Dave, > >> dbg: bayes: error inserting token for line: t 1 0 1308114254 >>   4fd2b3f2f0 dbg: bayes: _put_token: Updated an unexpected number >>   of rows. [repeats ...] > > Which version of MySQL? > > Did you remember to replace TYPE=MyISAM w

Re: High Performance Bayes Database Configuration?

2011-06-21 Thread Dominic Benson
On 21 Jun 2011, at 19:19, David F. Skoll wrote: > On Tue, 21 Jun 2011 21:12:58 +0300 > Jari Fredriksson wrote: > >> Are you sure you are not using MyISAM tables? > > I don't use MySQL at all. (Our CRM system requires it, but apart from > that, I stay away from it.) To be fair to MySQL, these

Re: High Performance Bayes Database Configuration?

2011-06-21 Thread David F. Skoll
On Tue, 21 Jun 2011 21:12:58 +0300 Jari Fredriksson wrote: > Are you sure you are not using MyISAM tables? I don't use MySQL at all. (Our CRM system requires it, but apart from that, I stay away from it.) > When they lock, they lock the entire table, which is BAD for > performance if there are

Re: High Performance Bayes Database Configuration?

2011-06-21 Thread Jari Fredriksson
21.6.2011 21:10, David F. Skoll kirjoitti: > On Tue, 21 Jun 2011 21:06:49 +0300 > Jari Fredriksson wrote: > >>> Our main database is 255MB, consisting of 6 220 831 tokens from >>> 731 289 spam messages and 900 447 non-spam messages. Each user >>> potentially has his/her own Bayes database in add

Re: High Performance Bayes Database Configuration?

2011-06-21 Thread David F. Skoll
On Tue, 21 Jun 2011 21:06:49 +0300 Jari Fredriksson wrote: > > Our main database is 255MB, consisting of 6 220 831 tokens from > > 731 289 spam messages and 900 447 non-spam messages. Each user > > potentially has his/her own Bayes database in addition to the > > central one, so the total Bayes

Re: High Performance Bayes Database Configuration?

2011-06-21 Thread Jari Fredriksson
21.6.2011 17:53, David F. Skoll kirjoitti: > On Tue, 21 Jun 2011 15:46:59 +0100 > a.sm...@ukgrid.net wrote: > >> Thats a bit harsh on MySQL isn't it? > > No. MySQL is horrible, no question about it. > >> Anyway, how big are the DB's of you guys?? > > Our main database is 255MB, consisting of 6

Re: High Performance Bayes Database Configuration?

2011-06-21 Thread David F. Skoll
On Tue, 21 Jun 2011 15:46:59 +0100 a.sm...@ukgrid.net wrote: > Thats a bit harsh on MySQL isn't it? No. MySQL is horrible, no question about it. > Anyway, how big are the DB's of you guys?? Our main database is 255MB, consisting of 6 220 831 tokens from 731 289 spam messages and 900 447 non-sp

Re: Migrating bayes to mysql fails with parsing errors

2011-06-21 Thread Mark Martinec
Dave, > dbg: bayes: error inserting token for line: t 1 0 1308114254 > 4fd2b3f2f0 dbg: bayes: _put_token: Updated an unexpected number > of rows. [repeats ...] Which version of MySQL? Did you remember to replace TYPE=MyISAM with TYPE=InnoDB in the schema (according to README.bayes) if you ar

Re: High Performance Bayes Database Configuration?

2011-06-21 Thread a . smith
Quoting "David F. Skoll" : On Tue, 21 Jun 2011 07:06:11 -0700 Marc Perkel wrote: Trying to get MySQL bays working in a high volume environment. Dedicated MySQL server with SSD drives. Can someone send me a sample my.cnf file and make other suggestings to keep it running wihout database corrup

Re: High Performance Bayes Database Configuration?

2011-06-21 Thread Yet Another Ninja
On 2011-06-21 16:30, Marc Perkel wrote: On 6/21/2011 7:23 AM, David F. Skoll wrote: On Tue, 21 Jun 2011 07:06:11 -0700 Marc Perkel wrote: Trying to get MySQL bays working in a high volume environment. Dedicated MySQL server with SSD drives. Can someone send me a sample my.cnf file and make o

Re: High Performance Bayes Database Configuration?

2011-06-21 Thread Toni Mueller
Hi, On Tue, 21.06.2011 at 07:30:51 -0700, Marc Perkel wrote: > Thanks David but I need real time updating and it's spread across > multiple servers. So need PostgreSQL or MySQL. just a shot in the dark: Maybe you can use mnesia, which is distributed and should be _quite_ fast. It's not SQL, ho

Re: High Performance Bayes Database Configuration?

2011-06-21 Thread David F. Skoll
On Tue, 21 Jun 2011 07:30:51 -0700 Marc Perkel wrote: > Thanks David but I need real time updating and it's spread across > multiple servers. So need PostgreSQL or MySQL. That's what we used to think. It turns out that real-time updating is a waste of resources; journalling Bayes updates and t

Re: High Performance Bayes Database Configuration?

2011-06-21 Thread Marc Perkel
On 6/21/2011 7:23 AM, David F. Skoll wrote: On Tue, 21 Jun 2011 07:06:11 -0700 Marc Perkel wrote: Trying to get MySQL bays working in a high volume environment. Dedicated MySQL server with SSD drives. Can someone send me a sample my.cnf file and make other suggestings to keep it running wiho

Re: High Performance Bayes Database Configuration?

2011-06-21 Thread David F. Skoll
On Tue, 21 Jun 2011 07:06:11 -0700 Marc Perkel wrote: > Trying to get MySQL bays working in a high volume environment. > Dedicated MySQL server with SSD drives. Can someone send me a sample > my.cnf file and make other suggestings to keep it running wihout > database corruption and other MySQL "f

High Performance Bayes Database Configuration?

2011-06-21 Thread Marc Perkel
Trying to get MySQL bays working in a high volume environment. Dedicated MySQL server with SSD drives. Can someone send me a sample my.cnf file and make other suggestings to keep it running wihout database corruption and other MySQL "features"? Or - should I be using some other DB? Thanks in a

Re: Migrating bayes to mysql fails with parsing errors

2011-06-21 Thread RW
On Tue, 21 Jun 2011 00:42:46 -0230 Lawrence @ Rogers wrote: > On 20/06/2011 11:55 PM, Dave Wreski wrote: > > Hi, > > > >>> I have an existing v3.3.2 on fedora14 (perl v5.12.3) that I'm > >>> trying to convert bayes to use mysql. The restore process fails > >>> after a few minutes due to too many e