I have compiled the most recent git snapshot on FreeBSD 7.2. My goal is to train a global user as a baseline for all my virtualusers. Using mysql/innodb as backend i'm trying to feed my old spam maildir to globaluser. During the process I get bursts of Broken results, like this: [test: spam ] /vmail/.Spam/cur/1180278503.M836 result: PASS [test: spam ] /vmail/.Spam/cur/1180439476.M314 result: PASS [test: spam ] /vmail/.Spam/cur/1180280107.M390 result: BROKEN result!! [test: spam ] /vmail/.Spam/cur/1180310099.M703 result: BROKEN result!! [test: spam ] /vmail/.Spam/cur/1180280166.M902 result: BROKEN result!! [test: spam ] /vmail/.Spam/cur/1180280172.M904 result: BROKEN result!! [test: spam ] /vmail/.Spam/cur/1180280191.M613 result: BROKEN result!! [test: spam ] /vmail/.Spam/cur/1180297408.M381 result: BROKEN result!! [test: spam ] /vmail/.Spam/cur/1180439478.M351 result: BROKEN result!! [test: spam ] /vmail/.Spam/cur/1180441411.M279 result: BROKEN result!! [test: spam ] /vmail/.Spam/cur/1180591220.M946 result: BROKEN result!! [test: spam ] /vmail/.Spam/cur/1180620806.M383 result: BROKEN result!! [test: spam ] /vmail/.Spam/cur/1180387441.M378 result: BROKEN result!! [test: spam ] /vmail/.Spam/cur/1180385602.M348 result: PASS [test: spam ] /vmail/.Spam/cur/1180381414.M769 result: PASS [test: spam ] /vmail/.Spam/cur/1180369487.M482 result: PASS
dspam log shows the following errors: Aug 25 00:46:38 mail dspam[31753]: Unable to attach DSPAM context Aug 25 00:46:38 mail dspam[31753]: process_message returned error -2. delivering. Aug 25 00:46:38 mail dspam[31755]: Can't connect to MySQL server on '10.1.0.1' (1) Aug 25 00:46:38 mail dspam[31755]: _ds_pref_load: unable to initialize tools context Aug 25 00:46:38 mail dspam[31755]: Can't connect to MySQL server on '10.1.0.1' (1) Aug 25 00:46:38 mail dspam[31755]: _ds_pref_load: unable to initialize tools context Aug 25 00:46:38 mail dspam[31755]: Can't connect to MySQL server on '10.1.0.1' (1) Aug 25 00:46:38 mail dspam[31755]: _ds_pref_load: unable to initialize tools context Aug 25 00:46:38 mail dspam[31755]: Can't connect to MySQL server on '10.1.0.1' (1) Aug 25 00:46:38 mail dspam[31755]: Unable to initialize handle to MySQL database Aug 25 00:46:38 mail dspam[31755]: Unable to attach DSPAM context Aug 25 00:46:38 mail dspam[31755]: process_message returned error -2. delivering. Aug 25 00:46:38 mail dspam[31757]: Can't connect to MySQL server on '10.1.0.1' (1) Aug 25 00:46:38 mail dspam[31757]: _ds_pref_load: unable to initialize tools context Aug 25 00:46:38 mail dspam[31757]: Can't connect to MySQL server on '10.1.0.1' (1) Aug 25 00:46:38 mail dspam[31757]: _ds_pref_load: unable to initialize tools context Aug 25 00:46:38 mail dspam[31757]: Can't connect to MySQL server on '10.1.0.1' (1) Aug 25 00:46:38 mail dspam[31757]: _ds_pref_load: unable to initialize tools context Aug 25 00:46:38 mail dspam[31757]: Can't connect to MySQL server on '10.1.0.1' (1) Aug 25 00:46:38 mail dspam[31757]: Unable to initialize handle to MySQL database Aug 25 00:46:38 mail dspam[31757]: Unable to attach DSPAM context Aug 25 00:46:38 mail dspam[31757]: process_message returned error -2. delivering. dspam.debug: 31737: [08/25/2009 00:46:38] DSPAM Instance Startup 31737: [08/25/2009 00:46:38] input args: /usr/local/bin/dspam --user globaluser --deliver=summary --stdout 31737: [08/25/2009 00:46:38] pass-thru args: 31737: [08/25/2009 00:46:38] processing user globaluser 31737: [08/25/2009 00:46:38] uid = 0, euid = 0, gid = 0, egid = 0 31737: [08/25/2009 00:46:38] loading preferences for user globaluser 31737: [08/25/2009 00:46:38] _mysql_drv_connect: failed 31737: [08/25/2009 00:46:38] _mysql_drv_init_tools: Bailing and returning NULL! 31737: [08/25/2009 00:46:38] _mysql_drv_connect: failed 31737: [08/25/2009 00:46:38] _mysql_drv_init_tools: Bailing and returning NULL! 31737: [08/25/2009 00:46:38] _mysql_drv_connect: failed 31737: [08/25/2009 00:46:38] _mysql_drv_init_tools: Bailing and returning NULL! 31737: [08/25/2009 00:46:38] default preferences empty. reverting to dspam.conf preferences. 31737: [08/25/2009 00:46:38] Loading preferences from dspam.conf 31737: [08/25/2009 00:46:38] using /var/db/dspam/opt-in/globaluser.dspam as path 31737: [08/25/2009 00:46:38] using /var/db/dspam/opt-out/globaluser.nodspam as path 31737: [08/25/2009 00:46:38] sedation level set to: 0 31737: [08/25/2009 00:46:38] _mysql_drv_connect: failed 31737: [08/25/2009 00:46:38] DSPAM Instance Shutdown. Exit Code: 0 Innodb settings: innodb_buffer_pool_size = 256M innodb_additional_mem_pool_size = 20M innodb_log_file_size = 64M innodb_log_buffer_size = 8M innodb_flush_log_at_trx_commit = 1 innodb_lock_wait_timeout = 50 innodb_file_per_table = 1 Watching show processlist from mysql console I can't see any sleeping/stale connections, dspam always disconnects before reconnecting dspam config: Home /var/db/dspam StorageDriver /usr/local/lib/dspam/libmysql_drv.so TrustedDeliveryAgent "/usr/libexec/mail.local" DeliveryHost 127.0.0.1 DeliveryPort 10026 DeliveryIdent localhost DeliveryProto SMTP EnablePlusedDetail on OnFail error Trust root Trust dspam Trust apache Trust mail Trust mailnull Trust smmsp Trust daemon Debug * TrainingMode toe TestConditionalTraining on Feature whitelist Algorithm graham burton Tokenizer chain PValue bcr WebStats on Preference "spamAction=tag" Preference "signatureLocation=message" # 'message' or 'headers' Preference "showFactors=off" AllowOverride trainingMode AllowOverride spamAction spamSubject AllowOverride statisticalSedation AllowOverride enableBNR AllowOverride enableWhitelist AllowOverride signatureLocation AllowOverride showFactors AllowOverride optIn optOut AllowOverride whitelistThreshold MySQLServer 10.1.0.1 MySQLPort MySQLUser <user> MySQLPass <pass> MySQLDb <db> MySQLCompress true MySQLReconnect true MySQLVirtualTable dspam_virtual_uids MySQLVirtualUIDField uid MySQLVirtualUsernameField username HashRecMax 98317 HashAutoExtend on HashMaxExtents 0 HashExtentSize 49157 HashPctIncrease 10 HashMaxSeek 10 HashConnectionCache 10 Notifications off PurgeSignatures 14 # Stale signatures PurgeNeutral 90 # Tokens with neutralish probabilities PurgeUnused 90 # Unused tokens PurgeHapaxes 30 # Tokens with less than 5 hits (hapaxes) PurgeHits1S 15 # Tokens with only 1 spam hit PurgeHits1I 15 # Tokens with only 1 innocent hit LocalMX 127.0.0.1 SystemLog on UserLog on Opt out ParseToHeaders on ChangeModeOnParse on ChangeUserOnParse on ClamAVPort 3310 ClamAVHost 127.0.0.1 ClamAVResponse accept ServerMode standard ServerParameters "--deliver=innocent,spam" ServerIdent "datira.com" ServerPID /var/run/dspam.pid ServerDomainSocketPath "/var/run/dspam.sock" ProcessorURLContext on ProcessorBias on StripRcptDomain off I have tried increasing the MysqlConnectionCache to 20 but it didn't help. A question regarding accuracy/performance: Should I use teft for training with my own spam (~12000), then switch to toe? BR, Jos ------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ Dspam-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/dspam-user
