Hi Thomas
Got it working further, by trimming the notspam folder to 9500 files. It gets
as far as "Nov-01-11 08:01:55 Finished populating Hidden Markov Model!" before
crashing.
No CPU spike, or memory surge, just crashes and autostarts a minute later
informing of an ASSP unclean shutdown.
Hth
Steve
-----Original Message-----
From: Steve Moffat [mailto:st...@optimum.bm]
Sent: Monday, October 31, 2011 4:17 PM
To: ASSP development mailing list
Subject: Re: [Assp-test] Antwort: Re: Antwort: Version 2.1.2(11304
Hi Thomas
Finally got it to run. Going with the stuck worker clue, I disabled SMTP
networking for the duration of the rebuild. It nearly completed successfully.
It managed to get to "Oct-31-11 16:07:42 start populating Hidden Markov Model
spam totals with 885542 records!" before crashing this time.
Hope this info helps
I'm also starting to get these reports again. Despite having the entry to allow
them in the assp.cfg correction file.
"Oct-31-11 16:13:18 [Worker_4] [TLS-out] [PTRinvalid] 206.53.187.90
<assp@assp.local> to: i...@optimum.bm [spam found] (PTR invalid
'host-206-53-187-90.telebermuda.com') [RebuildSpamDB report from ASSP nospam]
-> spam/RebuildSpamDB_report_from_ASSP--891.eml;"
Steve
------------------------------------------------------------------------------
Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes.
BlackBerry App World™ now supports Android™ Apps for the
BlackBerry® PlayBook™. Discover just how easy and simple it is!
http://p.sf.net/sfu/android-dev2dev
_______________________________________________
Assp-test mailing list
Assp-test@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/assp-test
Nov-01-11 07:10:55 RebuildSpamDB-thread rebuildspamdb-version 2.85 started in
ASSP version 2.1.2(11304)
Nov-01-11 07:10:55 RebuildSpamDB will create a Hidden Markov Model!
Nov-01-11 07:10:55 ---ASSP Settings---
Nov-01-11 07:10:55 Do Not Collect RedRe Messages: Enabled
**Messages matching the RedRe will be removed from the corpus!**
Nov-01-11 07:10:55 Use Subject as Maillog Names: True
Nov-01-11 07:10:55 Maxbytes: 4000
Nov-01-11 07:10:55 c:/assp/errors/spam
Nov-01-11 07:10:55 File Count: 42
Nov-01-11 07:10:55 Processing... errors/spam with 42 files
Nov-01-11 07:10:57 Imported Files: 42
Nov-01-11 07:10:57 Finished in 2 second(s)
Nov-01-11 07:10:57 c:/assp/errors/notspam
Nov-01-11 07:10:57 File Count: 29
Nov-01-11 07:10:57 Processing... errors/notspam with 29 files
Nov-01-11 07:11:02 Imported Files: 29
Nov-01-11 07:11:02 Finished in 5 second(s)
Nov-01-11 07:11:02 c:/assp/spam
Nov-01-11 07:11:03 File Count: 9,355
Nov-01-11 07:11:03 Processing... spam with 9355 files
Nov-01-11 07:22:26 Imported Files: 9,355
Nov-01-11 07:22:26 Finished in 684 second(s)
Nov-01-11 07:22:26 c:/assp/notspam
Nov-01-11 07:22:28 File Count: 15,381
Nov-01-11 07:22:28 Processing... notspam with 15381 files
Nov-01-11 07:45:43 Imported Files: 15,381
Nov-01-11 07:45:43 Folder contents exceeded `MaxFiles`(12000).
Nov-01-11 07:45:43 Finished in 1397 second(s)
Nov-01-11 07:45:43 Generating weighted Bayesian tuplets
Nov-01-11 07:51:08 cleaning old Spamdb records
Nov-01-11 07:51:40 done - cleaning old Spamdb records - removed 706013 from
125495
Nov-01-11 07:51:40 done - Generating weighted Bayesian tuplets
Nov-01-11 07:51:42 Bayesian Pairs: 125,495 new, 125,495 now in list
Nov-01-11 07:51:42 cleaning old Spamdb.helo records
Nov-01-11 07:51:42 done - cleaning old Spamdb.helo records
Nov-01-11 07:51:42 HELO Blacklist: 0 new, 0 now in list
Nov-01-11 07:51:42 Spam Weight: 3,265,551
Nov-01-11 07:51:42 Not-Spam Weight: 4,502,401
Nov-01-11 07:51:42 Corpus norm: 0.7253 - (ok - slighly ham heavy)
Nov-01-11 07:51:42 Recommendation: RebuildSpamDB will limit the number of used
messages in your corpus. Excess files will be ingored.
Nov-01-11 07:51:47 Start populating Hidden Markov Model!
Nov-01-11 07:51:47 start populating Hidden Markov Model ham chains with 886353
records!
Nov-01-11 07:54:22 Finished populating Hidden Markov Model ham chains with
886353 records!
Nov-01-11 07:54:22 start populating Hidden Markov Model ham totals with 799563
records!
Nov-01-11 07:56:29 Finished populating Hidden Markov Model ham totals with
799563 records!
Nov-01-11 07:56:29 start populating Hidden Markov Model spam chains with 971135
records!
Nov-01-11 07:59:23 Finished populating Hidden Markov Model spam chains with
971135 records!
Nov-01-11 07:59:23 start populating Hidden Markov Model spam totals with 889936
records!
Nov-01-11 08:01:55 Finished populating Hidden Markov Model spam totals with
889936 records!
Nov-01-11 08:01:55 Finished populating Hidden Markov Model!
------------------------------------------------------------------------------
RSA® Conference 2012
Save $700 by Nov 18
Register now
http://p.sf.net/sfu/rsa-sfdev2dev1
_______________________________________________
Assp-test mailing list
Assp-test@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/assp-test
