hi
my aim to use dspam for out-of-box filtering
Installed DSPAM-3.8
i choose to use classification or merged method
i trained a dspam "globaluser" using dspam_train tool with various proportions
of spam to non spam
First time
spam : 14000
ham : 5000
first time i was getting spam emails in subject tagged as spam and headers
marked as innocent
deleted entire db, create new and trained again
Second time
spam : 2200
ham : 4400
and finally again
deleted entire db, create new and trained again
Third time
spam : 5200
ham : 10400
the second and third time spam mails are never marked as spam
also the results in the headers never change
if i use group file with the line
globalgroup:classification:*globaluser
Always the header is innocent and always the headers below are the same
X-DSPAM-Confidence: 0.6000
X-DSPAM-Probability: 0.0023
if i change the group file and use
globaluser:merged:*
always the result for all incoming emails.
X-DSPAM-Confidence: 0.9937
X-DSPAM-Probability: 0.0000
None of the spam messages are ever marked as spam
statistics of global user
globaluser:
TP True Positives: 5118
TN True Negatives: 10376
FP False Positives: 0
FN False Negatives: 32
SC Spam Corpusfed: 1
NC Nonspam Corpusfed: 0
TL Training Left: 0
SHR Spam Hit Rate 99.38%
HSR Ham Strike Rate: 0.00%
OCA Overall Accuracy: 99.79%
my dspam conf file is as such.
Home /usr/local/dspam
StorageDriver /usr/local/dspam/lib/libmysql_drv.so
TrustedDeliveryAgent "/usr/bin/maildrop"
OnFail error
Trust root
Trust qmaild
Trust vpopmail
Trust vchkpw
TrainingMode toe
TestConditionalTraining on
Feature noise
Feature whitelist
Feature tb=5
Algorithm graham burton
Tokenizer chain
PValue bcr
WebStats on
Preference "signatureLocation=message" # 'message' or 'headers'
Preference "spamAction=tag"
Preference "spamSubject=SPAM"
AllowOverride trainingMode
AllowOverride spamAction spamSubject
AllowOverride statisticalSedation
AllowOverride enableBNR
AllowOverride enableWhitelist
AllowOverride signatureLocation
AllowOverride showFactors
AllowOverride optIn optOut
AllowOverride whitelistThreshold
MySQLServer /var/lib/mysql/mysql.sock
MySQLPort 3306
MySQLUser dspam1
MySQLPass dspam2
MySQLDb dspam3
MySQLCompress true
MySQLUIDInSignature on
HashRecMax 98317
HashAutoExtend on
HashMaxExtents 0
HashExtentSize 49157
HashPctIncrease 10
HashMaxSeek 10
HashConnectionCache 10
IgnoreHeader X-Spam-Flag
IgnoreHeader X-Spam-Checker-Version
IgnoreHeader X-Spam-Level
IgnoreHeader X-Spam-Status
Notifications off
PurgeSignatures 14 # Stale signatures
PurgeNeutral 90 # Tokens with neutralish probabilities
PurgeUnused 90 # Unused tokens
PurgeHapaxes 30 # Tokens with less than 5 hits (hapaxes)
PurgeHits1S 15 # Tokens with only 1 spam hit
PurgeHits1I 15 # Tokens with only 1 innocent hit
LocalMX 127.0.0.1
SystemLog on
UserLog on
Opt out
ProcessorURLContext on
ProcessorBias on
All guidance as to why emails are not being marked as spam will be greatly
appreciated
raj
