On Thu, 29 Apr 2010 17:26:25 -0400
Ed Szynaka <szyn...@localnet.com> wrote:

> 
> >> Trying to combine the 2 ideas above I tried this in the group file:
> >> corpususer:classification:*
> >>
> >> But unfortunately this causes a double free or corruption error in glibc 
> >> when trying to classify any message.  (I saw a ticket on that 
> >> http://sourceforge.net/tracker/?func=detail&atid=1126467&aid=2990455&group_id=250683
> >>  
> >> <http://sourceforge.net/tracker/?func=detail&atid=1126467&aid=2990455&group_id=250683>
> >>  
> >> and will be posting to that ticket right after this email)
> >>
> >>     
> > This issue is fixed in GIT repository. Check out and try again.
> >
> >   
> I've checked out the latest copy and the above group file line does not 
> cause the double free error but it does not seem to be working properly 
> either.  Before the return of every email I get this error message 
> repeated serveral times:
> > WARNING:  nonstandard use of escape in a string literal
> > LINE 1: ...plit_part(split_part(version(),' ',2),'.',1) FROM '\d+')::in...
> >                                                              ^
> > HINT:  Use the escape string syntax for escapes, e.g., E'\r\n'.
> 
> With the above group file line (corpususer:classification:*) I get no 
> X-DSPAM headers added unless the result is Whitelisted.
>
Classification group is a mess. I need to find time to fix that.
btw: the format above is not correct. Should be: 
groupname:classification:*classificationuser


> With 
> "corpususer:classification:*corpususer" it classifies and inserts 
> headers but debug does not have any entry showing corpususer.
>
It is broken. I mean the whole group support is not consistent.


> With 
> "corpususer:merged:*" I do see references to dspam using corpususer.
> >   
> >> My questions are:
> >> How should a Global Group be setup to get the results describe in the 
> >> README?
> >> Is there any way to tell if a Global Group is being used?
> >>
> >>     
> > A global group is many things in DSPAM. You mean a "classification" group. 
> > Right? So the question should be: How to check if a classification group is 
> > working.
> >   
> Yes, I believe I'm looking for a classification group.  A group that 
> will be used for new users who have no training data and where trained 
> users data is not confident in the result. So
> What format should I use the group file to get allusers to be in a 
> classification group with corpususer?
> And how do I check to see if its working?
> > Can you post the output of:
> > dspam_stats -H testu...@testdomain.com
> > dspam_admin ag pref testu...@testdomain.com
> > dspam_admin ag pref default
> > sed "/^[\t ]*#\|^[\t ]*$/d" /path/to/your/dspam.conf
> >
> >   
> $ /usr/local/dspam/bin/dspam_stats -H testu...@testdomain.com
> testu...@testdomain.com:
>                 TP True Positives:                    39
>                 TN True Negatives:                    60
>                 FP False Positives:                    9
>                 FN False Negatives:                   29
>                 SC Spam Corpusfed:                     0
>                 NC Nonspam Corpusfed:                  0
>                 TL Training Left:                   2431
>                 SHR Spam Hit Rate                 57.35%
>                 HSR Ham Strike Rate:              13.04%
>                 PPV Positive predictive value:    81.25%
>                 OCA Overall Accuracy:             72.26%
>        
> $ /usr/local/dspam/bin/dspam_admin ag pref testu...@testdomain.com
> trainingMode=TOE
> spamAction=quarantine
> spamSubject=[SPAM]
> statisticalSedation=5
> enableBNR=on
> enableWhitelist=on
> signatureLocation=headers
> tagSpam=off
> tagNonspam=off
> showFactors=off
> optIn=off
> optOut=off
> whitelistThreshold=10
> makeCorpus=off
> storeFragments=off
> localStore=
> processorBias=on
> fallbackDomain=off
> trainPristine=off
> optOutClamAV=off
> ignoreRBLLookups=off
> RBLInoculate=off
> 
> $ /usr/local/dspam/bin/dspam_admin ag pref default
> trainingMode=TOE
> spamAction=quarantine
> spamSubject=[SPAM]
> statisticalSedation=5
> enableBNR=on
> enableWhitelist=on
> signatureLocation=headers
> tagSpam=off
> tagNonspam=off
> showFactors=off
> optIn=off
> optOut=off
> whitelistThreshold=10
> makeCorpus=off
> storeFragments=off
> localStore=
> processorBias=on
> fallbackDomain=off
> trainPristine=off
> optOutClamAV=off
> ignoreRBLLookups=off
> RBLInoculate=off
> 
> $ sed "/^[\t ]*#\|^[\t ]*$/d" /usr/local/dspam/etc/dspam.conf
> Home /usr/local/dspam/var/dspam
> StorageDriver /usr/local/dspam/lib/dspam/libpgsql_drv.so
> OnFail error
> Trust root
> Trust dspam
> Trust www-data
> Trust mail
> Trust mailnull
> Trust smmsp
> Trust daemon
> TrainingMode toe
> TestConditionalTraining off
> Feature whitelist
> Feature tb=5
> Algorithm graham burton
> Tokenizer chain
> PValue bcr
> WebStats off
> Preference "trainingMode=TOE"           # { TOE | TUM | TEFT | NOTRAIN } 
> -> default:teft
> Preference "spamAction=quarantine"      # { quarantine | tag | deliver } 
> -> default:quarantine
> Preference "spamSubject=[SPAM]"         # { string } -> default:[SPAM]
> Preference "statisticalSedation=5"      # { 0 - 10 } -> default:0
> Preference "enableBNR=on"               # { on | off } -> default:off
> Preference "enableWhitelist=on"         # { on | off } -> default:on
> Preference "signatureLocation=headers"  # { message | headers } -> 
> default:message
> Preference "tagSpam=off"                # { on | off }
> Preference "tagNonspam=off"             # { on | off }
> Preference "showFactors=off"            # { on | off } -> default:off
> Preference "optIn=off"                  # { on | off }
> Preference "optOut=off"                 # { on | off }
> Preference "whitelistThreshold=10"      # { Integer } -> default:10
> Preference "makeCorpus=off"             # { on | off } -> default:off
> Preference "storeFragments=off"         # { on | off } -> default:off
> Preference "localStore="                # { on | off } -> default:username
> Preference "processorBias=on"           # { on | off } -> default:on
> Preference "fallbackDomain=off"         # { on | off } -> default:off
> Preference "trainPristine=off"          # { on | off } -> default:off
> Preference "optOutClamAV=off"           # { on | off } -> default:off
> Preference "ignoreRBLLookups=off"       # { on | off } -> default:off
> Preference "RBLInoculate=off"           # { on | off } -> default:off
> AllowOverride enableBNR
> AllowOverride enableWhitelist
> AllowOverride fallbackDomain
> AllowOverride ignoreGroups
> AllowOverride ignoreRBLLookups
> AllowOverride localStore
> AllowOverride makeCorpus
> AllowOverride optIn
> AllowOverride optOut
> AllowOverride optOutClamAV
> AllowOverride processorBias
> AllowOverride RBLInoculate
> AllowOverride showFactors
> AllowOverride signatureLocation
> AllowOverride spamAction
> AllowOverride spamSubject
> AllowOverride statisticalSedation
> AllowOverride storeFragments
> AllowOverride tagNonspam
> AllowOverride tagSpam
> AllowOverride trainPristine
> AllowOverride trainingMode
> AllowOverride whitelistThreshold
> AllowOverride dailyQuarantineSummary
> PgSQLServer             127.0.0.1
> PgSQLUser       dspam
> PgSQLPass       <removed>
> PgSQLDb         dspam
> PgSQLConnectionCache    20
> PgSQLUIDInSignature on
> PgSQLVirtualTable           dspam_virtual_uids
> PgSQLVirtualUIDField        uid
> PgSQLVirtualUsernameField   username
> IgnoreHeader X-DSPAM-Result
> IgnoreHeader X-DSPAM-Processed
> IgnoreHeader X-DSPAM-Confidence
> IgnoreHeader X-DSPAM-Probability
> IgnoreHeader X-DSPAM-Signature
> Notifications   off
> PurgeSignature  off     # Specified in purge.sql
> PurgeNeutral    90
> PurgeUnused     off     # Specified in purge.sql
> PurgeHapaxes    off     # Specified in purge.sql
> PurgeHits1S     off     # Specified in purge.sql
> PurgeHits1I     off     # Specified in purge.sql
> SystemLog       on
> UserLog         on
> Opt out
> ServerPort              24
> ServerQueueSize 32
> ServerPID               /var/run/dspam.pid
> ServerMode dspam
> ServerPass.Relay1       <removed>
> ClientHost      127.0.0.1
> ClientPort      24
> ClientIdent     <removed>
> ProcessorURLContext on
> ProcessorBias on
> StripRcptDomain off
> >   
> >> I'm using dspam 3.9.0 with a postgresql backend, compiled from source 
> >> with the following options:
> >> ../configure --prefix=/usr/local/dspam --sysconfdir=/usr/local/dspam/etc 
> >> --with-storage-driver=mysql_drv,pgsql_drv 
> >> --with-mysql-includes=/usr/include/mysql 
> >> --with-pgsql-includes=/usr/include/postgresql --enable-daemon 
> >> --enable-debug -
> >> -enable-virtual-users --enable-preferences-extension --enable-clamav
> >>
> >> Thanks,
> >> Ed
> >>
> >>
> >> corpususer:classification:*corpususer debug output:
> >>     
> >>> 6565: [04/29/2010 14:47:37] No QuarantineAgent option found. Using 
> >>> standard quarantine.
> >>> 6565: [04/29/2010 14:47:37] DSPAM Instance Startup
> >>> 6565: [04/29/2010 14:47:37] input args: /usr/local/dspam/bin/dspam 
> >>> --stdout --deliver=innocent,spam --user testu...@testdomain.com --debug
> >>> 6565: [04/29/2010 14:47:37] pass-thru args:
> >>> 6565: [04/29/2010 14:47:37] processing user testu...@testdomain.com
> >>> 6565: [04/29/2010 14:47:37] uid = 0, euid = 0, gid = 0, egid = 8
> >>> 6565: [04/29/2010 14:47:37] loading preferences for user 
> >>> testu...@testdomain.com
> >>> 6565: [04/29/2010 14:47:37] _pgsql_drv_getpwnam: successful returning 
> >>> struct for name: testu...@testdomain.com
> >>> 6565: [04/29/2010 14:47:37] Loading preferences for uid 3856
> >>> 6565: [04/29/2010 14:47:37] Loading preferences for uid 0
> >>> 6565: [04/29/2010 14:47:37] Loading preferences for uid 0
> >>> 6565: [04/29/2010 14:47:37] default preferences empty. reverting to 
> >>> dspam.conf preferences.
> >>> 6565: [04/29/2010 14:47:37] Loading preferences from dspam.conf
> >>> 6565: [04/29/2010 14:47:37] using 
> >>> /usr/local/dspam/var/dspam/opt-in/testu...@testdomain.com.dspam as path
> >>> 6565: [04/29/2010 14:47:37] using 
> >>> /usr/local/dspam/var/dspam/opt-out/testu...@testdomain.com.nodspam as path
> >>> 6565: [04/29/2010 14:47:37] sedation level set to: 5
> >>> 6565: [04/29/2010 14:47:37] _pgsql_drv_getpwnam: successful returning 
> >>> struct for name: testu...@testdomain.com
> >>> 6565: [04/29/2010 14:47:37] _pgsql_drv_getpwnam returning cached name 
> >>> testu...@testdomain.com.
> >>> 6565: [04/29/2010 14:47:39] Loading 7 BNR patterns
> >>> 6565: [04/29/2010 14:47:39] _pgsql_drv_getpwnam returning cached name 
> >>> testu...@testdomain.com.
> >>> 6565: [04/29/2010 14:47:39] Whitelist threshold: 10
> >>> <snip tokens>
> >>> 6565: [04/29/2010 14:47:39] Graham-Bayesian Probability: 0.002278 
> >>> Samples: 15
> >>> 6565: [04/29/2010 14:47:39] Burton-Bayesian Probability: 0.000018 
> >>> Samples: 27
> >>> 6565: [04/29/2010 14:47:39] no factors specified; using default
> >>> 6565: [04/29/2010 14:47:39] Result Confidence: 1.00
> >>> 6565: [04/29/2010 14:47:39] _pgsql_drv_getpwnam returning cached name 
> >>> testu...@testdomain.com.
> >>> 6565: [04/29/2010 14:47:39] Control: [10 10] [10 11] Delta: [0 1]
> >>> 6565: [04/29/2010 14:47:40] total processing time: 3.01203s
> >>> 6565: [04/29/2010 14:47:40] _pgsql_drv_getpwnam returning cached name 
> >>> testu...@testdomain.com.
> >>> 6565: [04/29/2010 14:47:40] _pgsql_drv_getpwnam returning cached name 
> >>> testu...@testdomain.com.
> >>> 6565: [04/29/2010 14:47:40] saving signature as 
> >>> 3856,4bd9d44c65657166613715
> >>> 6565: [04/29/2010 14:47:40] _pgsql_drv_getpwnam returning cached name 
> >>> testu...@testdomain.com.
> >>> 6565: [04/29/2010 14:47:40] libdspam returned probability of 0.002278
> >>> 6565: [04/29/2010 14:47:40] message result: NOT SPAM
> >>> 6565: [04/29/2010 14:47:40] _pgsql_drv_getpwnam returning cached name 
> >>> testu...@testdomain.com.
> >>> 6565: [04/29/2010 14:47:40] delivering message
> >>> 6565: [04/29/2010 14:47:40] DSPAM Instance Shutdown.  Exit Code: 
> >>> 0                   
> >>>       

------------------------------------------------------------------------------
_______________________________________________
Dspam-user mailing list
Dspam-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspam-user

Reply via email to