On Thu, 29 Apr 2010 17:26:25 -0400 Ed Szynaka <szyn...@localnet.com> wrote:
> > >> Trying to combine the 2 ideas above I tried this in the group file: > >> corpususer:classification:* > >> > >> But unfortunately this causes a double free or corruption error in glibc > >> when trying to classify any message. (I saw a ticket on that > >> http://sourceforge.net/tracker/?func=detail&atid=1126467&aid=2990455&group_id=250683 > >> > >> <http://sourceforge.net/tracker/?func=detail&atid=1126467&aid=2990455&group_id=250683> > >> > >> and will be posting to that ticket right after this email) > >> > >> > > This issue is fixed in GIT repository. Check out and try again. > > > > > I've checked out the latest copy and the above group file line does not > cause the double free error but it does not seem to be working properly > either. Before the return of every email I get this error message > repeated serveral times: > > WARNING: nonstandard use of escape in a string literal > > LINE 1: ...plit_part(split_part(version(),' ',2),'.',1) FROM '\d+')::in... > > ^ > > HINT: Use the escape string syntax for escapes, e.g., E'\r\n'. > > With the above group file line (corpususer:classification:*) I get no > X-DSPAM headers added unless the result is Whitelisted. > Classification group is a mess. I need to find time to fix that. btw: the format above is not correct. Should be: groupname:classification:*classificationuser > With > "corpususer:classification:*corpususer" it classifies and inserts > headers but debug does not have any entry showing corpususer. > It is broken. I mean the whole group support is not consistent. > With > "corpususer:merged:*" I do see references to dspam using corpususer. > > > >> My questions are: > >> How should a Global Group be setup to get the results describe in the > >> README? > >> Is there any way to tell if a Global Group is being used? > >> > >> > > A global group is many things in DSPAM. You mean a "classification" group. > > Right? So the question should be: How to check if a classification group is > > working. > > > Yes, I believe I'm looking for a classification group. A group that > will be used for new users who have no training data and where trained > users data is not confident in the result. So > What format should I use the group file to get allusers to be in a > classification group with corpususer? > And how do I check to see if its working? > > Can you post the output of: > > dspam_stats -H testu...@testdomain.com > > dspam_admin ag pref testu...@testdomain.com > > dspam_admin ag pref default > > sed "/^[\t ]*#\|^[\t ]*$/d" /path/to/your/dspam.conf > > > > > $ /usr/local/dspam/bin/dspam_stats -H testu...@testdomain.com > testu...@testdomain.com: > TP True Positives: 39 > TN True Negatives: 60 > FP False Positives: 9 > FN False Negatives: 29 > SC Spam Corpusfed: 0 > NC Nonspam Corpusfed: 0 > TL Training Left: 2431 > SHR Spam Hit Rate 57.35% > HSR Ham Strike Rate: 13.04% > PPV Positive predictive value: 81.25% > OCA Overall Accuracy: 72.26% > > $ /usr/local/dspam/bin/dspam_admin ag pref testu...@testdomain.com > trainingMode=TOE > spamAction=quarantine > spamSubject=[SPAM] > statisticalSedation=5 > enableBNR=on > enableWhitelist=on > signatureLocation=headers > tagSpam=off > tagNonspam=off > showFactors=off > optIn=off > optOut=off > whitelistThreshold=10 > makeCorpus=off > storeFragments=off > localStore= > processorBias=on > fallbackDomain=off > trainPristine=off > optOutClamAV=off > ignoreRBLLookups=off > RBLInoculate=off > > $ /usr/local/dspam/bin/dspam_admin ag pref default > trainingMode=TOE > spamAction=quarantine > spamSubject=[SPAM] > statisticalSedation=5 > enableBNR=on > enableWhitelist=on > signatureLocation=headers > tagSpam=off > tagNonspam=off > showFactors=off > optIn=off > optOut=off > whitelistThreshold=10 > makeCorpus=off > storeFragments=off > localStore= > processorBias=on > fallbackDomain=off > trainPristine=off > optOutClamAV=off > ignoreRBLLookups=off > RBLInoculate=off > > $ sed "/^[\t ]*#\|^[\t ]*$/d" /usr/local/dspam/etc/dspam.conf > Home /usr/local/dspam/var/dspam > StorageDriver /usr/local/dspam/lib/dspam/libpgsql_drv.so > OnFail error > Trust root > Trust dspam > Trust www-data > Trust mail > Trust mailnull > Trust smmsp > Trust daemon > TrainingMode toe > TestConditionalTraining off > Feature whitelist > Feature tb=5 > Algorithm graham burton > Tokenizer chain > PValue bcr > WebStats off > Preference "trainingMode=TOE" # { TOE | TUM | TEFT | NOTRAIN } > -> default:teft > Preference "spamAction=quarantine" # { quarantine | tag | deliver } > -> default:quarantine > Preference "spamSubject=[SPAM]" # { string } -> default:[SPAM] > Preference "statisticalSedation=5" # { 0 - 10 } -> default:0 > Preference "enableBNR=on" # { on | off } -> default:off > Preference "enableWhitelist=on" # { on | off } -> default:on > Preference "signatureLocation=headers" # { message | headers } -> > default:message > Preference "tagSpam=off" # { on | off } > Preference "tagNonspam=off" # { on | off } > Preference "showFactors=off" # { on | off } -> default:off > Preference "optIn=off" # { on | off } > Preference "optOut=off" # { on | off } > Preference "whitelistThreshold=10" # { Integer } -> default:10 > Preference "makeCorpus=off" # { on | off } -> default:off > Preference "storeFragments=off" # { on | off } -> default:off > Preference "localStore=" # { on | off } -> default:username > Preference "processorBias=on" # { on | off } -> default:on > Preference "fallbackDomain=off" # { on | off } -> default:off > Preference "trainPristine=off" # { on | off } -> default:off > Preference "optOutClamAV=off" # { on | off } -> default:off > Preference "ignoreRBLLookups=off" # { on | off } -> default:off > Preference "RBLInoculate=off" # { on | off } -> default:off > AllowOverride enableBNR > AllowOverride enableWhitelist > AllowOverride fallbackDomain > AllowOverride ignoreGroups > AllowOverride ignoreRBLLookups > AllowOverride localStore > AllowOverride makeCorpus > AllowOverride optIn > AllowOverride optOut > AllowOverride optOutClamAV > AllowOverride processorBias > AllowOverride RBLInoculate > AllowOverride showFactors > AllowOverride signatureLocation > AllowOverride spamAction > AllowOverride spamSubject > AllowOverride statisticalSedation > AllowOverride storeFragments > AllowOverride tagNonspam > AllowOverride tagSpam > AllowOverride trainPristine > AllowOverride trainingMode > AllowOverride whitelistThreshold > AllowOverride dailyQuarantineSummary > PgSQLServer 127.0.0.1 > PgSQLUser dspam > PgSQLPass <removed> > PgSQLDb dspam > PgSQLConnectionCache 20 > PgSQLUIDInSignature on > PgSQLVirtualTable dspam_virtual_uids > PgSQLVirtualUIDField uid > PgSQLVirtualUsernameField username > IgnoreHeader X-DSPAM-Result > IgnoreHeader X-DSPAM-Processed > IgnoreHeader X-DSPAM-Confidence > IgnoreHeader X-DSPAM-Probability > IgnoreHeader X-DSPAM-Signature > Notifications off > PurgeSignature off # Specified in purge.sql > PurgeNeutral 90 > PurgeUnused off # Specified in purge.sql > PurgeHapaxes off # Specified in purge.sql > PurgeHits1S off # Specified in purge.sql > PurgeHits1I off # Specified in purge.sql > SystemLog on > UserLog on > Opt out > ServerPort 24 > ServerQueueSize 32 > ServerPID /var/run/dspam.pid > ServerMode dspam > ServerPass.Relay1 <removed> > ClientHost 127.0.0.1 > ClientPort 24 > ClientIdent <removed> > ProcessorURLContext on > ProcessorBias on > StripRcptDomain off > > > >> I'm using dspam 3.9.0 with a postgresql backend, compiled from source > >> with the following options: > >> ../configure --prefix=/usr/local/dspam --sysconfdir=/usr/local/dspam/etc > >> --with-storage-driver=mysql_drv,pgsql_drv > >> --with-mysql-includes=/usr/include/mysql > >> --with-pgsql-includes=/usr/include/postgresql --enable-daemon > >> --enable-debug - > >> -enable-virtual-users --enable-preferences-extension --enable-clamav > >> > >> Thanks, > >> Ed > >> > >> > >> corpususer:classification:*corpususer debug output: > >> > >>> 6565: [04/29/2010 14:47:37] No QuarantineAgent option found. Using > >>> standard quarantine. > >>> 6565: [04/29/2010 14:47:37] DSPAM Instance Startup > >>> 6565: [04/29/2010 14:47:37] input args: /usr/local/dspam/bin/dspam > >>> --stdout --deliver=innocent,spam --user testu...@testdomain.com --debug > >>> 6565: [04/29/2010 14:47:37] pass-thru args: > >>> 6565: [04/29/2010 14:47:37] processing user testu...@testdomain.com > >>> 6565: [04/29/2010 14:47:37] uid = 0, euid = 0, gid = 0, egid = 8 > >>> 6565: [04/29/2010 14:47:37] loading preferences for user > >>> testu...@testdomain.com > >>> 6565: [04/29/2010 14:47:37] _pgsql_drv_getpwnam: successful returning > >>> struct for name: testu...@testdomain.com > >>> 6565: [04/29/2010 14:47:37] Loading preferences for uid 3856 > >>> 6565: [04/29/2010 14:47:37] Loading preferences for uid 0 > >>> 6565: [04/29/2010 14:47:37] Loading preferences for uid 0 > >>> 6565: [04/29/2010 14:47:37] default preferences empty. reverting to > >>> dspam.conf preferences. > >>> 6565: [04/29/2010 14:47:37] Loading preferences from dspam.conf > >>> 6565: [04/29/2010 14:47:37] using > >>> /usr/local/dspam/var/dspam/opt-in/testu...@testdomain.com.dspam as path > >>> 6565: [04/29/2010 14:47:37] using > >>> /usr/local/dspam/var/dspam/opt-out/testu...@testdomain.com.nodspam as path > >>> 6565: [04/29/2010 14:47:37] sedation level set to: 5 > >>> 6565: [04/29/2010 14:47:37] _pgsql_drv_getpwnam: successful returning > >>> struct for name: testu...@testdomain.com > >>> 6565: [04/29/2010 14:47:37] _pgsql_drv_getpwnam returning cached name > >>> testu...@testdomain.com. > >>> 6565: [04/29/2010 14:47:39] Loading 7 BNR patterns > >>> 6565: [04/29/2010 14:47:39] _pgsql_drv_getpwnam returning cached name > >>> testu...@testdomain.com. > >>> 6565: [04/29/2010 14:47:39] Whitelist threshold: 10 > >>> <snip tokens> > >>> 6565: [04/29/2010 14:47:39] Graham-Bayesian Probability: 0.002278 > >>> Samples: 15 > >>> 6565: [04/29/2010 14:47:39] Burton-Bayesian Probability: 0.000018 > >>> Samples: 27 > >>> 6565: [04/29/2010 14:47:39] no factors specified; using default > >>> 6565: [04/29/2010 14:47:39] Result Confidence: 1.00 > >>> 6565: [04/29/2010 14:47:39] _pgsql_drv_getpwnam returning cached name > >>> testu...@testdomain.com. > >>> 6565: [04/29/2010 14:47:39] Control: [10 10] [10 11] Delta: [0 1] > >>> 6565: [04/29/2010 14:47:40] total processing time: 3.01203s > >>> 6565: [04/29/2010 14:47:40] _pgsql_drv_getpwnam returning cached name > >>> testu...@testdomain.com. > >>> 6565: [04/29/2010 14:47:40] _pgsql_drv_getpwnam returning cached name > >>> testu...@testdomain.com. > >>> 6565: [04/29/2010 14:47:40] saving signature as > >>> 3856,4bd9d44c65657166613715 > >>> 6565: [04/29/2010 14:47:40] _pgsql_drv_getpwnam returning cached name > >>> testu...@testdomain.com. > >>> 6565: [04/29/2010 14:47:40] libdspam returned probability of 0.002278 > >>> 6565: [04/29/2010 14:47:40] message result: NOT SPAM > >>> 6565: [04/29/2010 14:47:40] _pgsql_drv_getpwnam returning cached name > >>> testu...@testdomain.com. > >>> 6565: [04/29/2010 14:47:40] delivering message > >>> 6565: [04/29/2010 14:47:40] DSPAM Instance Shutdown. Exit Code: > >>> 0 > >>> ------------------------------------------------------------------------------ _______________________________________________ Dspam-user mailing list Dspam-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspam-user
