Bug Tracker item #3033816, was opened at 2010-07-24 00:00
Message generated for change (Tracker Item Submitted) made by fhanzlik
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=1126467&aid=3033816&group_id=250683
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: daemon
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: franta (fhanzlik)
Assigned to: Nobody/Anonymous (nobody)
Summary: cssstat SIGSEGV (even on empty CSS file)
Initial Comment:
I wanted update my dspam 3.8.0 (and bit - it was compiled from cvs sometimes
year+ ago) installation to actual git version, using hash driver. It seems as
there is some bug in cssstat - it crashes at segmentation fault. This happen
even when I create empty .css file (e.g. "dspam_stats USER" create this one).
Only when I specify HashRecMax <=29 cssstat isn't crashing, but its output
isn't probably correct (this is output on empty file, is is really 504 bytes
long):
# cssstat hanzlik.css
filename hanzlik.css length 504
extent 0: record length 29
extent records used 10
extent records free 19
total database records used 10
total database records free 19
total extents 1
and when I dump this CSS file with od:
# od --address-radix=x --format=x1 hanzlik.css
000000 1d 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
*
0001f0 00 00 00 00 00 00 00 00
0001f8
then only first byte is non-zero, thus cssstat output is probably bad.
When I process any message (I want pre-train dspam), eg:
# cat minimail|dspam --deliver=summary --class=spam --source=corpus --user
hanzlik
X-DSPAM-Result: hanzlik; result="Spam"; class="Spam"; probability=1.0000;
confidence=1.00; signature=N/A
then dspam ends successfully, dspam_stats and dspam_dump seems work OK too:
# dspam_stats --user hanzlik
hanzlik TP: 0 TN: 0 FP: 0 FN: 0 SC: 1 NC: 0
# dspam_dump hanzlik
8996005352851322409 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
9169316699547378218 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
5349055502165153608 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
15709641654033341733 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
4637886019986600504 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
970584299665960736 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
14965821187402991925 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
7766758599308249167 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
7913747291603154473 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
15943718818929996215 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
295226099964587292 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
15859701681499630382 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
8658598621825873718 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
12483591854161531834 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
4374084325048266936 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
16559469134325792055 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
16965887720862590782 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
8752459743432750633 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
6779137002398331138 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
9824102154283395374 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
2306691580702949250 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
12945961346827347088 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
13256791050969591975 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
4639640792731806074 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
13936371986545168774 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
1950950490854615673 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
20133809054876176 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
2224351722190936134 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
610050303807831417 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
4314024453514932408 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
11234163362543816240 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
1157626966500770320 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
13827114725428849500 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
15201045862713809480 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
3088622238466519144 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
2520069556795489278 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
3418468506609306913 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
16127388803201990847 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
18174652029273579642 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
11367321635277769085 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
12304428922943536262 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
271902616987772573 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
7155745642258819647 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
17610007719560225133 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
16621411256315198775 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
4030275440602722488 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
10669105750463362821 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
10290788411166473527 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
4033394445041139197 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
15385305222388718728 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
16012568613011084915 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
12465277437864741367 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
1601088512613560847 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
770979300686060343 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
8780683443132657205 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
17893721553469055341 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
9056710341216162554 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
973904183204534215 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
2139162506254955556 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
3263287126393248294 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
16739593889211208634 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
15907356391510163381 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
9127398661990402610 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
12052151689113245744 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
5231906328728377502 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
16625133080499764535 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
15618020481011515583 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
11638815448217571049 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
9149926803744152478 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
7355371319312856460 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
7223761660528486975 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
7978641185449418295 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
14271619845104567121 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
15176438912093336981 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
11256507653313407278 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
13875117015498735490 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
8176580290709562464 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
1282560910891948092 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
8194228615862299932 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
4410169752316090526 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
16052330508639350360 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
224203590122434849 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
12208463967022006197 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
17223476119865710364 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
10371793780644804430 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
9352588677634101970 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
3621701205972467745 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
8668955117050143274 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
15076644883842577220 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
9669273125702026463 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
7931354398560331779 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
1816325184795606190 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
15916215413229604053 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
7721297711215901856 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
13342251111860683283 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
15353833691524283335 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
7935652662385260381 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
7718811131049952414 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
1685514754632480925 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
5207370366362285846 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
7601404653576529565 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
5499815378944059770 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
1950950769961429625 S: 00001 I: 00000 P: 0.5000 LH: Fri Jul 23 23:36:20 2010
but cssstat crashes:
# cssstat hanzlik.css
filename hanzlik.css length 2176
extent 0: record length 29
extent records used 16
extent records free 13
Segmentation fault (core dumped)
Same crash occur when increasing HashRecMax to 31+ even on empty file:
# dspam_stats --user hanzlik
hanzlik TP: 0 TN: 0 FP: 0 FN: 0 SC: 0 NC: 0
# od --address-radix=x --format=x1 hanzlik.css
000000 1f 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
*
000210 00 00 00 00 00 00 00 00
000218
# cssstat hanzlik.css
filename hanzlik.css length 536
extent 0: record length 31
Segmentation fault (core dumped)
Is somewhere CSS file structure description? I can do some little research
about this problem, but I have limited time for it.
I compile dspam from git commit e07482af36776c094052822b4a4d6f32eb530ffc. My
config:
# dspam --version
DSPAM Anti-Spam Suite GIT (agent/library)
Copyright (c) 2002-2010 DSPAM Project
http://dspam.sourceforge.net.
DSPAM may be copied only under the terms of the GNU General Public License,
a copy of which can be found with the DSPAM distribution kit.
Configuration parameters: '--build=i686-pc-linux-gnu'
'--host=i686-pc-linux-gnu' '--program-prefix=' '--disable-dependency-tracking'
'--prefix=/usr' '--exec-prefix=/usr' '--bindir=/usr/bin' '--sbindir=/usr/sbin'
'--sysconfdir=/etc' '--datadir=/usr/share' '--includedir=/usr/include'
'--libdir=/usr/lib' '--libexecdir=/usr/libexec' '--localstatedir=/var'
'--sharedstatedir=/var/lib' '--mandir=/usr/share/man'
'--infodir=/usr/share/info' '--sysconfdir=/etc/dspam'
'--with-storage-driver=hash_drv'
'--with-delivery-agent=/usr/bin/procmail.dspam' '--disable-homedir'
'--with-dspam-home=/var/dspam' '--with-dspam-home-mode=775'
'--with-dspam-home-owner=dspam' '--with-dspam-home-group=dspam'
'--enable-daemon' '--enable-debug' '--enable-split-configuration'
'--with-dspam-mode=2755' '--with-dspam-owner=dspam' '--with-dspam-group=dspam'
'--enable-warnings=yes' 'build_alias=i686-pc-linux-gnu'
'host_alias=i686-pc-linux-gnu' 'CFLAGS=-O2 -g -pipe -Wall
-Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector
--param=ssp-buffer-size=4 -m32 -march=i686 -mtune=atom
-fasynchronous-unwind-tables'
And dspam.conf:
Home /var/dspam
StorageDriver /usr/lib/dspam/libhash_drv.so
TrustedDeliveryAgent "/usr/bin/procmail.dspam"
OnFail error
Trust root
Trust dspam
Trust apache
Trust mail
Trust mailnull
Trust smmsp
Trust daemon
TrainingMode teft
TestConditionalTraining on
Feature whitelist
Algorithm graham burton
Tokenizer osb
PValue markov
WebStats on
Preference "trainingMode=TOE" # { TOE | TUM | TEFT | NOTRAIN } ->
default:teft
Preference "spamAction=quarantine" # { quarantine | tag | deliver } ->
default:quarantine
Preference "spamSubject=[SPAM]" # { string } -> default:[SPAM]
Preference "statisticalSedation=5" # { 0 - 10 } -> default:0
Preference "enableBNR=on" # { on | off } -> default:off
Preference "enableWhitelist=on" # { on | off } -> default:on
Preference "signatureLocation=message" # { message | headers } ->
default:message
Preference "tagSpam=on" # { on | off }
Preference "tagNonspam=on" # { on | off }
Preference "showFactors=off" # { on | off } -> default:off
Preference "optIn=off" # { on | off }
Preference "optOut=off" # { on | off }
Preference "whitelistThreshold=10" # { Integer } -> default:10
Preference "makeCorpus=off" # { on | off } -> default:off
Preference "storeFragments=off" # { on | off } -> default:off
Preference "localStore=" # { on | off } -> default:username
Preference "processorBias=on" # { on | off } -> default:on
Preference "fallbackDomain=off" # { on | off } -> default:off
Preference "trainPristine=off" # { on | off } -> default:off
Preference "optOutClamAV=off" # { on | off } -> default:off
Preference "ignoreRBLLookups=off" # { on | off } -> default:off
Preference "RBLInoculate=off" # { on | off } -> default:off
Preference "notifications=off" # { on | off } -> default:off
AllowOverride enableBNR
AllowOverride enableWhitelist
AllowOverride fallbackDomain
AllowOverride ignoreGroups
AllowOverride ignoreRBLLookups
AllowOverride localStore
AllowOverride makeCorpus
AllowOverride optIn
AllowOverride optOut
AllowOverride optOutClamAV
AllowOverride processorBias
AllowOverride RBLInoculate
AllowOverride showFactors
AllowOverride signatureLocation
AllowOverride spamAction
AllowOverride spamSubject
AllowOverride statisticalSedation
AllowOverride storeFragments
AllowOverride tagNonspam
AllowOverride tagSpam
AllowOverride trainPristine
AllowOverride trainingMode
AllowOverride whitelistThreshold
AllowOverride dailyQuarantineSummary
AllowOverride notifications
HashRecMax 31
HashAutoExtend on
HashMaxExtents 0
HashExtentSize 7
HashPctIncrease 10
HashMaxSeek 10
HashConnectionCache 10
Notifications on
PurgeSignatures 14 # Stale signatures
PurgeNeutral 90 # Tokens with neutralish probabilities
PurgeUnused 90 # Unused tokens
PurgeHapaxes 30 # Tokens with less than 5 hits (hapaxes)
PurgeHits1S 15 # Tokens with only 1 spam hit
PurgeHits1I 15 # Tokens with only 1 innocent hit
LocalMX 127.0.0.1
SystemLog on
UserLog on
Opt out
ParseToHeaders on
ChangeModeOnParse on
ChangeUserOnParse on
ProcessorURLContext on
ProcessorBias on
StripRcptDomain on
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=1126467&aid=3033816&group_id=250683
------------------------------------------------------------------------------
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
_______________________________________________
Dspam-devel mailing list
Dspam-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspam-devel
