-------- Original-Nachricht -------- > Datum: Sat, 15 Nov 2008 16:18:13 +0100 > Von: "Imposit.com - Webmaster" <[EMAIL PROTECTED]> > An: [email protected] > Betreff: AW: [dspam-users] mysql fetch row error
> Why you think the encoding comes from the dovecot? > It isnt envoled yet i think, isnt it? > It is involved. It must. Because the mail got delivered to his IMAP server and from there he is using a plugin (I think it is called dovecot antispam plugin) which scans certain folders for spam missclassification and depending on where the plugin finds the mail it will extract the DSPAM signature and execute the DSPAM binary with parameters in order to get the message trained. And I asked Markus to post the full header of the message in question. And already those headers have the encoding part in it. So it is not the plugin which is not okay. It must be something else. I suspect that amavisd-new is doing it. But I am not 100% sure. > -----Ursprüngliche Nachricht----- > Von: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] Im Auftrag von Steve > Gesendet: Samstag, 15. November 2008 15:32 > An: [email protected] > Betreff: AW: [dspam-users] mysql fetch row error > > > -------- Original-Nachricht -------- > > Datum: Sat, 15 Nov 2008 15:28:06 +0100 > > Von: "Imposit.com - Webmaster" <[EMAIL PROTECTED]> > > An: [email protected] > > Betreff: AW: [dspam-users] mysql fetch row error > > > Maybe ife another idea. > > > > I dont know the Gentoo Version but maybe this encoding comes from the > > Database. > > > No. It can not come from the DB backend as it is the dovecot plugin > executing the command even without contacting the DB backend. > > > > Please Post your my.cnf from the Mysql DB and also which Charset your > > system > > is using. > > Also we have to know which charset u use in the mysql tables and which > one > > fort he database. > > General ist a good idea to use for everything UTF-8. > > > > > > PS: i hope ill have this weekend more time fort he dev list and the > forum. > > > I could add a forum and a dev mailing list in 10 minutes if you want me to > do that for the DSPAM community. > > > > -----Ursprüngliche Nachricht----- > > Von: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] Im Auftrag von > Steve > > Gesendet: Samstag, 15. November 2008 14:09 > > An: [email protected] > > Betreff: Re: [dspam-users] mysql fetch row error > > > > -------- Original-Nachricht -------- > > > Datum: Sat, 15 Nov 2008 12:10:04 +0100 > > > Von: Marko Weber <[EMAIL PROTECTED]> > > > An: "[email protected]" > > <[email protected]> > > > Betreff: Re: [dspam-users] mysql fetch row error > > > > > Hi Steve, > > > nice to hear you are the ebuilder.... great job. > > > > > Not only the ebuild. There is a bunch of patches/fixes in Gentoo for > > DSPAM. > > Some of them are already in the CVS edition of DSPAM. > > > > > > > > > amvisd.conf = http://rafb.net/p/fkrpk553.html > > > main.cf = http://rafb.net/p/9nhKMt93.html > > > master.cf = http://rafb.net/p/QDiAPu11.html > > > > > > hope you can find anything that i can get work proper. > > > thank you at this time for all the effort > > > > > Phuu... I would rewrite much of it. Anway... I try to keep the changes > as > > small as possible. So I will not post whole config files. Is that okay > > with > > you? If you want, I could. Just let me know. I see you use > Postfix.Admin. > > Right? You could speed up a lot of things by using proxy maps and other > > stuff. But there is no point for me to rewrite the config if you don't > > want/need. > > > > > > Anyway.... lets do the config stuff. > > > > In main.cf remove the content_filter part: > > content_filter = amavis:[127.0.0.1]:10024 > > > > master.cf use this one here (I did a rewrite of it. Sorry for that. But > > the > > changes are commented in the file and I think you will understand why I > > changed things): > > http://rafb.net/p/f5PGTy80.html > > > > amavis.conf do this: > > > > Add a forward method on port 10025: > > $forward_method = 'smtp:[127.0.0.1]:10025'; # where to forward checked > > mail > > > > Add notify method on port 10026 (we will use it in DSPAM as well for > > delivery of certain stuff): > > $notify_method = 'smtp:[127.0.0.1]:10026'; # where to submit > > notifications > > > > Remove DSPAM access from Amavis (it's better to run DSPAM outside > > amavisd-new and use other ways then amavisd-new for tagging mails. > Amavis > > just runs under one single user and this is limiting the possibilities > of > > DSPAM): > > #$dspam = 'dspam'; > > > > > > In dspam.conf: > > > > Your trusted and untrusted agent should probably be the sendmail binary > > (Postfix edition but the ebuild is already taken care of this): > > TrustedDeliveryAgent "/usr/sbin/sendmail" > > UntrustedDeliveryAgent "/usr/sbin/sendmail" > > > > > > Switch the delivery to SMTP (remember the port 10026 above for > > amavisd-new? > > Well... we are going to reuse that port for DSPAM delivery): > > DeliveryHost 127.0.0.1 > > DeliveryPort 10026 > > DeliveryIdent localhost > > DeliveryProto SMTP > > > > > > Change the DSPAM server to use auto mode: > > ServerQueueSize 32 > > ServerMode auto > > > > > > Add config to identify the DSPAM agent and daemon (as ident I used kw1 > for > > kraftwerk1): > > ServerPass.kw1 "9252173122311528111" > > ServerParameters "--deliver=innocent" > > ServerIdent "kw1.dspam.server" > > ServerDomainSocketPath /var/run/dspam/dspam.sock > > ClientHost /var/run/dspam/dspam.sock > > ClientIdent "[EMAIL PROTECTED]" > > > > > > > > In the Gentoo forum you will find much more configuration tips and > > tricks.. > > Just search for the user "SteveB" and for the keyword dspam or postfix > or > > amavis. I run DSPAM for a long time and have probably a different > > viewpoint > > on DSPAM then you. This does not mean that "my way" is better then other > > configurations. I just got used of doing it a certain way. I as well > have > > patched my DSPAM with about 20 own made patches. Some of them add new > > functions and some of them fix memory leaks and others do speed up > things > > (I > > speeded up the MySQL part significantly on my setup). I do the training > as > > well much different then probably most users here. I use TONE (train on > or > > near error) and I use a own made patch to do that as well with > whitelisted > > DSPAM results (if the whitelisted message would result in spam if no > > whitelisting would be active). The result looks something like that > here: > > Nov 15 02:46:03 mail postfix/lmtp[30960]: 9229E15B3E49: > > to=<xxxxxxxxxxxxx>, > > relay=127.0.0.1[127.0.0.1]:10024, delay=7.4, delays=7/0.02/0.01/0..4, > > dsn=2.0.0, status=sent (250 2.0.0 Ok, id=29240-17, from > > MTA([127.0.0.1]:10025): 250 2.0.0 Ok: queued as 2962C15B3E4F) > > Nov 15 02:46:08 mail dspam[24389]: forcing learning of auto-whitelisted > > SPAM > > message as INNOCENT > > Nov 15 02:46:08 mail dspam[24389]: innocent message from 211.115.216.226 > > > > I like DSPAM much and it does tag spam messages very well but the most > > problem I have is that ham messages don't get so well recognized as > spam. > > So > > I had to take care of this and that's the reason why I added that > > functionality into DSPAM. > > > > Anyway... this has nothing to do with your problem. I just tried to > > explain > > why I have changed things in master.cf and why I would change things in > > main.cf and especially in dspam.conf. > > > > > > > marko > > > > > Steve > > > > > > > > > > > > > Steve schrieb: > > > > -------- Original-Nachricht -------- > > > > > > > >> Datum: Sat, 15 Nov 2008 11:23:24 +0100 > > > >> Von: Marko Weber <[EMAIL PROTECTED]> > > > >> An: "[email protected]" > > > <[email protected]> > > > >> Betreff: Re: [dspam-users] mysql fetch row error > > > >> > > > > > > > > > > > >> Hi Steve, > > > >> > > > >> > > > > Mallo Marko > > > > > > > > > > > > > > > >> MTA = Postfix > > > >> I have amavis - spamassassin - dspam installed. > > > >> > > > >> > > > > I think it's amavisd-new producing that iso stuff. Could you post > your > > > amaivs configuration somewhere? And your main.cf and master.cf as > well. > > > > > > > > > > > > > > > >> i think spamassassin scnas after dspam, cuase in the mail headers > > > dspam > > > >> comes at first. > > > >> I use Dovecot as Imap Server > > > >> OS = Gentoo Linux > > > >> > > > >> > > > > Okay. Then you are using my DSPAM ebuild. I am the one who created > the > > > DSPAM ebuild currently used in Gentoo :) > > > > > > > > > > > > > > > >> i put the config of dspam here = http://rafb.net/p/VCX8XO97.html > > > >> > > > >> if u need more confs just tell me , i can paste then > > > >> > > > >> marko > > > >> > > > >> > > > > // Steve > > > > > > > > > > > >> > > > >> Steve schrieb: > > > >> > > > >>> Hallo Marko > > > >>> > > > >>> This is not normal. DSPAM does not add the encoding. It must be > > > >>> > > > >> something else you are using/doing to get that tagged with the > > encoding > > > in front of > > > >> every DSPAM tag. And I don't see the DSPAM signature in your > header. > > > This > > > >> is not normal. If you have the other DSPAM header lines, then you > > > should > > > >> have the result as well. > > > >> > > > >>> What MTA are you using? > > > >>> How is the integration between MTA and DSPAM? > > > >>> Do you have other filters running before and after DSPAM? > > > >>> What IMAP server are you using? > > > >>> What OS are you using? > > > >>> Could you post your DSPAM config? > > > >>> > > > >>> > > > >>> (Grüsse aus Zürich) > > > >>> > > > >>> // Steve > > > >>> > > > >>> -------- Original-Nachricht -------- > > > >>> > > > >>> > > > >>>> Datum: Sat, 15 Nov 2008 10:37:38 +0100 > > > >>>> Von: Marko Weber <[EMAIL PROTECTED]> > > > >>>> An: "[email protected]" > > > >>>> > > > >> <[email protected]> > > > >> > > > >>>> Betreff: Re: [dspam-users] mysql fetch row error > > > >>>> > > > >>>> > > > >>> > > > >>> > > > >>>> Hello Steve this is the "full" Header of a spam mail where the > > > >>>> > > > >> training > > > >> > > > >>>> also fails. > > > >>>> withe the mysql fetch error............. > > > >>>> > > > >>>> marko > > > >>>> > > > >>>> > > > >>>> Return-Path: <[EMAIL PROTECTED]> > > > >>>> X-Original-To: [EMAIL PROTECTED] > > > >>>> Delivered-To: [EMAIL PROTECTED] > > > >>>> Received: from localhost (localhost [127.0.0.1]) > > > >>>> by salonwebserver.de (Postfix) with ESMTP id 02C8613BC09B > > > >>>> for <[EMAIL PROTECTED]>; Fri, 14 Nov 2008 21:38:09 > > > +0100 > > > >>>> (CET) > > > >>>> X-DSPAM-Result: =?iso-8859-1?Q?Spam=0D?= > > > >>>> X-DSPAM-Confidence: =?iso-8859-1?Q?0.7177=0D?= > > > >>>> X-DSPAM-Probability: =?iso-8859-1?Q?1.0000=0D?= > > > >>>> ?iso-8859-1?Q?491de1b0254959695846858=0D?= > > > >>>> X-DSPAM-Factors: 15, > > > >>>> X-Virus-Scanned: amavisd-new at salonwebserver.de > > > >>>> X-Spam-Flag: NO > > > >>>> X-Spam-Score: 2.415 > > > >>>> X-Spam-Level: ** > > > >>>> X-Spam-Status: No, score=2.415 tagged_above=-1000 required=2..5 > > > >>>> tests=[DNS_FROM_SECURITYSAGE=0.127, > > > >>>> > > > >> RCVD_IN_BL_SPAMCOP_NET=2.188, > > > >> > > > >>>> RDNS_DYNAMIC=0.1] > > > >>>> Received: from salonwebserver.de ([127.0.0.1]) > > > >>>> by localhost (kraftwerk1.salonwebserver.de [127.0.0.1]) > > > >>>> (amavisd-new, port 10024) > > > >>>> with ESMTP id nOQQilMNvp-o for <[EMAIL PROTECTED]>; > > > >>>> Fri, 14 Nov 2008 21:38:07 +0100 (CET) > > > >>>> Received: from zackbummfertig.de > > > >>>> (static.243.42.46.78.clients.your-server.de [78.46.42.243]) > > > >>>> (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 > > bits)) > > > >>>> (No client certificate requested) > > > >>>> by salonwebserver.de (Postfix) with ESMTPS id > E86BD13BC078 > > > >>>> for <[EMAIL PROTECTED]>; Fri, 14 Nov 2008 21:38:06 > > > +0100 > > > >>>> (CET) > > > >>>> Received: from localhost (localhost [127.0.0.1]) > > > >>>> by zackbummfertig.de (Postfix) with ESMTP id BC4BDECC067 > > > >>>> for <[EMAIL PROTECTED]>; Fri, 14 Nov 2008 21:37:46 > > > +0100 > > > >>>> (CET) > > > >>>> X-Virus-Scanned: amavisd-new at zackbummfertig.de > > > >>>> Received: from zackbummfertig.de ([127.0.0.1]) > > > >>>> by localhost (weberweb.zackbummfertig.de [127.0.0.1]) > > > >>>> (amavisd-new, port 10024) > > > >>>> with ESMTP id xr6ayW0lyDGC for <[EMAIL PROTECTED]>; > > > >>>> Fri, 14 Nov 2008 21:37:43 +0100 (CET) > > > >>>> Received: from rachel22b12579 (unknown [78.146.113.186]) > > > >>>> by zackbummfertig.de (Postfix) with SMTP id 3E83CECC040 > > > >>>> for <[EMAIL PROTECTED]>; Fri, 14 Nov 2008 21:37:43 > > +0100 > > > >>>> (CET) > > > >>>> Date: Fri, 14 Nov 2008 20:38:01 +0000 > > > >>>> From: Chrystal Huddleston > > <[EMAIL PROTECTED]> > > > >>>> Subject: gambling slot machines > > > >>>> To: [EMAIL PROTECTED] > > > >>>> Message-id: <[EMAIL PROTECTED]> > > > >>>> Organization: fightingbobfest.org > > > >>>> MIME-version: 1.0 > > > >>>> Content-type: text/plain; charset=us-ascii > > > >>>> Content-transfer-encoding: 7bit > > > >>>> X-Priority: 3 (Normal) > > > >>>> > > > >>>> Steve schrieb: > > > >>>> > > > >>>> > > > >>>>> Can you post the full header of the message in question? > > > >>>>> > > > >>>>> > > > >>>>> -------- Original-Nachricht -------- > > > >>>>> > > > >>>>> > > > >>>>> > > > >>>>>> Datum: Fri, 14 Nov 2008 23:18:39 +0100 > > > >>>>>> Von: Marko Weber <[EMAIL PROTECTED]> > > > >>>>>> An: "[email protected]" > > > >>>>>> > > > >>>>>> > > > >>>> <[email protected]> > > > >>>> > > > >>>> > > > >>>>>> Betreff: Re: [dspam-users] mysql fetch row error > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>> > > > >>>>> > > > >>>>> > > > >>>>>> Hi Steve, > > > >>>>>> this sed thing dont worked for me...... sorry > > > >>>>>> how i can get dspam working without this mysql fetch error ? > > > >>>>>> u have any hints ? > > > >>>>>> > > > >>>>>> marko > > > >>>>>> > > > >>>>>> > > > >>>>>> Steve schrieb: > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>>> -------- Original-Nachricht -------- > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>>> Datum: Fri, 14 Nov 2008 18:11:55 +0100 > > > >>>>>>>> Von: Marko Weber <[EMAIL PROTECTED]> > > > >>>>>>>> An: "[email protected]" > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>> <[email protected]> > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>>>> Betreff: [dspam-users] mysql fetch row error > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>>> Hello to all in the Mailinglist, > > > >>>>>>>> > > > >>>>>>>> i installed dspam on our server and it works so far that > > incoming > > > >>>>>>>> > > > >>>>>>>> > > > >>>> mails > > > >>>> > > > >>>> > > > >>>>>>>> are tagged by dspam. > > > >>>>>>>> i installed "dovecot-antispam" for retraining. > > > >>>>>>>> when in try to retrain a mail i get this in the dspam.debug > > log > > > = > > > >>>>>>>> > > > >>>>>>>> 9056: [11/14/2008 15:23:01] mysql_fetch_row() failed in > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>> _ds_get_signature > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>>>> in the /var/log/messages log i get this = > > > >>>>>>>> > > > >>>>>>>> Nov 14 15:29:25 kraftwerk1 imap: antispam: /usr/bin/dspam > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>> --source=error > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>>>> --class=spam > > > --signature==?iso-8859-1?Q?491d76cb23581804284693=0D?= > > > >>>>>>>> > > > >>>>>>>> > > > >>>> ... > > > >>>> > > > >>>> > > > >>>>>>>> Nov 14 15:29:25 kraftwerk1 dspam[9189]: Signature retrieval > for > > > >>>>>>>> '=?iso-8859-1?Q?491d76cb23581804284693=0D?=' failed > > > >>>>>>>> Nov 14 15:29:25 kraftwerk1 dspam[9189]: Unable to find a > valid > > > >>>>>>>> signature. Aborting. > > > >>>>>>>> Nov 14 15:29:25 kraftwerk1 dspam[9189]: process_message > > returned > > > >>>>>>>> > > > >>>>>>>> > > > >>>> error > > > >>>> > > > >>>> > > > >>>>>>>> -5. dropping message. > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> but when i search for the signatur 491d76cb23581804284693 in > > the > > > >>>>>>>> > > > >>>>>>>> > > > >>>> mysql > > > >>>> > > > >>>> > > > >>>>>>>> database i can find it there. > > > >>>>>>>> > > > >>>>>>>> what is this ?iso-8859-1?Q? , is this causing the error ? > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>> This means, that the plugin developer used the signature from > > the > > > >>>>>>> > > > >> body > > > >> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>> instead of the one found in the header. You can verify yourself > > > what > > > >>>>>> > > > >>>>>> > > > >>>> the > > > >>>> > > > >>>> > > > >>>>>> proper signature would be. Just issue this small one liner in > > sed: > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>>> sed -e '/^$/q' -ne 's/^X\-DSPAM\-Signature: > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>> \(\([1-9][0-9]*,\)\{0,1\}\([a-f0-9]\{20,32\}\)\)$/\1/p' > > > >>>>>> > > > >>>>>> > > > >>>> /path/to/your/message > > > >>>> > > > >>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>>> This should print out the proper signature DSPAM should > receive > > > from > > > >>>>>>> > > > >>>>>>> > > > >>>> the > > > >>>> > > > >>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>> plugin. The iso-8859-1 part indicates to me that the message is > > > taken > > > >>>>>> > > > >>>>>> > > > >>>> from > > > >>>> > > > >>>> > > > >>>>>> a iso8859-1 encoded message body. > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>>> do any1 need my dspam.conf , then i can paste it on web. > > > >>>>>>>> > > > >>>>>>>> thank for helping. > > > >>>>>>>> > > > >>>>>>>> marko > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>> Steve > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>> > > > >>>>> > > > >>>>> > > > >>>> > > > >>>> > > > >>> > > > >>> > > > >> > > > >> > > > > > > > > > > > > > > > > > > > > > -- > > Sensationsangebot nur bis 30.11: GMX FreeDSL - Telefonanschluss + DSL > > für nur 16,37 Euro/mtl.!* http://dsl.gmx.de/?ac=OM.AD.PD003K11308T4569a > > > > > > > > > > > > > > > > > > > > > > -- > Sensationsangebot nur bis 30.11: GMX FreeDSL - Telefonanschluss + DSL > für nur 16,37 Euro/mtl.!* http://dsl.gmx.de/?ac=OM.AD.PD003K11308T4569a > > > > > > > > > > -- Sensationsangebot nur bis 30.11: GMX FreeDSL - Telefonanschluss + DSL für nur 16,37 Euro/mtl.!* http://dsl.gmx.de/?ac=OM.AD.PD003K11308T4569a !DSPAM:1011,491ef81d150922338314364!
