Re: [dspam-users] mysql fetch row error

2008-11-15 Thread Steve
Hallo Marko

This is not normal. DSPAM does not add the encoding. It must be something else 
you are using/doing to get that tagged with the encoding in front of every 
DSPAM tag. And I don't see the DSPAM signature in your header. This is not 
normal. If you have the other DSPAM header lines, then you should have the 
result as well.

What MTA are you using?
How is the integration between MTA and DSPAM?
Do you have other filters running before and after DSPAM?
What IMAP server are you using?
What OS are you using?
Could you post your DSPAM config?


(Grüsse aus Zürich)

// Steve

 Original-Nachricht 
 Datum: Sat, 15 Nov 2008 10:37:38 +0100
 Von: Marko Weber [EMAIL PROTECTED]
 An: dspam-users@lists.nuclearelephant.com 
 dspam-users@lists.nuclearelephant.com
 Betreff: Re: [dspam-users] mysql fetch row error

 Hello Steve this is the full Header of  a spam mail where the training 
 also fails.
 withe the mysql fetch error.
 
 marko
 
 
 Return-Path: [EMAIL PROTECTED]
 X-Original-To: [EMAIL PROTECTED]
 Delivered-To: [EMAIL PROTECTED]
 Received: from localhost (localhost [127.0.0.1])
 by salonwebserver.de (Postfix) with ESMTP id 02C8613BC09B
 for [EMAIL PROTECTED]; Fri, 14 Nov 2008 21:38:09 +0100
 (CET)
 X-DSPAM-Result: =?iso-8859-1?Q?Spam=0D?=
 X-DSPAM-Confidence: =?iso-8859-1?Q?0.7177=0D?=
 X-DSPAM-Probability: =?iso-8859-1?Q?1.=0D?=
 ?iso-8859-1?Q?491de1b0254959695846858=0D?=
 X-DSPAM-Factors: 15,
 X-Virus-Scanned: amavisd-new at salonwebserver.de
 X-Spam-Flag: NO
 X-Spam-Score: 2.415
 X-Spam-Level: **
 X-Spam-Status: No, score=2.415 tagged_above=-1000 required=2.5
 tests=[DNS_FROM_SECURITYSAGE=0.127, RCVD_IN_BL_SPAMCOP_NET=2.188,
 RDNS_DYNAMIC=0.1]
 Received: from salonwebserver.de ([127.0.0.1])
 by localhost (kraftwerk1.salonwebserver.de [127.0.0.1]) 
 (amavisd-new, port 10024)
 with ESMTP id nOQQilMNvp-o for [EMAIL PROTECTED];
 Fri, 14 Nov 2008 21:38:07 +0100 (CET)
 Received: from zackbummfertig.de 
 (static.243.42.46.78.clients.your-server.de [78.46.42.243])
 (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
 (No client certificate requested)
 by salonwebserver.de (Postfix) with ESMTPS id E86BD13BC078
 for [EMAIL PROTECTED]; Fri, 14 Nov 2008 21:38:06 +0100
 (CET)
 Received: from localhost (localhost [127.0.0.1])
 by zackbummfertig.de (Postfix) with ESMTP id BC4BDECC067
 for [EMAIL PROTECTED]; Fri, 14 Nov 2008 21:37:46 +0100
 (CET)
 X-Virus-Scanned: amavisd-new at zackbummfertig.de
 Received: from zackbummfertig.de ([127.0.0.1])
 by localhost (weberweb.zackbummfertig.de [127.0.0.1]) 
 (amavisd-new, port 10024)
 with ESMTP id xr6ayW0lyDGC for [EMAIL PROTECTED];
 Fri, 14 Nov 2008 21:37:43 +0100 (CET)
 Received: from rachel22b12579 (unknown [78.146.113.186])
 by zackbummfertig.de (Postfix) with SMTP id 3E83CECC040
 for [EMAIL PROTECTED]; Fri, 14 Nov 2008 21:37:43 +0100
 (CET)
 Date: Fri, 14 Nov 2008 20:38:01 +
 From: Chrystal Huddleston [EMAIL PROTECTED]
 Subject: gambling slot machines
 To: [EMAIL PROTECTED]
 Message-id: [EMAIL PROTECTED]
 Organization: fightingbobfest.org
 MIME-version: 1.0
 Content-type: text/plain; charset=us-ascii
 Content-transfer-encoding: 7bit
 X-Priority: 3 (Normal)
 
 Steve schrieb:
  Can you post the full header of the message in question?
 
 
   Original-Nachricht 

  Datum: Fri, 14 Nov 2008 23:18:39 +0100
  Von: Marko Weber [EMAIL PROTECTED]
  An: dspam-users@lists.nuclearelephant.com
 dspam-users@lists.nuclearelephant.com
  Betreff: Re: [dspam-users] mysql fetch row error
  
 

  Hi Steve,
  this sed thing dont worked for me.. sorry
  how i can get dspam working without this mysql fetch error ?
  u have any hints ?
 
  marko
 
 
  Steve schrieb:
  
   Original-Nachricht 


  Datum: Fri, 14 Nov 2008 18:11:55 +0100
  Von: Marko Weber [EMAIL PROTECTED]
  An: dspam-users@lists.nuclearelephant.com
  
  dspam-users@lists.nuclearelephant.com
  
  Betreff: [dspam-users] mysql fetch row error
  
  


  Hello to all in the Mailinglist,
 
  i installed dspam on our server and it works so far that incoming
 mails
  are tagged by dspam.
  i installed dovecot-antispam for retraining.
  when in try to retrain a mail  i get this in the dspam.debug log =
 
  9056: [11/14/2008 15:23:01] mysql_fetch_row() failed in
  
  _ds_get_signature
  
  in the /var/log/messages log i get this =
 
  Nov 14 15:29:25 kraftwerk1 imap: antispam: /usr/bin/dspam
  
  --source=error 
  
  --class=spam --signature==?iso-8859-1?Q?491d76cb23581804284693=0D?=
 ...
  Nov 14 15:29:25 kraftwerk1 dspam[9189]: Signature retrieval for 
  '=?iso-8859-1?Q?491d76cb23581804284693=0D?=' failed
  Nov 14 15:29:25 kraftwerk1 dspam[9189]: Unable to find a valid 
  signature. Aborting.
  Nov 14 15:29:25 kraftwerk1 dspam

Re: [dspam-users] mysql fetch row error

2008-11-15 Thread Marko Weber

Hi Steve,

MTA = Postfix
I have amavis - spamassassin - dspam installed.
i think spamassassin scnas after dspam, cuase in the  mail headers dspam 
comes at first.

I use Dovecot as Imap Server
OS = Gentoo Linux

i put the config of dspam here = http://rafb.net/p/VCX8XO97.html

if u need more confs just tell me , i can paste then

marko




Steve schrieb:

Hallo Marko

This is not normal. DSPAM does not add the encoding. It must be something else 
you are using/doing to get that tagged with the encoding in front of every 
DSPAM tag. And I don't see the DSPAM signature in your header. This is not 
normal. If you have the other DSPAM header lines, then you should have the 
result as well.

What MTA are you using?
How is the integration between MTA and DSPAM?
Do you have other filters running before and after DSPAM?
What IMAP server are you using?
What OS are you using?
Could you post your DSPAM config?


(Grüsse aus Zürich)

// Steve

 Original-Nachricht 
  

Datum: Sat, 15 Nov 2008 10:37:38 +0100
Von: Marko Weber [EMAIL PROTECTED]
An: dspam-users@lists.nuclearelephant.com 
dspam-users@lists.nuclearelephant.com
Betreff: Re: [dspam-users] mysql fetch row error



  
Hello Steve this is the full Header of  a spam mail where the training 
also fails.

withe the mysql fetch error.

marko


Return-Path: [EMAIL PROTECTED]
X-Original-To: [EMAIL PROTECTED]
Delivered-To: [EMAIL PROTECTED]
Received: from localhost (localhost [127.0.0.1])
by salonwebserver.de (Postfix) with ESMTP id 02C8613BC09B
for [EMAIL PROTECTED]; Fri, 14 Nov 2008 21:38:09 +0100
(CET)
X-DSPAM-Result: =?iso-8859-1?Q?Spam=0D?=
X-DSPAM-Confidence: =?iso-8859-1?Q?0.7177=0D?=
X-DSPAM-Probability: =?iso-8859-1?Q?1.=0D?=
?iso-8859-1?Q?491de1b0254959695846858=0D?=
X-DSPAM-Factors: 15,
X-Virus-Scanned: amavisd-new at salonwebserver.de
X-Spam-Flag: NO
X-Spam-Score: 2.415
X-Spam-Level: **
X-Spam-Status: No, score=2.415 tagged_above=-1000 required=2.5
tests=[DNS_FROM_SECURITYSAGE=0.127, RCVD_IN_BL_SPAMCOP_NET=2.188,
RDNS_DYNAMIC=0.1]
Received: from salonwebserver.de ([127.0.0.1])
by localhost (kraftwerk1.salonwebserver.de [127.0.0.1]) 
(amavisd-new, port 10024)

with ESMTP id nOQQilMNvp-o for [EMAIL PROTECTED];
Fri, 14 Nov 2008 21:38:07 +0100 (CET)
Received: from zackbummfertig.de 
(static.243.42.46.78.clients.your-server.de [78.46.42.243])

(using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
(No client certificate requested)
by salonwebserver.de (Postfix) with ESMTPS id E86BD13BC078
for [EMAIL PROTECTED]; Fri, 14 Nov 2008 21:38:06 +0100
(CET)
Received: from localhost (localhost [127.0.0.1])
by zackbummfertig.de (Postfix) with ESMTP id BC4BDECC067
for [EMAIL PROTECTED]; Fri, 14 Nov 2008 21:37:46 +0100
(CET)
X-Virus-Scanned: amavisd-new at zackbummfertig.de
Received: from zackbummfertig.de ([127.0.0.1])
by localhost (weberweb.zackbummfertig.de [127.0.0.1]) 
(amavisd-new, port 10024)

with ESMTP id xr6ayW0lyDGC for [EMAIL PROTECTED];
Fri, 14 Nov 2008 21:37:43 +0100 (CET)
Received: from rachel22b12579 (unknown [78.146.113.186])
by zackbummfertig.de (Postfix) with SMTP id 3E83CECC040
for [EMAIL PROTECTED]; Fri, 14 Nov 2008 21:37:43 +0100
(CET)
Date: Fri, 14 Nov 2008 20:38:01 +
From: Chrystal Huddleston [EMAIL PROTECTED]
Subject: gambling slot machines
To: [EMAIL PROTECTED]
Message-id: [EMAIL PROTECTED]
Organization: fightingbobfest.org
MIME-version: 1.0
Content-type: text/plain; charset=us-ascii
Content-transfer-encoding: 7bit
X-Priority: 3 (Normal)

Steve schrieb:


Can you post the full header of the message in question?


 Original-Nachricht 
  
  

Datum: Fri, 14 Nov 2008 23:18:39 +0100
Von: Marko Weber [EMAIL PROTECTED]
An: dspam-users@lists.nuclearelephant.com


dspam-users@lists.nuclearelephant.com


Betreff: Re: [dspam-users] mysql fetch row error


  
  

Hi Steve,
this sed thing dont worked for me.. sorry
how i can get dspam working without this mysql fetch error ?
u have any hints ?

marko


Steve schrieb:



 Original-Nachricht 
  
  
  

Datum: Fri, 14 Nov 2008 18:11:55 +0100
Von: Marko Weber [EMAIL PROTECTED]
An: dspam-users@lists.nuclearelephant.com



dspam-users@lists.nuclearelephant.com



Betreff: [dspam-users] mysql fetch row error



  
  
  

Hello to all in the Mailinglist,

i installed dspam on our server and it works so far that incoming


mails


are tagged by dspam.
i installed dovecot-antispam for retraining.
when in try to retrain a mail  i get this in the dspam.debug log =

9056: [11/14/2008 15:23:01] mysql_fetch_row() failed in



_ds_get_signature



in the /var/log/messages log i get this =

Nov 14 15:29:25 kraftwerk1 imap: antispam

Re: [dspam-users] mysql fetch row error

2008-11-15 Thread Steve

 Original-Nachricht 
 Datum: Sat, 15 Nov 2008 11:23:24 +0100
 Von: Marko Weber [EMAIL PROTECTED]
 An: dspam-users@lists.nuclearelephant.com 
 dspam-users@lists.nuclearelephant.com
 Betreff: Re: [dspam-users] mysql fetch row error

 Hi Steve,
 
Mallo Marko


 MTA = Postfix
 I have amavis - spamassassin - dspam installed.

I think it's amavisd-new producing that iso stuff. Could you post your amaivs 
configuration somewhere? And your main.cf and master.cf as well.


 i think spamassassin scnas after dspam, cuase in the  mail headers dspam 
 comes at first.
 I use Dovecot as Imap Server
 OS = Gentoo Linux
 
Okay. Then you are using my DSPAM ebuild. I am the one who created the DSPAM 
ebuild currently used in Gentoo :)


 i put the config of dspam here = http://rafb.net/p/VCX8XO97.html
 
 if u need more confs just tell me , i can paste then
 
 marko
 
// Steve

 
 
 
 Steve schrieb:
  Hallo Marko
 
  This is not normal. DSPAM does not add the encoding. It must be
 something else you are using/doing to get that tagged with the encoding in 
 front of
 every DSPAM tag. And I don't see the DSPAM signature in your header. This
 is not normal. If you have the other DSPAM header lines, then you should
 have the result as well.
 
  What MTA are you using?
  How is the integration between MTA and DSPAM?
  Do you have other filters running before and after DSPAM?
  What IMAP server are you using?
  What OS are you using?
  Could you post your DSPAM config?
 
 
  (Grüsse aus Zürich)
 
  // Steve
 
   Original-Nachricht 

  Datum: Sat, 15 Nov 2008 10:37:38 +0100
  Von: Marko Weber [EMAIL PROTECTED]
  An: dspam-users@lists.nuclearelephant.com
 dspam-users@lists.nuclearelephant.com
  Betreff: Re: [dspam-users] mysql fetch row error
  
 

  Hello Steve this is the full Header of  a spam mail where the
 training 
  also fails.
  withe the mysql fetch error.
 
  marko
 
 
  Return-Path: [EMAIL PROTECTED]
  X-Original-To: [EMAIL PROTECTED]
  Delivered-To: [EMAIL PROTECTED]
  Received: from localhost (localhost [127.0.0.1])
  by salonwebserver.de (Postfix) with ESMTP id 02C8613BC09B
  for [EMAIL PROTECTED]; Fri, 14 Nov 2008 21:38:09 +0100
  (CET)
  X-DSPAM-Result: =?iso-8859-1?Q?Spam=0D?=
  X-DSPAM-Confidence: =?iso-8859-1?Q?0.7177=0D?=
  X-DSPAM-Probability: =?iso-8859-1?Q?1.=0D?=
  ?iso-8859-1?Q?491de1b0254959695846858=0D?=
  X-DSPAM-Factors: 15,
  X-Virus-Scanned: amavisd-new at salonwebserver.de
  X-Spam-Flag: NO
  X-Spam-Score: 2.415
  X-Spam-Level: **
  X-Spam-Status: No, score=2.415 tagged_above=-1000 required=2.5
  tests=[DNS_FROM_SECURITYSAGE=0.127,
 RCVD_IN_BL_SPAMCOP_NET=2.188,
  RDNS_DYNAMIC=0.1]
  Received: from salonwebserver.de ([127.0.0.1])
  by localhost (kraftwerk1.salonwebserver.de [127.0.0.1]) 
  (amavisd-new, port 10024)
  with ESMTP id nOQQilMNvp-o for [EMAIL PROTECTED];
  Fri, 14 Nov 2008 21:38:07 +0100 (CET)
  Received: from zackbummfertig.de 
  (static.243.42.46.78.clients.your-server.de [78.46.42.243])
  (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
  (No client certificate requested)
  by salonwebserver.de (Postfix) with ESMTPS id E86BD13BC078
  for [EMAIL PROTECTED]; Fri, 14 Nov 2008 21:38:06 +0100
  (CET)
  Received: from localhost (localhost [127.0.0.1])
  by zackbummfertig.de (Postfix) with ESMTP id BC4BDECC067
  for [EMAIL PROTECTED]; Fri, 14 Nov 2008 21:37:46 +0100
  (CET)
  X-Virus-Scanned: amavisd-new at zackbummfertig.de
  Received: from zackbummfertig.de ([127.0.0.1])
  by localhost (weberweb.zackbummfertig.de [127.0.0.1]) 
  (amavisd-new, port 10024)
  with ESMTP id xr6ayW0lyDGC for [EMAIL PROTECTED];
  Fri, 14 Nov 2008 21:37:43 +0100 (CET)
  Received: from rachel22b12579 (unknown [78.146.113.186])
  by zackbummfertig.de (Postfix) with SMTP id 3E83CECC040
  for [EMAIL PROTECTED]; Fri, 14 Nov 2008 21:37:43 +0100
  (CET)
  Date: Fri, 14 Nov 2008 20:38:01 +
  From: Chrystal Huddleston [EMAIL PROTECTED]
  Subject: gambling slot machines
  To: [EMAIL PROTECTED]
  Message-id: [EMAIL PROTECTED]
  Organization: fightingbobfest.org
  MIME-version: 1.0
  Content-type: text/plain; charset=us-ascii
  Content-transfer-encoding: 7bit
  X-Priority: 3 (Normal)
 
  Steve schrieb:
  
  Can you post the full header of the message in question?
 
 
   Original-Nachricht 


  Datum: Fri, 14 Nov 2008 23:18:39 +0100
  Von: Marko Weber [EMAIL PROTECTED]
  An: dspam-users@lists.nuclearelephant.com
  
  dspam-users@lists.nuclearelephant.com
  
  Betreff: Re: [dspam-users] mysql fetch row error
  
  


  Hi Steve,
  this sed thing dont worked for me.. sorry
  how i can get dspam working without this mysql fetch error ?
  u have any hints ?
 
  marko
 
 
  Steve schrieb:
  
  
   Original-Nachricht

AW: [dspam-users] mysql fetch row error

2008-11-15 Thread Imposit.com - Webmaster
Maybe ife another idea.

I dont know the Gentoo Version but maybe this encoding comes from the
Database.

Please Post your my.cnf from the Mysql DB and also which Charset your system
is using.
Also we have to know which charset u use in the mysql tables and which one
fort he database.
General ist a good idea to use for everything UTF-8. 


PS: i hope ill have this weekend more time fort he dev list and the forum.

-Ursprüngliche Nachricht-
Von: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] Im Auftrag von Steve
Gesendet: Samstag, 15. November 2008 14:09
An: dspam-users@lists.nuclearelephant.com
Betreff: Re: [dspam-users] mysql fetch row error

 Original-Nachricht 
 Datum: Sat, 15 Nov 2008 12:10:04 +0100
 Von: Marko Weber [EMAIL PROTECTED]
 An: dspam-users@lists.nuclearelephant.com
dspam-users@lists.nuclearelephant.com
 Betreff: Re: [dspam-users] mysql fetch row error

 Hi Steve,
 nice to hear you are the ebuilder great job.
 
Not only the ebuild. There is a bunch of patches/fixes in Gentoo for DSPAM.
Some of them are already in the CVS edition of DSPAM.



 amvisd.conf = http://rafb.net/p/fkrpk553.html
 main.cf = http://rafb.net/p/9nhKMt93.html
 master.cf  = http://rafb.net/p/QDiAPu11.html
 
 hope you can find anything that i can get work proper.
 thank you at this time for all the effort
 
Phuu... I would rewrite much of it. Anway... I try to keep the changes as
small as possible. So I will not post whole config files. Is that okay with
you? If you want, I could. Just let me know. I see you use Postfix.Admin.
Right? You could speed up a lot of things by using proxy maps and other
stuff. But there is no point for me to rewrite the config if you don't
want/need.


Anyway lets do the config stuff.

In main.cf remove the content_filter part:
content_filter = amavis:[127.0.0.1]:10024

master.cf use this one here (I did a rewrite of it. Sorry for that. But the
changes are commented in the file and I think you will understand why I
changed things):
http://rafb.net/p/f5PGTy80.html

amavis.conf do this:

Add a forward method on port 10025:
$forward_method = 'smtp:[127.0.0.1]:10025';  # where to forward checked mail

Add notify method on port 10026 (we will use it in DSPAM as well for
delivery of certain stuff):
$notify_method = 'smtp:[127.0.0.1]:10026';  # where to submit notifications

Remove DSPAM access from Amavis (it's better to run DSPAM outside
amavisd-new and use other ways then amavisd-new for tagging mails. Amavis
just runs under one single user and this is limiting the possibilities of
DSPAM):
#$dspam  = 'dspam';


In dspam.conf:

Your trusted and untrusted agent should probably be the sendmail binary
(Postfix edition but the ebuild is already taken care of this):
TrustedDeliveryAgent /usr/sbin/sendmail
UntrustedDeliveryAgent /usr/sbin/sendmail


Switch the delivery to SMTP (remember the port 10026 above for amavisd-new?
Well... we are going to reuse that port for DSPAM delivery):
DeliveryHost127.0.0.1
DeliveryPort10026
DeliveryIdent   localhost
DeliveryProto   SMTP


Change the DSPAM server to use auto mode:
ServerQueueSize 32
ServerMode   auto


Add config to identify the DSPAM agent and daemon (as ident I used kw1 for
kraftwerk1):
ServerPass.kw1 9252173122311528111
ServerParameters--deliver=innocent
ServerIdent kw1.dspam.server
ServerDomainSocketPath  /var/run/dspam/dspam.sock
ClientHost  /var/run/dspam/dspam.sock
ClientIdent [EMAIL PROTECTED]



In the Gentoo forum you will find much more configuration tips and tricks..
Just search for the user SteveB and for the keyword dspam or postfix or
amavis. I run DSPAM for a long time and have probably a different viewpoint
on DSPAM then you. This does not mean that my way is better then other
configurations. I just got used of doing it a certain way. I as well have
patched my DSPAM with about 20 own made patches. Some of them add new
functions and some of them fix memory leaks and others do speed up things (I
speeded up the MySQL part significantly on my setup). I do the training as
well much different then probably most users here. I use TONE (train on or
near error) and I use a own made patch to do that as well with whitelisted
DSPAM results (if the whitelisted message would result in spam if no
whitelisting would be active). The result looks something like that here:
Nov 15 02:46:03 mail postfix/lmtp[30960]: 9229E15B3E49: to=x,
relay=127.0.0.1[127.0.0.1]:10024, delay=7.4, delays=7/0.02/0.01/0.4,
dsn=2.0.0, status=sent (250 2.0.0 Ok, id=29240-17, from
MTA([127.0.0.1]:10025): 250 2.0.0 Ok: queued as 2962C15B3E4F)
Nov 15 02:46:08 mail dspam[24389]: forcing learning of auto-whitelisted SPAM
message as INNOCENT
Nov 15 02:46:08 mail dspam[24389]: innocent message from 211.115.216.226

I like DSPAM much and it does tag spam messages very well but the most
problem I have is that ham messages don't get so well recognized as spam. So
I had to take

AW: [dspam-users] mysql fetch row error

2008-11-15 Thread Steve

 Original-Nachricht 
 Datum: Sat, 15 Nov 2008 15:28:06 +0100
 Von: Imposit.com - Webmaster [EMAIL PROTECTED]
 An: dspam-users@lists.nuclearelephant.com
 Betreff: AW: [dspam-users] mysql fetch row error

 Maybe ife another idea.
 
 I dont know the Gentoo Version but maybe this encoding comes from the
 Database.
 
No. It can not come from the DB backend as it is the dovecot plugin executing 
the command even without contacting the DB backend.


 Please Post your my.cnf from the Mysql DB and also which Charset your
 system
 is using.
 Also we have to know which charset u use in the mysql tables and which one
 fort he database.
 General ist a good idea to use for everything UTF-8. 
 
 
 PS: i hope ill have this weekend more time fort he dev list and the forum.
 
I could add a forum and a dev mailing list in 10 minutes if you want me to do 
that for the DSPAM community.


 -Ursprüngliche Nachricht-
 Von: [EMAIL PROTECTED]
 [mailto:[EMAIL PROTECTED] Im Auftrag von Steve
 Gesendet: Samstag, 15. November 2008 14:09
 An: dspam-users@lists.nuclearelephant.com
 Betreff: Re: [dspam-users] mysql fetch row error
 
  Original-Nachricht 
  Datum: Sat, 15 Nov 2008 12:10:04 +0100
  Von: Marko Weber [EMAIL PROTECTED]
  An: dspam-users@lists.nuclearelephant.com
 dspam-users@lists.nuclearelephant.com
  Betreff: Re: [dspam-users] mysql fetch row error
 
  Hi Steve,
  nice to hear you are the ebuilder great job.
  
 Not only the ebuild. There is a bunch of patches/fixes in Gentoo for
 DSPAM.
 Some of them are already in the CVS edition of DSPAM.
 
 
 
  amvisd.conf = http://rafb.net/p/fkrpk553.html
  main.cf = http://rafb.net/p/9nhKMt93.html
  master.cf  = http://rafb.net/p/QDiAPu11.html
  
  hope you can find anything that i can get work proper.
  thank you at this time for all the effort
  
 Phuu... I would rewrite much of it. Anway... I try to keep the changes as
 small as possible. So I will not post whole config files. Is that okay
 with
 you? If you want, I could. Just let me know. I see you use Postfix.Admin.
 Right? You could speed up a lot of things by using proxy maps and other
 stuff. But there is no point for me to rewrite the config if you don't
 want/need.
 
 
 Anyway lets do the config stuff.
 
 In main.cf remove the content_filter part:
 content_filter = amavis:[127.0.0.1]:10024
 
 master.cf use this one here (I did a rewrite of it. Sorry for that. But
 the
 changes are commented in the file and I think you will understand why I
 changed things):
 http://rafb.net/p/f5PGTy80.html
 
 amavis.conf do this:
 
 Add a forward method on port 10025:
 $forward_method = 'smtp:[127.0.0.1]:10025';  # where to forward checked
 mail
 
 Add notify method on port 10026 (we will use it in DSPAM as well for
 delivery of certain stuff):
 $notify_method = 'smtp:[127.0.0.1]:10026';  # where to submit
 notifications
 
 Remove DSPAM access from Amavis (it's better to run DSPAM outside
 amavisd-new and use other ways then amavisd-new for tagging mails. Amavis
 just runs under one single user and this is limiting the possibilities of
 DSPAM):
 #$dspam  = 'dspam';
 
 
 In dspam.conf:
 
 Your trusted and untrusted agent should probably be the sendmail binary
 (Postfix edition but the ebuild is already taken care of this):
 TrustedDeliveryAgent /usr/sbin/sendmail
 UntrustedDeliveryAgent /usr/sbin/sendmail
 
 
 Switch the delivery to SMTP (remember the port 10026 above for
 amavisd-new?
 Well... we are going to reuse that port for DSPAM delivery):
 DeliveryHost127.0.0.1
 DeliveryPort10026
 DeliveryIdent   localhost
 DeliveryProto   SMTP
 
 
 Change the DSPAM server to use auto mode:
 ServerQueueSize   32
 ServerMode   auto
 
 
 Add config to identify the DSPAM agent and daemon (as ident I used kw1 for
 kraftwerk1):
 ServerPass.kw1 9252173122311528111
 ServerParameters--deliver=innocent
 ServerIdent kw1.dspam.server
 ServerDomainSocketPath  /var/run/dspam/dspam.sock
 ClientHost  /var/run/dspam/dspam.sock
 ClientIdent [EMAIL PROTECTED]
 
 
 
 In the Gentoo forum you will find much more configuration tips and
 tricks..
 Just search for the user SteveB and for the keyword dspam or postfix or
 amavis. I run DSPAM for a long time and have probably a different
 viewpoint
 on DSPAM then you. This does not mean that my way is better then other
 configurations. I just got used of doing it a certain way. I as well have
 patched my DSPAM with about 20 own made patches. Some of them add new
 functions and some of them fix memory leaks and others do speed up things
 (I
 speeded up the MySQL part significantly on my setup). I do the training as
 well much different then probably most users here. I use TONE (train on or
 near error) and I use a own made patch to do that as well with whitelisted
 DSPAM results (if the whitelisted message would result in spam if no
 whitelisting would be active). The result looks something like

AW: [dspam-users] mysql fetch row error

2008-11-15 Thread Imposit.com - Webmaster
Ill make a Forum with an ListGateway. Also it should be secure and Fast and
and and.. :-)

-Ursprüngliche Nachricht-
Von: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] Im Auftrag von Steve
Gesendet: Samstag, 15. November 2008 15:32
An: dspam-users@lists.nuclearelephant.com
Betreff: AW: [dspam-users] mysql fetch row error


 Original-Nachricht 
 Datum: Sat, 15 Nov 2008 15:28:06 +0100
 Von: Imposit.com - Webmaster [EMAIL PROTECTED]
 An: dspam-users@lists.nuclearelephant.com
 Betreff: AW: [dspam-users] mysql fetch row error

 Maybe ife another idea.
 
 I dont know the Gentoo Version but maybe this encoding comes from the
 Database.
 
No. It can not come from the DB backend as it is the dovecot plugin
executing the command even without contacting the DB backend.


 Please Post your my.cnf from the Mysql DB and also which Charset your
 system
 is using.
 Also we have to know which charset u use in the mysql tables and which one
 fort he database.
 General ist a good idea to use for everything UTF-8. 
 
 
 PS: i hope ill have this weekend more time fort he dev list and the forum.
 
I could add a forum and a dev mailing list in 10 minutes if you want me to
do that for the DSPAM community.


 -Ursprüngliche Nachricht-
 Von: [EMAIL PROTECTED]
 [mailto:[EMAIL PROTECTED] Im Auftrag von Steve
 Gesendet: Samstag, 15. November 2008 14:09
 An: dspam-users@lists.nuclearelephant.com
 Betreff: Re: [dspam-users] mysql fetch row error
 
  Original-Nachricht 
  Datum: Sat, 15 Nov 2008 12:10:04 +0100
  Von: Marko Weber [EMAIL PROTECTED]
  An: dspam-users@lists.nuclearelephant.com
 dspam-users@lists.nuclearelephant.com
  Betreff: Re: [dspam-users] mysql fetch row error
 
  Hi Steve,
  nice to hear you are the ebuilder great job.
  
 Not only the ebuild. There is a bunch of patches/fixes in Gentoo for
 DSPAM.
 Some of them are already in the CVS edition of DSPAM.
 
 
 
  amvisd.conf = http://rafb.net/p/fkrpk553.html
  main.cf = http://rafb.net/p/9nhKMt93.html
  master.cf  = http://rafb.net/p/QDiAPu11.html
  
  hope you can find anything that i can get work proper.
  thank you at this time for all the effort
  
 Phuu... I would rewrite much of it. Anway... I try to keep the changes as
 small as possible. So I will not post whole config files. Is that okay
 with
 you? If you want, I could. Just let me know. I see you use Postfix.Admin.
 Right? You could speed up a lot of things by using proxy maps and other
 stuff. But there is no point for me to rewrite the config if you don't
 want/need.
 
 
 Anyway lets do the config stuff.
 
 In main.cf remove the content_filter part:
 content_filter = amavis:[127.0.0.1]:10024
 
 master.cf use this one here (I did a rewrite of it. Sorry for that. But
 the
 changes are commented in the file and I think you will understand why I
 changed things):
 http://rafb.net/p/f5PGTy80.html
 
 amavis.conf do this:
 
 Add a forward method on port 10025:
 $forward_method = 'smtp:[127.0.0.1]:10025';  # where to forward checked
 mail
 
 Add notify method on port 10026 (we will use it in DSPAM as well for
 delivery of certain stuff):
 $notify_method = 'smtp:[127.0.0.1]:10026';  # where to submit
 notifications
 
 Remove DSPAM access from Amavis (it's better to run DSPAM outside
 amavisd-new and use other ways then amavisd-new for tagging mails. Amavis
 just runs under one single user and this is limiting the possibilities of
 DSPAM):
 #$dspam  = 'dspam';
 
 
 In dspam.conf:
 
 Your trusted and untrusted agent should probably be the sendmail binary
 (Postfix edition but the ebuild is already taken care of this):
 TrustedDeliveryAgent /usr/sbin/sendmail
 UntrustedDeliveryAgent /usr/sbin/sendmail
 
 
 Switch the delivery to SMTP (remember the port 10026 above for
 amavisd-new?
 Well... we are going to reuse that port for DSPAM delivery):
 DeliveryHost127.0.0.1
 DeliveryPort10026
 DeliveryIdent   localhost
 DeliveryProto   SMTP
 
 
 Change the DSPAM server to use auto mode:
 ServerQueueSize   32
 ServerMode   auto
 
 
 Add config to identify the DSPAM agent and daemon (as ident I used kw1 for
 kraftwerk1):
 ServerPass.kw1 9252173122311528111
 ServerParameters--deliver=innocent
 ServerIdent kw1.dspam.server
 ServerDomainSocketPath  /var/run/dspam/dspam.sock
 ClientHost  /var/run/dspam/dspam.sock
 ClientIdent [EMAIL PROTECTED]
 
 
 
 In the Gentoo forum you will find much more configuration tips and
 tricks..
 Just search for the user SteveB and for the keyword dspam or postfix or
 amavis. I run DSPAM for a long time and have probably a different
 viewpoint
 on DSPAM then you. This does not mean that my way is better then other
 configurations. I just got used of doing it a certain way. I as well have
 patched my DSPAM with about 20 own made patches. Some of them add new
 functions and some of them fix memory leaks and others do speed up things
 (I
 speeded up the MySQL part

AW: [dspam-users] mysql fetch row error

2008-11-15 Thread Steve

 Original-Nachricht 
 Datum: Sat, 15 Nov 2008 16:18:13 +0100
 Von: Imposit.com - Webmaster [EMAIL PROTECTED]
 An: dspam-users@lists.nuclearelephant.com
 Betreff: AW: [dspam-users] mysql fetch row error

 Why you think the encoding comes from the dovecot?
 It isnt envoled yet i think, isnt it?
 
It is involved. It must. Because the mail got delivered to his IMAP server and 
from there he is using a plugin (I think it is called dovecot antispam plugin) 
which scans certain folders for spam missclassification and depending on where 
the plugin finds the mail it will extract the DSPAM signature and execute the 
DSPAM binary with parameters in order to get the message trained.
And I asked Markus to post the full header of the message in question. And 
already those headers have the encoding part in it. So it is not the plugin 
which is not okay. It must be something else. I suspect that amavisd-new is 
doing it. But I am not 100% sure.


 -Ursprüngliche Nachricht-
 Von: [EMAIL PROTECTED]
 [mailto:[EMAIL PROTECTED] Im Auftrag von Steve
 Gesendet: Samstag, 15. November 2008 15:32
 An: dspam-users@lists.nuclearelephant.com
 Betreff: AW: [dspam-users] mysql fetch row error
 
 
  Original-Nachricht 
  Datum: Sat, 15 Nov 2008 15:28:06 +0100
  Von: Imposit.com - Webmaster [EMAIL PROTECTED]
  An: dspam-users@lists.nuclearelephant.com
  Betreff: AW: [dspam-users] mysql fetch row error
 
  Maybe ife another idea.
  
  I dont know the Gentoo Version but maybe this encoding comes from the
  Database.
  
 No. It can not come from the DB backend as it is the dovecot plugin
 executing the command even without contacting the DB backend.
 
 
  Please Post your my.cnf from the Mysql DB and also which Charset your
  system
  is using.
  Also we have to know which charset u use in the mysql tables and which
 one
  fort he database.
  General ist a good idea to use for everything UTF-8. 
  
  
  PS: i hope ill have this weekend more time fort he dev list and the
 forum.
  
 I could add a forum and a dev mailing list in 10 minutes if you want me to
 do that for the DSPAM community.
 
 
  -Ursprüngliche Nachricht-
  Von: [EMAIL PROTECTED]
  [mailto:[EMAIL PROTECTED] Im Auftrag von
 Steve
  Gesendet: Samstag, 15. November 2008 14:09
  An: dspam-users@lists.nuclearelephant.com
  Betreff: Re: [dspam-users] mysql fetch row error
  
   Original-Nachricht 
   Datum: Sat, 15 Nov 2008 12:10:04 +0100
   Von: Marko Weber [EMAIL PROTECTED]
   An: dspam-users@lists.nuclearelephant.com
  dspam-users@lists.nuclearelephant.com
   Betreff: Re: [dspam-users] mysql fetch row error
  
   Hi Steve,
   nice to hear you are the ebuilder great job.
   
  Not only the ebuild. There is a bunch of patches/fixes in Gentoo for
  DSPAM.
  Some of them are already in the CVS edition of DSPAM.
  
  
  
   amvisd.conf = http://rafb.net/p/fkrpk553.html
   main.cf = http://rafb.net/p/9nhKMt93.html
   master.cf  = http://rafb.net/p/QDiAPu11.html
   
   hope you can find anything that i can get work proper.
   thank you at this time for all the effort
   
  Phuu... I would rewrite much of it. Anway... I try to keep the changes
 as
  small as possible. So I will not post whole config files. Is that okay
  with
  you? If you want, I could. Just let me know. I see you use
 Postfix.Admin.
  Right? You could speed up a lot of things by using proxy maps and other
  stuff. But there is no point for me to rewrite the config if you don't
  want/need.
  
  
  Anyway lets do the config stuff.
  
  In main.cf remove the content_filter part:
  content_filter = amavis:[127.0.0.1]:10024
  
  master.cf use this one here (I did a rewrite of it. Sorry for that. But
  the
  changes are commented in the file and I think you will understand why I
  changed things):
  http://rafb.net/p/f5PGTy80.html
  
  amavis.conf do this:
  
  Add a forward method on port 10025:
  $forward_method = 'smtp:[127.0.0.1]:10025';  # where to forward checked
  mail
  
  Add notify method on port 10026 (we will use it in DSPAM as well for
  delivery of certain stuff):
  $notify_method = 'smtp:[127.0.0.1]:10026';  # where to submit
  notifications
  
  Remove DSPAM access from Amavis (it's better to run DSPAM outside
  amavisd-new and use other ways then amavisd-new for tagging mails.
 Amavis
  just runs under one single user and this is limiting the possibilities
 of
  DSPAM):
  #$dspam  = 'dspam';
  
  
  In dspam.conf:
  
  Your trusted and untrusted agent should probably be the sendmail binary
  (Postfix edition but the ebuild is already taken care of this):
  TrustedDeliveryAgent /usr/sbin/sendmail
  UntrustedDeliveryAgent /usr/sbin/sendmail
  
  
  Switch the delivery to SMTP (remember the port 10026 above for
  amavisd-new?
  Well... we are going to reuse that port for DSPAM delivery):
  DeliveryHost127.0.0.1
  DeliveryPort10026
  DeliveryIdent   localhost
  DeliveryProto   SMTP
  
  
  Change

Re: [dspam-users] mysql fetch row error

2008-11-14 Thread Marko Weber

Hi Steve,
this sed thing dont worked for me.. sorry
how i can get dspam working without this mysql fetch error ?
u have any hints ?

marko


Steve schrieb:

 Original-Nachricht 
  

Datum: Fri, 14 Nov 2008 18:11:55 +0100
Von: Marko Weber [EMAIL PROTECTED]
An: dspam-users@lists.nuclearelephant.com 
dspam-users@lists.nuclearelephant.com
Betreff: [dspam-users] mysql fetch row error



  

Hello to all in the Mailinglist,

i installed dspam on our server and it works so far that incoming mails 
are tagged by dspam.

i installed dovecot-antispam for retraining.
when in try to retrain a mail  i get this in the dspam.debug log =

9056: [11/14/2008 15:23:01] mysql_fetch_row() failed in _ds_get_signature


in the /var/log/messages log i get this =

Nov 14 15:29:25 kraftwerk1 imap: antispam: /usr/bin/dspam --source=error 
--class=spam --signature==?iso-8859-1?Q?491d76cb23581804284693=0D?= ...
Nov 14 15:29:25 kraftwerk1 dspam[9189]: Signature retrieval for 
'=?iso-8859-1?Q?491d76cb23581804284693=0D?=' failed
Nov 14 15:29:25 kraftwerk1 dspam[9189]: Unable to find a valid 
signature. Aborting.
Nov 14 15:29:25 kraftwerk1 dspam[9189]: process_message returned error 
-5.  dropping message.



but when i search for the signatur 491d76cb23581804284693 in the mysql 
database i can find it there.


what is this  ?iso-8859-1?Q? , is this causing the error ?



This means, that the plugin developer used the signature from the body instead 
of the one found in the header. You can verify yourself what the proper 
signature would be. Just issue this small one liner in sed:
sed -e '/^$/q' -ne 's/^X\-DSPAM\-Signature: 
\(\([1-9][0-9]*,\)\{0,1\}\([a-f0-9]\{20,32\}\)\)$/\1/p' /path/to/your/message

This should print out the proper signature DSPAM should receive from the 
plugin. The iso-8859-1 part indicates to me that the message is taken from a 
iso8859-1 encoded message body.



  

do any1 need my dspam.conf , then i can paste it on web.

thank for helping.

marko



Steve


  





  


!DSPAM:1011,491df903150921679976700!