On Thu, 22 Jul 2010 17:18:35 +0200 Stevan Bajić <ste...@bajic.ch> wrote:
> On Thu, 22 Jul 2010 10:51:02 -0400 > Disconnect <dc.disconn...@gmail.com> wrote: > > > I must not have realized that this was a recruiting drive masquerading as a > > survey. > > > > If I had time and inclination to contribute to dspam, I would have done so > > already (or at least, more recently.) It is incredibly painful and fragile > > and it sits in a core part of my environment, so I don't touch it if I can > > possibly avoid it. (I don't even retrain if I can avoid it because it does > > so much db load it triggers a hang in postfix-policyd that causes it to stop > > accepting mail until it is killed.) > > > Gee... you really, really should consider upgrading to 3.9.0. > I have a lot of servers where I run DSPAM. But let me show you the memory > used by DSPAM (and MySQL since I use on those two systems MySQL as storage > backend) on two servers that I use for a bunch of users. Those two servers > handle several hundred domains and several thousand end-users: > > MX1: > =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= > theia ~ # ps -ylC dspam,mysqld --sort rss > S UID PID PPID C PRI NI RSS SZ WCHAN TTY TIME CMD > S 0 2613 1 0 80 0 5592 10948 - ? 00:02:32 dspam > S 60 4386 1 0 80 0 446384 242326 - ? 00:27:05 mysqld > theia ~ # > =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= > > MX2: > =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= > nyx ~ # ps -ylC dspam,mysqld --sort rss > S UID PID PPID C PRI NI RSS SZ WCHAN TTY TIME CMD > S 0 2498 1 0 80 0 5048 10850 - ? 00:01:49 dspam > S 60 4134 1 0 80 0 468248 356689 - ? 00:22:00 mysqld > nyx ~ # > =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= > And here the data from a client where I have installed 3.9.0 for them. They used to run 3.8.0 with patches from Gentoo but now they use the RPM from the EPEL repository: =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= [r...@zh-lx12 ~]# ps -ylC dspam,mysqld,mysqld_safe --sort rss S UID PID PPID C PRI NI RSS SZ WCHAN TTY TIME CMD S 0 9524 1 0 85 0 28 13189 wait ? 00:00:00 mysqld_safe S 0 11667 1 0 76 0 21864 30249 184467 ? 00:32:44 dspam S 27 9568 9524 0 76 0 25068 47202 - ? 1-18:30:08 mysqld [r...@zh-lx12 ~]# uptime 17:34:34 up 678 days, 6:16, 1 user, load average: 0.10, 0.08, 0.08 [r...@zh-lx12 ~]# dspam --version DSPAM Anti-Spam Suite 3.9.0 (agent/library) Copyright (c) 2002-2009 DSPAM Project http://dspam.sourceforge.net. DSPAM may be copied only under the terms of the GNU General Public License, a copy of which can be found with the DSPAM distribution kit. Configuration parameters: '--build=x86_64-redhat-linux-gnu' '--host=x86_64-redhat-linux-gnu' '--target=x86_64-redhat-linux-gnu' '--program-prefix=' '--prefix=/usr' '--exec-prefix=/usr' '--bindir=/usr/bin' '--sbindir=/usr/sbin' '--datadir=/usr/share' '--includedir=/usr/include' '--libdir=/usr/lib64' '--libexecdir=/usr/libexec' '--localstatedir=/var' '--sharedstatedir=/usr/com' '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--enable-long-usernames' '--enable-syslog' '--enable-large-scale' '--disable-domain-scale' '--disable-homedir' '--enable-virtual-users' '--enable-preferences-extension' '--with-mysql-includes=/usr/include/mysql' '--with-mysql-libraries=/usr/lib64/mysql' '--with-pgsql-includes=/usr/include/pgsql' '--with-pgsql-libraries=/usr/lib64' '--enable-daemon' '--enable-external-lookup' '--with-storage-driver=hash_drv,mysql_drv,pgsql_drv,sqlite3_drv' '--with-dspam-home=/var/lib/dspam' '--with-dspam-owner=dspam' '--with-dspam-group=mail' '--with-dspam-home-group=mail' '--with-dspam-mode=2511' '--with-logdir=/var/log/dspam' '--sysconfdir=/etc' 'CFLAGS=-O2 -g -pipe -m64' 'CXXFLAGS=-O2 -g -pipe -m64' 'FFLAGS=-O2 -g -pipe -m64' 'build_alias=x86_64-redhat-linux-gnu' 'host_alias=x86_64-redhat-linux-gnu' 'target_alias=x86_64-redhat-linux-gnu' [r...@zh-lx12 ~]# mysql --version mysql Ver 14.12 Distrib 5.0.82sp1, for redhat-linux-gnu (x86_64) using readline 5.1 [r...@zh-lx12 ~]# =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= I don't know how long the DSPAM is running on their system. For sure it is not running since 678 days. However... they never have any issues with stability. Memory usage for DSPAM is higher then on my setup but that has other reasons. However... their 3.9.0 install uses less memory then their older 3.8.0 + patches setup. > This is the usage after running around one week (I updated the Kernel to > 2.6.34.1 and needed to reboot both systems). > > MySQL version is 5.1.48 and I run the two nodes in a Master <-> Master mode. > Storage engine in MySQL is InnoDB. MySQL is not only used for DSPAM. The MTA > and other tools use the MySQL server too. > > The DSPAM data is resisting on a GlusterFS share that is replicated on both > nodes. So both nodes see the same data (quarantine, etc...). > > Average processing time in DSPAM is around 47ms per message (aka: 21 messages > per second). This is just the time DSPAM takes/needs to process and does not > include my MTA and other things. > > Both systems are p...@2.8ghz systems. Nothing special. > > With all the other things that I haver running for fighting Spam my current > Spam volume is around 2% to 6% (this includes Spam from Spam honeypots). Most > of my users never or rarely see Spam. > > > > That makes me a bad person to do > > testing, because I need it to work. 3.8.0 works, mostly, so it is left > > alone. (Although spam filtering is on the list of things to be reevaluated > > soon, simply because it is so fragile and resource intensive.) > > > Fragile? UHA! You really need to reevaluate your Anti-Spam solution. Whatever > you use it should NOT be fragile. Resource intensive is another thing but > fragile? Fragile in a server environment? This should not be the case > regardless what Anti-Spam solution you use. > > > -- > Kind Regards from Switzerland, > > Stevan Bajić > > > On Thu, Jul 22, 2010 at 10:41 AM, Paul Cockings > > <ds...@cytringan.co.uk>wrote: > > > > > Disconnect wrote: > > > > > >> As was stated earlier, the installs were amazingly painful and finicky. > > >> The upgrades were worse. So it is sitting at 3.8.0 because I -really- > > >> don't > > >> want to have it start dropping mail again, or blowing up, or not > > >> training, > > >> etc.. > > >> > > >> The other reason is http://packages.debian.org/search?keywords=dspam .. > > >> you're likely to find servers running that version until it gets changed. > > >> The unstable bleeding-edge version is still 3.6.8... > > >> > > > Hi 'Disconnect' > > > > > > So what setup do you have? Debian ? Postfix + Mysql? > > > Are you running stock 3.8.0 or have you tweaked the code yourself to fix > > > some bugs > > > How much mail do you process and what type of hardware > > > > > > Do you have any coding skills that can help Dspam project out? > > > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by Sprint > What will you do first with EVO, the first 4G phone? > Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first > _______________________________________________ > Dspam-user mailing list > Dspam-user@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/dspam-user ------------------------------------------------------------------------------ This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first _______________________________________________ Dspam-user mailing list Dspam-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspam-user
