Hi again! First, Thanks all of you for input/output in this matter.
I have now applied the BerkeleyDB for rebuild, which was not set (must have slipped past me at installation) Allso DelayShowDB and DelayShowDBwhite is set to DB: Mysql my.cnf is reconfigured and set to accept 800 connections and not the default 151 that is used if not max_connections is set in my.cnf. (can be good to know) Next step will be to upgrade to latest version. (later this week) I have been documenting my install of ASSP(not the optimized ASSP settings in assp.cfg) for Debian(6.0.4) Squeeze with packages Mysql(5.1.16), Perl(5.10.1) and needed modules. (Versions are not optimal but is default for aptitude and apt-get installs in Debian Squeeze for now!) When ready, I will release an url for everyone to use, professional or not. Regards and happy Easter, Pontus -----Original Message----- From: Thomas Eckardt [mailto:thomas.ecka...@thockar.com] Sent: den 3 april 2012 14:07 To: pontus.karls...@scandinavianhosting.se; ASSP development mailing list Subject: Antwort: Re: [Assp-test] Antwort: Stable versions? >Are there switches elsewhere to set? - install BerkelyDB and the perl module BerkelyDB - check 'useDB4Rebuild' and 'useDB4IntCache' and 'useDB4griplist' - setup MySQL so that it never terminates any connection on timeout ! - setup MySQL to allow at least 800 concurrent connections - use INNODB for the assp tables >Ok, sarcasm or not, you then recommend always having mysql on a >separate server, right? always - ?? - This depends on the configuration settings, usage of plugins, workload and available system resources. For example: if you use the HMM and Bayes, it could happen that assp generates 6000 SQL querys in one second What if the rebuild is still running using 100% of one CPU-core and the MaintThread checks the perl modules for upgrade using also one core at 100%, you have 7 workers running each is still processing a mail and generates minimum 50 SQL querys per mail and processes several of the large regular expressons - even if there is nothing other running on your system than assp and mysql - 4 CPU cores are tooooooo less in this case. >"warning: got database error Database select statement failed: MySQL server has gone away The MySQL server has terminated the connection !!! This should never happen! And - I hope assp V2 was not your starting point for using ASSP. V2 is called the professional version. Which does'nt mean that it is made by professionals - it is made for professionals. Professionals ... ?? let me explain in what skills you need more than the 'IT-basics' to use ASSP V2. - SMTP handshake, mail/MIME stucture, encodings, charsets - you should know what SPF, SRS, DKIM, BATV are and how they are used - some LDAP knowledge will help - setup and manage the DB of your choice to be used by assp, how its perl driver is implemented and configured - perl regular expression (and the assp addons to that) - system hardware design (disk IO optimization) - OS/kernel switches and functions and there optimized usage - DNS server setup - the usage of DNSBL queries - it helps to know perl and if possible its threadding model - if BerkeleyDB is used you should know how to backup / restore and to repair it - if the ASSP_OCR plugin is used also for OCR - tesseract should be well known - if the ASSP_ARC plugin is used - openssl should be known - some more than basic SSL skills are fine - enhanced SNMP skills are required to use the assp SNMP interface - some programing skills in perl, HTML and JAVA script, if you want to modify the Blockreports And you should have read the complete GUI one time - some of the parts possibly more times. This will help you to get an overview and to see important hints and to remember them some time. Thomas Von: "Pontus Karlsson" <pon...@scandinavianhosting.se> An: <assp-test@lists.sourceforge.net> Datum: 03.04.2012 12:40 Betreff: Re: [Assp-test] Antwort: Stable versions? Hi again! Ok, sarcasm or not, you then recommend always having mysql on a separate server, right? You say: "looks like the rebuild task uses no database for the internal hashes!?" How can I check this? All is checked for mysql use in the ASSP interface. Are there switches elsewhere to set? Regards, Pontus Btw, will switch to latest release when time is given. -----Original Message----- From: Thomas Eckardt [mailto:thomas.ecka...@thockar.com] Sent: den 3 april 2012 10:17 To: pontus.karls...@scandinavianhosting.se; ASSP development mailing list Subject: Antwort: [Assp-test] Stable versions? >The mysql(5.1.61) is located on the server itself An nice system design!? If assp requests some hundreds of MySQL records and some other threads are doing regexes at the same time - and the MySQl server uses multiple threads to process the request, ASSP and MySQL are fighting against each other for system resources. Yes, such a setup could work for some configurations. but if not - use a separate system for the DB. An bad designed regular expression could cause the same issue. I use such a setup on a low load system (2000 mails a day) with 6GB RAM and 4 CPU cores. >Question: what other version could be considered to be "stable"? All my systems are running the latest dev version (2.1.2) every time - never saw a major problem . >I think it has something to do with the fact that ASSP goes from 1Gb to >4Gb(all of the servers memory) memory consumption in less than 3 days. An ASSP system should never swap memory! 1GB at startup - this is only normal (if DB: is used for all main lists and hashes) for a setup of 8-10 SMTP workers on a 64 Bit Perl. 4Gb(all of the servers memory) - looks like the rebuild task uses no database for the internal hashes!? Thomas Von: "Pontus Karlsson" <pon...@scandinavianhosting.se> An: <assp-test@lists.sourceforge.net> Datum: 02.04.2012 13:53 Betreff: [Assp-test] Stable versions? Hi! I run ASSP version 2.1.2(12064) mostly due to read "recommendations" on this list, but during a test period of 4 days it sometimes flip and I get loads of: "warning: got database error Database select statement failed: MySQL server has gone away at sub main::checkDBCon line 27 thread 6 on table delaywhitedb - try to reconnect" Then it all go ballistic... (And I get nuked with error reports 800+ in the assp log it escalates with loads of mysql errors) I think it has something to do with the fact that ASSP goes from 1Gb to 4Gb(all of the servers memory) memory consumption in less than 3 days. The mysql(5.1.61) is located on the server itself and is using localhost when connecting so I am confused to find there would be a problem to connect to it. I would think ASSP steals all the memory and there is no left to create mysqlconnections. I run all this on Debian Squeeze(6.0.4). Question: what other version could be considered to be "stable"? (I guess one would say/think the latest... is it?) Regards, Pontus ---------------------------------------------------------------------------- -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test DISCLAIMER: ******************************************************* This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the individual to whom it is addressed. This email was multiple times scanned for viruses. There should be no known virus in this email! ******************************************************* ---------------------------------------------------------------------------- -- Better than sec? Nothing is better than sec when it comes to monitoring Big Data applications. Try Boundary one-second resolution app monitoring today. Free. http://p.sf.net/sfu/Boundary-dev2dev _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test DISCLAIMER: ******************************************************* This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the individual to whom it is addressed. This email was multiple times scanned for viruses. There should be no known virus in this email! ******************************************************* ------------------------------------------------------------------------------ Better than sec? Nothing is better than sec when it comes to monitoring Big Data applications. Try Boundary one-second resolution app monitoring today. Free. http://p.sf.net/sfu/Boundary-dev2dev _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test
