Hi, i have more or less your table sizes on mysql.
I use mysql for spamdb, hmmdb and other 22 tables (whitelist, pbblack,
caches, ...).
i have 1 master and 1 slave assp and the mysql database is on the slave.
my spamdb (411mb) has ~4.4million rows and my hmmdb (348mb) has ~3.3millon
rows.
Each assp host processes ~52k message per day and has 10 workers running.
No delay here on startup.
The slave, having local mysql, starts faster than the master, which
accesses mysql on the network and starts in, like, 7 seconds.
But i have good performing servers (4cpu, 8gb ram).
Regards,
On Wed, Mar 16, 2016 at 3:30 PM, Jay <h...@herodata.com> wrote:
> Good day everyone.
>
> I am hoping someone can give me some guidance on this. Here's some info
> and the issue I am dealing with:
>
> We are using ASSP 2.4.5(15272) with ActiveState Perl 5.16.3 (32bit). We
> also use MySQL(5.1.45) as our database back end. The only data that we
> send through MySQL is the spamdb and HMMdb.
>
> Here's some info on MySQL, currently HMMdb is 826mb and has almost
> 5.4million rows. Our spamdb is currently at 237mb and has almost 1.9
> million rows. We have a lot more users on our mail server now than we
> did when we started using ASSP which has been in place for several years
> now. Close to 8 years at this point.
>
> Problems:
> 1. So the first issue I am dealing with is when we have to restart ASSP,
> it can take several minutes for ASSP to be ready because it appears the
> hold up at this point is MySQL. MySQL is slow to send the info needed to
> ASSP and thus holds up the SMTP processing of email. I realize this and
> am planning on making whatever changes I need to get this resolved.
>
> 2. Trying to use the spamdb and HMMdb files resident in memory at this
> point is an issue because we are using Perl 32bit. Once the perl service
> hits 1.8GB of ram it crashes instantly. I researched this and it is a
> know problem with Perl 32bit unless USE_64_BIT_INT enabled and compiled
> in that version of Perl. I want to use the HMM and spamdb in
> conjunction with each other.
>
> 3. Strawberry Perl has a build specially for still using a 32bit build
> but have the USE_64_BIT_INT enabled in the build so 32bit Perl can use
> 3GB of ram total. The other alternative is to use 64bit Perl, but I
> remember in the past trying this and ASSP would just crash within a few
> seconds after starting. Reading through the previous knowledge base
> there was at one point the discussion that not all modules on CPAN are
> compiled in 64bit. So the consensus was to use 32bit Perl. Is this still
> the case anymore or does it make sense to move to Perl 64bit?
>
> So I realize that MySQL is not really cutting it for us any longer. We
> are out growing it quickly. For now I turned off DoHMM so we don't have
> to wait for several minutes for ASSP to start up. Once we disabled
> DoHMM, ASSP starts within 30 seconds. This is only a temporary measure
> until I can get some guidance on what to do about Perl. Anyone out there
> using either the special build of Strawberry Perl with the
> USE_64_BIT_INT enabled? Or successfully using 64bit Perl itself?
>
> Please let me know and thank you any assistance. I really appreciate it.
>
>
>
>
> ------------------------------------------------------------------------------
> Transform Data into Opportunity.
> Accelerate data analysis in your applications with
> Intel Data Analytics Acceleration Library.
> Click to learn more.
> http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
> _______________________________________________
> Assp-user mailing list
> Assp-user@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/assp-user
>
--
"Madness, like small fish, runs in hosts, in vast numbers of instances."
Nessuno mi pettina bene come il vento.
------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
_______________________________________________
Assp-user mailing list
Assp-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/assp-user
