>Pertaining to the USE_64_BIT_INT flag, I think we are not on the same
>page here. The build of Perl I am using does not have the USE_64_BIT_INT
>enabled. So I run into the situation where Perl dies at 1.8GB of ram
>usage. Sorry for the confusion and I didn't mean to aggravate anyone. I
>just figured I would ask if anyone has used Strawberry Perl with that
>flag enabled. I will figure it out.
What we are doing here - IT?
Perl 32 Bit is limited to 4GB memory - it does'nt matter, if the
USE_64_BIT_INT flag is set or not.
The USE_64_BIT_INT flag enables the 64Bit integer variable usage and
calculation in Perl.
Because assp does not use any integer variable that breaks the 32Bit
limit, the usage of the USE_64_BIT_INT flag is useless - it only allocates
more memory.
If you want to break the 4GB limit, you have to use a 64Bit Perl.
>Strawberry Perl
Strawberry Perl 64Bit is the only 64Bit Perl than can be used on Windows
for assp. ActivePerl 64 Bit misses too many XS modules - how ever, even
this can be used with some XS and include modifications for several
modules and the right compiler.
Thomas
Von: Jay <h...@herodata.com>
An: assp-user@lists.sourceforge.net
Datum: 18.03.2016 14:42
Betreff: Re: [Assp-user] A few questions on ASSP.....
Good day Thomas.
Thank you for the follow up. I suspected MySQL already and to be more
exact, the HMM table. I already have a plan to install MySQL 5.5 and
port the database over. Most likely I am going to have to start HMM over
again fresh.
Pertaining to the USE_64_BIT_INT flag, I think we are not on the same
page here. The build of Perl I am using does not have the USE_64_BIT_INT
enabled. So I run into the situation where Perl dies at 1.8GB of ram
usage. Sorry for the confusion and I didn't mean to aggravate anyone. I
just figured I would ask if anyone has used Strawberry Perl with that
flag enabled. I will figure it out.
Thanks anyways.
On 3/18/2016 7:30 AM, Thomas Eckardt wrote:
> At startup assp analyzes several databases - spamdb, whitelistdb, HMMdb.
>
> Foreach of these tables a simple 'SELECT COUNT(*) FROM ..' is done. If
> this SQL statement fails for any reason, assp counts records.
>
> Your MySQL server is simply badly installed or configured - it is too
> slow. Even you have 6 million records in table, this statement should
> never take longer than 2 to 5 seconds!
>
>> a know problem with Perl 32bit unless USE_64_BIT_INT enabled
> What has the USE_64_BIT_INT flag to do with the 4GB memory restriction
of
> a 32Bit application?
> (please answer this question your self!)
>
> Thomas
>
>
>
> Von: Jay <h...@herodata.com>
> An: For Users of ASSP <assp-user@lists.sourceforge.net>
> Datum: 16.03.2016 15:47
> Betreff: [Assp-user] A few questions on ASSP.....
>
>
>
> Good day everyone.
>
> I am hoping someone can give me some guidance on this. Here's some info
> and the issue I am dealing with:
>
> We are using ASSP 2.4.5(15272) with ActiveState Perl 5.16.3 (32bit). We
> also use MySQL(5.1.45) as our database back end. The only data that we
> send through MySQL is the spamdb and HMMdb.
>
> Here's some info on MySQL, currently HMMdb is 826mb and has almost
> 5.4million rows. Our spamdb is currently at 237mb and has almost 1.9
> million rows. We have a lot more users on our mail server now than we
> did when we started using ASSP which has been in place for several years
> now. Close to 8 years at this point.
>
> Problems:
> 1. So the first issue I am dealing with is when we have to restart ASSP,
> it can take several minutes for ASSP to be ready because it appears the
> hold up at this point is MySQL. MySQL is slow to send the info needed to
> ASSP and thus holds up the SMTP processing of email. I realize this and
> am planning on making whatever changes I need to get this resolved.
>
> 2. Trying to use the spamdb and HMMdb files resident in memory at this
> point is an issue because we are using Perl 32bit. Once the perl service
> hits 1.8GB of ram it crashes instantly. I researched this and it is a
> know problem with Perl 32bit unless USE_64_BIT_INT enabled and compiled
> in that version of Perl. I want to use the HMM and spamdb in
> conjunction with each other.
>
> 3. Strawberry Perl has a build specially for still using a 32bit build
> but have the USE_64_BIT_INT enabled in the build so 32bit Perl can use
> 3GB of ram total. The other alternative is to use 64bit Perl, but I
> remember in the past trying this and ASSP would just crash within a few
> seconds after starting. Reading through the previous knowledge base
> there was at one point the discussion that not all modules on CPAN are
> compiled in 64bit. So the consensus was to use 32bit Perl. Is this still
> the case anymore or does it make sense to move to Perl 64bit?
>
> So I realize that MySQL is not really cutting it for us any longer. We
> are out growing it quickly. For now I turned off DoHMM so we don't have
> to wait for several minutes for ASSP to start up. Once we disabled
> DoHMM, ASSP starts within 30 seconds. This is only a temporary measure
> until I can get some guidance on what to do about Perl. Anyone out there
> using either the special build of Strawberry Perl with the
> USE_64_BIT_INT enabled? Or successfully using 64bit Perl itself?
>
> Please let me know and thank you any assistance. I really appreciate it.
>
>
>
>
------------------------------------------------------------------------------
> Transform Data into Opportunity.
> Accelerate data analysis in your applications with
> Intel Data Analytics Acceleration Library.
> Click to learn more.
> http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
> _______________________________________________
> Assp-user mailing list
> Assp-user@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/assp-user
>
>
>
>
>
>
> DISCLAIMER:
> *******************************************************
> This email and any files transmitted with it may be confidential,
legally
> privileged and protected in law and are intended solely for the use of
the
>
> individual to whom it is addressed.
> This email was multiple times scanned for viruses. There should be no
> known virus in this email!
> *******************************************************
>
>
>
>
>
------------------------------------------------------------------------------
> Transform Data into Opportunity.
> Accelerate data analysis in your applications with
> Intel Data Analytics Acceleration Library.
> Click to learn more.
> http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
>
>
> _______________________________________________
> Assp-user mailing list
> Assp-user@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/assp-user
>
>
> -----
> No virus found in this message.
> Checked by AVG - www.avg.com
> Version: 2016.0.7497 / Virus Database: 4542/11829 - Release Date:
03/17/16
------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
_______________________________________________
Assp-user mailing list
Assp-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/assp-user
DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally
privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no
known virus in this email!
*******************************************************
------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
_______________________________________________
Assp-user mailing list
Assp-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/assp-user
