So here's my next question here, the version of Perl we use is from
ActiveState. I have been researching some information on 32bit Perl and
found an interesting post. It has to do with /LARGEADDRESSAWARE, which
allows the memory limit to expand from 1.8GB to 3.6GB. Now the version
of Perl we are using is 5.16.3 and running perl -V in the command line
the ActiveState Perl is not compiled with LARGEADDRESSAWARE active. I
did however see that some versions of strawberry perl 32bit are compiled
with the largeaddressaware switch turned on.
Anybody use strawberry perl with ASSP? Any issues? The version I am
looking at is 5.18.0.1 which is compiled with the LARGEADDRESSAWARE enabled.
When the largeaddressaware is enabled your perl -V output will look
similar to this:
Platform:
osname=MSWin32, osvers=4.0, archname=MSWin32-x86-multi-thread-64int
I appreciate any input/advice. Thank you in advance.
On 10/22/2015 3:17 PM, Jay wrote:
Good Day Thomas.
So I have further information from the command line:
perl.exe *32 this time died at 1.82GB ram usage in the taskmanager.
Here's the last 2 lines in the command window when perl.exe
disappeared from the taskmanager:
Oct-22-15 15:08:00 [Worker_5] Disconnected: session:705DDD84
104.206.121.4 - pro
cessing time 1 seconds
Error in my_thread_global_end(): 10 threads didn't exit
So this would lead me to believe that perl for some reason just drops
off unexpectedly.
Here's a few lines from the rebuildrun.txt and rebuilddebug.txt:
Rebuildrun.txt:
Oct-22-15 14:53:23 C:/ASSP/notspam
Oct-22-15 14:53:24 File Count: 94,245
Oct-22-15 14:53:24 Processing... notspam with 21,000 files
Oct-22-15 14:54:03 ignore and remove files older than Sep-21-15
14:53:23 in folder notspam
RebuildDebugr.txt:
Oct-22-15 15:08:05 file (9533)[0]: C:/ASSP/notspam/14692--4655619.eml
Oct-22-15 15:08:05 file (9534)[0]: C:/ASSP/notspam/4894--4655620.eml
Oct-22-15 15:08:05 file (9535)[0]: C:/ASSP/notspam/8649--4655618.eml
Oct-22-15 15:08:05 file (9536)[0]: C:/ASSP/notspam/19865--4655617.eml
Oct-22-15 15:08:05 file (9537)[0]: C:/ASSP/notspam/3469--4655615.eml
Oct-22-15 15:08:05 file (9538)[0]: C:/ASSP/notspam/11129--4655614.eml
On 10/22/2015 11:06 AM, Jay wrote:
Good day Thomas.
We don't use the BerkleyDB. UseBerkleyDB is off and useDB4Rebuild is
off.
Last section in rebuildrun.txt:
Oct-20-15 17:02:44 c:/assp/notspam
Oct-20-15 17:02:45 File Count: 88,069
Oct-20-15 17:02:45 Processing... notspam with 21,000 files
Oct-20-15 17:03:23 ignore and remove files older than Sep-19-15
17:02:44 in folder notspam
I already have a rebuilddebug.txt file in place. Here's the last
section:
Oct-20-15 17:08:48 file (4122)[0]: c:/assp/notspam/1098--4653603.eml
Oct-20-15 17:08:48 1 ham-attachment/image entries processed in file
c:/assp/notspam/1098--4653603.eml
I will run ASSP in cmd line mode and see what displays in the cmd
window. Hopefully it will give me a clue as to what is causing this.
Do you think General Debug Mode /(debug)/ <javascript:void(0);> might
be useful here as well?
I appreciate the advice and help. Thank you.
On 10/22/2015 3:56 AM, Thomas Eckardt wrote:
- is the Perl module BerkeleyDB installed ?
- is 'useDB4Rebuild' set to on ?
- start assp interactive (cmd) - start the rebuild - the last lines
in the
cmd windows may show the reason
- have a look in to rebuildrun.txt - what is the last line logged
there ?
- in addition you may enable the debug output of the rebuild task
(create
the file rebuilddebug.txt)
It seems to die around 1.8GB
the 4GB limit is imposed for the value of 'physical + virtual' memory !
I do have a memory limit set in ASSP but I have
that set to 3096mb which would be 3GB of ram.
While the rebuild is running, the internal memory usage check is
switched
off.
Thomas
Von: Jay <[email protected]>
An: For Users of ASSP <[email protected]>
Datum: 21.10.2015 21:13
Betreff: [Assp-user] SpamDB rebuild dies
So I have a weird issue happening all of the sudden. We are using ASSP
version 2.4.5(15162) and I have RebuildSchedule set for a 6am rebuild
everyday on our Windows mail server. We are running a 64bit version of
Windows 7 on our mail server and use the 32bit version of Perl
5.16.3(1604). The server itself is using a Core i7 3.4GHz processor and
16GB of ram. There are some days when the rebuild finishes fine but
most
days it seems the rebuild just dies in the middle of it and never
finishes. It even happens when I kick the rebuild off manually.
So today I kicked off the rebuild manually through the email interface
on the server and watched the task manager to see where the rebuild
would die. It seems to die around 1.8GB of ram the Perl 32 just drops
off the task manager. I do have a memory limit set in ASSP but I have
that set to 3096mb which would be 3GB of ram. Looking at my ASSP log
file there is no indication that ASSP is restarting at all (which it
shouldn't be yet) and the log just stops when Perl died which is to be
expected. I have to start the ASSP service back up again. Any idea if
Perl has a memory usage upper limit? I know being 32bit a 4GB limit is
imposed on any 32bit application but I am not even getting close to
that.
I checked the version of all the modules I have active on the server in
ASSP and either they are the same version that is required or higher in
some cases. Anyone else run into a similar situation with this? I
checked through my system logs and nothing there is indicating an issue
anywhere. We use MySQL for our spamdb and hmmdb.
Thank you ahead of time for any input/advice. I appreciate it.
------------------------------------------------------------------------------
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user
DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential,
legally
privileged and protected in law and are intended solely for the use
of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no
known virus in this email!
*******************************************************
------------------------------------------------------------------------------
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user
-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 2015.0.6173 / Virus Database: 4450/10870 - Release Date:
10/22/15
------------------------------------------------------------------------------
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user
-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 2015.0.6173 / Virus Database: 4450/10870 - Release Date:
10/22/15
------------------------------------------------------------------------------
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user
-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 2015.0.6173 / Virus Database: 4450/10870 - Release Date: 10/22/15
------------------------------------------------------------------------------
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user
