Masood,
>warning: got unexpected signal SEGV.....
These error are most related to the regex engine of Perl. Maybe the reason
is a very high (100%) CPU workload over some time.
>Worker_2: Can't call method
"fetchrow_arrayref" on an undefined value at
The MySQL server was not able to do a SQL-select statement. Is the MySQL
server running on the same system ? Maybe Perl (assp) , MySQL, ClamAV and
possibly some other processes are fighting for system resources!?
It looks like the system is going out of system resources (memory -
CPU-time). Keep in mind (as I've told you) - running 10 SMTP-Workers (13
threads) + MySQL + ClamAV .... on a very high workload system will need
a (dual? ) quadcore system (switch off hyperthreading - this will produce
an unneeded overhead with Perl)! How much memory is used by assp? What is
the average CPU usage of assp in relation to the whole system?
Thomas
Von: "Masood Rahim" <mas...@intertune.com>
An: <assp-test@lists.sourceforge.net>
Datum: 17.03.2010 18:31
Betreff: Re: [Assp-test] Assp dying
So after almost 20 hours of testing with using the mysql database instead
of
the flatfiles and the BerkeleyDB options for caching, the assp v2 process
on
this box that I am testing it on is still dying. It has died twice.
There is an exception.log file but it doesn't seem to provide any
information around the time the process died. I just see many entries for
the following: Mar-16-10 12:37:33 Error: Worker_2: Can't call method
"fetchrow_arrayref" on an undefined value at
/usr/local/lib/perl5/site_perl/5.10.1/Tie/RDBM.pm line 166.
I did find the following debugSignal.txt file which looks like it does
contain some errors from right around the time before the server crashed:
Mar-08-10 16:00:38 warning: got unexpected signal ALRM in Worker_10001:
package - main, file - assp.pl, line - 38606!
Mar-08-10 18:15:00 warning: got unexpected signal ALRM in Main_Thread:
package - main, file - assp.pl, line - 37079!
Mar-11-10 20:36:57 warning: got unexpected signal SEGV in Worker_3:
package
- main, file - assp.pl, line - 17523!
Mar-13-10 00:36:01 warning: got unexpected signal ALRM in Main_Thread:
package - Encode::Guess, file -
/usr/local/lib/perl5/5.10.1/i686-linux/Encode/Guess.pm, line - 139!
Mar-13-10 00:37:33 warning: got unexpected signal ALRM in Main_Thread:
package - IO::Socket::INET, file -
/usr/local/lib/perl5/5.10.1/i686-linux/IO/Socket/INET.pm, line - 270!
Mar-13-10 00:38:29 warning: got unexpected signal ALRM in Main_Thread:
package - Encode::Guess, file -
/usr/local/lib/perl5/5.10.1/i686-linux/Encode/Guess.pm, line - 134!
Mar-13-10 01:44:25 warning: got unexpected signal SEGV in Worker_10:
package
- main, file - assp.pl, line - 18160!
Mar-13-10 05:15:18 warning: got unexpected signal SEGV in Worker_4:
package
- main, file - assp.pl, line - 17554!
Mar-13-10 08:39:14 warning: got unexpected signal SEGV in Worker_9:
package
- main, file - assp.pl, line - 17554!
Mar-15-10 11:48:50 warning: got unexpected signal SEGV in Worker_9:
package
- main, file - assp.pl, line - 17554!
Mar-16-10 06:34:40 warning: got unexpected signal SEGV in Worker_3:
package
- Email::Simple, file -
/usr/local/lib/perl5/site_perl/5.10.1/Email/Simple.pm, line - 89!
Mar-17-10 09:52:32 warning: got unexpected signal SEGV in Worker_1:
package
- main, file - assp.pl, line - 17907!
Any help is greatly appreciated, I am out of ideas and hope the
information
above helps.
Thanks,
Masood
-----Original Message-----
From: assp-test-requ...@lists.sourceforge.net
[mailto:assp-test-requ...@lists.sourceforge.net]
Sent: Wednesday, March 17, 2010 4:41 AM
To: assp-test@lists.sourceforge.net
Subject: Assp-test Digest, Vol 32, Issue 33
Send Assp-test mailing list submissions to
assp-test@lists.sourceforge.net
To subscribe or unsubscribe via the World Wide Web, visit
https://lists.sourceforge.net/lists/listinfo/assp-test
or, via email, send a message with subject or body 'help' to
assp-test-requ...@lists.sourceforge.net
You can reach the person managing the list at
assp-test-ow...@lists.sourceforge.net
When replying, please edit your Subject line so it is more specific than
"Re: Contents of Assp-test digest..."
Today's Topics:
1. Re: Assp dying (Thomas Eckardt)
2. Re: DB_File (Thomas Eckardt)
3. Re: Assp dying (GrayHat)
4. Re: DB_File (GrayHat)
5. Re: DB_File (Scott MacLean)
6. Re: Assp dying (Scott MacLean)
----------------------------------------------------------------------
Message: 1
Date: Wed, 17 Mar 2010 06:45:09 +0100
From: Thomas Eckardt <thomas.ecka...@thockar.com>
Subject: Re: [Assp-test] Assp dying
To: ASSP development mailing list <assp-test@lists.sourceforge.net>
Message-ID:
<titc.3692ca544f.of60da4747.bdb0ae74-onc12576e9.001f8437-c12576e9.001f9...@t
hockar.com>
Content-Type: text/plain; charset="us-ascii"
>Inside this GZip archive is a file named assp.pl, which unpacks to
396,392 bytes.
I'm unable to reproduce this. Has anyone else seen this 'problem'?
Thomas
Von: Scott MacLean <a...@hollsco.com>
An: ASSP development mailing list <assp-test@lists.sourceforge.net>
Datum: 17.03.2010 03:18
Betreff: Re: [Assp-test] Assp dying
At 01:48 PM 3/16/2010, Thomas Eckardt wrote:
> >This double GZipped,
>
>No it is not double GZipped - it is also used by the autoupdate and this
>would fail if it where wrong GZipped.
I beg to differ. The file I downloaded this afternoon is assp.pl.gz,
and was 396,535 bytes.
Inside this GZip archive is a file named assp.pl, which unpacks to
396,392 bytes.
This assp.pl file, if renamed to assp.pl.gz and opened as a gzip
file, contains another assp.pl file, dated 3/12/2010 4:11 PM, and
which unpacks to 1,823,065 bytes.
> > ASSP dying
>
>Run assp in console mode - this should give you more informations. btw.:
>is there a file exception.log ? and what is in there?
There is no exception.log file.
I can't run it in console mode, because this is a production machine,
and I need my watchdog process to be able to restart the service should it
die.
I should note that unlike Masood's experiences, version 2 has been
ROCK SOLID for me for a very long time, and it is only with the most
recent couple versions that I have been experiencing this dying problem.
----------------------------------------------------------------------------
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Assp-test mailing list
Assp-test@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/assp-test
DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally
privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no
known virus in this email!
*******************************************************
------------------------------
Message: 2
Date: Wed, 17 Mar 2010 06:55:23 +0100
From: Thomas Eckardt <thomas.ecka...@thockar.com>
Subject: Re: [Assp-test] DB_File
To: ASSP development mailing list <assp-test@lists.sourceforge.net>
Message-ID:
<titc.169289ff7e.ofe0be30f0.6401516d-onc12576e9.001fb41c-c12576e9.00208...@t
hockar.com>
Content-Type: text/plain; charset="us-ascii"
>What would you recommend? Stick with flat files, mysql, mssql if
possible, berkeley, a mix?
Using flat files is the most worth option for V2 - but it should work for
the default setup (max 5 Workers and no warnings about too large hashes at
startup).
This depend on the size of the flat files. Use the RDBM (SQL) DB of your
choice (MySQL,MSSQL,Oracle,ProstgreSQL,DB2) for the main lists and hashes
and BerkeleyDB for the others.
In the past we had some problems using BerkeleyDB for the main hashes -
but this is fixed. Using BerkeleyDB for the main hashes needs more DB
knowledge, if more than 7 SMTP-Workers are running.
Thomas
Von: K Post <nntp.p...@gmail.com>
An: ASSP development mailing list <assp-test@lists.sourceforge.net>
Datum: 17.03.2010 03:39
Betreff: Re: [Assp-test] DB_File
Excellent. I'll try this out in the morning and see what it reports.
I've always run our server without traditional databases and have just
have everything in flat files. We're seeing a startup memory usage of
around 700mb, growing to 1.3gb+ after it runs for a while. I am
asuming that using a database will greatly reduce that usage and speed
things up.
I want to continue to keep maintenance needs on this server low. I've
used mysql before, but i'm by no means an expert. I know MSSQL really
well, but presume that doesn't work with ASSP. I know nothing about
berkeleydb and have never run it.
What would you recommend? Stick with flat files, mysql, mssql if
possible, berkeley, a mix?
Your experience is appreciated.
Ken
On Tue, Mar 16, 2010 at 2:35 AM, Thomas Eckardt
<thomas.ecka...@thockar.com> wrote:
> The module name is "DB_File" (case sensitive !!).
>
> Thomas
>
>
>
> Von: K Post <nntp.p...@gmail.com>
> An: ASSP development mailing list <assp-test@lists.sourceforge.net>
> Datum: 15.03.2010 14:02
> Betreff: Re: [Assp-test] DB_File
>
>
>
> Using your suggestion, from the compress:zlib thread:
>
> C:\>perl -e "use db_file"
> Can't locate db_file.pm in @INC (@INC contains: C:/Perl/site/lib
> C:/Perl/lib .)
> at -e line 1.
> BEGIN failed--compilation aborted at -e line 1.
>
> Thanks
> On Mon, Mar 15, 2010 at 1:20 AM, Thomas Eckardt
> <thomas.ecka...@thockar.com> wrote:
>> DB_File should be part of default Perl installation (Active Perl for
>> example)!
>>
>> Thomas
>>
>>
>> Von: K Post <nntp.p...@gmail.com>
>> An: ASSP development mailing list <assp-test@lists.sourceforge.net>
>> Datum: 14.03.2010 21:25
>> Betreff: [Assp-test] DB_File
>>
>>
>>
>> Where can I find the DB_File perl module for windows 32? Is doesn't
>> seem to be in assp.mod.
>>
>> Thanks
>>
>>
>
----------------------------------------------------------------------------
--
>> Download Intel® Parallel Studio Eval
>> Try the new software tools for yourself. Speed compiling, find bugs
>> proactively, and fine-tune applications for parallel performance.
>> See why Intel Parallel Studio got high marks during beta.
>> http://p.sf.net/sfu/intel-sw-dev
>> _______________________________________________
>> Assp-test mailing list
>> Assp-test@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/assp-test
>>
>>
>>
>>
>> DISCLAIMER:
>> *******************************************************
>> This email and any files transmitted with it may be confidential,
> legally
>> privileged and protected in law and are intended solely for the use of
> the
>>
>> individual to whom it is addressed.
>> This email was multiple times scanned for viruses. There should be no
>> known virus in this email!
>> *******************************************************
>>
>>
>>
>
----------------------------------------------------------------------------
--
>> Download Intel® Parallel Studio Eval
>> Try the new software tools for yourself. Speed compiling, find bugs
>> proactively, and fine-tune applications for parallel performance.
>> See why Intel Parallel Studio got high marks during beta.
>> http://p.sf.net/sfu/intel-sw-dev
>> _______________________________________________
>> Assp-test mailing list
>> Assp-test@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/assp-test
>>
>
>
----------------------------------------------------------------------------
--
> Download Intel® Parallel Studio Eval
> Try the new software tools for yourself. Speed compiling, find bugs
> proactively, and fine-tune applications for parallel performance.
> See why Intel Parallel Studio got high marks during beta.
> http://p.sf.net/sfu/intel-sw-dev
> _______________________________________________
> Assp-test mailing list
> Assp-test@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/assp-test
>
>
>
>
> DISCLAIMER:
> *******************************************************
> This email and any files transmitted with it may be confidential,
legally
> privileged and protected in law and are intended solely for the use of
the
>
> individual to whom it is addressed.
> This email was multiple times scanned for viruses. There should be no
> known virus in this email!
> *******************************************************
>
>
>
>
----------------------------------------------------------------------------
--
> Download Intel® Parallel Studio Eval
> Try the new software tools for yourself. Speed compiling, find bugs
> proactively, and fine-tune applications for parallel performance.
> See why Intel Parallel Studio got high marks during beta.
> http://p.sf.net/sfu/intel-sw-dev
> _______________________________________________
> Assp-test mailing list
> Assp-test@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/assp-test
>
>
----------------------------------------------------------------------------
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Assp-test mailing list
Assp-test@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/assp-test
DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally
privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no
known virus in this email!
*******************************************************
------------------------------
Message: 3
Date: Wed, 17 Mar 2010 08:36:57 +0100
From: "GrayHat" <gray...@gmx.net>
Subject: Re: [Assp-test] Assp dying
To: "ASSP development mailing list" <assp-test@lists.sourceforge.net>
Message-ID: <006e01cac5a4$9fa9e360$1400a...@apra.it>
Content-Type: text/plain; charset="iso-8859-1"
> I'm unable to reproduce this. Has anyone else seen this 'problem'?
I think it's due to the program used to open the file, some "zip"
critters don't really know how to deal with gzipped or tar-gzipped
files and when you open such files they'll just show a compressed
file inside another file; just for a test, I opened the assp.pl.gz
sitting
into the download folder of an ASSP instance using IZarc (that's
an open source windows archiver, http://www.izarc.org/) and it
correctly shows the "pl" file, no "binary" or whatever
------------------------------
Message: 4
Date: Wed, 17 Mar 2010 08:54:52 +0100
From: "GrayHat" <gray...@gmx.net>
Subject: Re: [Assp-test] DB_File
To: "ASSP development mailing list" <assp-test@lists.sourceforge.net>
Message-ID: <009101cac5a7$2051ea10$1400a...@apra.it>
Content-Type: text/plain; charset="iso-8859-1"
> Using your suggestion, from the compress:zlib thread:
>
> C:\>perl -e "use db_file"
> Can't locate db_file.pm in @INC (@INC contains: C:/Perl/site/lib
C:/Perl/lib
> .) at -e line 1.
> BEGIN failed--compilation aborted at -e line 1.
Did you download/extract the "assp.mod" file and run the installer ?
That one will add some repositories to your Perl installation and
will install all the needed modules; just for a test, try running the
following
ppm s DB_File
and post here the complete output
------------------------------
Message: 5
Date: Wed, 17 Mar 2010 07:38:19 -0400
From: Scott MacLean <a...@hollsco.com>
Subject: Re: [Assp-test] DB_File
To: ASSP development mailing list <assp-test@lists.sourceforge.net>
Message-ID: <e77e2a13-3049-4ba9-8f67-208a34c87...@mail.frogstar.com>
Content-Type: text/plain; charset="us-ascii"; format=flowed
Thomas,
Is there an elegant way to move a server from flat files to MSSQL
(the server has a fast MSSQL server available, so I'd like to use it)
without losing data?
At 01:55 AM 3/17/2010, Thomas Eckardt wrote:
>This depend on the size of the flat files. Use the RDBM (SQL) DB of your
>choice (MySQL,MSSQL,Oracle,ProstgreSQL,DB2) for the main lists and hashes
>and BerkeleyDB for the others.
>In the past we had some problems using BerkeleyDB for the main hashes -
>but this is fixed. Using BerkeleyDB for the main hashes needs more DB
>knowledge, if more than 7 SMTP-Workers are running.
>
>Thomas
------------------------------
Message: 6
Date: Wed, 17 Mar 2010 07:39:32 -0400
From: Scott MacLean <a...@hollsco.com>
Subject: Re: [Assp-test] Assp dying
To: GrayHat <gray...@gmx.net>, ASSP development mailing list
<assp-test@lists.sourceforge.net>
Message-ID: <b485bb4e-07e3-4769-8c7b-c5a8eb74f...@mail.frogstar.com>
Content-Type: text/plain; charset="us-ascii"; format=flowed
You're correct. I was using WinRAR, which has never given me problems
before. I tried IZarc on the same file, and it worked correctly.
At 03:36 AM 3/17/2010, GrayHat wrote:
>I think it's due to the program used to open the file, some "zip"
>critters don't really know how to deal with gzipped or tar-gzipped
>files and when you open such files they'll just show a compressed
>file inside another file; just for a test, I opened the assp.pl.gz
>sitting
>into the download folder of an ASSP instance using IZarc (that's
>an open source windows archiver, http://www.izarc.org/) and it
>correctly shows the "pl" file, no "binary" or whatever
------------------------------
----------------------------------------------------------------------------
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
------------------------------
_______________________________________________
Assp-test mailing list
Assp-test@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/assp-test
End of Assp-test Digest, Vol 32, Issue 33
*****************************************
------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Assp-test mailing list
Assp-test@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/assp-test
DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally
privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no
known virus in this email!
*******************************************************
------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Assp-test mailing list
Assp-test@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/assp-test
