Hi Pascal,
I've just relased ASSP_WordStem.pm 1.06 on CVS.
The stemming engine is switched to Lingua::Stem::Snowball (Dutch is now
available). Leave the module as is - and try it.
You have to install Lingua::Stem::Snowball via ppm or CPAN!
Thomas
Von: Pascal Dreissen <[email protected]>
An: ASSP development mailing list <[email protected]>
Datum: 05.08.2011 18:45
Betreff: Re: [Assp-test] Antwort: Re: fixes and news in
2.0.2_3.2.07
Hi Thomas,
Just tried with 3.2.11 and the 1.0.5 WordStem.pm and language set to: our
@langs = ('de','en','fr');
ASSP crashed within a half an hour sorry!
Log starts to fill up very quickly with these messages:
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Aug-05-11 18:36:58 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Does this for a couple of minutes with CPU going through the roof, and
ending:
Aug-05-11 18:39:02 [Main_Thread] Warning: Main_Thread is unable to
transfer connection to any worker - try again!
Aug-05-11 18:39:02 [Main_Thread] Info: notification message queued to sent
to [email protected]
Aug-05-11 18:39:02 [Main_Thread] Error: Main_Thread is unable to transfer
connection to any worker within 120 seconds - restart ASSP!
Aug-05-11 18:39:02 [Main_Thread] Initializing shutdown sequence
Mvg,
Pascal
'An Apple a day keeps the doctor and the viruses away'
Op 5 aug. 2011, om 17:45 heeft Pascal Dreissen het volgende geschreven:
>
> Thomas,
>
> One question though. Is the supported list of languages a restriction of
the perl modules used ? I saw that other perl modules related
Lingua::Stem::Storm for example is providing more languages (for example
dutch :) ).
>
> Thanks again!
>
> Mvg,
>
> Pascal
>
> 'An Apple a day keeps the doctor and the viruses away'
>
> Op 5 aug. 2011, om 17:29 heeft Thomas Eckardt het volgende geschreven:
>
>> Hi Pascal,
>>
>> I also saw such long delays with possible restarts.
>>
>> Edit the .pm
>>
>> reduce the list of languages to detect, to the possible smallest.
>>
>> our @langs = ('da','de','en','fr','ga','it','no','pt','ru','sv');
>>
>> eg.: our @langs = ('de','en','fr');
>>
>> Thomas
>>
>>
>>
>> Von: Pascal Dreissen <[email protected]>
>> An: ASSP development mailing list <[email protected]>
>> Datum: 05.08.2011 17:17
>> Betreff: Re: [Assp-test] fixes and news in 2.0.2_3.2.07
>>
>>
>>
>>
>> Hi Thomas,
>>
>> Had it running for a couple of days (WordStem feature) but on my
install
>> it is unstable. ASSP Crashes every hour when i enabled this option. It
is
>> working as expected, but unstable. I disabled it for the moment and
things
>> are stable again. Also i saw that CPU is kicking 100% for 10 minutes or
so
>> before ASSP decides to shutdown !
>>
>> Running Perl 5.10.1 64 Bit
>>
>> Mvg,
>>
>> Pascal
>>
>> 'An Apple a day keeps the doctor and the viruses away'
>>
>> Op 31 jul. 2011, om 19:34 heeft Thomas Eckardt het volgende geschreven:
>>
>>> Hi all,
>>>
>>> fixed in 2.0.2_3.2.07:
>>>
>>> - the DNSBL check was not working for OIP addresses
>>>
>>> new in 2.0.2_3.2.07:
>>>
>>> - An new module ASSP_WordStem.pm version is available.
>>> If installed in the '[asspBase]/lib' path, this module converts words
>> to
>>> its stem from, for example plural, sigular,future,present,past ....
>>> This should improve the ASSP-Bayes-engine.
>>>
>>> Currently supported languages by this module are :
>>>
>>> DA - Danish
>>> DE - German
>>> EN - English (also EN-US und EN-UK)
>>> FR - French
>>> GL - Galician
>>> IT - Italian
>>> NO - Norwegian
>>> PT - Portuguese
>>> RU - Russian (also RU-RU und RU-RU.KOI8-R)
>>> SV - Swedish
>>>
>>> Undetected and unsupported languages will be processed the same way,
>> like
>>> the module is not available.
>>>
>>> Download the module from assp CVS
>>> http://assp.cvs.sourceforge.net/viewvc/assp/assp2/lib/
>>>
>>> For this module to work, the Perl modules Lingua::Stem and
>>> Lingua::Identify must be installed. To install -
>>>
>>> on windows:
>>> - ppm install Lingua-Stem
>>> - ppm install Lingua-Identify
>>>
>>> on all other platforms:
>>> - cpan install Lingua::Stem
>>> - cpan install Lingua::Identify
>>>
>>> if ask - follow the installation on all dependend modules.
>>>
>>> The improvement is available after the next rebuild of the spamdb.
>>>
>>> You can/should modify the module to your needs. There are two possible
>>> values that could/should be changed
>>>
>>> - line 50 - change the value to the default language you want to use
-
>> eg
>>> 'en','pt' ..... normaly this is your national language (of supported)
-
>> If
>>> your national language is not supprted, set the value to 'en' .
>>> $locale = 'de';
>>>
>>> - line 59 - change the logging level to your needs
>>> $logging = 1;
>>>
>>> Changing the module requires a restart of assp.
>>>
>>> To see if the module is working for you - use the GUI-mail-analyzer
and
>>> set $logging = 1; to $logging = 3;. So assp will write the
>>> unconverted and the converted text to files in [asspBase]/lingua.
>>>
>>> This Bayes enhancement is at experimental state!
>>>
>>> Thomas
>>>
>>> DISCLAIMER:
>>> *******************************************************
>>> This email and any files transmitted with it may be confidential,
>> legally
>>> privileged and protected in law and are intended solely for the use of
>> the
>>>
>>> individual to whom it is addressed.
>>> This email was multiple times scanned for viruses. There should be no
>>> known virus in this email!
>>> *******************************************************
>>>
>>>
>>>
>>
------------------------------------------------------------------------------
>>> Got Input? Slashdot Needs You.
>>> Take our quick survey online. Come on, we don't ask for help often.
>>> Plus, you'll get a chance to win $100 to spend on ThinkGeek.
>>>
>>
http://p.sf.net/sfu/slashdot-survey_______________________________________________
>>
>>> Assp-test mailing list
>>> [email protected]
>>> https://lists.sourceforge.net/lists/listinfo/assp-test
>>
>>
>>
------------------------------------------------------------------------------
>> BlackBerry® DevCon Americas, Oct. 18-20, San Francisco, CA
>> The must-attend event for mobile developers. Connect with experts.
>> Get tools for creating Super Apps. See the latest technologies.
>> Sessions, hands-on labs, demos & much more. Register early & save!
>> http://p.sf.net/sfu/rim-blackberry-1
>> _______________________________________________
>> Assp-test mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/assp-test
>>
>>
>>
>>
>> DISCLAIMER:
>> *******************************************************
>> This email and any files transmitted with it may be confidential,
legally
>> privileged and protected in law and are intended solely for the use of
the
>>
>> individual to whom it is addressed.
>> This email was multiple times scanned for viruses. There should be no
>> known virus in this email!
>> *******************************************************
>>
>>
>>
------------------------------------------------------------------------------
>> BlackBerry® DevCon Americas, Oct. 18-20, San Francisco, CA
>> The must-attend event for mobile developers. Connect with experts.
>> Get tools for creating Super Apps. See the latest technologies.
>> Sessions, hands-on labs, demos & much more. Register early & save!
>>
http://p.sf.net/sfu/rim-blackberry-1_______________________________________________
>> Assp-test mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/assp-test
>
>
>
------------------------------------------------------------------------------
> BlackBerry® DevCon Americas, Oct. 18-20, San Francisco, CA
> The must-attend event for mobile developers. Connect with experts.
> Get tools for creating Super Apps. See the latest technologies.
> Sessions, hands-on labs, demos & much more. Register early & save!
> http://p.sf.net/sfu/rim-blackberry-1
> _______________________________________________
> Assp-test mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
BlackBerry® DevCon Americas, Oct. 18-20, San Francisco, CA
The must-attend event for mobile developers. Connect with experts.
Get tools for creating Super Apps. See the latest technologies.
Sessions, hands-on labs, demos & much more. Register early & save!
http://p.sf.net/sfu/rim-blackberry-1
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test
DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally
privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no
known virus in this email!
*******************************************************
------------------------------------------------------------------------------
BlackBerry® DevCon Americas, Oct. 18-20, San Francisco, CA
The must-attend event for mobile developers. Connect with experts.
Get tools for creating Super Apps. See the latest technologies.
Sessions, hands-on labs, demos & much more. Register early & save!
http://p.sf.net/sfu/rim-blackberry-1
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test
