> but since 9am this morning not a single one. I'm a bit baffled on that 
one..

This depends on the character set of the received mails. Wordstem 1.24 has 
used hard unicode regular expressions on the mail text. For Perl < 5.16 
version 1.25 uses a more soft but less exact regex (same like 1.23).

- the soft separator variant '[^\S]+' (same like '\s+') with the utf8 flag 
set to off will never hang - but is unable to detect multibyte UTF8 
characters

- the soft separator variant '[^\S]+' (same like '\s+') with the utf8 flag 
set to on will never hang - will detect multibyte UTF8 characters , but 
will stop and warn at first unknown (non unicode) byte combination

- the hard separator variant '\P{IsAlpha}' must have the utf8 flag set to 
on - will detect all unicode characters perfectly - but seems to infinity 
loop on some byte combinations (possibly non unicode)  in Perl < 5.16


I develope on Perl 5.16.3 and I've done extensive tests with the hard 
variant on Han, Cyrillic, Greek, Arabic, several (ISO-8859-X) Latins and 
Hebrew . Also mixing several of these unicode scripts in a single mail was 
never a problem.



Thomas




Von:    "Colin Waring" <[email protected]>
An:     "'ASSP development mailing list'" 
<[email protected]>, 
Datum:  07.02.2014 18:14
Betreff:        Re: [Assp-test] ASSP_WordStem.pm 1.25



Hi Thomas,

Thanks for the quick work - I will get it up and running now.

Oddly I had several restarts due to hanging workers last night but since 
9am
this morning not a single one. I'm a bit baffled on that one..

All the best,
Colin Waring.

-----Original Message-----
From: Thomas Eckardt [mailto:[email protected]] 
Sent: 07 February 2014 16:39
To: ASSP development mailing list
Subject: [Assp-test] ASSP_WordStem.pm 1.25

Hi all,

ASSP_WordStem.pm version 1.25 is released on SF-CVS.
It will fix the hanging Workers/rebuildspamdb for Perl version < 5.16. I
don't expect to see this issue on Perl 5.16 and higher.

Responses are wanted!

Thomas


DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally
privileged and protected in law and are intended solely for the use of the 


individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no 
known
virus in this email!
*******************************************************




------------------------------------------------------------------------------
Managing the Performance of Cloud-Based Applications
Take advantage of what the Cloud has to offer - Avoid Common Pitfalls.
Read the Whitepaper.
http://pubads.g.doubleclick.net/gampad/clk?id=121051231&iu=/4140/ostg.clktrk

_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally 
privileged and protected in law and are intended solely for the use of the 

individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no 
known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Managing the Performance of Cloud-Based Applications
Take advantage of what the Cloud has to offer - Avoid Common Pitfalls.
Read the Whitepaper.
http://pubads.g.doubleclick.net/gampad/clk?id=121051231&iu=/4140/ostg.clktrk
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test

Reply via email to