>Is tesseract and/or ImageMagic work within Perl process, or they start 
their own processes for image conwerting?

perl (assp) calls the executable of the products via a system call  qx(). 
A thread is blocked (and out of control) while both are running.

>On weekend I'm planning to migrate mail server, so I'll try to enable OCR 
plugin for a while and look whether is issue appears again...

Only use the pdf-function, do not enable any OCR image processing! btw. to 
make tesseract usable, you have to learn tesseract how to do OCR (this has 
taken me 2 weeks)!
OCR image processing is for those, who have much time, less emails and big 
systems.

>appears again...

Yes it will, if image processing is switched on !


Thomas




"Shabalin, Alexander" <[email protected]> 
11.12.2009 14:03
Bitte antworten an
ASSP development mailing list <[email protected]>


An
"ASSP development mailing list" <[email protected]>
Kopie

Thema
Re: [Assp-test] Antwort: convert and send data (stuck) in 2.0.1_RC0.6.13






I have 2 single core xeon with HT on mail server (total = 4 logical CPU), 
but I didn't see if there more than one logical CPU is used for 
processing.
Is tesseract and/or ImageMagic work within Perl process, or they start 
their own processes for image conwerting?

Until I found a solve - plugin will remain disabled.

On weekend I'm planning to migrate mail server, so I'll try to enable OCR 
plugin for a while and look whether is issue appears again...

Best regards,
Alexander Shabalin


-----Original Message-----
From: Thomas Eckardt/eck [mailto:[email protected]] 
Sent: Friday, December 11, 2009 1:48 PM
To: ASSP development mailing list
Subject: [Assp-test] Antwort: convert and send data (stuck) in 
2.0.1_RC0.6.13

>What circumstances can provoke this behavior?

the OCR plugin uses tesseract and ImageMagic to convert images to raw
(uncompressed) format and to do the OCR. Read the documentation of both! I 
think you should not configure the usage of OCR (image processing) - 
extracting and analyzing the text from *.pdf files is OK.

tesseract and imageMagic are running out of assp's control. If you have 4 
CPU-cores  5 workers and 4 of them are processing images - the complete 
system will stuck!

Thomas




"Shabalin, Alexander" <[email protected]>
11.12.2009 09:47
Bitte antworten an
ASSP development mailing list <[email protected]>


An
<[email protected]>
Kopie

Thema
[Assp-test] convert and send data (stuck) in 2.0.1_RC0.6.13






Hi All!

Most of outbound mail get stuck in outbound exchange queue caused by 
strange behavior of ASSP.

ASSP Worker/DB Status - not healthy
convert and send data (stuck) - and loop age is grow up to 300 seconds and 

more...
In this time ASSP (Perl.EXE) grows up in memory usage to 1.2-1.3 GB of 
RAM.

Affected: 2.0.1_RC0.6.11 and 2.0.1_RC0.6.13
Have to fall back to 2.0.1_RC0.6.06 but the issue is appeared again.

I haven't time yet to thoroughly look in to logs but the one line is pins 
my attention:
Dec-11-09 11:13:42 18847-03932 [Worker_4] 192.168.10.210 
<[email protected]> to: [email protected] 
ASSP_OCR: converted file image001.png is to large for OCR - skip

I'm disable OCR plugin, restart ASSP and problems appears to be gone.
20 minutes later I upgraded ASSP to the latest version (2.0.1_RC0.6.13) 
and problem did not appear.

What circumstances can provoke this behavior?
Any ideas?

The one and only thing I can accuse - is that I updated all Perl modules 
on this server two day before.
But why ASSP takes full resource of one logical CPU and grows up in memory 

usage - is the goal question that I have to solve.

PS. I can't reboot server right now...
PPS. Server uptime - 40 days.


Best regards,
Alexander Shabalin
 


------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test



DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally 
privileged and protected in law and are intended solely for the use of the 


individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no 
known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test
------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally 
privileged and protected in law and are intended solely for the use of the 

individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no 
known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test

Reply via email to