>The Server is running on a VMware 5 virtual with two Sockets and 1 core
per socket.
This is simply too less for OCR. ImageMagick convert and tesseract are
running in a system call and are using as much CPU as they can get. So, if
your VM has two cores available, it is enough to send assp two mails with
difficult to decompress and/or to OCR analyze at the same time to get the
VM to 100% CPU usage over a long time. If any of the both processes is
running, the thread could'nt be interrupted.
Yes, it may happen that you never saw this behavior before - because this
issue is time critic. As long as not two or more threads are running OCR
image processing at the same time, you'll not get this issue.
How ever, the OCR plugin will get a config parameter to limit the
concurrent running image processing calls.
Thomas
Von: "Daniel K. Du Vall" <[email protected]>
An: ASSP development mailing list <[email protected]>
Datum: 26.12.2011 20:27
Betreff: Re: [Assp-test] Antwort: Dec-25-11 14:32:25 [Main_Thread]
Info: unable to detect any running worker for a new connection - wait
I always love your answers.
The Server is running on a VMware 5 virtual with two Sockets and 1 core
per socket.
2048 MB ram on CENTOS 6.1
The host has 16GB ram and 2 quad core 2.5GHz XEON processors on a
PowerEdge 2900
The only thing running on this virtual is ASSP using mostly default
settings and required Perl.
Also if this is an issue in all versions then explain why I have not run
out of resources using the 2.1.1(11278) version and been running since I
sent the errors?
-----Original Message-----
From: Thomas Eckardt [mailto:[email protected]]
Sent: Sunday, December 25, 2011 11:46 PM
To: ASSP development mailing list
Subject: [Assp-test] Antwort: Dec-25-11 14:32:25 [Main_Thread] Info:
unable to detect any running worker for a new connection - wait
>Dec-25-11 14:29:48 m1-48572-12048 [Worker_1] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: OCR (PDF-Image) data
extracted
All workers are still executing tesseract or Image-Magick-convert - in
both cases the workers are uninterruptable and out of controll for the
MainThread.
>Dec-25-11 14:30:29 [Worker_10000] Warning: got database error Database
select statement failed: MySQL server has gone away at sub
main::checkDBCon line 27 thread 1
on table whitelist - try to reconnect
The system seems to be overloaded - because five workers are doing image
processing!
>This is not an issue with ASSP version 2.1.1(11278)
This is an issue in all versions - if assp is wrong configured or
tesseract is not well trained and all workers processing mails with an
attached image.
>I do not use LDAP if that may be the problem.
LDAP is not the problem
Solution:
Use a faster system (more cores ) - or better switch off all image
processing in the OCR plugin!
Thomas
Von: "Daniel K. Du Vall" <[email protected]>
An: "ASSP development mailing list ([email protected])"
<[email protected]>
Datum: 25.12.2011 22:58
Betreff: [Assp-test] Dec-25-11 14:32:25 [Main_Thread] Info: unable
to detect any running worker for a new connection - wait
With ASSP version 2.1.2(11358) I am getting the Worker issues again.
The Exception.log is empty.
I did notice the LDAP quarries before this happens. I do not use LDAP if
that may be the problem.
This is not an issue with ASSP version 2.1.1(11278)
Dec-25-11 14:29:37 [Worker_5] LDAP - @go.mailsvc.com not found in LDAPlist
Dec-25-11 14:29:37 m1-48572-04774 [Worker_4] 172.31.254.22
<[email protected]> to: [email protected] Message-ID found:
[email protected]
Dec-25-11 14:29:37 [Worker_4] LDAP - @swissmail.org not found in LDAPlist
Dec-25-11 14:29:37 [Worker_3] LDAP - @juno.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_3] LDAP - @juno.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_3] LDAP - @juno.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @usa.net not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @usa.net not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @usa.net not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @go.mailsvc.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @go.mailsvc.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @go.mailsvc.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @verizon.net not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @verizon.net not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @verizon.net not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_4] LDAP - @rocketmail.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_4] LDAP - @rocketmail.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_4] LDAP - @rocketmail.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @golees.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @golees.com not found in LDAPlist
Dec-25-11 14:29:37 [Worker_5] LDAP - @golees.com not found in LDAPlist
Dec-25-11 14:29:38 m1-48573-10211 [Worker_3] 172.31.254.22
<[email protected]> to: [email protected] Message-ID found:
[email protected]
Dec-25-11 14:29:38 [Worker_3] LDAP - @swissmail.org not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @verizon.net not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @verizon.net not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @verizon.net not found in LDAPlist
Dec-25-11 14:29:38 [Worker_4] LDAP - @rogers.com not found in LDAPlist
Dec-25-11 14:29:38 [Worker_4] LDAP - @rogers.com not found in LDAPlist
Dec-25-11 14:29:38 [Worker_4] LDAP - @rogers.com not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @graceefc.net not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @graceefc.net not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @graceefc.net not found in LDAPlist
Dec-25-11 14:29:38 [Worker_4] LDAP - @salud.unm.edu not found in LDAPlist
Dec-25-11 14:29:38 [Worker_4] LDAP - @salud.unm.edu not found in LDAPlist
Dec-25-11 14:29:38 [Worker_4] LDAP - @salud.unm.edu not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @verizon.net not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @verizon.net not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @verizon.net not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @graceefc.net not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @graceefc.net not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @graceefc.net not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:38 m1-48572-12048 [Worker_1] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: (att) file
RD_-_Christmas.pdf found in mime part 4
Dec-25-11 14:29:38 m1-48572-12048 [Worker_1] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: processing (att) file
RD_-_Christmas.pdf
Dec-25-11 14:29:38 [Worker_5] LDAP - @westoverministries.org not found in
LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @westoverministries.org not found in
LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @westoverministries.org not found in
LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @groupwise1.duc.auburn.edu not found
in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @groupwise1.duc.auburn.edu not found
in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @groupwise1.duc.auburn.edu not found
in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:38 m1-48573-12101 [Worker_4] 172.31.254.22
<[email protected]> to: [email protected] Message-ID found:
[email protected]
Dec-25-11 14:29:38 [Worker_4] LDAP - @swissmail.org not found in LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @westoverministries.org not found in
LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @westoverministries.org not found in
LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @westoverministries.org not found in
LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @henryschein.com not found in
LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @henryschein.com not found in
LDAPlist
Dec-25-11 14:29:38 [Worker_5] LDAP - @henryschein.com not found in
LDAPlist
Dec-25-11 14:29:39 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:39 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:39 [Worker_5] LDAP - @gmail.com not found in LDAPlist
Dec-25-11 14:29:39 m1-48573-10211 [Worker_3] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: (att) file
RD_-_Christmas.pdf found in mime part 4
Dec-25-11 14:29:39 m1-48573-10211 [Worker_3] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: processing (att)
file RD_-_Christmas.pdf
Dec-25-11 14:29:39 [Worker_5] LDAP - @westoverministries.org not found in
LDAPlist
Dec-25-11 14:29:39 [Worker_5] LDAP - @westoverministries.org not found in
LDAPlist
Dec-25-11 14:29:39 [Worker_5] LDAP - @westoverministries.org not found in
LDAPlist
Dec-25-11 14:29:39 [Worker_5] LDAP - @hmnet.org.gr not found in LDAPlist
Dec-25-11 14:29:39 [Worker_5] LDAP - @hmnet.org.gr not found in LDAPlist
Dec-25-11 14:29:39 [Worker_5] LDAP - @hmnet.org.gr not found in LDAPlist
Dec-25-11 14:29:39 [Worker_5] LDAP - @westoverministries.org not found in
LDAPlist
Dec-25-11 14:29:39 [Worker_5] LDAP - @westoverministries.org not found in
LDAPlist
Dec-25-11 14:29:39 [Worker_5] LDAP - @westoverministries.org not found in
LDAPlist
Dec-25-11 14:29:39 m1-48572-10876 [Worker_5] 172.31.254.22
<[email protected]> to: [email protected] Message-ID found:
[email protected]
Dec-25-11 14:29:39 [Worker_5] LDAP - @swissmail.org not found in LDAPlist
Dec-25-11 14:29:39 m1-48572-04774 [Worker_4] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: (att) file
RD_-_Christmas.pdf found in mime part 4
Dec-25-11 14:29:39 m1-48572-04774 [Worker_4] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: processing (att)
file RD_-_Christmas.pdf
Dec-25-11 14:29:39 [Worker_5] LDAP - @winfieldbible.org not found in
LDAPlist
Dec-25-11 14:29:39 [Worker_5] LDAP - @winfieldbible.org not found in
LDAPlist
Dec-25-11 14:29:39 [Worker_5] LDAP - @winfieldbible.org not found in
LDAPlist
Dec-25-11 14:29:39 m1-48573-04364 [Worker_5] 172.31.254.22
<[email protected]> to: [email protected] Message-ID found:
[email protected]
Dec-25-11 14:29:39 [Worker_5] LDAP - @swissmail.org not found in LDAPlist
Dec-25-11 14:29:39 m1-48573-09878 [Worker_5] 172.31.254.22
<[email protected]> to: [email protected] Message-ID found:
[email protected]
Dec-25-11 14:29:39 [Worker_5] LDAP - @swissmail.org not found in LDAPlist
Dec-25-11 14:29:40 m1-48572-10876 [Worker_5] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: (att) file
RD_-_Christmas.pdf found in mime part 4
Dec-25-11 14:29:40 m1-48572-10876 [Worker_5] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: processing (att)
file RD_-_Christmas.pdf
Dec-25-11 14:29:41 m1-48573-03145 [Worker_2] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: OCR (PDF-Image) data
extracted
Dec-25-11 14:29:41 m1-48573-03145 [Worker_2] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: Plugin successful
called for runlevel 'complete mail'!
Dec-25-11 14:29:48 m1-48572-12048 [Worker_1] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: OCR (PDF-Image) data
extracted
Dec-25-11 14:29:48 m1-48572-12048 [Worker_1] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: Plugin successful called
for runlevel 'complete mail'!
Dec-25-11 14:29:48 m1-48573-10211 [Worker_3] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: OCR (PDF-Image)
data extracted
Dec-25-11 14:29:48 m1-48573-10211 [Worker_3] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: Plugin
successful called for runlevel 'complete mail'!
Dec-25-11 14:29:50 [Main_Thread] Info: Main_Thread got connection request
Dec-25-11 14:29:50 [Main_Thread] Info: Main_Thread looks up the best
Worker for new connection - 360
Dec-25-11 14:29:50 [Main_Thread] Info: try to interrupt worker Worker_1
(1) for new connection
Dec-25-11 14:29:50 [Main_Thread] Info: Main_Thread interrupted Worker_1
(1) to submit the connection
Dec-25-11 14:29:50 [Main_Thread] Info: Main_Thread will wait (max 30 s)
for the answer of Worker_1 which handles 1 sockets
Dec-25-11 14:29:51 m1-48572-04774 [Worker_4] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: OCR (PDF-Image)
data extracted
Dec-25-11 14:29:51 m1-48572-04774 [Worker_4] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: Plugin successful
called for runlevel 'complete mail'!
Dec-25-11 14:29:55 m1-48572-10876 [Worker_5] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: OCR (PDF-Image)
data extracted
Dec-25-11 14:29:55 m1-48572-10876 [Worker_5] [Plugin] 172.31.254.22
<[email protected]> to: [email protected] ASSP_OCR: Plugin successful
called for runlevel 'complete mail'!
Dec-25-11 14:30:21 [Main_Thread] Info: Worker_1 handles 1 sockets and does
not answer - will try other worker
Dec-25-11 14:30:21 [Main_Thread] Info: try to interrupt worker Worker_3
(1) for new connection
Dec-25-11 14:30:21 [Main_Thread] Info: Main_Thread interrupted Worker_3
(1) to submit the connection
Dec-25-11 14:30:21 [Main_Thread] Info: Main_Thread will wait (max 30 s)
for the answer of Worker_3 which handles 1 sockets
Dec-25-11 14:30:29 [Worker_10000] Warning: got database error Database
select statement failed: MySQL server has gone away at sub
main::checkDBCon line 27 thread 1
on table whitelist - try to reconnect
Dec-25-11 14:30:29 [Worker_10000] Info: reusing table <whitelist> in
mysql Database <assp>
Dec-25-11 14:30:52 [Main_Thread] Info: Worker_3 handles 1 sockets and does
not answer - will try other worker
Dec-25-11 14:30:52 [Main_Thread] Info: try to interrupt worker Worker_4
(2) for new connection
Dec-25-11 14:30:52 [Main_Thread] Info: Main_Thread interrupted Worker_4
(2) to submit the connection
Dec-25-11 14:30:52 [Main_Thread] Info: Main_Thread will wait (max 30 s)
for the answer of Worker_4 which handles 2 sockets
Dec-25-11 14:31:23 [Main_Thread] Info: Worker_4 handles 2 sockets and does
not answer - will try other worker
Dec-25-11 14:31:23 [Main_Thread] Info: try to interrupt worker Worker_2
(3) for new connection
Dec-25-11 14:31:23 [Main_Thread] Info: Main_Thread interrupted Worker_2
(3) to submit the connection
Dec-25-11 14:31:23 [Main_Thread] Info: Main_Thread will wait (max 30 s)
for the answer of Worker_2 which handles 3 sockets
Dec-25-11 14:31:54 [Main_Thread] Info: Worker_2 handles 3 sockets and does
not answer - will try other worker
Dec-25-11 14:31:54 [Main_Thread] Info: try to interrupt worker Worker_5
(3) for new connection
Dec-25-11 14:31:54 [Main_Thread] Info: Main_Thread interrupted Worker_5
(3) to submit the connection
Dec-25-11 14:31:54 [Main_Thread] Info: Main_Thread will wait (max 30 s)
for the answer of Worker_5 which handles 3 sockets
Dec-25-11 14:32:10 [Worker_10000] Info: looking for files to (re)send
Dec-25-11 14:32:25 [Main_Thread] Info: Worker_5 handles 3 sockets and does
not answer - will try other worker
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker
for a new connection - wait
Daniel Du Vall
http://1peter4-10.org
http://volkswageninsanity.us
------------------------------------------------------------------------------
Write once. Port to many.
Get the SDK and tools to simplify cross-platform app development. Create
new or port existing apps to sell to consumers worldwide. Explore the
Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join
http://p.sf.net/sfu/intel-appdev
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test
DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally
privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no
known virus in this email!
*******************************************************
------------------------------------------------------------------------------
Write once. Port to many.
Get the SDK and tools to simplify cross-platform app development. Create
new or port existing apps to sell to consumers worldwide. Explore the
Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join
http://p.sf.net/sfu/intel-appdev
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test
DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally
privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no
known virus in this email!
*******************************************************
------------------------------------------------------------------------------
Write once. Port to many.
Get the SDK and tools to simplify cross-platform app development. Create
new or port existing apps to sell to consumers worldwide. Explore the
Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join
http://p.sf.net/sfu/intel-appdev
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test
