Thanks this explanation helps a lot in my understanding why it might be happening. I will add more cores etc. and see how it does. By the way what would you recommend? Thanks much
-----Original Message----- From: Thomas Eckardt [mailto:[email protected]] Sent: Tuesday, December 27, 2011 12:27 AM To: ASSP development mailing list Subject: [Assp-test] Antwort: Re: Antwort: Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait >The Server is running on a VMware 5 virtual with two Sockets and 1 core per socket. This is simply too less for OCR. ImageMagick convert and tesseract are running in a system call and are using as much CPU as they can get. So, if your VM has two cores available, it is enough to send assp two mails with difficult to decompress and/or to OCR analyze at the same time to get the VM to 100% CPU usage over a long time. If any of the both processes is running, the thread could'nt be interrupted. Yes, it may happen that you never saw this behavior before - because this issue is time critic. As long as not two or more threads are running OCR image processing at the same time, you'll not get this issue. How ever, the OCR plugin will get a config parameter to limit the concurrent running image processing calls. Thomas Von: "Daniel K. Du Vall" <[email protected]> An: ASSP development mailing list <[email protected]> Datum: 26.12.2011 20:27 Betreff: Re: [Assp-test] Antwort: Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait I always love your answers. The Server is running on a VMware 5 virtual with two Sockets and 1 core per socket. 2048 MB ram on CENTOS 6.1 The host has 16GB ram and 2 quad core 2.5GHz XEON processors on a PowerEdge 2900 The only thing running on this virtual is ASSP using mostly default settings and required Perl. Also if this is an issue in all versions then explain why I have not run out of resources using the 2.1.1(11278) version and been running since I sent the errors? -----Original Message----- From: Thomas Eckardt [mailto:[email protected]] Sent: Sunday, December 25, 2011 11:46 PM To: ASSP development mailing list Subject: [Assp-test] Antwort: Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait >Dec-25-11 14:29:48 m1-48572-12048 [Worker_1] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: OCR (PDF-Image) data extracted All workers are still executing tesseract or Image-Magick-convert - in both cases the workers are uninterruptable and out of controll for the MainThread. >Dec-25-11 14:30:29 [Worker_10000] Warning: got database error Database select statement failed: MySQL server has gone away at sub main::checkDBCon line 27 thread 1 on table whitelist - try to reconnect The system seems to be overloaded - because five workers are doing image processing! >This is not an issue with ASSP version 2.1.1(11278) This is an issue in all versions - if assp is wrong configured or tesseract is not well trained and all workers processing mails with an attached image. >I do not use LDAP if that may be the problem. LDAP is not the problem Solution: Use a faster system (more cores ) - or better switch off all image processing in the OCR plugin! Thomas Von: "Daniel K. Du Vall" <[email protected]> An: "ASSP development mailing list ([email protected])" <[email protected]> Datum: 25.12.2011 22:58 Betreff: [Assp-test] Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait With ASSP version 2.1.2(11358) I am getting the Worker issues again. The Exception.log is empty. I did notice the LDAP quarries before this happens. I do not use LDAP if that may be the problem. This is not an issue with ASSP version 2.1.1(11278) Dec-25-11 14:29:37 [Worker_5] LDAP - @go.mailsvc.com not found in LDAPlist Dec-25-11 14:29:37 m1-48572-04774 [Worker_4] 172.31.254.22 <[email protected]> to: [email protected] Message-ID found: [email protected] Dec-25-11 14:29:37 [Worker_4] LDAP - @swissmail.org not found in LDAPlist Dec-25-11 14:29:37 [Worker_3] LDAP - @juno.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_3] LDAP - @juno.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_3] LDAP - @juno.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @usa.net not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @usa.net not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @usa.net not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @go.mailsvc.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @go.mailsvc.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @go.mailsvc.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @verizon.net not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @verizon.net not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @verizon.net not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_4] LDAP - @rocketmail.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_4] LDAP - @rocketmail.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_4] LDAP - @rocketmail.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @golees.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @golees.com not found in LDAPlist Dec-25-11 14:29:37 [Worker_5] LDAP - @golees.com not found in LDAPlist Dec-25-11 14:29:38 m1-48573-10211 [Worker_3] 172.31.254.22 <[email protected]> to: [email protected] Message-ID found: [email protected] Dec-25-11 14:29:38 [Worker_3] LDAP - @swissmail.org not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @verizon.net not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @verizon.net not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @verizon.net not found in LDAPlist Dec-25-11 14:29:38 [Worker_4] LDAP - @rogers.com not found in LDAPlist Dec-25-11 14:29:38 [Worker_4] LDAP - @rogers.com not found in LDAPlist Dec-25-11 14:29:38 [Worker_4] LDAP - @rogers.com not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @graceefc.net not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @graceefc.net not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @graceefc.net not found in LDAPlist Dec-25-11 14:29:38 [Worker_4] LDAP - @salud.unm.edu not found in LDAPlist Dec-25-11 14:29:38 [Worker_4] LDAP - @salud.unm.edu not found in LDAPlist Dec-25-11 14:29:38 [Worker_4] LDAP - @salud.unm.edu not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @verizon.net not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @verizon.net not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @verizon.net not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @graceefc.net not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @graceefc.net not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @graceefc.net not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:38 m1-48572-12048 [Worker_1] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: (att) file RD_-_Christmas.pdf found in mime part 4 Dec-25-11 14:29:38 m1-48572-12048 [Worker_1] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: processing (att) file RD_-_Christmas.pdf Dec-25-11 14:29:38 [Worker_5] LDAP - @westoverministries.org not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @westoverministries.org not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @westoverministries.org not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @groupwise1.duc.auburn.edu not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @groupwise1.duc.auburn.edu not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @groupwise1.duc.auburn.edu not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:38 m1-48573-12101 [Worker_4] 172.31.254.22 <[email protected]> to: [email protected] Message-ID found: [email protected] Dec-25-11 14:29:38 [Worker_4] LDAP - @swissmail.org not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @westoverministries.org not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @westoverministries.org not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @westoverministries.org not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @henryschein.com not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @henryschein.com not found in LDAPlist Dec-25-11 14:29:38 [Worker_5] LDAP - @henryschein.com not found in LDAPlist Dec-25-11 14:29:39 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:39 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:39 [Worker_5] LDAP - @gmail.com not found in LDAPlist Dec-25-11 14:29:39 m1-48573-10211 [Worker_3] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: (att) file RD_-_Christmas.pdf found in mime part 4 Dec-25-11 14:29:39 m1-48573-10211 [Worker_3] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: processing (att) file RD_-_Christmas.pdf Dec-25-11 14:29:39 [Worker_5] LDAP - @westoverministries.org not found in LDAPlist Dec-25-11 14:29:39 [Worker_5] LDAP - @westoverministries.org not found in LDAPlist Dec-25-11 14:29:39 [Worker_5] LDAP - @westoverministries.org not found in LDAPlist Dec-25-11 14:29:39 [Worker_5] LDAP - @hmnet.org.gr not found in LDAPlist Dec-25-11 14:29:39 [Worker_5] LDAP - @hmnet.org.gr not found in LDAPlist Dec-25-11 14:29:39 [Worker_5] LDAP - @hmnet.org.gr not found in LDAPlist Dec-25-11 14:29:39 [Worker_5] LDAP - @westoverministries.org not found in LDAPlist Dec-25-11 14:29:39 [Worker_5] LDAP - @westoverministries.org not found in LDAPlist Dec-25-11 14:29:39 [Worker_5] LDAP - @westoverministries.org not found in LDAPlist Dec-25-11 14:29:39 m1-48572-10876 [Worker_5] 172.31.254.22 <[email protected]> to: [email protected] Message-ID found: [email protected] Dec-25-11 14:29:39 [Worker_5] LDAP - @swissmail.org not found in LDAPlist Dec-25-11 14:29:39 m1-48572-04774 [Worker_4] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: (att) file RD_-_Christmas.pdf found in mime part 4 Dec-25-11 14:29:39 m1-48572-04774 [Worker_4] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: processing (att) file RD_-_Christmas.pdf Dec-25-11 14:29:39 [Worker_5] LDAP - @winfieldbible.org not found in LDAPlist Dec-25-11 14:29:39 [Worker_5] LDAP - @winfieldbible.org not found in LDAPlist Dec-25-11 14:29:39 [Worker_5] LDAP - @winfieldbible.org not found in LDAPlist Dec-25-11 14:29:39 m1-48573-04364 [Worker_5] 172.31.254.22 <[email protected]> to: [email protected] Message-ID found: [email protected] Dec-25-11 14:29:39 [Worker_5] LDAP - @swissmail.org not found in LDAPlist Dec-25-11 14:29:39 m1-48573-09878 [Worker_5] 172.31.254.22 <[email protected]> to: [email protected] Message-ID found: [email protected] Dec-25-11 14:29:39 [Worker_5] LDAP - @swissmail.org not found in LDAPlist Dec-25-11 14:29:40 m1-48572-10876 [Worker_5] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: (att) file RD_-_Christmas.pdf found in mime part 4 Dec-25-11 14:29:40 m1-48572-10876 [Worker_5] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: processing (att) file RD_-_Christmas.pdf Dec-25-11 14:29:41 m1-48573-03145 [Worker_2] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: OCR (PDF-Image) data extracted Dec-25-11 14:29:41 m1-48573-03145 [Worker_2] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: Plugin successful called for runlevel 'complete mail'! Dec-25-11 14:29:48 m1-48572-12048 [Worker_1] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: OCR (PDF-Image) data extracted Dec-25-11 14:29:48 m1-48572-12048 [Worker_1] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: Plugin successful called for runlevel 'complete mail'! Dec-25-11 14:29:48 m1-48573-10211 [Worker_3] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: OCR (PDF-Image) data extracted Dec-25-11 14:29:48 m1-48573-10211 [Worker_3] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: Plugin successful called for runlevel 'complete mail'! Dec-25-11 14:29:50 [Main_Thread] Info: Main_Thread got connection request Dec-25-11 14:29:50 [Main_Thread] Info: Main_Thread looks up the best Worker for new connection - 360 Dec-25-11 14:29:50 [Main_Thread] Info: try to interrupt worker Worker_1 (1) for new connection Dec-25-11 14:29:50 [Main_Thread] Info: Main_Thread interrupted Worker_1 (1) to submit the connection Dec-25-11 14:29:50 [Main_Thread] Info: Main_Thread will wait (max 30 s) for the answer of Worker_1 which handles 1 sockets Dec-25-11 14:29:51 m1-48572-04774 [Worker_4] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: OCR (PDF-Image) data extracted Dec-25-11 14:29:51 m1-48572-04774 [Worker_4] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: Plugin successful called for runlevel 'complete mail'! Dec-25-11 14:29:55 m1-48572-10876 [Worker_5] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: OCR (PDF-Image) data extracted Dec-25-11 14:29:55 m1-48572-10876 [Worker_5] [Plugin] 172.31.254.22 <[email protected]> to: [email protected] ASSP_OCR: Plugin successful called for runlevel 'complete mail'! Dec-25-11 14:30:21 [Main_Thread] Info: Worker_1 handles 1 sockets and does not answer - will try other worker Dec-25-11 14:30:21 [Main_Thread] Info: try to interrupt worker Worker_3 (1) for new connection Dec-25-11 14:30:21 [Main_Thread] Info: Main_Thread interrupted Worker_3 (1) to submit the connection Dec-25-11 14:30:21 [Main_Thread] Info: Main_Thread will wait (max 30 s) for the answer of Worker_3 which handles 1 sockets Dec-25-11 14:30:29 [Worker_10000] Warning: got database error Database select statement failed: MySQL server has gone away at sub main::checkDBCon line 27 thread 1 on table whitelist - try to reconnect Dec-25-11 14:30:29 [Worker_10000] Info: reusing table <whitelist> in mysql Database <assp> Dec-25-11 14:30:52 [Main_Thread] Info: Worker_3 handles 1 sockets and does not answer - will try other worker Dec-25-11 14:30:52 [Main_Thread] Info: try to interrupt worker Worker_4 (2) for new connection Dec-25-11 14:30:52 [Main_Thread] Info: Main_Thread interrupted Worker_4 (2) to submit the connection Dec-25-11 14:30:52 [Main_Thread] Info: Main_Thread will wait (max 30 s) for the answer of Worker_4 which handles 2 sockets Dec-25-11 14:31:23 [Main_Thread] Info: Worker_4 handles 2 sockets and does not answer - will try other worker Dec-25-11 14:31:23 [Main_Thread] Info: try to interrupt worker Worker_2 (3) for new connection Dec-25-11 14:31:23 [Main_Thread] Info: Main_Thread interrupted Worker_2 (3) to submit the connection Dec-25-11 14:31:23 [Main_Thread] Info: Main_Thread will wait (max 30 s) for the answer of Worker_2 which handles 3 sockets Dec-25-11 14:31:54 [Main_Thread] Info: Worker_2 handles 3 sockets and does not answer - will try other worker Dec-25-11 14:31:54 [Main_Thread] Info: try to interrupt worker Worker_5 (3) for new connection Dec-25-11 14:31:54 [Main_Thread] Info: Main_Thread interrupted Worker_5 (3) to submit the connection Dec-25-11 14:31:54 [Main_Thread] Info: Main_Thread will wait (max 30 s) for the answer of Worker_5 which handles 3 sockets Dec-25-11 14:32:10 [Worker_10000] Info: looking for files to (re)send Dec-25-11 14:32:25 [Main_Thread] Info: Worker_5 handles 3 sockets and does not answer - will try other worker Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Dec-25-11 14:32:25 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Daniel Du Vall http://1peter4-10.org http://volkswageninsanity.us ------------------------------------------------------------------------------ Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev _______________________________________________ Assp-test mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/assp-test DISCLAIMER: ******************************************************* This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the individual to whom it is addressed. This email was multiple times scanned for viruses. There should be no known virus in this email! ******************************************************* ------------------------------------------------------------------------------ Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev _______________________________________________ Assp-test mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/assp-test DISCLAIMER: ******************************************************* This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the individual to whom it is addressed. This email was multiple times scanned for viruses. There should be no known virus in this email! ******************************************************* ------------------------------------------------------------------------------ Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev _______________________________________________ Assp-test mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/assp-test
