I've noticed over the past week an ASSP failure that is happening at an alarming frequency - at times it happens once an hour, sometimes once every few hours. This problem began with the installation of 2.2.2(12151) and continues with 2.2.2 (12169). The logs report normal operation, with no commonality in cause - then, out of nowhere, this will occur:
Jun-20-12 00:39:46 [Main_Thread] Info: Main_Thread got connection request Nothing is logged for 30 seconds, and then it will begin logging these errors - about 100 of them per second: Jun-20-12 00:40:17 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Jun-20-12 00:40:17 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Jun-20-12 00:40:17 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Jun-20-12 00:40:17 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Every 30 seconds it logs this: Jun-20-12 00:40:48 [Main_Thread] Warning: Main_Thread is unable to transfer connection to any worker - try again! It then continues on logging about a hundred of these per second: Jun-20-12 00:40:48 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Jun-20-12 00:40:48 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Jun-20-12 00:40:48 [Main_Thread] Info: unable to detect any running worker for a new connection - wait After two minutes of this, it decides that it has failed entirely, and restarts itself - interestingly, it completes the delivery of an email before doing so: Jun-20-12 00:42:20 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Jun-20-12 00:42:21 [Main_Thread] Info: unable to detect any running worker for a new connection - wait Jun-20-12 00:42:21 [Main_Thread] Warning: Main_Thread is unable to transfer connection to any worker - try again! Jun-20-12 00:42:21 [Main_Thread] Info: notification message queued to sent to r...@domain.com Jun-20-12 00:42:21 [Main_Thread] Error: Main_Thread is unable to transfer connection to any worker within 120 seconds - restart ASSP! Jun-20-12 00:42:21 [Main_Thread] Initializing shutdown sequence Jun-20-12 00:42:21 [Shutdown] Info: removing all SMTP and Proxy listeners Jun-20-12 00:42:21 [Shutdown] Tell Worker 6 - QUIT Jun-20-12 00:42:21 [Shutdown] Tell Worker 3 - QUIT Jun-20-12 00:42:21 [Shutdown] Tell Worker 7 - QUIT Jun-20-12 00:42:21 [Shutdown] Tell Worker 2 - QUIT Jun-20-12 00:42:21 [Shutdown] Tell Worker 8 - QUIT Jun-20-12 00:42:21 [Worker_8] Worker_8 wakes up Jun-20-12 00:42:21 [Shutdown] Tell Worker 1 - QUIT Jun-20-12 00:42:21 [Shutdown] Tell Worker 4 - QUIT Jun-20-12 00:42:21 [Shutdown] Tell Worker 5 - QUIT Jun-20-12 00:42:21 [Shutdown] Waiting for all SMTP-Workers to be finished Jun-20-12 00:42:21 [Worker_8] Worker_8 finished Jun-20-12 00:42:25 FS-67184-00324 [Worker_7] 204.244.xxx.yyy <f...@domain1.com> to: bon...@domain2.com [scoring] DKIM domain-check skipped - domain1.com does not support DKIM Jun-20-12 00:42:25 FS-67184-00324 [Worker_7] 204.244.xxx.yyy <f...@domain1.com> to: bon...@domain2.com Bayesian Check [monitoring] - Prob: 1.00000 => spam Jun-20-12 00:42:25 FS-67184-00324 [Worker_7] [MessageOK] 204.244.xxx.yyy <f...@domain1.com> to: bon...@domain2.com message ok [Green Bay Bible Camp Payment ID 1591 Processed] Jun-20-12 00:42:25 [Worker_7] Worker_7 has active connections. Will wait until all connections are finished but max 45 seconds! Jun-20-12 00:42:25 [Worker_7] bon...@domain2.com matches bon...@domain2.com in LocalAddresses_Flat Jun-20-12 00:42:25 FS-67345-14794 [Worker_7] 204.244.xxx.yyy <f...@domain1.com> to: bon...@domain2.com recipient accepted: bon...@domain2.com Jun-20-12 00:42:26 [Worker_7] Info: enhanced Originated IP detection ignored IP's: 204.244.xxx.yyy Jun-20-12 00:42:26 FS-67345-14794 [Worker_7] 204.244.xxx.yyy <f...@domain1.com> to: bon...@domain2.com Message-Score: added -15 (pbwValencePB) for In Penalty White Box, total score for this message is now -15 Jun-20-12 00:42:26 FS-67345-14794 [Worker_7] 204.244.xxx.yyy <f...@domain1.com> to: bon...@domain2.com Message-Score: added -10 (spfpValencePB) for SPF pass, total score for this message is now -25 Jun-20-12 00:42:26 FS-67345-14794 [Worker_7] 204.244.xxx.yyy <f...@domain1.com> to: bon...@domain2.com Bayesian Check [monitoring] - Prob: 0.00024 => ham Jun-20-12 00:42:26 FS-67345-14794 [Worker_7] [MessageOK] 204.244.xxx.yyy <f...@domain1.com> to: bon...@domain2.com message ok [Green Bay Bible Camp Registration Application Received] Jun-20-12 00:42:26 FS-67345-14794 [Worker_7] 204.244.xxx.yyy <f...@domain1.com> to: bon...@domain2.com finished message - received DATA size: 2.05 kByte - sent DATA size: 2.36 kByte Jun-20-12 00:42:26 [Worker_7] Disconnected: 204.244.xxx.yyy - command list was 'EHLO,MAIL FROM,RCPT TO,DATA,MAIL FROM,RCPT TO,DATA,QUIT' - used 10 SocketCalls - processing time 163 seconds Jun-20-12 00:43:10 [Worker_7] 24.71.xxx.yyy info: wrote all current available connection data to file D:/ASSP/debug/con385.txt Jun-20-12 00:43:10 [Worker_7] info: wrote all current available connection data to file D:/ASSP/debug/con386.txt Jun-20-12 00:43:10 [Worker_7] Worker_7 finished Jun-20-12 00:43:11 [Shutdown] Info: notification message queued to sent to r...@domain.com Jun-20-12 00:43:11 [Shutdown] Error: at least one of the SMTP workers has not finished work within 50 seconds Jun-20-12 00:43:11 [Shutdown] Info: synchronizing and compacting all BerkeleyDB hashes to disk Jun-20-12 00:43:11 [Shutdown] Closing all databases Jun-20-12 00:43:11 [Shutdown] Info: removing all WEB listeners Jun-20-12 00:43:11 [Shutdown] Info: shutdown reason was: restarting Jun-20-12 00:43:11 [Shutdown] ASSP finished work Jun-20-12 00:43:15 [startup] Starting as a service Jun-20-12 00:43:19 [startup] ASSP-professional version 2.2.2(12169) (Perl 5.014002) (on MSWin32) initializing As expected, my debug directory is filling up with con*.txt files. Any idea what I should be looking for as a cause? ------------------------------------------------------------------------------ Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test
