[sniffer] Slow processing times, errors

2013-06-27 Thread Matt

Pete,

I've had many recent incidences where, as it turns out, SNFclient.exe 
takes 30 to 90 seconds to respond to every message with a result code 
(normally less than a second), and as a result backs up processing.  
Restarting the Sniffer service seems to do the trick, but I only tested 
that for the first time today after figuring this out.


I believe the events are triggered by updates, but I'm not sure as of 
yet.  Updates subsequent to the slow down do not appear to fix the 
situation, so it seems to be resident in the service.  When this 
happens, my SNFclient.exe.err log fill up with lines like this:


20130627155608, arg1=F:\\proc\work\D6063018a2550.smd : Could 
Not Connect!


At the same time, my Sniffer logs start showing frequent 
ERROR_MSG_FILE results on about 1/8th of the messages.


I'm currently using the service version 3.0.2-E3.0.17.  It's not 
entirely clear to me what the most current one is.


Any suggestions as to the cause or solution?

Thanks,

Matt


#
This message is sent to you because you are subscribed to
 the mailing list sniffer@sortmonster.com.
This list is for discussing Message Sniffer,
Anti-spam, Anti-Malware, and related email topics.
For More information see http://www.armresearch.com
To unsubscribe, E-mail to: sniffer-...@sortmonster.com
To switch to the DIGEST mode, E-mail to sniffer-dig...@sortmonster.com
To switch to the INDEX mode, E-mail to sniffer-in...@sortmonster.com
Send administrative queries to  sniffer-requ...@sortmonster.com



[sniffer] Re: Slow processing times, errors

2013-06-27 Thread eric
We were experiencing this several days ago and couldn't find a fix that 
worked or worked for long.  We uninstalled SNF and reinstalled and have not 
detected a problem since.  I will check the logs and report back if I see 
anything intermittent.




Sent using SmarterSync Over-The-Air sync for iPad, iPhone, BlackBerry and 
other SmartPhones.  May use speech to text.  If something seems odd please 
don't hesitate to ask for clarification.  E.O.E.

On 2013-06-27, at 2:06 PM, Matt for...@mailpure.com wrote:

 Pete,
 
 I've had many recent incidences where, as it turns out, SNFclient.exe 
takes 30 to 90 seconds to respond to every message with a result code 
(normally less than a second), and as a result backs up processing.  
Restarting the Sniffer service seems to do the trick, but I only tested 
that for the first time today after figuring this out.
 
 I believe the events are triggered by updates, but I'm not sure as of 
yet.  Updates subsequent to the slow down do not appear to fix the 
situation, so it seems to be resident in the service.  When this happens, 
my SNFclient.exe.err log fill up with lines like this:
 
20130627155608, arg1=F:\\proc\work\D6063018a2550.smd : Could Not 
Connect!
 
 At the same time, my Sniffer logs start showing frequent ERROR_MSG_FILE 
results on about 1/8th of the messages.
 
 I'm currently using the service version 3.0.2-E3.0.17.  It's not entirely 
clear to me what the most current one is.
 
 Any suggestions as to the cause or solution?
 
 Thanks,
 
 Matt
 
 
 #
 This message is sent to you because you are subscribed to
 the mailing list sniffer@sortmonster.com.
 This list is for discussing Message Sniffer,
 Anti-spam, Anti-Malware, and related email topics.
 For More information see http://www.armresearch.com
 To unsubscribe, E-mail to: sniffer-...@sortmonster.com
 To switch to the DIGEST mode, E-mail to sniffer-dig...@sortmonster.com
 To switch to the INDEX mode, E-mail to sniffer-in...@sortmonster.com
 Send administrative queries to  sniffer-requ...@sortmonster.com
 



[sniffer] Re: Slow processing times, errors

2013-06-27 Thread Darin Cox
When we had sluggish performance similar that yours, resulting in numerous 
sniffer .tmp files in the spool, the cause was eventually traced to a 
proliferation of files in the sniffer directory.  Clearing them out brought 
performance back up to normal.

Darin.



From: e...@protologic.com
Sent: Thursday, June 27, 2013 5:17 PM
To: Message Sniffer Community
Subject: [sniffer] Re: Slow processing times, errors

We were experiencing this several days ago and couldn't find a fix that 
worked or worked for long. We uninstalled SNF and reinstalled and have not 
detected a problem since. I will check the logs and report back if I see 
anything intermittent.




Sent using SmarterSync Over-The-Air sync for iPad, iPhone, BlackBerry and 
other SmartPhones. May use speech to text. If something seems odd please 
don't hesitate to ask for clarification. E.O.E.

On 2013-06-27, at 2:06 PM, Matt wrote:

 Pete,

 I've had many recent incidences where, as it turns out, SNFclient.exe 
 takes 30 to 90 seconds to respond to every message with a result code 
 (normally less than a second), and as a result backs up processing. 
 Restarting the Sniffer service seems to do the trick, but I only tested 
 that for the first time today after figuring this out.

 I believe the events are triggered by updates, but I'm not sure as of yet. 
 Updates subsequent to the slow down do not appear to fix the situation, so 
 it seems to be resident in the service. When this happens, my 
 SNFclient.exe.err log fill up with lines like this:

 20130627155608, arg1=F:\\proc\work\D6063018a2550.smd : Could Not 
 Connect!

 At the same time, my Sniffer logs start showing frequent ERROR_MSG_FILE 
 results on about 1/8th of the messages.

 I'm currently using the service version 3.0.2-E3.0.17. It's not entirely 
 clear to me what the most current one is.

 Any suggestions as to the cause or solution?

 Thanks,

 Matt


 #
 This message is sent to you because you are subscribed to
 the mailing list .
 This list is for discussing Message Sniffer,
 Anti-spam, Anti-Malware, and related email topics.
 For More information see http://www.armresearch.com
 To unsubscribe, E-mail to:
 To switch to the DIGEST mode, E-mail to
 To switch to the INDEX mode, E-mail to
 Send administrative queries to




[sniffer] Re: Slow processing times, errors

2013-06-27 Thread Matt

Darin,

I'm not seeing that sort of thing.  With 3.x, there doesn't appear to be 
any extraneous file creation in the Sniffer program directory, and never 
any TMP files in my spool.  I do not have Sniffer modifying headers, so 
that may be different on our systems.


Matt


On 6/27/2013 5:25 PM, Darin Cox wrote:
When we had sluggish performance similar that yours, resulting in 
numerous sniffer .tmp files in the spool, the cause was eventually 
traced to a proliferation of files in the sniffer directory.  Clearing 
them out brought performance back up to normal.

Darin.

*From:* e...@protologic.com mailto:e...@protologic.com
*Sent:* Thursday, June 27, 2013 5:17 PM
*To:* Message Sniffer Community mailto:sniffer@sortmonster.com
*Subject:* [sniffer] Re: Slow processing times, errors
We were experiencing this several days ago and couldn't find a fix 
that worked or worked for long. We uninstalled SNF and reinstalled and 
have not detected a problem since. I will check the logs and report 
back if I see anything intermittent.





Sent using SmarterSync Over-The-Air sync for iPad, iPhone, BlackBerry 
and other SmartPhones. May use speech to text. If something seems odd 
please don't hesitate to ask for clarification. E.O.E.


On 2013-06-27, at 2:06 PM, Matt wrote:

 Pete,

 I've had many recent incidences where, as it turns out, 
SNFclient.exe takes 30 to 90 seconds to respond to every message with 
a result code (normally less than a second), and as a result backs up 
processing. Restarting the Sniffer service seems to do the trick, but 
I only tested that for the first time today after figuring this out.


 I believe the events are triggered by updates, but I'm not sure as 
of yet. Updates subsequent to the slow down do not appear to fix the 
situation, so it seems to be resident in the service. When this 
happens, my SNFclient.exe.err log fill up with lines like this:


 20130627155608, arg1=F:\\proc\work\D6063018a2550.smd : Could Not 
Connect!


 At the same time, my Sniffer logs start showing frequent 
ERROR_MSG_FILE results on about 1/8th of the messages.


 I'm currently using the service version 3.0.2-E3.0.17. It's not 
entirely clear to me what the most current one is.


 Any suggestions as to the cause or solution?

 Thanks,

 Matt


 #
 This message is sent to you because you are subscribed to
 the mailing list .
 This list is for discussing Message Sniffer,
 Anti-spam, Anti-Malware, and related email topics.
 For More information see http://www.armresearch.com
 To unsubscribe, E-mail to:
 To switch to the DIGEST mode, E-mail to
 To switch to the INDEX mode, E-mail to
 Send administrative queries to






[sniffer] Re: Slow processing times, errors

2013-06-27 Thread Darin Cox
HI Matt,

We started having that problem coincidentally right after we upgraded to 
3.x.  For us the .tmp file creation in the spool was indicative of sniffer 
processing delays.  We do have Sniffer modifying headers.

Darin.



From: Matt
Sent: Thursday, June 27, 2013 5:32 PM
To: Message Sniffer Community
Subject: [sniffer] Re: Slow processing times, errors

Darin,

I'm not seeing that sort of thing.  With 3.x, there doesn't appear to be any 
extraneous file creation in the Sniffer program directory, and never any TMP 
files in my spool.  I do not have Sniffer modifying headers, so that may be 
different on our systems.

Matt



On 6/27/2013 5:25 PM, Darin Cox wrote:

  When we had sluggish performance similar that yours, resulting in numerous 
sniffer .tmp files in the spool, the cause was eventually traced to a 
proliferation of files in the sniffer directory.  Clearing them out brought 
performance back up to normal.

  Darin.



  From: e...@protologic.com
  Sent: Thursday, June 27, 2013 5:17 PM
  To: Message Sniffer Community
  Subject: [sniffer] Re: Slow processing times, errors

  We were experiencing this several days ago and couldn't find a fix that 
worked or worked for long. We uninstalled SNF and reinstalled and have not 
detected a problem since. I will check the logs and report back if I see 
anything intermittent.




  Sent using SmarterSync Over-The-Air sync for iPad, iPhone, BlackBerry and 
other SmartPhones. May use speech to text. If something seems odd please 
don't hesitate to ask for clarification. E.O.E.

  On 2013-06-27, at 2:06 PM, Matt wrote:

   Pete,
  
   I've had many recent incidences where, as it turns out, SNFclient.exe 
takes 30 to 90 seconds to respond to every message with a result code 
(normally less than a second), and as a result backs up processing. 
Restarting the Sniffer service seems to do the trick, but I only tested that 
for the first time today after figuring this out.
  
   I believe the events are triggered by updates, but I'm not sure as of 
yet. Updates subsequent to the slow down do not appear to fix the situation, 
so it seems to be resident in the service. When this happens, my 
SNFclient.exe.err log fill up with lines like this:
  
   20130627155608, arg1=F:\\proc\work\D6063018a2550.smd : Could Not 
Connect!
  
   At the same time, my Sniffer logs start showing frequent 
ERROR_MSG_FILE results on about 1/8th of the messages.
  
   I'm currently using the service version 3.0.2-E3.0.17. It's not entirely 
clear to me what the most current one is.
  
   Any suggestions as to the cause or solution?
  
   Thanks,
  
   Matt
  
  
   #
   This message is sent to you because you are subscribed to
   the mailing list .
   This list is for discussing Message Sniffer,
   Anti-spam, Anti-Malware, and related email topics.
   For More information see http://www.armresearch.com
   To unsubscribe, E-mail to:
   To switch to the DIGEST mode, E-mail to
   To switch to the INDEX mode, E-mail to
   Send administrative queries to
  





[sniffer] Re: Slow processing times, errors

2013-06-27 Thread DFN Systems
unsubscribe

 

  _  

From: Message Sniffer Community [mailto:sniffer@sortmonster.com] On Behalf
Of e...@protologic.com
Sent: Thursday, June 27, 2013 3:18 PM
To: Message Sniffer Community
Subject: [sniffer] Re: Slow processing times, errors

 

We were experiencing this several days ago and couldn't find a fix that
worked or worked for long. We uninstalled SNF and reinstalled and have not
detected a problem since. I will check the logs and report back if I see
anything intermittent.




Sent using SmarterSync Over-The-Air sync for iPad, iPhone, BlackBerry and
other SmartPhones. May use speech to text. If something seems odd please
don't hesitate to ask for clarification. E.O.E.

On 2013-06-27, at 2:06 PM, Matt wrote:

 Pete,
 
 I've had many recent incidences where, as it turns out, SNFclient.exe
takes 30 to 90 seconds to respond to every message with a result code
(normally less than a second), and as a result backs up processing.
Restarting the Sniffer service seems to do the trick, but I only tested that
for the first time today after figuring this out.
 
 I believe the events are triggered by updates, but I'm not sure as of yet.
Updates subsequent to the slow down do not appear to fix the situation, so
it seems to be resident in the service. When this happens, my
SNFclient.exe.err log fill up with lines like this:
 
 20130627155608, arg1=F:\\proc\work\D6063018a2550.smd : Could Not
Connect!
 
 At the same time, my Sniffer logs start showing frequent ERROR_MSG_FILE
results on about 1/8th of the messages.
 
 I'm currently using the service version 3.0.2-E3.0.17. It's not entirely
clear to me what the most current one is.
 
 Any suggestions as to the cause or solution?
 
 Thanks,
 
 Matt
 
 
 #
 This message is sent to you because you are subscribed to
 the mailing list .
 This list is for discussing Message Sniffer,
 Anti-spam, Anti-Malware, and related email topics.
 For More information see http://www.armresearch.com
 To unsubscribe, E-mail to: 
 To switch to the DIGEST mode, E-mail to 
 To switch to the INDEX mode, E-mail to 
 Send administrative queries to 
 



[sniffer] Re: Slow processing times, errors

2013-06-27 Thread Matt
This is an automated message from the mailing list software.  In order 
to unsubscribe you must issue the command please unsubscribe.



#
This message is sent to you because you are subscribed to
 the mailing list sniffer@sortmonster.com.
This list is for discussing Message Sniffer,
Anti-spam, Anti-Malware, and related email topics.
For More information see http://www.armresearch.com
To unsubscribe, E-mail to: sniffer-...@sortmonster.com
To switch to the DIGEST mode, E-mail to sniffer-dig...@sortmonster.com
To switch to the INDEX mode, E-mail to sniffer-in...@sortmonster.com
Send administrative queries to  sniffer-requ...@sortmonster.com



[sniffer] Re: Slow processing times, errors

2013-06-27 Thread Pete McNeil

On 2013-06-27 17:25, Darin Cox wrote:
When we had sluggish performance similar that yours, resulting in 
numerous sniffer .tmp files in the spool, the cause was eventually 
traced to a proliferation of files in the sniffer directory.  Clearing 
them out brought performance back up to normal.


This is usually the problem. NTFS performs very badly when there are a 
lot of files in a directory -- and that slows everything down.


If SNF takes 30 seconds or more to process a message then SNFClient will 
give up and let the message through (fail safe).


_M

--
Pete McNeil
Chief Scientist
ARM Research Labs, LLC
www.armresearch.com
866-770-1044 x7010
twitter/codedweller


#
This message is sent to you because you are subscribed to
 the mailing list sniffer@sortmonster.com.
This list is for discussing Message Sniffer,
Anti-spam, Anti-Malware, and related email topics.
For More information see http://www.armresearch.com
To unsubscribe, E-mail to: sniffer-...@sortmonster.com
To switch to the DIGEST mode, E-mail to sniffer-dig...@sortmonster.com
To switch to the INDEX mode, E-mail to sniffer-in...@sortmonster.com
Send administrative queries to  sniffer-requ...@sortmonster.com



[sniffer] Re: Slow processing times, errors

2013-06-27 Thread Pete McNeil

On 2013-06-27 16:04, Matt wrote:

like this:

20130627155608, arg1=F:\\proc\work\D6063018a2550.smd : Could 
Not Connect!


That is SNFClient giving up after waiting for SNF to process the message 
for too long.




At the same time, my Sniffer logs start showing frequent 
ERROR_MSG_FILE results on about 1/8th of the messages. 


This is SNFServer giving up after trying to open the message file and 
read it.


What's happening is that the OS is not delivering the file to SNF, SNF 
is waiting for this (it has no choice, it's a call to the OS's open() 
command), and then eventually it fails so SNF produces the 
ERROR_MSG_FILE result because it was not able to open the file it was 
supposed to scan.


This is often caused by fragmentation, or it can be that there are too 
many files in the directory that contains the message file. Ultimately 
it is an IO problem.


This shouldn't be associated with updates -- but if it is, I might guess 
that's because the file system is ready to fall over and saving a new 
rulebase file to disk, or reading afterward is enough to push it over 
the edge.


Seeing ERROR_MSG_FILE on 1/8th of the scans means that SNF is being 
asked to scan a message that the file system can't or won't give it. 
That is a strong indication that the system is IO bound. SNF can't 
really do anything different in that case -- it's simply asking to open 
the file so it can read it. If the IO system says No then it spits out 
that error.


Hope this helps,

_M

--
Pete McNeil
Chief Scientist
ARM Research Labs, LLC
www.armresearch.com
866-770-1044 x7010
twitter/codedweller


#
This message is sent to you because you are subscribed to
 the mailing list sniffer@sortmonster.com.
This list is for discussing Message Sniffer,
Anti-spam, Anti-Malware, and related email topics.
For More information see http://www.armresearch.com
To unsubscribe, E-mail to: sniffer-...@sortmonster.com
To switch to the DIGEST mode, E-mail to sniffer-dig...@sortmonster.com
To switch to the INDEX mode, E-mail to sniffer-in...@sortmonster.com
Send administrative queries to  sniffer-requ...@sortmonster.com