[MBF] Re: Call external batch file from Declude

[Don Winsauer]

Hi David,

I was able to write a batch script to do what I needed and have it called as a 
Declude external test.

We currently have about 550 mailboxes across 40 domains.

Don

-- Original Message --
From: "David Barker | Mail's Best Friend | 1-866-919-2075" 
<david.bar...@mailsbestfriend.com>
Reply-To: <community@mailsbestfriend.com>
Date:  Wed, 11 May 2016 08:47:25 -0500

>Hi Don,
>
>Yes Declude can call an external program to rewrite the file. Depending on
>how much email the server receives this may be a lot of overhead re-writing
>email files which could introduce additional performance issues.  Maybe it's
>time to get off IMail.
>
>How many mailboxes do you host ?
>
>David
>
>-Original Message-
>From: community@mailsbestfriend.com [mailto:community@mailsbestfriend.com]
>On Behalf Of Don Winsauer
>Sent: Wednesday, May 11, 2016 2:02 AM
>To: community@mailsbestfriend.com
>Subject: [MBF] Re: Call external batch file from Declude
>
>Good suggestion.  I know what you mean.
>
>I had already checked it with a hex editor.  The original file did have the
>correct 0x0d 0x0a sequences.
>
>No extraneous CRs or LFs.
>
>Thanks though,
>Don
>
>-- Original Message --
>From: "'Andy Schmidt'" <andy_schm...@hm-software.com>
>Reply-To: <community@mailsbestfriend.com>
>Date:  Wed, 11 May 2016 02:52:51 -0400
>
>>Hm - just consider the possibility that the problem is an INVALID "EOL"
>>sequence.
>>
>>SMTP requires a CR/LF combination at the end of a line.
>>
>>But, some operating systems (like UNIX) just use a "LF", some just a "CR"
>>(at some time MACs), and sometimes programmers accidentally code "LF/CR". 
>>
>>There have been cases, where a software tries to "fix" invalid EOF 
>>sequences, by replacing a single "CR" (not followed by a LF) or a 
>>single "LF" (not preceded by a "CR"), with a CR/LF - and the fails in 
>>the case of a LF/CR sequence becoming a LF/CR/LF or a CR/LF/CR - which 
>>another application might interpret as two EOLs.
>>
>>My point - make sure you inspect the original file using a HEX editor 
>>for single CR or single LF characters - THIS might be the ultimate 
>>source of the problem and the trigger of all subsequent issues.
>>
>>-Original Message-
>>From: community@mailsbestfriend.com 
>>[mailto:community@mailsbestfriend.com]
>>On Behalf Of Don Winsauer
>>Sent: Wednesday, May 11, 2016 1:22 AM
>>To: community@mailsbestfriend.com
>>Subject: [MBF] Re: Call external batch file from Declude
>>
>>Ok, Here ya go...
>>
>>For this customer of mine, I am scanning all their email for spam and 
>>viruses and then forwarding the email to their Exchange server.
>>
>>It appears when Microsoft's Office 365 Exchange servers find an 
>>attachment in the email, they are adding a header:
>>
>>x-microsoft-exchange-diagnostics:
>>1;CO1PR04MB554;5:uIPmx3dm3PK/UJjiWJfcZKKgooCYjfXMN/RlsoZaA9l50T3ppyfEZL
>>7hV
>>0/b9lb2ameTAtuhrpdbSvHbPrOz6rkwXwybtN0NfVio9xbvrCXGemr4ElqtHO7qnlQgSVNF
>>fs7 
>>pQvr3Ik3TWCeV433olw==;24:8DgC4bge5fDd2sgE3gKjyQSudpsCI2J68HI5XChAq6H/ev
>>gOT
>>mn6pKnNx0FQS6aorGkRqORLzQaFVhM43MyWtb0BfiaV29+KboF8dNmBWRE=;7:FH8DkU9P/
>>mn6pKnNx0FQS6aorGkRqORLzQaFVhM43MyWtb0BfiaV29+vAA
>>2cZf0DCaqz5AJcXiy0ygl+Y8/LrpsGe5MAcP4A/EFx9j+hYJmORCaEjCtA/JWl80qdNRjjv
>>2cZf0DCaqz5AJcXiy0ygl+o0h
>>L4LnEt++q1KirBBcD5K1ervta5qLh42AsICnwR2hakHCxbOjf6EdMQtgxf/6M0Vj8JMmSuW
>>L4LnEt++08/
>>X0mL49SuD3kM8YHnljh4K8dAvOo+bCu3
>>
>>
>>It is being added by several of his vendors (different domains).  All 
>>from *.outlook.com servers.
>>
>>The SMTP32.exe process of my IMail (v8.15) sees the data in this header 
>>and for some reason is adding a blank line after the header.  This 
>>server has been in production since v8.15 was current.  It has 
>>processed millions of emails and this is the first time I've had a problem
>like this.
>>
>>I grabbed the raw email in the D*.smd file and all looks good.  In my 
>>email client, it looks good.  When that file is processed and forwarded 
>>to my customer's Exchange server, it shows headers in the body of the
>email.
>>It took me quite awhile removing headers until I figured out which one 
>>it was.  With the help of a colleague, I had IMail send the email to 
>>their email server (non-Exchange).  He grabbed the raw email file from 
>>their end and we saw the extra blank line that was throwin

[MBF] Re: Call external batch file from Declude

[David Barker | Mail's Best Friend | 1-866-919-2075]

Hi Don,

Yes Declude can call an external program to rewrite the file. Depending on
how much email the server receives this may be a lot of overhead re-writing
email files which could introduce additional performance issues.  Maybe it's
time to get off IMail.

How many mailboxes do you host ?

David

-Original Message-
From: community@mailsbestfriend.com [mailto:community@mailsbestfriend.com]
On Behalf Of Don Winsauer
Sent: Wednesday, May 11, 2016 2:02 AM
To: community@mailsbestfriend.com
Subject: [MBF] Re: Call external batch file from Declude

Good suggestion.  I know what you mean.

I had already checked it with a hex editor.  The original file did have the
correct 0x0d 0x0a sequences.

No extraneous CRs or LFs.

Thanks though,
Don

-- Original Message --
From: "'Andy Schmidt'" <andy_schm...@hm-software.com>
Reply-To: <community@mailsbestfriend.com>
Date:  Wed, 11 May 2016 02:52:51 -0400

>Hm - just consider the possibility that the problem is an INVALID "EOL"
>sequence.
>
>SMTP requires a CR/LF combination at the end of a line.
>
>But, some operating systems (like UNIX) just use a "LF", some just a "CR"
>(at some time MACs), and sometimes programmers accidentally code "LF/CR". 
>
>There have been cases, where a software tries to "fix" invalid EOF 
>sequences, by replacing a single "CR" (not followed by a LF) or a 
>single "LF" (not preceded by a "CR"), with a CR/LF - and the fails in 
>the case of a LF/CR sequence becoming a LF/CR/LF or a CR/LF/CR - which 
>another application might interpret as two EOLs.
>
>My point - make sure you inspect the original file using a HEX editor 
>for single CR or single LF characters - THIS might be the ultimate 
>source of the problem and the trigger of all subsequent issues.
>
>-Original Message-
>From: community@mailsbestfriend.com 
>[mailto:community@mailsbestfriend.com]
>On Behalf Of Don Winsauer
>Sent: Wednesday, May 11, 2016 1:22 AM
>To: community@mailsbestfriend.com
>Subject: [MBF] Re: Call external batch file from Declude
>
>Ok, Here ya go...
>
>For this customer of mine, I am scanning all their email for spam and 
>viruses and then forwarding the email to their Exchange server.
>
>It appears when Microsoft's Office 365 Exchange servers find an 
>attachment in the email, they are adding a header:
>
>x-microsoft-exchange-diagnostics:
>1;CO1PR04MB554;5:uIPmx3dm3PK/UJjiWJfcZKKgooCYjfXMN/RlsoZaA9l50T3ppyfEZL
>7hV
>0/b9lb2ameTAtuhrpdbSvHbPrOz6rkwXwybtN0NfVio9xbvrCXGemr4ElqtHO7qnlQgSVNF
>fs7 
>pQvr3Ik3TWCeV433olw==;24:8DgC4bge5fDd2sgE3gKjyQSudpsCI2J68HI5XChAq6H/ev
>gOT
>mn6pKnNx0FQS6aorGkRqORLzQaFVhM43MyWtb0BfiaV29+KboF8dNmBWRE=;7:FH8DkU9P/
>mn6pKnNx0FQS6aorGkRqORLzQaFVhM43MyWtb0BfiaV29+vAA
>2cZf0DCaqz5AJcXiy0ygl+Y8/LrpsGe5MAcP4A/EFx9j+hYJmORCaEjCtA/JWl80qdNRjjv
>2cZf0DCaqz5AJcXiy0ygl+o0h
>L4LnEt++q1KirBBcD5K1ervta5qLh42AsICnwR2hakHCxbOjf6EdMQtgxf/6M0Vj8JMmSuW
>L4LnEt++08/
>X0mL49SuD3kM8YHnljh4K8dAvOo+bCu3
>
>
>It is being added by several of his vendors (different domains).  All 
>from *.outlook.com servers.
>
>The SMTP32.exe process of my IMail (v8.15) sees the data in this header 
>and for some reason is adding a blank line after the header.  This 
>server has been in production since v8.15 was current.  It has 
>processed millions of emails and this is the first time I've had a problem
like this.
>
>I grabbed the raw email in the D*.smd file and all looks good.  In my 
>email client, it looks good.  When that file is processed and forwarded 
>to my customer's Exchange server, it shows headers in the body of the
email.
>It took me quite awhile removing headers until I figured out which one 
>it was.  With the help of a colleague, I had IMail send the email to 
>their email server (non-Exchange).  He grabbed the raw email file from 
>their end and we saw the extra blank line that was throwing everything off.
>SMTP32.EXE is inserting a blank line after this header.  While it is a 
>long header, it is not the longest header in the email.
>
>I find that when I remove this header, all works fine.  So that is what 
>I am trying to do.
>
>I have been working on this issue for two weeks.  It took me until 
>tonight to determine that SMTP32.exe was at fault.  During my research, 
>I even removed Declude from the chain and things still failed.  I am 
>trying to fix the problem with the tools I have at hand.
>
>Don
>
>-- Original Message --
>From: "David Barker | Mail's Best Friend | 1-866-919-2075"
><david.bar...@mailsbestfriend.com>
>Reply-To: <community@mailsbestfriend.com>
>Date:  Tue, 10 May 2016 17:34:23 

[MBF] Re: Call external batch file from Declude

['Andy Schmidt']

Hm - just consider the possibility that the problem is an INVALID "EOL"
sequence.

SMTP requires a CR/LF combination at the end of a line.

But, some operating systems (like UNIX) just use a "LF", some just a "CR"
(at some time MACs), and sometimes programmers accidentally code "LF/CR". 

There have been cases, where a software tries to "fix" invalid EOF
sequences, by replacing a single "CR" (not followed by a LF) or a single
"LF" (not preceded by a "CR"), with a CR/LF - and the fails in the case of a
LF/CR sequence becoming a LF/CR/LF or a CR/LF/CR - which another application
might interpret as two EOLs.

My point - make sure you inspect the original file using a HEX editor for
single CR or single LF characters - THIS might be the ultimate source of the
problem and the trigger of all subsequent issues.

-Original Message-
From: community@mailsbestfriend.com [mailto:community@mailsbestfriend.com]
On Behalf Of Don Winsauer
Sent: Wednesday, May 11, 2016 1:22 AM
To: community@mailsbestfriend.com
Subject: [MBF] Re: Call external batch file from Declude

Ok, Here ya go...

For this customer of mine, I am scanning all their email for spam and
viruses and then forwarding the email to their Exchange server.

It appears when Microsoft's Office 365 Exchange servers find an attachment
in the email, they are adding a header:

x-microsoft-exchange-diagnostics:
1;CO1PR04MB554;5:uIPmx3dm3PK/UJjiWJfcZKKgooCYjfXMN/RlsoZaA9l50T3ppyfEZL7hV
0/b9lb2ameTAtuhrpdbSvHbPrOz6rkwXwybtN0NfVio9xbvrCXGemr4ElqtHO7qnlQgSVNFfs7
pQvr3Ik3TWCeV433olw==;24:8DgC4bge5fDd2sgE3gKjyQSudpsCI2J68HI5XChAq6H/evgOT
mn6pKnNx0FQS6aorGkRqORLzQaFVhM43MyWtb0BfiaV29+KboF8dNmBWRE=;7:FH8DkU9P/vAA
2cZf0DCaqz5AJcXiy0ygl+Y8/LrpsGe5MAcP4A/EFx9j+hYJmORCaEjCtA/JWl80qdNRjjvo0h
L4LnEt++q1KirBBcD5K1ervta5qLh42AsICnwR2hakHCxbOjf6EdMQtgxf/6M0Vj8JMmSuW08/
X0mL49SuD3kM8YHnljh4K8dAvOo+bCu3


It is being added by several of his vendors (different domains).  All from
*.outlook.com servers.

The SMTP32.exe process of my IMail (v8.15) sees the data in this header
and for some reason is adding a blank line after the header.  This server
has been in production since v8.15 was current.  It has processed millions
of emails and this is the first time I've had a problem like this.

I grabbed the raw email in the D*.smd file and all looks good.  In my
email client, it looks good.  When that file is processed and forwarded to
my customer's Exchange server, it shows headers in the body of the email.
It took me quite awhile removing headers until I figured out which one it
was.  With the help of a colleague, I had IMail send the email to their
email server (non-Exchange).  He grabbed the raw email file from their end
and we saw the extra blank line that was throwing everything off.
SMTP32.EXE is inserting a blank line after this header.  While it is a
long header, it is not the longest header in the email.

I find that when I remove this header, all works fine.  So that is what I
am trying to do.

I have been working on this issue for two weeks.  It took me until tonight
to determine that SMTP32.exe was at fault.  During my research, I even
removed Declude from the chain and things still failed.  I am trying to
fix the problem with the tools I have at hand.

Don

-- Original Message --
From: "David Barker | Mail's Best Friend | 1-866-919-2075"
<david.bar...@mailsbestfriend.com>
Reply-To: <community@mailsbestfriend.com>
Date:  Tue, 10 May 2016 17:34:23 -0500

>Lets start at the end and work backwards what is the reason for 
>removing the header line and secondly which headerline do you want to
remove ?
>
>-Original Message-
>From: community@mailsbestfriend.com 
>[mailto:community@mailsbestfriend.com]
>On Behalf Of Don Winsauer
>Sent: Tuesday, May 10, 2016 3:56 PM
>To: community@mailsbestfriend.com
>Subject: [MBF] Call external batch file from Declude
>
>I need to remove a header line from a set of emails.
>
>Can I use Declude to call an external batch file to modify the D*.smd
file?
>Possibly either as a Junkmail test or possibly a emulating a virus
scanner?
>
>Anyone doing anything like this?
>
>Don
> 
>
>
>
>
>
>Sent via the WebMail system at net1media.com
>
>
> 
>   
>
>#
>This message is sent to you because you are subscribed to
>  the mailing list <community@mailsbestfriend.com>.
>To unsubscribe, E-mail to: <community-...@mailsbestfriend.com>
>To switch to the DIGEST mode, E-mail to 
><community-dig...@mailsbestfriend.com>
>To switch to the INDEX mode, E-mail to 
><community-in...@mailsbestfriend.com>
>Send administrative queries to

[MBF] Re: Call external batch file from Declude

[Don Winsauer]

Ok, Here ya go...

For this customer of mine, I am scanning all their email for spam and viruses 
and then forwarding the email to their Exchange server.

It appears when Microsoft's Office 365 Exchange servers find an attachment in 
the email, they are adding a header:

x-microsoft-exchange-diagnostics: 
1;CO1PR04MB554;5:uIPmx3dm3PK/UJjiWJfcZKKgooCYjfXMN/RlsoZaA9l50T3ppyfEZL7hV0/b9lb2ameTAtuhrpdbSvHbPrOz6rkwXwybtN0NfVio9xbvrCXGemr4ElqtHO7qnlQgSVNFfs7pQvr3Ik3TWCeV433olw==;24:8DgC4bge5fDd2sgE3gKjyQSudpsCI2J68HI5XChAq6H/evgOTmn6pKnNx0FQS6aorGkRqORLzQaFVhM43MyWtb0BfiaV29+KboF8dNmBWRE=;7:FH8DkU9P/vAA2cZf0DCaqz5AJcXiy0ygl+Y8/LrpsGe5MAcP4A/EFx9j+hYJmORCaEjCtA/JWl80qdNRjjvo0hL4LnEt++q1KirBBcD5K1ervta5qLh42AsICnwR2hakHCxbOjf6EdMQtgxf/6M0Vj8JMmSuW08/X0mL49SuD3kM8YHnljh4K8dAvOo+bCu3


It is being added by several of his vendors (different domains).  All from 
*.outlook.com servers.

The SMTP32.exe process of my IMail (v8.15) sees the data in this header and for 
some reason is adding a blank line after the header.  This server has been in 
production since v8.15 was current.  It has processed millions of emails and 
this is the first time I've had a problem like this.

I grabbed the raw email in the D*.smd file and all looks good.  In my email 
client, it looks good.  When that file is processed and forwarded to my 
customer's Exchange server, it shows headers in the body of the email.  It took 
me quite awhile removing headers until I figured out which one it was.  With 
the help of a colleague, I had IMail send the email to their email server 
(non-Exchange).  He grabbed the raw email file from their end and we saw the 
extra blank line that was throwing everything off.  SMTP32.EXE is inserting a 
blank line after this header.  While it is a long header, it is not the longest 
header in the email.

I find that when I remove this header, all works fine.  So that is what I am 
trying to do.

I have been working on this issue for two weeks.  It took me until tonight to 
determine that SMTP32.exe was at fault.  During my research, I even removed 
Declude from the chain and things still failed.  I am trying to fix the problem 
with the tools I have at hand.

Don

-- Original Message --
From: "David Barker | Mail's Best Friend | 1-866-919-2075" 

Reply-To: 
Date:  Tue, 10 May 2016 17:34:23 -0500

>Lets start at the end and work backwards what is the reason for removing
>the header line and secondly which headerline do you want to remove ?
>
>-Original Message-
>From: community@mailsbestfriend.com [mailto:community@mailsbestfriend.com]
>On Behalf Of Don Winsauer
>Sent: Tuesday, May 10, 2016 3:56 PM
>To: community@mailsbestfriend.com
>Subject: [MBF] Call external batch file from Declude
>
>I need to remove a header line from a set of emails.
>
>Can I use Declude to call an external batch file to modify the D*.smd file?
>Possibly either as a Junkmail test or possibly a emulating a virus scanner?
>
>Anyone doing anything like this?
>
>Don
> 
>
>
>
>
>
>Sent via the WebMail system at net1media.com
>
>
> 
>   
>
>#
>This message is sent to you because you are subscribed to
>  the mailing list .
>To unsubscribe, E-mail to: 
>To switch to the DIGEST mode, E-mail to
>
>To switch to the INDEX mode, E-mail to 
>Send administrative queries to  
>
>
>
>#
>This message is sent to you because you are subscribed to
>  the mailing list .
>To unsubscribe, E-mail to: 
>To switch to the DIGEST mode, E-mail to 
>To switch to the INDEX mode, E-mail to 
>Send administrative queries to  
>
>
 





Sent via the WebMail system at net1media.com


 
   

#
This message is sent to you because you are subscribed to
  the mailing list .
To unsubscribe, E-mail to: 
To switch to the DIGEST mode, E-mail to 
To switch to the INDEX mode, E-mail to 
Send administrative queries to  

[MBF] Re: Call external batch file from Declude

[David Barker | Mail's Best Friend | 1-866-919-2075]

Lets start at the end and work backwards what is the reason for removing
the header line and secondly which headerline do you want to remove ?

-Original Message-
From: community@mailsbestfriend.com [mailto:community@mailsbestfriend.com]
On Behalf Of Don Winsauer
Sent: Tuesday, May 10, 2016 3:56 PM
To: community@mailsbestfriend.com
Subject: [MBF] Call external batch file from Declude

I need to remove a header line from a set of emails.

Can I use Declude to call an external batch file to modify the D*.smd file?
Possibly either as a Junkmail test or possibly a emulating a virus scanner?

Anyone doing anything like this?

Don
 





Sent via the WebMail system at net1media.com


 
   

#
This message is sent to you because you are subscribed to
  the mailing list .
To unsubscribe, E-mail to: 
To switch to the DIGEST mode, E-mail to

To switch to the INDEX mode, E-mail to 
Send administrative queries to  



#
This message is sent to you because you are subscribed to
  the mailing list .
To unsubscribe, E-mail to: 
To switch to the DIGEST mode, E-mail to 
To switch to the INDEX mode, E-mail to 
Send administrative queries to