Re: CC destinations dropped

2012-07-20 Thread Marc Patermann
Brian,

brian schrieb (20.07.2012 01:22 Uhr):

 I believe the problem does not involve postfix, as pipe appears to be 
 sending both. It looks to me as if lmtpunix is looking at just the one 
 address and thinks there's a duplicate.
You have postfix and spamassassin and procmail and last lmtp involed here.

 postfix/pipe[26602]: E401F7A25EF: to=ju...@domain.org,
  relay=spamassassin, delay=1.5, delays=0.23/0/0/1.3, dsn=2.0.0,
  status=sent (delivered via spamassassin service)
Mail is relayed to spamassassin. What happened there, have you checked?

postfix/pipe[26606]: 66E757A25FC: to=ju...@domain.org, 
 relay=procmail, delay=0.2, delays=0.16/0/0/0.04, dsn=2.0.0, status=sent 
 (delivered via procmail service)
Mail is relayed to procmail. What happened there, have you checked?

Did your grep in the mailboxes for the message-id?


Marc

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus


Re: CC destinations dropped

2012-07-20 Thread Adam Tauno Williams
On Thu, 2012-07-19 at 19:22 -0400, brian wrote:
 A client of mine is complaining about not receiving certain messages. 
 Her colleague is also being sent them and receives them just fine. She 
 insists that they are not being sent to her junk folder and that she has 
 no filters that might be moving them elsewhere.

You can check for existence of a SIEVE [filter] script
in /var/lib/imap/sieve/{letter}/{username} [you path may vary a little,
but something like that].

You can grep -d recurse
{message-id} /var/lib/spool/imap/{letter}/user/{username}/* to see if it
is really there.  It may be there event if deleted and expunged if
delayedexpunge is enabled.

Otherwise it is almost certainly an MTA issue.

 I believe the problem does not involve postfix, as pipe appears to be 
 sending both. It looks to me as if lmtpunix is looking at just the one 
 address and thinks there's a duplicate. Note the two duplicate_check 
 lines, both of which reference the julia account. I've sent a test 
 message and indeed the duplicate_check again referenced only the julia 
 account again, and admin did not receive it.

Where is the e-mail coming from?  It is possible it really is a
duplicate message-id?  some real-world devices recycle message ids [our
Xerox document centers do].

postfix/pipe[26606]: 66E757A25FC: to=ad...@domain.org, 
 relay=procmail, delay=0.2, delays=0.16/0/0/0.04, dsn=2.0.0, status=sent 
 (delivered via procmail service)
postfix/pipe[26606]: 66E757A25FC: to=ju...@domain.org, 
 relay=procmail, delay=0.2, delays=0.16/0/0/0.04, dsn=2.0.0, status=sent 
 (delivered via procmail service)

delivered via procmail ???


signature.asc
Description: This is a digitally signed message part

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: CC destinations dropped

2012-07-20 Thread Eric Luyten
On Fri, July 20, 2012 1:37 pm, Eric Luyten wrote:

 The less components stacked one upon another, the less
 issues you're likely to witness.


fewer


Eric Luyten, Computing Centre VUB/ULB.



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus


Re: CC destinations dropped

2012-07-20 Thread Dan White
On 07/19/12 19:22 -0400, brian wrote:
A client of mine is complaining about not receiving certain messages.
Her colleague is also being sent them and receives them just fine. She
insists that they are not being sent to her junk folder and that she has
no filters that might be moving them elsewhere.

I've had a look at the logs and can see that the latest msg appears to
have been successfully sent to both mailboxes. However, I'm not sure how
to correctly interpret the log entries. I'm including the entries below
(removed date/time and indented for legibility) and hope that someone
could be kind enough to clarify what's happening.

I believe the problem does not involve postfix, as pipe appears to be
sending both. It looks to me as if lmtpunix is looking at just the one
address and thinks there's a duplicate. Note the two duplicate_check
lines, both of which reference the julia account. I've sent a test
message and indeed the duplicate_check again referenced only the julia
account again, and admin did not receive it.

The client cannot confirm whether this only happens when a message is
addressed to both of them but thinks that may be the case.

But then pipe appears to send a copy to each mailbox after all. I'm
quite confused.

The mailbox that is NOT receiving the msgs is admin, while julia does
get them.

-- snip --
   postfix/smtpd[26599]: connect from
mail-ob0-f171.google.com[209.85.214.171]
   postfix/smtpd[26599]: setting up TLS connection from
mail-ob0-f171.google.com[209.85.214.171]
   postfix/smtpd[26599]: Anonymous TLS connection established from
mail-ob0-f171.google.com[209.85.214.171]: TLSv1 with cipher RC4-SHA
(128/128 bits)
   postfix/smtpd[26599]: E401F7A25EF:
client=mail-ob0-f171.google.com[209.85.214.171]
   postfix/cleanup[26601]: E401F7A25EF:
message-id=caacv9k3oj8yzxwyroglvukecpusivebblwjpu5eqrtsxhbe...@mail.gmail.com
   postfix/qmgr[27662]: E401F7A25EF: from=sen...@gmail.com, size=2295,
nrcpt=2 (queue active)
   postfix/pipe[26602]: E401F7A25EF: to=ad...@domain.org,
relay=spamassassin, delay=1.5, delays=0.23/0/0/1.3, dsn=2.0.0,
status=sent (delivered via spamassassin service)
   postfix/pipe[26602]: E401F7A25EF: to=ju...@domain.org,
relay=spamassassin, delay=1.5, delays=0.23/0/0/1.3, dsn=2.0.0,
status=sent (delivered via spamassassin service)
   postfix/qmgr[27662]: E401F7A25EF: removed
   postfix/pickup[26486]: 66E757A25FC: uid=5001 from=sen...@gmail.com
   postfix/cleanup[26601]: 66E757A25FC:
message-id=caacv9k3oj8yzxwyroglvukecpusivebblwjpu5eqrtsxhbe...@mail.gmail.com
   postfix/qmgr[27662]: 66E757A25FC: from=sen...@gmail.com, size=2646,
nrcpt=2 (queue active)
   cyrus/master[26609]: about to exec /usr/lib/cyrus/bin/lmtpd
   cyrus/lmtpunix[26609]: executed
   cyrus/lmtpunix[26609]: accepted connection
   cyrus/lmtpunix[26609]: lmtp connection preauth'd as postman
   cyrus/lmtpunix[26609]: duplicate_check:
caacv9k3oj8yzxwyroglvukecpusivebblwjpu5eqrtsxhbe...@mail.gmail.com
DOMAIN.ORG!user.julia   0
   cyrus/lmtpunix[26609]: duplicate_check:
caacv9k3oj8yzxwyroglvukecpusivebblwjpu5eqrtsxhbe...@mail.gmail.com
DOMAIN.ORG!user.julia   0
   cyrus/lmtpunix[26609]: mystore: starting txn 2147619229
   cyrus/lmtpunix[26609]: mystore: committing txn 2147619229
   cyrus/lmtpunix[26609]: duplicate_mark:
caacv9k3oj8yzxwyroglvukecpusivebblwjpu5eqrtsxhbe...@mail.gmail.com
DOMAIN.ORG!user.julia   1342580059 0
   cyrus/lmtpunix[26609]: Delivered:
caacv9k3oj8yzxwyroglvukecpusivebblwjpu5eqrtsxhbe...@mail.gmail.com to
mailbox: DOMAIN.ORG!user.julia
   postfix/pipe[26606]: 66E757A25FC: to=ad...@domain.org,
relay=procmail, delay=0.2, delays=0.16/0/0/0.04, dsn=2.0.0, status=sent
(delivered via procmail service)
   postfix/pipe[26606]: 66E757A25FC: to=ju...@domain.org,
relay=procmail, delay=0.2, delays=0.16/0/0/0.04, dsn=2.0.0, status=sent
(delivered via procmail service)
   postfix/qmgr[27662]: 66E757A25FC: removed
   postfix/smtpd[26599]: disconnect from
mail-ob0-f171.google.com[209.85.214.171]
-- snip --

I see the message piped to spamassasin, and then to procmail:

postfix/pipe[26602]: E401F7A25EF: to=ad...@domain.org,
relay=spamassassin...

postfix/pipe[26602]: E401F7A25EF: to=ju...@domain.org,
relay=spamassassin...

postfix/pipe[26606]: 66E757A25FC: to=ad...@domain.org, relay=procmail...

postfix/pipe[26606]: 66E757A25FC: to=ju...@domain.org, relay=procmail...

However, cyrus/lmtpunix is not getting the message for admin:

cyrus/lmtpunix[26609]: duplicate_check: ... DOMAIN.ORG!user.julia   0
cyrus/lmtpunix[26609]: duplicate_check: ... DOMAIN.ORG!user.julia   0

cyrus/lmtpunix[26609]: Delivered: ... to mailbox: DOMAIN.ORG!user.julia

I'm guessing that you have a postfix content filter in place which passes the
message through spam assassin, after which postfix then delivers to cyrus
via procmail/(cyrus)deliver. If that's the case, something appears to be going
wrong with the procmail/deliver step, and you should look at replacing that
piece with direct postfix-lmtp delivery.

-- 
Dan White

Cyrus 

Re: CC destinations dropped

2012-07-20 Thread brian
On 12-07-20 02:33 AM, Marc Patermann wrote:
 
  Mail is relayed to spamassassin. What happened there, have you
  checked?

My apologies. Nothing of note in the logs.

  Did your grep in the mailboxes for the message-id?

Yes

On 12-07-20 07:37 AM, Eric Luyten wrote:
 On Fri, July 20, 2012 1:01 pm, Adam  Tauno Williams wrote:
 Where is the e-mail coming from?  It is possible it really is a
 duplicate message-id?  some real-world devices recycle message ids [our
 Xerox document centers do].

The example from the logs was a msg from a gmail acct. My own test came 
from my domain. The problem doesn't appear to have anything to do with 
the source.

 delivered via procmail ???

 On the day I cut procmail out from between our Postfix and Cyrus, all
 (well, one major, causing newly arriving messages to disappear) delivery
 mysteries disappeared.
 The less components stacked one upon another, the less issues you're
 likely to witness.

Agreed. But I'm no expert on these things and there are an awful lot of 
HOWTOs out there that include procmail in the stack. Thanks to both 
yourself and Dan White for the suggestion to cut it out of the process. 
I'm uncertain as to how best to do this but I'll send that query to the 
Postfix list, where I suppose it belongs.

b

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus


Re: CC destinations dropped

2012-07-20 Thread brian
On 12-07-20 03:32 PM, brian wrote:
 On 12-07-20 02:33 AM, Marc Patermann wrote:
   
 Mail is relayed to spamassassin. What happened there, have you
 checked?

 My apologies. Nothing of note in the logs.

Sorry again. I meant to include it. There's only a single set of entries 
in the log for this message.

-- snip --
   info: spamd: connection from localhost.localdomain [127.0.0.1] at 
port 57493
   info: spamd: processing message 
caacv9k3oj8yzxwyroglvukecpusivebblwjpu5eqrtsxhbe...@mail.gmail.com for 
spamd:5001
   info: spamd: clean message (-3.5/5.0) for spamd:5001 in 1.2 seconds, 
2247 bytes.
   info: spamd: result: . -3 - 
AWL,BAYES_00,HTML_MESSAGE,RCVD_IN_DNSWL_LOW 
scantime=1.2,size=2247,user=spamd,uid=5001,required_score=5.0,rhost=localhost.localdomain,raddr=127.0.0.1,rport=57493,mid=caacv9k3oj8yzxwyroglvukecpusivebblwjpu5eqrtsxhbe...@mail.gmail.com,bayes=0.00,autolearn=ham
-- snip --

I have no idea is SA is clever enough to not run through the message 
again, even though Postfix is piping it to SA twice.

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus


CC destinations dropped

2012-07-19 Thread brian
A client of mine is complaining about not receiving certain messages. 
Her colleague is also being sent them and receives them just fine. She 
insists that they are not being sent to her junk folder and that she has 
no filters that might be moving them elsewhere.

I've had a look at the logs and can see that the latest msg appears to 
have been successfully sent to both mailboxes. However, I'm not sure how 
to correctly interpret the log entries. I'm including the entries below 
(removed date/time and indented for legibility) and hope that someone 
could be kind enough to clarify what's happening.

I believe the problem does not involve postfix, as pipe appears to be 
sending both. It looks to me as if lmtpunix is looking at just the one 
address and thinks there's a duplicate. Note the two duplicate_check 
lines, both of which reference the julia account. I've sent a test 
message and indeed the duplicate_check again referenced only the julia 
account again, and admin did not receive it.

The client cannot confirm whether this only happens when a message is 
addressed to both of them but thinks that may be the case.

But then pipe appears to send a copy to each mailbox after all. I'm 
quite confused.

The mailbox that is NOT receiving the msgs is admin, while julia does 
get them.

-- snip --
   postfix/smtpd[26599]: connect from 
mail-ob0-f171.google.com[209.85.214.171]
   postfix/smtpd[26599]: setting up TLS connection from 
mail-ob0-f171.google.com[209.85.214.171]
   postfix/smtpd[26599]: Anonymous TLS connection established from 
mail-ob0-f171.google.com[209.85.214.171]: TLSv1 with cipher RC4-SHA 
(128/128 bits)
   postfix/smtpd[26599]: E401F7A25EF: 
client=mail-ob0-f171.google.com[209.85.214.171]
   postfix/cleanup[26601]: E401F7A25EF: 
message-id=caacv9k3oj8yzxwyroglvukecpusivebblwjpu5eqrtsxhbe...@mail.gmail.com
   postfix/qmgr[27662]: E401F7A25EF: from=sen...@gmail.com, size=2295, 
nrcpt=2 (queue active)
   postfix/pipe[26602]: E401F7A25EF: to=ad...@domain.org, 
relay=spamassassin, delay=1.5, delays=0.23/0/0/1.3, dsn=2.0.0, 
status=sent (delivered via spamassassin service)
   postfix/pipe[26602]: E401F7A25EF: to=ju...@domain.org, 
relay=spamassassin, delay=1.5, delays=0.23/0/0/1.3, dsn=2.0.0, 
status=sent (delivered via spamassassin service)
   postfix/qmgr[27662]: E401F7A25EF: removed
   postfix/pickup[26486]: 66E757A25FC: uid=5001 from=sen...@gmail.com
   postfix/cleanup[26601]: 66E757A25FC: 
message-id=caacv9k3oj8yzxwyroglvukecpusivebblwjpu5eqrtsxhbe...@mail.gmail.com
   postfix/qmgr[27662]: 66E757A25FC: from=sen...@gmail.com, size=2646, 
nrcpt=2 (queue active)
   cyrus/master[26609]: about to exec /usr/lib/cyrus/bin/lmtpd
   cyrus/lmtpunix[26609]: executed
   cyrus/lmtpunix[26609]: accepted connection
   cyrus/lmtpunix[26609]: lmtp connection preauth'd as postman
   cyrus/lmtpunix[26609]: duplicate_check: 
caacv9k3oj8yzxwyroglvukecpusivebblwjpu5eqrtsxhbe...@mail.gmail.com 
DOMAIN.ORG!user.julia   0
   cyrus/lmtpunix[26609]: duplicate_check: 
caacv9k3oj8yzxwyroglvukecpusivebblwjpu5eqrtsxhbe...@mail.gmail.com 
DOMAIN.ORG!user.julia   0
   cyrus/lmtpunix[26609]: mystore: starting txn 2147619229
   cyrus/lmtpunix[26609]: mystore: committing txn 2147619229
   cyrus/lmtpunix[26609]: duplicate_mark: 
caacv9k3oj8yzxwyroglvukecpusivebblwjpu5eqrtsxhbe...@mail.gmail.com 
DOMAIN.ORG!user.julia   1342580059 0
   cyrus/lmtpunix[26609]: Delivered: 
caacv9k3oj8yzxwyroglvukecpusivebblwjpu5eqrtsxhbe...@mail.gmail.com to 
mailbox: DOMAIN.ORG!user.julia
   postfix/pipe[26606]: 66E757A25FC: to=ad...@domain.org, 
relay=procmail, delay=0.2, delays=0.16/0/0/0.04, dsn=2.0.0, status=sent 
(delivered via procmail service)
   postfix/pipe[26606]: 66E757A25FC: to=ju...@domain.org, 
relay=procmail, delay=0.2, delays=0.16/0/0/0.04, dsn=2.0.0, status=sent 
(delivered via procmail service)
   postfix/qmgr[27662]: 66E757A25FC: removed
   postfix/smtpd[26599]: disconnect from 
mail-ob0-f171.google.com[209.85.214.171]
-- snip --


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus