[Mailman-Users] Re: Mailman 2.1 - notifications not being properly sent to list owner

2021-04-07 Thread David Nicol 
Mark

Thank-you.  A small edit, and now its working

David
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
https://mail.python.org/archives/list/mailman-users@python.org/

[Mailman-Users] Re: Mailman 2.1 - notifications not being properly sent to list owner

2021-04-07 Thread Mark Sapiro 
On 4/7/21 3:00 AM, David Nicol wrote:
> Mark
> 
> Apr  5 22:12:05 ip-172-26-1-182 postfix/smtp[9473]: 6D0973EB91: 
> to=testmail-ow...@lists.xxx.org.uk, 
> relay=email-smtp.eu-west-2.amazonaws.com[x.x.x.x]:587, delay=0.25, 
> delays=0/0.03/0.11/0.1, dsn=2.0.0, status=sent (250 Ok 
> 010b0178a417c95d-aabe4f9d-9d5d-4508-849e-8902dc08c9b7-00)



>From the above, the mail to the `-owner` address is
`to=testmail-ow...@lists.xxx.org.uk`


> Thank-you for the relay explanation. The postconf -n command, yields for the 
> settings which are overruled as:
> 
...
> mydestination = $myhostname, localhost, 
> ip-172-26-1-182.eu-west-2.compute.internal, testlist.xxx.org.uk


and the lists.xxx.org.uk domain is not in mydestination, thus that mail
is sent to the relayhost. Mailman gets that domain from the list's
host_name attribute and it must be in mydestination to avoid the mail
being sent to the relayhost.

-- 
Mark Sapiro The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
https://mail.python.org/archives/list/mailman-users@python.org/

[Mailman-Users] Re: Mailman 2.1 - notifications not being properly sent to list owner

2021-04-07 Thread David Nicol 
And your other questions:

> Are there a set of mailman aliases in /etc/aliases
   No, that file looks like I have never touched it. It contains

# See man 5 aliases for format
postmaster:root

I do have mailman aliases in 

/usr/lib/mailman/data/aliases

# STANZA START: mailman
# CREATED: Sat Jan 30 22:48:49 2021
mailman: "|/usr/lib/mailman/mail/mailman post mailman"
mailman-admin:   "|/usr/lib/mailman/mail/mailman admin mailman"
mailman-bounces: "|/usr/lib/mailman/mail/mailman bounces mailman"
mailman-confirm: "|/usr/lib/mailman/mail/mailman confirm mailman"
mailman-join:"|/usr/lib/mailman/mail/mailman join mailman"
mailman-leave:   "|/usr/lib/mailman/mail/mailman leave mailman"
mailman-owner:   "|/usr/lib/mailman/mail/mailman owner mailman"
mailman-request: "|/usr/lib/mailman/mail/mailman request mailman"
mailman-subscribe:   "|/usr/lib/mailman/mail/mailman subscribe mailman"
mailman-unsubscribe: "|/usr/lib/mailman/mail/mailman unsubscribe mailman"
# STANZA END: mailman

> What is the content of postfix transport maps. 
I ran
   postconf transport_maps

and got the response
transport_maps =
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
https://mail.python.org/archives/list/mailman-users@python.org/

[Mailman-Users] Re: Mailman 2.1 - notifications not being properly sent to list owner

2021-04-07 Thread David Nicol 
Mark

Apr  5 22:12:05 ip-172-26-1-182 postfix/smtp[9473]: 6D0973EB91: 
to=testmail-ow...@lists.xxx.org.uk, 
relay=email-smtp.eu-west-2.amazonaws.com[x.x.x.x]:587, delay=0.25, 
delays=0/0.03/0.11/0.1, dsn=2.0.0, status=sent (250 Ok 
010b0178a417c95d-aabe4f9d-9d5d-4508-849e-8902dc08c9b7-00)

Thank-you for the relay explanation. The postconf -n command, yields for the 
settings which are overruled as:

alias_database = hash:/etc/aliases
alias_maps = hash:/etc/aliases, hash:/usr/lib/mailman/data/aliases
append_dot_mydomain = no
biff = no
compatibility_level = 2
inet_interfaces = loopback-only
inet_protocols = all
mailbox_size_limit = 0
mydestination = $myhostname, localhost, 
ip-172-26-1-182.eu-west-2.compute.internal, testlist.xxx.org.uk
myhostname = testlist.xxx.org.uk
mynetworks = 127.0.0.0/8 [:::127.0.0.0]/104 [::1]/128
myorigin = /etc/mailname
readme_directory = no
recipient_delimiter = +
relayhost = [email-smtp.eu-west-2.amazonaws.com]:587
smtp - various entries
smtpd - various entries
unknown_local_recipient_reject_code = 

Re the misplaced line in /usr/lib/mailman/data/aliases, all the entries are 
there contiguously

# STANZA START: testmail
# CREATED: Fri Feb  5 20:25:21 2021
testmail: "|/usr/lib/mailman/mail/mailman post testmail"
testmail-admin:   "|/usr/lib/mailman/mail/mailman admin testmail"
testmail-bounces: "|/usr/lib/mailman/mail/mailman bounces testmail"
testmail-confirm: "|/usr/lib/mailman/mail/mailman confirm testmail"
testmail-join:"|/usr/lib/mailman/mail/mailman join testmail"
testmail-leave:   "|/usr/lib/mailman/mail/mailman leave testmail"
testmail-owner:   "|/usr/lib/mailman/mail/mailman owner testmail"
testmail-request: "|/usr/lib/mailman/mail/mailman request testmail"
testmail-subscribe:   "|/usr/lib/mailman/mail/mailman subscribe testmail"
testmail-unsubscribe: "|/usr/lib/mailman/mail/mailman unsubscribe testmail"
# STANZA END: testmail

and output from the directory listing (which i was trying to use to show 
correct ownership of the files) does not appear in the middle. Cut and paste 
error.

David
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
https://mail.python.org/archives/list/mailman-users@python.org/

[Mailman-Users] Re: Mailman 2.1 - notifications not being properly sent to list owner

2021-04-06 Thread Mark Sapiro 
On 4/6/21 3:37 PM, David Nicol wrote:
> Thanks for your help. This is the postfix log around the time of the email 
> from my account david.ni...@x.co.uk, which is not a member of testmail.
> 
> Apr  5 22:12:02 ip-172-26-1-182 postfix/qmgr[1716]: 562AD3EB8F: 
> from=, size=11241, nrcpt=1 (queue active)
> Apr  5 22:12:02 ip-172-26-1-182 postfix/local[9468]: 562AD3EB8F: 
> to=, relay=local, delay=0.13, delays=0.04/0.01/0/0.09, 
> dsn=2.0.0, status=sent (delivered to command: /usr/lib/mailman/mail/mailman 
> post testmail)

This is your post to testmail@localhost being delivered to Mailman.


> Apr  5 22:12:05 ip-172-26-1-182 postfix/smtp[9473]: 6D0973EB91: 
> to=, 
> relay=email-smtp.eu-west-2.amazonaws.com[x.x.x.x]:587, delay=0.25, 
> delays=0/0.03/0.11/0.1, dsn=2.0.0, status=sent (250 Ok 
> 010b0178a417c95d-aabe4f9d-9d5d-4508-849e-8902dc08c9b7-00)

This is the message from Mailman to testmail-ow...@lists.xxx.org.uk, but
Postfix is not delivering it to Mailman but is realying it to
email-smtp.eu-west-2.amazonaws.com.


> In the postfix main.cf file, i have
> alias_maps = hash:/etc/aliases, hash:/usr/lib/mailman/data/aliases
> alias_database = hash:/etc/aliases


Good.


> postfix main.cf already had
> recipient_delimiter = +
> 
> * Ran the bin/genaliases script - checking file ownershp
>   and edited main.cf to add in the map to the aliases
>  
> alias_maps = hash:/etc/aliases, hash:/usr/lib/mailman/data/aliases
> 
> part of /usr/lib/mailman/data/aliases is:
> 
> # STANZA START: testmail
> # CREATED: Fri Feb  5 20:25:21 2021
> testmail: "|/usr/lib/mailman/mail/mailman post testmail"
> testmail-admin:   "|/usr/lib/mailman/mail/mailman admin testmail"
> testmail-bounces: "|/usr/lib/mailman/mail/mailman bounces testmail"
> testmail-confirm: "|/usr/lib/mailman/mail/mailman confirm testmail"
> testmail-join:"|/usr/lib/mailman/mail/mailman join testmail"
> testmail-leave:   "|/usr/lib/mailman/mail/mailman leave testmail"

> The directory listing for:  ls -l /usr/lib/mailman/data/alias*  is
> -rw-rw-r-- 1 mailman mailman  3595 Feb  5 20:50 aliases
> -rw-rw-r-- 1 mailman mailman 12288 Feb  5 20:50 aliases.db
> -

The above lines seem misplaced. Assuming that the following are also in
/usr/lib/mailman/data/aliases, that is correct.

> testmail-owner:   "|/usr/lib/mailman/mail/mailman owner testmail"
> testmail-request: "|/usr/lib/mailman/mail/mailman request testmail"
> testmail-subscribe:   "|/usr/lib/mailman/mail/mailman subscribe testmail"
> testmail-unsubscribe: "|/usr/lib/mailman/mail/mailman unsubscribe testmail"
> # STANZA END: testmail
> 
> with similar entries for the other mailing lists.
> 
> * Also configured amazon SES in postfix for outgoing email sending
> * set up systemctl to autorun mailman on reboot.

So what is the output from `postconf -n` and are there any `mailman`
aliases in /etc/aliases. And what is the content of Postfix transport maps

Something in Postfix is relaying mail for testmail-owner to
email-smtp.eu-west-2.amazonaws.com but delivering mail for testmail to
Mailman.

It seems that either there is another alias for testmail that trumps the
AWS relay but doesn't include the other list addresses or there is
something that exempts the testmail address from the AWS relay but
doesn't exempt the other addresses.


-- 
Mark Sapiro The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
https://mail.python.org/archives/list/mailman-users@python.org/

[Mailman-Users] Re: Mailman 2.1 - notifications not being properly sent to list owner

2021-04-06 Thread David Nicol 
Thanks for your help. This is the postfix log around the time of the email from 
my account david.ni...@x.co.uk, which is not a member of testmail.

Apr  5 22:12:02 ip-172-26-1-182 postfix/pickup[8839]: 562AD3EB8F: uid=1002 
from=
Apr  5 22:12:02 ip-172-26-1-182 postfix/cleanup[9466]: 562AD3EB8F: 
message-id=
Apr  5 22:12:02 ip-172-26-1-182 postfix/qmgr[1716]: 562AD3EB8F: 
from=, size=11241, nrcpt=1 (queue active)
Apr  5 22:12:02 ip-172-26-1-182 postfix/local[9468]: 562AD3EB8F: 
to=, relay=local, delay=0.13, delays=0.04/0.01/0/0.09, 
dsn=2.0.0, status=sent (delivered to command: /usr/lib/mailman/mail/mailman 
post testmail)
Apr  5 22:12:02 ip-172-26-1-182 postfix/qmgr[1716]: 562AD3EB8F: removed
Apr  5 22:12:05 ip-172-26-1-182 postfix/smtpd[9470]: connect from 
localhost[127.0.0.1]
Apr  5 22:12:05 ip-172-26-1-182 postfix/smtpd[9470]: 69CEC3EB8F: 
client=localhost[127.0.0.1]
Apr  5 22:12:05 ip-172-26-1-182 postfix/cleanup[9466]: 69CEC3EB8F: 
message-id=
Apr  5 22:12:05 ip-172-26-1-182 postfix/qmgr[1716]: 69CEC3EB8F: 
from=, size=1293, nrcpt=1 (queue active)
Apr  5 22:12:05 ip-172-26-1-182 postfix/smtpd[9470]: disconnect from 
localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5
Apr  5 22:12:05 ip-172-26-1-182 postfix/smtpd[9470]: connect from 
localhost[127.0.0.1]
Apr  5 22:12:05 ip-172-26-1-182 postfix/smtpd[9470]: 6D0973EB91: 
client=localhost[127.0.0.1]
Apr  5 22:12:05 ip-172-26-1-182 postfix/cleanup[9466]: 6D0973EB91: 
message-id=
Apr  5 22:12:05 ip-172-26-1-182 postfix/qmgr[1716]: 6D0973EB91: 
from=, size=13631, nrcpt=1 (queue active)
Apr  5 22:12:05 ip-172-26-1-182 postfix/smtpd[9470]: disconnect from 
localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5
Apr  5 22:12:05 ip-172-26-1-182 postfix/smtp[9473]: 6D0973EB91: 
to=, 
relay=email-smtp.eu-west-2.amazonaws.com[x.x.x.x]:587, delay=0.25, 
delays=0/0.03/0.11/0.1, dsn=2.0.0, status=sent (250 Ok 
010b0178a417c95d-aabe4f9d-9d5d-4508-849e-8902dc08c9b7-00)
Apr  5 22:12:05 ip-172-26-1-182 postfix/qmgr[1716]: 6D0973EB91: removed
Apr  5 22:12:05 ip-172-26-1-182 postfix/smtp[9472]: 69CEC3EB8F: 
to=, 
relay=email-smtp.eu-west-2.amazonaws.com[x.x.x.x]:587, delay=0.27, 
delays=0.01/0.03/0.12/0.11, dsn=2.0.0, status=sent (250 Ok 
010b0178a417c957-51900b52-b622-4d5c-9cb5-701458709957-00)
Apr  5 22:12:05 ip-172-26-1-182 postfix/qmgr[1716]: 69CEC3EB8F: removed

My (inexpert) reading was that it is showing:
* incoming email from david.ni...@x.co.uk
* email message back to david.ni...@x.co.uk - saying email is held. That 
email is received
* email message to testmail-owner about the held email

The work flow:
* emails for the club mailing lists: eg testm...@xxx.org.uk are sent to 
accounts sitting on the legacy version of google G-suite
* server sitting on AWS has a cron job running getmail6 which pulls emails from 
google, and delivers them to local email accounts

For installation of mailman, created an ansible script to do a basic install of
* python 2.7, 
* apache2, and
* mailman - which was installed to /usr/lib/mailman

Installed postfix with a standard apt install

Tried to follow the instructions in GNU Mailman - Installation Manual
Release 2.1
Barry Warsaw
February 26, 2019

to configure mailman, and postfix. Use of getmail6 pretty much copied across 
from old server (getmail4) which had been running on Debian 8, for which the 
LTS had expired.

At the bottom of ‘$prefix/Mailman/mm cfg.py’ file I have:
MTA = ’Postfix’

In the postfix main.cf file, i have
alias_maps = hash:/etc/aliases, hash:/usr/lib/mailman/data/aliases
alias_database = hash:/etc/aliases

postfix main.cf already had
recipient_delimiter = +

* Ran the bin/genaliases script - checking file ownershp
  and edited main.cf to add in the map to the aliases
 
alias_maps = hash:/etc/aliases, hash:/usr/lib/mailman/data/aliases

part of /usr/lib/mailman/data/aliases is:

# STANZA START: testmail
# CREATED: Fri Feb  5 20:25:21 2021
testmail: "|/usr/lib/mailman/mail/mailman post testmail"
testmail-admin:   "|/usr/lib/mailman/mail/mailman admin testmail"
testmail-bounces: "|/usr/lib/mailman/mail/mailman bounces testmail"
testmail-confirm: "|/usr/lib/mailman/mail/mailman confirm testmail"
testmail-join:"|/usr/lib/mailman/mail/mailman join testmail"
testmail-leave:   "|/usr/lib/mailman/mail/mailman leave testmail"

The directory listing for:  ls -l /usr/lib/mailman/data/alias*  is
-rw-rw-r-- 1 mailman mailman  3595 Feb  5 20:50 aliases
-rw-rw-r-- 1 mailman mailman 12288 Feb  5 20:50 aliases.db
-
testmail-owner:   "|/usr/lib/mailman/mail/mailman owner testmail"
testmail-request: "|/usr/lib/mailman/mail/mailman request testmail"
testmail-subscribe:   "|/usr/lib/mailman/mail/mailman subscribe testmail"
testmail-unsubscribe: "|/usr/lib/mailman/mail/mailman unsubscribe testmail"
# STANZA END: testmail

with similar entries for the other mailing lists.

* Also configured amazon SES in postfix for outgoing email sending
*

[Mailman-Users] Re: Mailman 2.1 - notifications not being properly sent to list owner

2021-04-06 Thread Mark Sapiro 
On 4/6/21 12:21 AM, David Nicol wrote:
> * But looking at the postfix logs, it appears to me that mailman does try
> to send a message to the moderator
> 
> Apr  5 22:12:05 ip-xxx-xxx-xxx-xxx postfix/smtp[9473]: 6D0973EB91: to=<
> testmail-ow...@lists.xxx.org.uk>,
> 
> But, the email message is being sent to the generic owner, rather than the
> specific names filled into either the moderator or administrator boxes on
> the general tab.


But that message should be delivered to Mailman and Mailman should then
resend it to the owners and moderators.

There is some issue with your aliases for delivery to Mailman.  Are you
using Postfix/Mailman integration? Do you have a full set of aliases for
each list including ones for the -owner address?

Also, what are the other Postfix log entries for queue ID 6D0973EB91?

> Also, I note that the footer of the mailing list has:
>TESTmail list run by testmail-owner at lists.XXX.org.uk
> rather than the specific owner. Which suggests the same issue.


That's not related. That's the result of the fix for
 Any clues as to what is not quite correct in the mailman setup?


Postfix delivery to the list-owner addresses.

The rest of this is personal and off topic and you can reply off list to
me, but you are not now a member of the mailman-users@python.org list. I
had trouble approving your post because you were subscribed to the list
as a `user`, but your `user` record had no associated address record.
This was causing all posts to the list (fortunately caught while yours
was still the only one) the be shunted because Mailman could not look up
the delivery status for your address. Needless to say, this should not
happen.

Please tell me as best as you can recall the steps you took and the
order in which you took them in order to join the list.

-- 
Mark Sapiro The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
https://mail.python.org/archives/list/mailman-users@python.org/