Re: [Mailman-Users] Mailman-Users Digest, Vol 191, Issue 3

2020-01-05 Thread Allan Hansen

Thanks again, Mark!
My responses below.

> On 1/4/20 5:47 PM, Allan Hansen wrote:
>> 
>> a. The server was set up with the wrong domain name (our fault), so I had to 
>> add the ‘correct’ one. I had seen the command ‘Add Domain’ in
>> the UI and thought that would do it, but Brian kindly sent me a list of 
>> additional instructions, which we then implemented. That made it possible to 
>> create a list in the new domain, subscribe people and post messages. 
>> However, messages are not archived. What extra step is needed to enable 
>> archiving? 
> 
> 
> What are the setytings in Postorius -> Settings -> Archiving?

Archive policy: Private archives
Archive archivers: hyperkitty, prototype
> 
> 
>> b. When go to the server using the new domain (both before and after logging 
>> in), I see not just the lists I created in the new domain, but the lists 
>> created in the old domain. These lists of lists are domain specific and 
>> should not be listed together. That’s just IMHO, but not serious, as I will 
>> soon get rid of anything in the old domain. So feel free to ignore this one 
>> if this is intended, which I could see might be the case.
> 
> 
> Set
> 
> FILTER_VHOST = True
> 
> in settings_local.py
> 

Yes, Brian told me to do the same. This is the what I wrote back:

hansen@rccrmail:/opt/mailman/mm$ sudo vi settings.py

Edited the setting to:
# Only display mailing-lists from the same virtual host as the webserver
FILTER_VHOST = True

Then Brian told me to restart qcluster:
hansen@rccrmail:/opt/mailman/mm$ sudo systemctl restart qcluster

I then logged in, but the same lists are showing. It either takes the system a 
long time to reset or it has ignored the 
setting.
Just tried it again, and the lists are all showing. Do I need to manually 
recompile the file?

> 
>> c. I then moved on to the templates and added a template for the message 
>> text to send to new subscribers. That resulted in the following error 
>> message when I went in as moderator to approve of a new subscription:
>> 
>> Something went wrong
>> Mailman REST API not available. Please start Mailman core.
> 
> 
> Postorius is unable to access core's REST API. Is Mailman running?

Well, I was able to post to the lists, so I assume it is. Listing at processes, 
I see a bunch of postgres, python3, nginx, django-adminp but
nothing explicitly with a ‘mailman’ string.

> If so, what's in /opt/mailman/mm/var/logs/mailmansuite.log or whatever it's
> called - defined as `filename` in the `file` handler in the LOGGING
> definition in settings(_local).py.

hansen@rccrmail:/opt/mailman/mm/logs$ tail -f mailmansuite.log
return Site.objects.get_current(request)
  File 
"/opt/mailman/mm/venv/lib/python3.7/site-packages/django/contrib/sites/models.py",
 line 60, in get_current
return self._get_site_by_request(request)
  File 
"/opt/mailman/mm/venv/lib/python3.7/site-packages/django/contrib/sites/models.py",
 line 45, in _get_site_by_request
SITE_CACHE[domain] = self.get(domain__iexact=domain)
  File 
"/opt/mailman/mm/venv/lib/python3.7/site-packages/django/db/models/manager.py", 
line 82, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
  File 
"/opt/mailman/mm/venv/lib/python3.7/site-packages/django/db/models/query.py", 
line 408, in get
self.model._meta.object_name
django.contrib.sites.models.Site.DoesNotExist: Site matching query does not 
exist.

[ABH] At this point I click to accept a subsription request:

ERROR 2020-01-06 07:32:41,439 699 postorius.middleware Mailman REST API not 
available
Traceback (most recent call last):
  File 
"/opt/mailman/mm/venv/lib/python3.7/site-packages/urllib3/connectionpool.py", 
line 672, in urlopen
chunked=chunked,
  File 
"/opt/mailman/mm/venv/lib/python3.7/site-packages/urllib3/connectionpool.py", 
line 421, in _make_request
six.raise_from(e, None)
  File "", line 3, in raise_from
  File 
"/opt/mailman/mm/venv/lib/python3.7/site-packages/urllib3/connectionpool.py", 
line 416, in _make_request
httplib_response = conn.getresponse()
  File "/usr/lib/python3.7/http/client.py", line 1321, in getresponse
response.begin()
  File "/usr/lib/python3.7/http/client.py", line 296, in begin
version, status, reason = self._read_status()
  File "/usr/lib/python3.7/http/client.py", line 265, in _read_status
raise RemoteDisconnected("Remote end closed connection without"
http.client.RemoteDisconnected: Remote end closed connection without response

So yes, the REST API is not there. How can I get it going? 
Before we added the new domain, I was able to accept subscription requests to 
the previous domain’s lists. No more.

Yours,

Allan

> 
> 
> -- 
> Mark Sapiro The highway is for gamblers,
> San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: 

Re: [Mailman-Users] msg marked as spam 554 5.7.1 [P4]

2020-01-05 Thread Stephen J. Turnbull
Thanks for the update, Bruce!

Bruce  Johnson writes:

 > This was the actual bounce error from one of the offending messages:
 > 
 > A message that you sent could not be delivered to one or more of its
 > recipients. This is a permanent error. The following address(es) failed:
 > 
 >   
 > [redacted]@alaskan.com
 > 
 > host 
 > inbound.gci.net
 >  [69.168.106.130]
 > SMTP error from remote mail server after end of data:
 > 554 5.7.1 [P4] Message blocked due to spam content in the message.

Note to OP: This is different from the message mentioned by you ("550
illegal Unicode BOM in header" or similar).  I'd need to see that
message's full header to debug that fully, but it sounds like GCI is
generally not doing a great job here.

 > It’s being bounced by some spam rule on CGI.net; it’s a global one
 > so it’s something in their configuration, since none of the other
 > providers are bouncing it, it’s not really recognizable as spam.

Bruce, Looking at your "from" address, I wonder did your message mention
pharmaceuticals, conditions, or treatments by name?  I know that for a
long time my personal filter had an enormous variety of spellings of
erectile dysfunction treatments. :-/  Nevertheless, I would say very
probably GCI is responsible.  Recipient ISPs are very hard problems,
as such ISPs generally don't give anywhere near as many damns about
lost mail (which they invariably blame on senders and/or mailing
lists) as they do about any uptick in spam.

The list should start by opening an issue with GCI, if necessary by
mail to postmaster.  If they give you "you're not a customer" BS,
report that to their users, too (see below).  At the same time, I
would inform the sender of the mail that's systematically
misclassified and ask *them* to open an issue with GCI, and to inform
you of any response.  Since they're a governmental body according to
the OP, they may have more pull than a mailing list with a "mere"
X,000 members.  If they don't get a timely, responsive answer, or get
"not a customer", send a post to the list saying "GCI-based
subscribers *are provably* losing certain kinds of list mail on a
regular basis, and since it's an automated filter, *may* be losing
non-list mail as well.  GCI is not cooperating in resolving the
problem."  Cc: the help desk, or if necessary, postmaster@gci.

If that gets no action, the next step would be to suggest well-behaved
competitors to GCI. }:^}  (If postmaster@ bounces, this is the first
step. ;-)

I agree with Jayson Smith that it's quite possible that GCI is not
running its own spam filters, but that's too bad for them.
postmaster@GCI is responsible for the health of its mail system by
definition, and that includes getting timely action from outsourced
service vendors.

I don't think there's much the list can do about this (short of
unsubscribing GCI addresses, which is not recommended unless required
by law or applicable regulation ;-), as both the sender and the
recipients' providers are effectively sovereign in this area, and the
message content is apparently innocuous.

Steve

--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] msg marked as spam 554 5.7.1 [P4]

2020-01-05 Thread Jayson Smith

Hi,

I've seen this exact error before with various ISPs. I believe one of 
them is Centurytel. I assume what's happened is that several ISPs use a 
certain spam filtering service or app, and that filter is rejecting the 
messages for some unknown reason. If that's the case, the particular ISP 
in question probably won't have a clue what's going on. Hopefully 
they'll care enough to consult with the third-party filtering service.


Jayson

On 1/5/2020 5:23 PM, Bruce Johnson wrote:

I was the off-list person...

This was the actual bounce error from one of the offending messages:

A message that you sent could not be delivered to one or more of its
recipients. This is a permanent error. The following address(es) failed:

   
[redacted]@alaskan.com


 host
inbound.gci.net
  [69.168.106.130]
 SMTP error from remote mail server after end of data:
 554 5.7.1 [P4] Message blocked due to spam content in the message.

It’s being bounced by some spam rule on CGI.net; it’s a global one so it’s 
something in their configuration, since none of the other providers are 
bouncing it, it’s not really recognizable as spam.

(or one user reported it as spam and they took the lazy way out and blocked all 
the emails from that list address…we have one user who routinely marks email 
from one list on our domain as ’spam’…then complains that he’s not getting 
emails from the list…sigh )




On Jan 5, 2020, at 11:48 AM, Jim Dory  wrote:

On Sun, Jan 5, 2020 at 12:56 AM Stephen J. Turnbull <
turnbull.stephen...@u.tsukuba.ac.jp> wrote:


Jim Dory writes:



Sometimes I do get this: host mx1.arandomserver.com [198.252.100.64]
SMTP error from remote mail server after end of data:
550 Headers contain illegal BOM
on my personal email from the same sender (city), but not sure that is

same

issue.

I don't understand.  You say it's personal mail *from the city*, but
you're getting the bounce message?  That should not happen; the bounce
message should go to the city.




I don't think the city would see a bounce because the list accepted their
message and a lot of subscribers would see it.. but it was rejected only by
one or two other subscriber email providers. That is my understanding
anyway, perhaps I'm wrong.  I see the bounces as admin for the list. Isn't
this proper behavior of the mailman software? It seems that people would
complain (or ask about it) if they saw all the bounces caused by one of
their messages and they never have.




That's nothing.  Don't hesitate.  It's much more annoying to have to
go back and forth if you send incomplete headers.



Could it be that GCI needs to whitelist or something?

Not enough information.  It sounds like either or both the city and
GCI have difficulty with email since it's that particular combination,
but which one is whack I can't tell without a look at the delivery
status notice (bounce message) for the mass bounces.  This is often in
your mail server's log as well.




Steve, thanks very much for replying and looking at this. I realize now I
didn't provide sufficient info and will in the future amend my ways.

I'm going to contact GCI and see if I can get them to either whitelist or
clean up a possible mis-configure in their system. Another kind gentlemen
from this mailman list contacted me off-list with an offer to help - I sent
him the complete header and reject message.. and he felt that there was
nothing apparent to warrant an email provider to reject it.

thanks, Jim
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/johnson%40pharmacy.arizona.edu



--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] msg marked as spam 554 5.7.1 [P4]

2020-01-05 Thread Bruce Johnson
I was the off-list person...

This was the actual bounce error from one of the offending messages:

A message that you sent could not be delivered to one or more of its
recipients. This is a permanent error. The following address(es) failed:

  
[redacted]@alaskan.com

host 
inbound.gci.net
 [69.168.106.130]
SMTP error from remote mail server after end of data:
554 5.7.1 [P4] Message blocked due to spam content in the message.

It’s being bounced by some spam rule on CGI.net; it’s a global one so it’s 
something in their configuration, since none of the other providers are 
bouncing it, it’s not really recognizable as spam.

(or one user reported it as spam and they took the lazy way out and blocked all 
the emails from that list address…we have one user who routinely marks email 
from one list on our domain as ’spam’…then complains that he’s not getting 
emails from the list…sigh )



> On Jan 5, 2020, at 11:48 AM, Jim Dory  wrote:
> 
> On Sun, Jan 5, 2020 at 12:56 AM Stephen J. Turnbull <
> turnbull.stephen...@u.tsukuba.ac.jp> wrote:
> 
>> Jim Dory writes:
>> 
>> 
>>> Sometimes I do get this: host mx1.arandomserver.com [198.252.100.64]
>>>SMTP error from remote mail server after end of data:
>>>550 Headers contain illegal BOM
>>> on my personal email from the same sender (city), but not sure that is
>> same
>>> issue.
>> 
>> I don't understand.  You say it's personal mail *from the city*, but
>> you're getting the bounce message?  That should not happen; the bounce
>> message should go to the city.
>> 
>> 
>> 
> 
> I don't think the city would see a bounce because the list accepted their
> message and a lot of subscribers would see it.. but it was rejected only by
> one or two other subscriber email providers. That is my understanding
> anyway, perhaps I'm wrong.  I see the bounces as admin for the list. Isn't
> this proper behavior of the mailman software? It seems that people would
> complain (or ask about it) if they saw all the bounces caused by one of
> their messages and they never have.
> 
> 
> 
>> 
>> That's nothing.  Don't hesitate.  It's much more annoying to have to
>> go back and forth if you send incomplete headers.
>> 
>> 
>>> 
>>> Could it be that GCI needs to whitelist or something?
>> 
>> Not enough information.  It sounds like either or both the city and
>> GCI have difficulty with email since it's that particular combination,
>> but which one is whack I can't tell without a look at the delivery
>> status notice (bounce message) for the mass bounces.  This is often in
>> your mail server's log as well.
>> 
>> 
>> 
> Steve, thanks very much for replying and looking at this. I realize now I
> didn't provide sufficient info and will in the future amend my ways.
> 
> I'm going to contact GCI and see if I can get them to either whitelist or
> clean up a possible mis-configure in their system. Another kind gentlemen
> from this mailman list contacted me off-list with an offer to help - I sent
> him the complete header and reject message.. and he felt that there was
> nothing apparent to warrant an email provider to reject it.
> 
> thanks, Jim
> --
> Mailman-Users mailing list Mailman-Users@python.org
> https://mail.python.org/mailman/listinfo/mailman-users
> Mailman FAQ: http://wiki.list.org/x/AgA3
> Security Policy: http://wiki.list.org/x/QIA9
> Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
> Unsubscribe: 
> https://mail.python.org/mailman/options/mailman-users/johnson%40pharmacy.arizona.edu

-- 
Bruce Johnson
University of Arizona
College of Pharmacy
Information Technology Group

Institutions do not have opinions, merely customs


--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] msg marked as spam 554 5.7.1 [P4]

2020-01-05 Thread Jim Dory
On Sun, Jan 5, 2020 at 12:56 AM Stephen J. Turnbull <
turnbull.stephen...@u.tsukuba.ac.jp> wrote:

> Jim Dory writes:
>
>
>  > Sometimes I do get this: host mx1.arandomserver.com [198.252.100.64]
>  > SMTP error from remote mail server after end of data:
>  > 550 Headers contain illegal BOM
>  > on my personal email from the same sender (city), but not sure that is
> same
>  > issue.
>
> I don't understand.  You say it's personal mail *from the city*, but
> you're getting the bounce message?  That should not happen; the bounce
> message should go to the city.
>
>
>

I don't think the city would see a bounce because the list accepted their
message and a lot of subscribers would see it.. but it was rejected only by
one or two other subscriber email providers. That is my understanding
anyway, perhaps I'm wrong.  I see the bounces as admin for the list. Isn't
this proper behavior of the mailman software? It seems that people would
complain (or ask about it) if they saw all the bounces caused by one of
their messages and they never have.



>
> That's nothing.  Don't hesitate.  It's much more annoying to have to
> go back and forth if you send incomplete headers.
>
>
>  >
>  > Could it be that GCI needs to whitelist or something?
>
> Not enough information.  It sounds like either or both the city and
> GCI have difficulty with email since it's that particular combination,
> but which one is whack I can't tell without a look at the delivery
> status notice (bounce message) for the mass bounces.  This is often in
> your mail server's log as well.
>
>
>
Steve, thanks very much for replying and looking at this. I realize now I
didn't provide sufficient info and will in the future amend my ways.

I'm going to contact GCI and see if I can get them to either whitelist or
clean up a possible mis-configure in their system. Another kind gentlemen
from this mailman list contacted me off-list with an offer to help - I sent
him the complete header and reject message.. and he felt that there was
nothing apparent to warrant an email provider to reject it.

thanks, Jim
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


[Mailman-Users] msg marked as spam 554 5.7.1 [P4]

2020-01-05 Thread Stephen J. Turnbull
Jim Dory writes:

 > I have one problem that when a particular user (the city) sends an
 > announcement, it tends to bounce hundreds of mainly one ISP's users.. that
 > ISP being Alaska's GCI.com .

I assume you mean that the attempt to deliver to users at GCI bounce
back to you?

What we would like to see is the delivery service message from GCI
which explains why the message is being refused.

 > Sometimes I do get this: host mx1.arandomserver.com [198.252.100.64]
 > SMTP error from remote mail server after end of data:
 > 550 Headers contain illegal BOM
 > on my personal email from the same sender (city), but not sure that is same
 > issue.

I don't understand.  You say it's personal mail *from the city*, but
you're getting the bounce message?  That should not happen; the bounce
message should go to the city.

 > The city usually includes a link to the city codes on a public webpage -
 > perhaps that triggers GCI.

Are you saying there's a link in the header?  Those are common (eg,
Mailman can be configured to put certain links in the header), and
should not cause problems if correctly formed.  Nothing in the content
should cause any kind of bounce except a 552 "We don't like your mail
for some reason" Administrative Denial (or perhaps another 55x
response.

 > I could post one of the headers in total but it is probably about 3 pages
 > worth.

That's nothing.  Don't hesitate.  It's much more annoying to have to
go back and forth if you send incomplete headers.

 > Everything sort of looks ok to me except I notice this:
 > BODY: Bayes spam probability is 0 to 1% [score: 0.] 0.0
 > RCVD_IN_DNSWL_BLOCKED RBL: ADMINISTRATOR NOTICE: The query to DNSWL was
 > blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block
 > for more information. [34.212.96.103 listed in list.dnswl.org] -0.0
 > SPF_PASS SPF: sender matches SPF record 0.0 HTML_MESSAGE BODY: HTML
 > included in message

The sentence about querying DNSWL is a bit weird, but I don't think
it's a problem.  That check was just skipped.

The rest is perfectly normal and is not symptomatic of a problem.

 > The link in the messages is https://www.codepublishing.com/AK/Nome/ .

That link is never going to cause a problem.
 > 
 > I can post more of the header if need be.
 > 
 > Could it be that GCI needs to whitelist or something?

Not enough information.  It sounds like either or both the city and
GCI have difficulty with email since it's that particular combination,
but which one is whack I can't tell without a look at the delivery
status notice (bounce message) for the mass bounces.  This is often in
your mail server's log as well.

Steve
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org