Look like a crawler-bot (e.g. for Search-Engines) is triggering this. 

  HTTP_USER_AGENT = 'Mozilla/5.0 (compatible; SemrushBot/7~bl; 
+http://www.semrush.com/bot.html)'

Not sure though, how they harvested the URL that is triggering the error. Maybe 
that URL is exposed somewhere, e.g. in Postorius or Hyperkitty.


Easy mitigation is to add a robots.txt with the following content to your site:

```
  User-agent: *
  Disallow: /
```

i.e. 'https://<your_site_url>/robots.txt' should return the above (or sth. 
alike).

I added an Alias pointing to a 'robots.txt' file to the apache2 config, e.g.:

```
      Alias /robots.txt           /var/www/robots/robots.txt
```
_______________________________________________
Mailman-users mailing list -- [email protected]
To unsubscribe send an email to [email protected]
https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/
Archived at: 
https://lists.mailman3.org/archives/list/[email protected]/message/HNXPIHBGYTPHN6KQXA3HYVDVAHEFJIMK/

This message sent to [email protected]

Reply via email to