Re: [exim-dev] [exim] Exim 4.89 RC7

2017-03-02 Thread The Doctor 
On Fri, Mar 03, 2017 at 01:07:13AM +, Phil Pennock wrote:
> On 2017-02-28 at 22:48 -0500, Phil Pennock wrote:
> > I have uploaded Exim 4.89 RC7 to:
> > 
> > https://ftp.exim.org/pub/exim/exim4/test/
> 
> No replies.  I don't know whether to be ecstatic or very very afraid.
> 
> Unless I hear of issues, I intend to cut Exim 4.89 on Tuesday 7th March,
> sometime in the morning in US/Eastern timezone.
> 
> It would still be nice to see "yes, this has fixed all the issues we've
> been seeing", but I understand that for intermittent failures, folks
> want to give it enough time to have confidence that the issues really
> are gone, not just doing a better job of hiding.
>

Looking good to me.

> -Phil
> 
> -- 
> ## List details at https://lists.exim.org/mailman/listinfo/exim-users
> ## Exim details at http://www.exim.org/
> ## Please use the Wiki with this list - http://wiki.exim.org/

-- 
Member - Liberal International This is doctor@@nl2k.ab.ca Ici doctor@@nl2k.ab.ca
Yahweh, Queen & country!Never Satan President Republic!Beware AntiChrist rising!
http://www.fullyfollow.me/rootnl2k  Look at Psalms 14 and 53 on Atheism
God is dead! Yahweh lives! Jesus his only begotten Son is the Risen Saviour!!

-- 
## List details at https://lists.exim.org/mailman/listinfo/exim-dev Exim 
details at http://www.exim.org/ ##

Re: [exim-dev] [exim] Exim 4.89 RC7

2017-03-02 Thread Phil Pennock 
On 2017-02-28 at 22:48 -0500, Phil Pennock wrote:
> I have uploaded Exim 4.89 RC7 to:
> 
> https://ftp.exim.org/pub/exim/exim4/test/

No replies.  I don't know whether to be ecstatic or very very afraid.

Unless I hear of issues, I intend to cut Exim 4.89 on Tuesday 7th March,
sometime in the morning in US/Eastern timezone.

It would still be nice to see "yes, this has fixed all the issues we've
been seeing", but I understand that for intermittent failures, folks
want to give it enough time to have confidence that the issues really
are gone, not just doing a better job of hiding.

-Phil

-- 
## List details at https://lists.exim.org/mailman/listinfo/exim-dev Exim 
details at http://www.exim.org/ ##

[exim-dev] [Bug 2066] Disappeared messages.

2017-03-02 Thread admin 
https://bugs.exim.org/show_bug.cgi?id=2066

--- Comment #4 from Phil Pennock  ---
Also: can you check the mailbox to see if the mail arrived there, despite the
missing logging from Exim?

Inbound mail is written to stable storage before being acknowledged (unless
you've built with the strongly-discouraged disable-fsync support).

So if the mail is not present, then with high confidence, either it was never
accepted ("fakereject", mis-logged before 4.88) or it was delivered onwards but
Exim failed to log it.  An Exim process crashing after successful delivery
would explain missing logs and mails not in the queue.

Also, if you're able to build with 4.89RC7 (*not* 4.88) and try that, it would
help.  There have been a number of crash fixes and I seem to recall one tied in
with event-based logging to mysql.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
-- 
## List details at https://lists.exim.org/mailman/listinfo/exim-dev Exim 
details at http://www.exim.org/ ##

[exim-dev] [Bug 2066] Disappeared messages.

2017-03-02 Thread admin 
https://bugs.exim.org/show_bug.cgi?id=2066

Phil Pennock  changed:

   What|Removed |Added

 CC||p...@exim.org

--- Comment #3 from Phil Pennock  ---
Are you using "fakereject"?  Prior to 4.88, these were logged as "<=" instead
of "(=".

-- 
You are receiving this mail because:
You are on the CC list for the bug.
-- 
## List details at https://lists.exim.org/mailman/listinfo/exim-dev Exim 
details at http://www.exim.org/ ##

[exim-dev] [Bug 2066] Disappeared messages.

2017-03-02 Thread admin 
https://bugs.exim.org/show_bug.cgi?id=2066

--- Comment #2 from Ros  ---
Thank you for your reply.
2) Yes, I checked "mailq" output and message was not there. Besides, there was
log line "1cj5wG-000B8D-1j Completed".
3) Here is my routing chain:

aliases_fallback:
  driver  = manualroute
  domains = local.domain
  condition   =
${lookup{LPART_STRIP_PLUS}lsearch{/usr/DOMAIN-ROUTING}{yes}{no}}
  transport   = remote_smtp
  hosts_randomize
  route_list  = * mx-fallback1:mx-fallback2

second_delivery:
  driver  = manualroute
  domains = local.domain
  condition   = ${if !first_delivery}
  transport   = remote_smtp
  hosts_randomize
  route_list  = * mx-fallback1:mx-fallback2

hidden_router:
  driver  = manualroute
  transport   = remote_smtp
  condition   = ${lookup{$domain}lsearch{/usr/lists/HIDDEN}{yes}{no}}
  route_data  = ${lookup{$domain}lsearch{/usr/lists/HIDDEN}}

dnslookup:
  driver  = dnslookup
  domains = ! +local_domains
  transport   = remote_smtp
  ignore_target_hosts =
127.0.0.0/8:0.0.0.0/32:10.0.0.0/8:192.168.0.0/16:172.16.0.0/12:192.0.32.10/32

smtp_inbox_sf:
  driver   = manualroute
  domains  = local.domain
  host_find_failed = defer
  condition= ${lookup mysql{select data} {yes}{no}}
  condition= ${lookup mysql{insert data} {yes}{no}}
  headers_add  = "X-Mask: $acl_m_mask"
  transport= remote_lmtp
  route_data   = AUTH_INFO_GET_STORAGE::2555

smtp_inbox:
  driver   = manualroute
  domains  = local.domain
  host_find_failed = defer
  condition= ${lookup mysql{insert data} {yes}{no}}
  headers_add  = "X-Mask: $acl_m_mask"
  transport= remote_lmtp
  route_data   = AUTH_INFO_GET_STORAGE::2555

general_fallback:
  driver  = manualroute
  domains = local.domain
  headers_remove  = "X-Mask:"
  headers_add = "X-Mask: $acl_m_mask"
  transport   = remote_smtp
  hosts_randomize
  route_list  = * mx-fallback1

general_fallback router was added when we've noticed "disappearing" and it has
never occurred in logs.
If AUTH_INFO_GET_STORAGE::2555 fail in smtp_inbox router then next queue runner
delivery message to fallback hosts via second_delivery router.
{select data} query is ${if eq {${lookup mysql{SELECT count(*) FROM book WHERE
hpair=MD5(LOWER('USER_SENDER_PAIR')) and flag=1 limit 1}}}{1}{yes}{no}}
{insert data} query is ${lookup mysql{INSERT INTO rep SET
ip=inet_aton('$sender_host_address'), inbox=0, spam=1 ON DUPLICATE KEY UPDATE
spam=spam+1}{yes}{no}}
USER_SENDER_PAIR=${quote_mysql:$local_part@$domain$acl_m_mailfrom}

This is my sysfilter file:
# Exim filter for MX
if "${if def:h_Message-Id {yes}{no}}" is no
then
headers add "Message-Id:
<${tod_epoch}-${message_exim_id}@${sender_address_domain}>"
endif

if not first_delivery
then finish
endif

I hope this information will be helpful.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
-- 
## List details at https://lists.exim.org/mailman/listinfo/exim-dev Exim 
details at http://www.exim.org/ ##

[exim-dev] [Bug 2066] Disappeared messages.

2017-03-02 Thread admin 
https://bugs.exim.org/show_bug.cgi?id=2066

--- Comment #1 from Jeremy Harris  ---
1) You can run debug mode for selected messages using a "control = debug"
   ACL modifier.
   See
http://exim.org/exim-html-4.87/doc/html/spec_html/ch-access_control_lists.html#SECTcontrols

2) I assume you searched the log for the message-id involved and saw no
delivery.
   Did you check "mailq" output?  Is the message still in the queue?

3) If your router declined thanks to its condition options, what should the
   routers chain have gone on to do?

-- 
You are receiving this mail because:
You are on the CC list for the bug.
-- 
## List details at https://lists.exim.org/mailman/listinfo/exim-dev Exim 
details at http://www.exim.org/ ##

[exim-dev] [Bug 2066] New: Disappeared messages.

2017-03-02 Thread admin 
https://bugs.exim.org/show_bug.cgi?id=2066

Bug ID: 2066
   Summary: Disappeared messages.
   Product: Exim
   Version: 4.87
  Hardware: x86-64
OS: FreeBSD
Status: NEW
  Severity: bug
  Priority: medium
 Component: Routing
  Assignee: ni...@exim.org
  Reporter: zarabo...@gmail.com
CC: exim-dev@exim.org

Hello,

I've faced with a problem of disappeared messages. In logs it looks like server
takes message and then message disappears:
#cat main.log.0 | grep 1cj5wG-000B8D-1j
2017-03-01 17:13:12 [42793] 1cj5wG-000B8D-1j DKIM: d=sender.domain s=us
c=relaxed/relaxed a=rsa-sha1 b=1024 i=bestdeal@sender.domain [verification
succeeded]
2017-03-01 17:13:12 [42793] 1cj5wG-000B8D-1j DMARC results:
spf_domain=emluni.com dmarc_domain=sender.domain spf_align=no dkim_align=yes
enforcement='Accept'
2017-03-01 17:13:12 [42793] 1cj5wG-000B8D-1j <= post...@emluni.com
H=smtp278.emlone.com [85.206.175.34] P=esmtp S=95356
id=e1cj5we-ztyqtj...@ucs11-ucs-5.msgpanel.com T="Subject was changed." for
user@local.domain
2017-03-01 17:14:46 [71994] 1cj5wG-000B8D-1j Completed
(Original sender domain and my domain were changed to sender.domain and
local.domain respectively.)
Message 1cj5wG-000B8D-1j hasn't been delivered to user@local.domain's mailbox.

I had router:
smtp_inbox:
  driver   = manualroute
  domains  = local.domain
  host_find_failed = defer
  condition= ${lookup mysql{select data} {yes}{no}}
  condition= ${lookup mysql{insert data} {yes}{no}}
  headers_add  = "Some header: some info"
  transport= remote_lmtp
  route_data   = AUTH_INFO_GET_STORAGE::2555

and transport for it:
remote_lmtp:
  driver = smtp
  protocol = lmtp
  hosts_override
  port = 2555
  return_path_add

After deleting two conditions with mysql queries messages stopped disappearing.
Even if database was inaccessible I haven't found any errors about it in exim's
or mysql's logs.
Unfortunately, I cannot run exim in debugging mode because incoming message's
flow is very big.
I have found a thread https://bugs.exim.org/show_bug.cgi?id=1788 with similar
problem but not the same. 
"Disappearing" does not depend on sender domain or time.
Do you have any idea why messages disappear from queue silently?

-- 
You are receiving this mail because:
You are on the CC list for the bug.
-- 
## List details at https://lists.exim.org/mailman/listinfo/exim-dev Exim 
details at http://www.exim.org/ ##