Re: [exim] Outstanding problems with Exim 4.90.1?

2018-09-27 Thread Mike Brudenell via Exim-users 
Thanks, Andreas, but I think this is a different problem…

On my Exim I see either:

   - the message is accepted into the queue then successfully delivered
   onward and removed from my queue, but the sending MTA doesn't see the SMTP
   2xx response so *it* retains the message in *its* queues, or
   - the message does not arrive into my queue completely, with each end
   sitting there waiting for something, before eventually one end times out
   and the connection closes again leaving the message in the *far end's*
queue.

It's this first that's giving rise to duplicate transmissions from the far
MTA and deliveries, and the latter to repeated attempts to transmit the
message in to us and having it fail.

There must be something odd somewhere if others are using cutthrough
successfully, as these servers only relay a small amount of incoming mail
to a couple of local servers plus virtual host some legacy domains. It's
not exactly busy! Strange…

Cheers,
Mike B-)

On Wed, 26 Sep 2018 at 19:00, Andreas Metzler via Exim-users <
exim-users@exim.org> wrote:

> Mike Brudenell via Exim-users  wrote:
> [..]
> > The sad news is that I've had to give up on cutthrough_delivery and turn
> it
> > off. The problems we were seeing:
> [...]
> >- Duplicate deliveries when our Exim sometimes received enough of the
> >message to spool into the queue but the far end didn't get the SMTP
> >acknowledgement because the connection had "stuck", so held the
> message in
> >their queues to retry later;
>
> Sounds like this change in exim 4.91+fixes:
>
> JH/05 Bug 2273: Cutthrough delivery left a window where the received
> messsage
>   files in the spool were present and unlocked.  A queue-runner could
> spot
>   them, resulting in a duplicate delivery.  Fix that by doing the
> unlock
>   after the unlink.  Investigation by Tim Stewart.
>
> cu Andreas
>
>
> --
> ## List details at https://lists.exim.org/mailman/listinfo/exim-users
> ## Exim details at http://www.exim.org/
> ## Please use the Wiki with this list - http://wiki.exim.org/
>


-- 
Systems Administrator & Change Manager
IT Services, University of York, Heslington, York YO10 5DD, UK
Tel: +44-(0)1904-323811

Web: www.york.ac.uk/it-services
Disclaimer: www.york.ac.uk/docs/disclaimer/email.htm
-- 
## List details at https://lists.exim.org/mailman/listinfo/exim-users
## Exim details at http://www.exim.org/
## Please use the Wiki with this list - http://wiki.exim.org/

Re: [exim] Outstanding problems with Exim 4.90.1?

2018-09-27 Thread Jeremy Harris via Exim-users 
On 9/27/18 11:04 AM, Mike Brudenell via Exim-users wrote:
>
> 
>to their *Ubuntu Changes* page listing changes.

>From the dates, that runs up to mid-February. So, no - it seems
unlikely.  Is that Ubuntu's most recent?
-- 
Cheers,
  Jeremy

-- 
## List details at https://lists.exim.org/mailman/listinfo/exim-users
## Exim details at http://www.exim.org/
## Please use the Wiki with this list - http://wiki.exim.org/

Re: [exim] Outstanding problems with Exim 4.90.1?

2018-09-27 Thread Evgeniy Berdnikov via Exim-users 
On Thu, Sep 27, 2018 at 11:04:46AM +0100, Mike Brudenell via Exim-users wrote:
> I'm not brilliant at checking whether a specific patch has been included
> within a Ubuntu-distributed package…
> 
>- We're using Ubuntu 18.04.1 LTS (bionic) with the
>package exim4-daemon-heavy 4.90.1-1ubuntu1.

 On Debian/Ubuntu look into /usr/share/doc/exim4-base/changelog.gz.
 As Andreas wrote, the patch was for 4.91+.
-- 
 Eugene Berdnikov

-- 
## List details at https://lists.exim.org/mailman/listinfo/exim-users
## Exim details at http://www.exim.org/
## Please use the Wiki with this list - http://wiki.exim.org/

Re: [exim] Outstanding problems with Exim 4.90.1?

2018-09-27 Thread Mike Brudenell via Exim-users 
I've managed to unpack the .xz archive files (Tip: just use GNU tar and it
recognises/unpacks it) for the source and patches and it doesn't appear to
have been applied. I'm not overly surprised as they'll have been working
towards the release of Ubuntu 18.04 LTS (Long Term Stable) which happened
in April 2018.

However the next release of Ubuntu 18.10 (cosmic) will contain Exim 4.91
and checking its source code shows that patch has indeed been applied to it.

Sadly our current policy is to only use LTS releases of Ubuntu, so unless
this changes I guess I'm stuck with 18.04 LTS and the unpatched Exim 4.90.1
for the next 18 months: hence no cutthrough still. (I've just asked, and
our policy is unlikely to be changed. Hey-ho.)


On Thu, 27 Sep 2018 at 12:26, Evgeniy Berdnikov via Exim-users <
exim-users@exim.org> wrote:

> On Thu, Sep 27, 2018 at 11:04:46AM +0100, Mike Brudenell via Exim-users
> wrote:
> >- We're using Ubuntu 18.04.1 LTS (bionic) with the
> >package exim4-daemon-heavy 4.90.1-1ubuntu1.
>
>  On Debian/Ubuntu look into /usr/share/doc/exim4-base/changelog.gz.
>  As Andreas wrote, the patch was for 4.91+.


I'd noticed that,  but Jeremy asked me to check the Ubuntu distribution of
the 4.90.1 we're using: I guess just in case it had been backported.

Cheers,
Mike B-)

On Thu, 27 Sep 2018 at 12:06, Jeremy Harris via Exim-users <
exim-users@exim.org> wrote:

> On 9/27/18 11:04 AM, Mike Brudenell via Exim-users wrote:
> ><
> http://changelogs.ubuntu.com/changelogs/pool/main/e/exim4/exim4_4.90.1-1ubuntu1/changelog
> >
> >to their *Ubuntu Changes* page listing changes.
>
> From the dates, that runs up to mid-February. So, no - it seems
> unlikely.  Is that Ubuntu's most recent?
> --
> Cheers,
>   Jeremy
>
> --
> ## List details at https://lists.exim.org/mailman/listinfo/exim-users
> ## Exim details at http://www.exim.org/
> ## Please use the Wiki with this list - http://wiki.exim.org/
>


-- 
Systems Administrator & Change Manager
IT Services, University of York, Heslington, York YO10 5DD, UK
Tel: +44-(0)1904-323811

Web: www.york.ac.uk/it-services
Disclaimer: www.york.ac.uk/docs/disclaimer/email.htm
-- 
## List details at https://lists.exim.org/mailman/listinfo/exim-users
## Exim details at http://www.exim.org/
## Please use the Wiki with this list - http://wiki.exim.org/

Re: [exim] Outstanding problems with Exim 4.90.1?

2018-09-27 Thread Andreas Metzler via Exim-users 
Jeremy Harris via Exim-users  wrote:
> On 9/27/18 9:59 AM, Mike Brudenell via Exim-users wrote:
>> Thanks, Andreas, but I think this is a different problem…

> But it does match the first problem you described, where you got
> a duplicate delivery (and a msglog unlink error).  The reporter
> of it also saw the unlink error.

> Does your Ubuntu version carry that fix Andreas noted?
> It was cfbb0d24e8 in the Exim master branch; 56b566daa2
> in exim 4.91+fixes, dated 2018/05/05.

Hello,

it won't be included. Are you able run packages from Debian backports?

cu Andreas
-- 
`What a good friend you are to him, Dr. Maturin. His other friends are
so grateful to you.'
`I sew his ears on from time to time, sure'


-- 
## List details at https://lists.exim.org/mailman/listinfo/exim-users
## Exim details at http://www.exim.org/
## Please use the Wiki with this list - http://wiki.exim.org/

Re: [exim] Outstanding problems with Exim 4.90.1?

2018-09-27 Thread Jeremy Harris via Exim-users 
On 9/27/18 9:59 AM, Mike Brudenell via Exim-users wrote:
> Thanks, Andreas, but I think this is a different problem…

But it does match the first problem you described, where you got
a duplicate delivery (and a msglog unlink error).  The reporter
of it also saw the unlink error.

Does your Ubuntu version carry that fix Andreas noted?
It was cfbb0d24e8 in the Exim master branch; 56b566daa2
in exim 4.91+fixes, dated 2018/05/05.


[ Thanks, Andreas! ]

-- 
Cheers,
  Jeremy

-- 
## List details at https://lists.exim.org/mailman/listinfo/exim-users
## Exim details at http://www.exim.org/
## Please use the Wiki with this list - http://wiki.exim.org/

Re: [exim] Outstanding problems with Exim 4.90.1?

2018-09-27 Thread Mike Brudenell via Exim-users 
Ah-ha! My apologies: I'd forgotten that was causing duplicate deliveries
too. (I've not had my first cup of coffee here yet!)

I'm not brilliant at checking whether a specific patch has been included
within a Ubuntu-distributed package…

   - We're using Ubuntu 18.04.1 LTS (bionic) with the
   package exim4-daemon-heavy 4.90.1-1ubuntu1.
   - The page at the Ubuntu packages site is here
   .
   - It has an onward link
   

   to their *Ubuntu Changes* page listing changes.

Sadly I get stuck there, not being able to figure out from that Change Log
whether the patch has been backported from 4.91 to 4.90.1 and applied or
not. I've tried downloading the source code from there but can't get it
unpacked; bring back straightforward .tar.gz files!

However I do see Andres' name many times in the Ubuntu package's Change
Log… :-)
Andreas, do you know if that patch has been backported/applied?

Cheers,
Mike B-)
-- 
Systems Administrator & Change Manager
IT Services, University of York, Heslington, York YO10 5DD, UK
Tel: +44-(0)1904-323811

Web: www.york.ac.uk/it-services
Disclaimer: www.york.ac.uk/docs/disclaimer/email.htm
-- 
## List details at https://lists.exim.org/mailman/listinfo/exim-users
## Exim details at http://www.exim.org/
## Please use the Wiki with this list - http://wiki.exim.org/