GitHub user majorendre opened a pull request:
https://github.com/apache/flume/pull/229
FLUME-3223 Flume HDFS Sink should retry close prior release lease
This is based on @mcsanady 's original pull request #202
I have took the test changes from him but reworked the new feature
implementation since it failed some unit tests.
Previously when a close failed we immediately did a recover lease. This PR
introduces a background retry mechanism. It uses the already existing
"hdfs.closeTries" parameter. Unfortunately it has infinite retries by default,
that seems a bit too long for me.
I also did a minimal code clean up.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/majorendre/flume FLUME-3223
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flume/pull/229.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #229
----
commit 5514f0489ae6091bec5eea814a4c8a9990eede35
Author: Endre Major <emajor@...>
Date: 2018-09-27T12:05:38Z
FLUME-3223 Flume HDFS Sink should retry close prior release lease
----
---
