Connor Woodson created FLUME-1856:
-------------------------------------
Summary: HDFS sink idleTimeout does not close removed BucketWriters
Key: FLUME-1856
URL: https://issues.apache.org/jira/browse/FLUME-1856
Project: Flume
Issue Type: Bug
Components: Sinks+Sources
Affects Versions: v1.3.1, v1.4.0
Reporter: Connor Woodson
When a BucketWriter idles out, it is removed from the bucket list but it is
never closed. Optimal solution will be to override LinkedHashMap.remove similar
to the removeEldestEntry code to close the bucket.
The effects of this not happening is that if you rely on idleTimeout for
closing buckets (such as setting no roll period and attempting to roll via
timestamped path), as the buckets never get closed the data never goes to s3
and so the heap gets very full.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
