[
https://issues.apache.org/jira/browse/FLUME-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13710185#comment-13710185
]
Hari Shreedharan commented on FLUME-2007:
-----------------------------------------
Thanks Ted. This file is missing the ASF license header:
flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/MockFileSystemCloseRetryWrapper.java
Also I changed this to:
{code}
if (numberOfCloseRetries > 0) {
try {
timeBetweenCloseRetries = context.getLong("hdfs.callTimeout", 10000l);
} catch (NumberFormatException e) {
logger.warn("hdfs.callTimeout can not be parsed to a long: " +
context.getLong("hdfs.callTimeout"));
}
timeBetweenCloseRetries =
Math.max(timeBetweenCloseRetries/numberOfCloseRetries, 1000);
}
{code}
and this change in the test:
{code}
context.put("hdfs.closeTries", String.valueOf(numberOfCloseRetriesToAttempt));
{code}
> HDFS Sink should check if file is closed and retry if it is not.
> ----------------------------------------------------------------
>
> Key: FLUME-2007
> URL: https://issues.apache.org/jira/browse/FLUME-2007
> Project: Flume
> Issue Type: Bug
> Reporter: Hari Shreedharan
> Assignee: Ted Malaska
> Attachments: FLUME-2007-0.patch, FLUME-2007-1.patch,
> FLUME-2007-2.patch, FLUME-2007-4.patch, FLUME-2007-5.patch,
> FLUME-2007-6.patch, FLUME-2007-6.patch
>
>
> We can use the new API added in HDFS-4525. We will need to use reflection
> though, so we can run against a version of HDFS which does not have this API.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
