Repository: flume Updated Branches: refs/heads/trunk 94f568b96 -> 4188e4ded
FLUME-2665. Update documentation for hdfs.closeTries based on FLUME-2586 (Johny Rufus via Hari) Project: http://git-wip-us.apache.org/repos/asf/flume/repo Commit: http://git-wip-us.apache.org/repos/asf/flume/commit/4188e4de Tree: http://git-wip-us.apache.org/repos/asf/flume/tree/4188e4de Diff: http://git-wip-us.apache.org/repos/asf/flume/diff/4188e4de Branch: refs/heads/trunk Commit: 4188e4dedb4af0792bfac3086e3b2a7d415f2248 Parents: 94f568b Author: Hari Shreedharan <[email protected]> Authored: Tue Apr 14 16:21:26 2015 -0700 Committer: Hari Shreedharan <[email protected]> Committed: Tue Apr 14 16:22:23 2015 -0700 ---------------------------------------------------------------------- flume-ng-doc/sphinx/FlumeUserGuide.rst | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/flume/blob/4188e4de/flume-ng-doc/sphinx/FlumeUserGuide.rst ---------------------------------------------------------------------- diff --git a/flume-ng-doc/sphinx/FlumeUserGuide.rst b/flume-ng-doc/sphinx/FlumeUserGuide.rst index 43ca5db..8d91cec 100644 --- a/flume-ng-doc/sphinx/FlumeUserGuide.rst +++ b/flume-ng-doc/sphinx/FlumeUserGuide.rst @@ -1728,10 +1728,10 @@ hdfs.roundValue 1 Rounded down to the highest multiple of th hdfs.roundUnit second The unit of the round down value - ``second``, ``minute`` or ``hour``. hdfs.timeZone Local Time Name of the timezone that should be used for resolving the directory path, e.g. America/Los_Angeles. hdfs.useLocalTimeStamp false Use the local time (instead of the timestamp from the event header) while replacing the escape sequences. -hdfs.closeTries 0 Number of times the sink must try to close a file. If set to 1, this sink will not re-try a failed close +hdfs.closeTries 0 Number of times the sink must try renaming a file, after initiating a close attempt. If set to 1, this sink will not re-try a failed rename (due to, for example, NameNode or DataNode failure), and may leave the file in an open state with a .tmp extension. - If set to 0, the sink will try to close the file until the file is eventually closed - (there is no limit on the number of times it would try). + If set to 0, the sink will try to rename the file until the file is eventually renamed (there is no limit on the number of times it would try). + The file may still remain open if the close call fails but the data will be intact and in this case, the file will be closed only after a Flume restart. hdfs.retryInterval 180 Time in seconds between consecutive attempts to close a file. Each close call costs multiple RPC round-trips to the Namenode, so setting this too low can cause a lot of load on the name node. If set to 0 or less, the sink will not attempt to close the file if the first attempt fails, and may leave the file open or with a ".tmp" extension.
