[jira] [Commented] (FLUME-3216) When I rename the file, it causes flume to read the data repeatedly.
[ https://issues.apache.org/jira/browse/FLUME-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359326#comment-16359326 ] jifei_yang commented on FLUME-3216: --- I modified the method of judgment: Judge the log file only by inode. > When I rename the file, it causes flume to read the data repeatedly. > > > Key: FLUME-3216 > URL: https://issues.apache.org/jira/browse/FLUME-3216 > Project: Flume > Issue Type: Improvement > Components: Sinks+Sources >Affects Versions: 1.8.0 > Environment: centos-6.8 >Reporter: jifei_yang >Priority: Critical > Fix For: 1.7.0, 1.8.0 > > > When I use Taildir source, whenever I rename a file, it causes flume to read > the data repeatedly.This resulted in duplication of uploaded data. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@flume.apache.org For additional commands, e-mail: issues-h...@flume.apache.org
[jira] [Commented] (FLUME-3216) When I rename the file, it causes flume to read the data repeatedly.
[ https://issues.apache.org/jira/browse/FLUME-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359324#comment-16359324 ] jifei_yang commented on FLUME-3216: --- flume monitor files in the specified directory, rename the file in the directory, flume will think the renamed file is a new file, will be read from the first log, resulting in the duplication of the log upload. > When I rename the file, it causes flume to read the data repeatedly. > > > Key: FLUME-3216 > URL: https://issues.apache.org/jira/browse/FLUME-3216 > Project: Flume > Issue Type: Improvement > Components: Sinks+Sources >Affects Versions: 1.8.0 > Environment: centos-6.8 >Reporter: jifei_yang >Priority: Critical > Fix For: 1.7.0, 1.8.0 > > > When I use Taildir source, whenever I rename a file, it causes flume to read > the data repeatedly.This resulted in duplication of uploaded data. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@flume.apache.org For additional commands, e-mail: issues-h...@flume.apache.org
