[
https://issues.apache.org/jira/browse/FLUME-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527279#comment-16527279
]
ASF GitHub Bot commented on FLUME-3235:
---------------------------------------
GitHub user ffernandez92 opened a pull request:
https://github.com/apache/flume/pull/213
FLUME-3235.patch Flume TAILDIR lost last line
There is an open issue
https://issues.apache.org/jira/projects/FLUME/issues/FLUME-3235?filter=allopenissues
that reports a problem about avoiding last line when this line does not
contain a \n or \r\n.
This commit fix the problem
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ffernandez92/flume patch-1
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flume/pull/213.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #213
----
commit 43585412892276fc924d3e2fb0e16300510652af
Author: ffernandez92 <ffernandez.upc@...>
Date: 2018-06-29T07:07:28Z
FLUME-3235. Flume TAILDIR lost last line
There is an open issue
https://issues.apache.org/jira/projects/FLUME/issues/FLUME-3235?filter=allopenissues
that reports a problem about avoiding last line when this line does not
contain a \n or \r\n.
This commit fix the problem
----
> Flume TAILDIR source lost last line when file upload from windows
> -----------------------------------------------------------------
>
> Key: FLUME-3235
> URL: https://issues.apache.org/jira/browse/FLUME-3235
> Project: Flume
> Issue Type: Bug
> Components: Sinks+Sources
> Affects Versions: 1.8.0
> Environment: flume ng 1.8
> centos 7.3
> Reporter: zhenhuanli708
> Priority: Blocker
> Attachments: flume.PNG, flume_result.PNG
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> 1.upload windows file to /root/windows_file.txt.
> file conent is
> !flume.PNG!
> The last line "end_line" end without \n
> 2. config flume ng
> {quote}flow.channels = c1
> flow.sources = r1
> flow.sinks = k1
> flow.channels.c1.type = memory
> flow.sources.r1.type = TAILDIR
> flow.sources.r1.filegroups = f1
> flow.sources.r1.filegroups.f1 = /root/windows_file.txt
> flow.sources.r1.batchSize = 100
> flow.sinks.k1.type = logger
> flow.sources.r1.channels = c1
> flow.sinks.k1.channel = c1
> {quote}
>
> 3. remove /root/.flume/taildir_position.json then run this config flume ng:
> {quote}nohup bin/flume-ng agent --conf conf/ -f
> conf/flume-conf_windows_end_file.properties -n flow
> -Dflume.root.logger=DEBUG,console &
> {quote}
> 4.check nohup.out : this file does not contains end_line.
> !flume_result.PNG!
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
