[
https://issues.apache.org/jira/browse/NIFI-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272861#comment-16272861
]
ASF subversion and git services commented on NIFI-3975:
-------------------------------------------------------
Commit 45df23b1e09f340fb2c7f3c3234462570ddb5f6b in nifi's branch
refs/heads/master from [~markap14]
[ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=45df23b ]
NIFI-4607, NIFI-3975, NIFI-4602, NIFI-4606: This closes #2272. Fixed bug in
TailFile that caused new Primary Node to not pull current Clustered State when
File Location was set to Remote. Fixed bug that caused TailFile to occasionally
become 'stuck' when the file it is tailing is renamed and a new file is created
with the same name. Removed the 'Rolling Strategy' property from TailFile
because it is not actually used in the processor anymore. Deleted
MonitorMemoryTest because the unit test was testing the behavior of
FlowController more than the behavior of the reporting task itself and in order
to do so had a dependency in the pom.xml on nifi-framework-core, which means
that it no longer compiles when FlowController is modified.
Signed-off-by: joewitt <joew...@apache.org>
> TailFile stopped tailing file
> -----------------------------
>
> Key: NIFI-3975
> URL: https://issues.apache.org/jira/browse/NIFI-3975
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Affects Versions: 1.2.0
> Environment: Linux
> Reporter: Mark Payne
> Assignee: Mark Payne
> Fix For: 1.5.0
>
>
> I have a TailFile processor running on a 3-node cluster. It is tailing
> logs/nifi-app.log. Two of the nodes seem to be working well. The third node
> is not picking up any data. I enabled DEBUG logging and see the following
> logs:
> {code}
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-48]
> o.a.nifi.processors.standard.TailFile
> TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Recovering Rolled Off
> Files; total number of files rolled off = 0
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-48]
> o.a.nifi.processors.standard.TailFile
> TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Reading lines starting at
> position 105133313
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-48]
> o.a.nifi.processors.standard.TailFile
> TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] No data to consume; removed
> created FlowFile
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-48]
> o.a.nifi.processors.standard.TailFile
> TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Returning LOCAL State:
> StandardStateMap[version=442100928, values={file.0.length=0,
> file.0.position=105133313, file.0.checksum=0,
> file.0.filename=logs/nifi-app.log, file.0.timestamp=1495637757000}]
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-48]
> o.a.nifi.processors.standard.TailFile
> TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Setting LOCAL State to
> {file.0.length=0, file.0.position=105133313, file.0.checksum=0,
> file.0.filename=logs/nifi-app.log, file.0.timestamp=1495637757000}
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10]
> o.a.nifi.processors.standard.TailFile
> TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Recovering Rolled Off
> Files; total number of files rolled off = 0
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10]
> o.a.nifi.processors.standard.TailFile
> TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Reading lines starting at
> position 105133313
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10]
> o.a.nifi.processors.standard.TailFile
> TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] No data to consume; removed
> created FlowFile
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10]
> o.a.nifi.processors.standard.TailFile
> TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Returning LOCAL State:
> StandardStateMap[version=442100929, values={file.0.length=0,
> file.0.position=105133313, file.0.checksum=0,
> file.0.filename=logs/nifi-app.log, file.0.timestamp=1495637757000}]
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10]
> o.a.nifi.processors.standard.TailFile
> TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Setting LOCAL State to
> {file.0.length=0, file.0.position=105133313, file.0.checksum=0,
> file.0.filename=logs/nifi-app.log, file.0.timestamp=1495637757000}
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10]
> o.a.nifi.processors.standard.TailFile
> TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Recovering Rolled Off
> Files; total number of files rolled off = 0
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10]
> o.a.nifi.processors.standard.TailFile
> TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Reading lines starting at
> position 105133313
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10]
> o.a.nifi.processors.standard.TailFile
> TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] No data to consume; removed
> created FlowFile
> 2017-05-25 13:00:32,563 DEBUG [Timer-Driven Process Thread-10]
> o.a.nifi.processors.standard.TailFile
> TailFile[id=47f4a068-015a-1000-81b7-7d991bbbf80f] Returning LOCAL State:
> StandardStateMap[version=442100930, values={file.0.length=0,
> file.0.position=105133313, file.0.checksum=0,
> file.0.filename=logs/nifi-app.log, file.0.timestamp=1495637757000}]
> {code}
> The file is approximately 33 MB right now. But the state indicates that the
> position it is at in the file is over 105 MB; also, according to state, the
> checksum is 0 and the file length is 0. This likely indicates that the file
> was about 105 MB at one point and then it rolled over and stopped processing
> properly, given that it thinks the checksum is 0.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
