[
https://issues.apache.org/jira/browse/NIFI-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194037#comment-15194037
]
ASF subversion and git services commented on NIFI-1588:
-------------------------------------------------------
Commit 56f79e1e8560ba9343b4da072673fcfe894d156b in nifi's branch
refs/heads/master from [~markap14]
[ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=56f79e1 ]
NIFI-1588: Reworked how ListHDFS store state so that only 2 timestamps are
stored and no paths
Signed-off-by: joewitt <[email protected]>
> ListHDFS to retaining wrong state in zookeeper
> ----------------------------------------------
>
> Key: NIFI-1588
> URL: https://issues.apache.org/jira/browse/NIFI-1588
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Core Framework
> Affects Versions: 0.4.1
> Environment: latest 0.5.1
> Reporter: Matthew Clarke
> Assignee: Mark Payne
> Fix For: 0.6.0
>
> Attachments:
> 0001-NIFI-1588-Reworked-how-ListHDFS-store-state-so-that-.patch,
> 0001-NIFI-1588-Reworked-how-ListHDFS-store-state-so-that-.patch
>
>
> The expected state that should be retained by listHDFS processor is the last
> modified timestamp. The processor instead is retaining the filename and path
> of every file it lists. This results in excessive disk usage by zookeeper to
> retain this filename based state.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
