[ 
https://issues.apache.org/jira/browse/NIFI-673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962456#comment-14962456
 ] 

Aldrin Piri commented on NIFI-673:
----------------------------------

Comment about data duplication was that, at least with the preivous patch 
chain, the session can be committed before a specified "complete action" could 
take place and could lead to duplication should that process fail and/or be 
interrupted.

Will start scoping out the new patch set.

> Create ListSFTP, FetchSFTP Processors
> -------------------------------------
>
>                 Key: NIFI-673
>                 URL: https://issues.apache.org/jira/browse/NIFI-673
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Extensions
>            Reporter: Mark Payne
>            Assignee: Mark Payne
>             Fix For: 0.4.0
>
>         Attachments: 
> 0001-NIFI-673-Initial-implementation-of-ListSFTP-FetchSFT.patch, 
> 0002-NIFI-673-Added-Completion-Strategy-to-FetchSFTP.patch
>
>
> This will allow us to pull a listing from a single primary node and then 
> distribute the work of pulling and processing the data across the cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to