[ 
https://issues.apache.org/jira/browse/NIFI-673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957254#comment-14957254
 ] 

Mark Payne commented on NIFI-673:
---------------------------------

[~aldrin] I uploaded a new version of the second patch. This should work better 
for you. I made sure that the properties are consistent with what I expect 
should be there. Added the <protocol>.remote.port attribute for the 
ListFileTransfer.

I left the property descriptors in both locations (FetchFileTransfer, 
SFTPTransfer), as some have to do specifically with the abstract fetch 
processors; others are SFTP related. I could copy the SFTP-related Property 
Descriptors into FetchSFTP, but then I think that's a bad idea because we would 
have the same property descriptors repeated over and over again; this way 
Property Names, validators, etc. are consistent between across SFTP processors.

I am not sure that I understood your comment about data duplication. Can you 
elaborate?

Thanks
-Mark

> Create ListSFTP, FetchSFTP Processors
> -------------------------------------
>
>                 Key: NIFI-673
>                 URL: https://issues.apache.org/jira/browse/NIFI-673
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Extensions
>            Reporter: Mark Payne
>            Assignee: Mark Payne
>             Fix For: 0.4.0
>
>         Attachments: 
> 0001-NIFI-673-Initial-implementation-of-ListSFTP-FetchSFT.patch, 
> 0002-NIFI-673-Added-Completion-Strategy-to-FetchSFTP.patch
>
>
> This will allow us to pull a listing from a single primary node and then 
> distribute the work of pulling and processing the data across the cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to