Re: Help with SFTP processor

2017-04-21 Thread James Keeney
Joe - Still working with the SFTP chain. We have been testing and have encountered a different problem. During some transfers but not all, when doing a transfer of a large number of files (>10), some of the files are not transferring. I'm getting no errors at all. Here is the chain I'm using:

Re: Help with SFTP processor

2017-04-06 Thread James Keeney
Thanks. On Thu, Apr 6, 2017 at 5:24 PM Joe Witt wrote: > I just mean while designing/interacting with the flow you can > start/stop processors, you can click on the connections and say 'list > queue' and then you can click on each object in the queue and see its > attributes

Re: Help with SFTP processor

2017-04-06 Thread Joe Witt
I just mean while designing/interacting with the flow you can start/stop processors, you can click on the connections and say 'list queue' and then you can click on each object in the queue and see its attributes and content. Really helps step through the flow at each step. On Thu, Apr 6, 2017

Re: Help with SFTP processor

2017-04-06 Thread James Keeney
Thanks again. When you refer to live queue listing and data viewing what are you referring to? The dashboard or something else. Jim K. On Thu, Apr 6, 2017 at 4:49 PM Joe Witt wrote: > No problem. Remember you can use live queue listing and data viewing > to see all the

Re: Help with SFTP processor

2017-04-06 Thread James Keeney
Thank you. That was the final detail I was not getting. The use of the ${path} expression variable. I now see that I needed to look at the writes attributes section of the ListFile processor. Jim K. On Thu, Apr 6, 2017 at 2:30 PM Joe Witt wrote: > Jim, > > Yep I understand

Re: Help with SFTP processor

2017-04-06 Thread Joe Witt
Jim, Yep I understand your question and how to support that is what I was trying to convey. ListFile should pull from "/home/source". Lets say it finds that 'home/source/test/newfile.txt file. The resulting flowfile will have an attribute called 'path' that says 'test' Then you use FetchFile

Re: Help with SFTP processor

2017-04-06 Thread James Keeney
Thanks for getting back to me. I will follow up on the documentation Pull Request. As to the directory question, I wasn't specific enough. I've already configured the setting you described. Here is what is going on: Say the source directory is /home/source and the destination is /www/files

Re: Help with SFTP processor

2017-04-06 Thread Joe Witt
Jim, Glad you've made progress on the SFTP side. Please file a JIRA with your suggestions for the docs and the ideal case then is you'd file a Pull Request (https://cwiki.apache.org/confluence/display/NIFI/Contributor+Guide) which actually provides the suggested documentation changes. For the

Re: Help with SFTP processor

2017-04-06 Thread James Keeney
Joe and Juan - Thank you very much for the help. It turned out to be the prompt for verifying the authenticity of the host. With that fixed, I have a new question: I'm using ListFile and FetchFile to identify new files as they are added to a directory. When they are I am using SFTP to transfer

Re: Help with SFTP processor

2017-04-04 Thread Joe Witt
definitely agree with Juan's suggestion to get more details on what the actual authentication process is when trying ssh -vvv. Also, be sure to check what order of authorization occurs. It is possible it is trying keyboard-interactive before the certs and this could create problems so ordering

Re: Help with SFTP processor

2017-04-04 Thread Juan Sequeiros
Good afternoon, I would try this command from command line: ssh -vvv -i user@server Example: ssh -vvv -i /some/path/.ssh/id_rsa nifi@10.10.10.10 If that works then I would double check the "private key path" property of your GetSFTP it should point to the fully qualified file to the private

Help with SFTP processor

2017-04-04 Thread James Keeney
I am using SFTP to transfer files between two servers. I have tried multiple configurations to try to get the authentication to work but i keep getting the Auth Fail error. I'm able to go onto the Nifi server sftp over to the destination server but I cannot get it to work in Nifi. I'm just not