Hi Bryan: Thanks for you response.
Using GetSFTP and PutHDFS is helpful. Now I meet another problem. Besides the HDFS, the priictures from remote server also need to put into HBase. The filename is rowkey and the file as a column. This is the reason why I store the pictures in local and then use ExecuteFlumeSource with spooldir which can read the picture as a whole, but I lose the filename. -----邮件原件----- 发件人: Bryan Bende [mailto:[email protected]] 发送时间: 2018年3月23日 0:42 收件人: [email protected] 主题: Re: put pictures from remote server into hdfs Hello, It would probably be best to use GetSFTP -> PutHDFS. No need to write the files out to local disk somewhere else with PutFile, they can go straight to HDFS. The filename in HDFS will be the "filename" attribute of the flow file, which GetSFTP should be setting to the filename it picked up. If you need a different filename, you can stick an UpdateAttribute before PutHDFS and change the filename attribute to whatever makes sense. -Bryan On Thu, Mar 22, 2018 at 12:18 PM, 李 磊 <[email protected]> wrote: > Hi all, > > > > It is my requirement that put pictures from remote server(not in nifi > cluster) into hdfs. > > First I use the GetSFTP and PutFile to get pictures to local, and then > use ExecuteFlumeSource and ExecuteFlumeSink to put pictures into hdfs > from local. > > > > However, there is a problem that the name of pictures that put into > hdfs cannot keep the same with local. > > > > Could you tell me the way to keep the name same or a better way to put > pictures into hdfs from remote server with nifi? > > > > Thanks!
