endzeit created NIFI-12900: ------------------------------ Summary: Avoid unnecessary file listing in PutSFTP Key: NIFI-12900 URL: https://issues.apache.org/jira/browse/NIFI-12900 Project: Apache NiFi Issue Type: Improvement Reporter: endzeit Assignee: endzeit
The processor `PutSFTP` is based on `PutFileTransfer`. Before an actual upload takes place, potential conflicts (e.g. existing file) are identified and resolved using `identifyAndResolveConflictFile(...)`. As part of this process, information on the target file is retrieved using `FileTransfer.getRemoteFileInfo(...)`. In case of `PutSFTP` this is implemented by `SFTPTransfer`. The implementation of `getRemoteFileInfo` executes `ls` on the target directory path. In case there are a lot of files inside the remote directory, e.g. >10.000 files, the listing reduces the performance of `PutSFTP` significantly. Instead of a listing on the directory, file information should be retrieved using either `ls` or `stat` on the target file directly. -- This message was sent by Atlassian Jira (v8.20.10#820010)