Hi, We are considering using Minifi to transfer files from scanner workstations to a central Nifi server. In this particular use case the files are huge, 500GB or so (digitized movies).
So, a simplified flow would be to use ListFile/FetchFile to read the files from local disk, and send it to the server via a RPG. If my understanding is correct, Minifi will be streaming the file into its local content repo (during FetchFile), and stream it to the remote server via the RPG. So low memory consumption. But in effect the file will be copied from its local path to the content repo, meaning that the local disk usage will double, from say 500GB to 1TB. Is this correct? If so, that might be a challenge. Is there a way to stream the file directly from is local path to the remote server? Also, will S2S be able to handle such large files? Best, Geir
