I have one flow that will have to handle files that are anywhere from 500mb to several GB in size. The current plan is to store the in HDFS or S3 and then bring them down for processing in NiFi. Are there any suggestions on how to handle such large single files?
Thanks, Mike
