Am currently using flume 1.7.0 .
Configured spooling directory source and writing files in to HDFS sink. The
source directory contains csv files which need to be written to HDFS, these
csv files are also read by other applications.
Is there a way I can avoid adding a fileSuffix to these csv files once read
Once completely ingested, these csv files are being renamed with .COMPLETED
fileSuffix and making it unreadable for the other applications.
Any workarounds for this?