Hi: I was able to successfully implement flume ng 1.x.4 version and I am able to create pipeline between source=spooldir and sinks=HDFS/S3. My management would want the data to be encrypted going into S3. We did add file channel encryption but if I am right this encryption is for the persistent data in the disk. I would like to know if there is any way by configuring flume that I will be able to send text file -> encrypted file into S3. This is our very last hurdle to get it to production, can some one help me clarify if my understanding is right and what would be a good option to encrypt files, we are rolling over files at 10MB for huge log files.
Thanks Michael Email: [email protected]<mailto:[email protected]>
