Laurens, 12 hours seems quite long cycle for the availability of CloudTrail logs! Are the logs low volume?
I assume you are using ListS3 -> FetchS3 to currently get the logs from S3? Am I correct? Cheers On Sat, Mar 24, 2018 at 5:15 AM, Laurens Vets <[email protected]> wrote: > Hi list, > > Has anyone tried to setup NiFi to get real-time CloudWatch logs somehow? > > I can export CloudWatch logs to S3, but it might take up to 12 hours for > them to become available. I suspect the only other option is to go through > AWS Kinesis Firehose to stream to S3 and have NiFi pick up the logs there? > > Any ideas/comments/suggestions are highly appreciated :) >
