Hi Andre, 

The "up to 12 hours" is from the Amazon documentation when you enable
export from CloudWatch (NOT CloudTrail) to S3. I'm just trying to cover
my bases and find a better/quicker way. I don't have anything specific
set up right now... 

On 2018-03-25 14:06, Andre wrote:

> Laurens, 
> 
> 12 hours seems quite long cycle for the availability of CloudTrail logs! Are 
> the logs low volume? 
> 
> I assume you are using ListS3 -> FetchS3 to currently get the logs from S3? 
> Am I correct? 
> 
> Cheers 
> 
> On Sat, Mar 24, 2018 at 5:15 AM, Laurens Vets <[email protected]> wrote:
> 
>> Hi list,
>> 
>> Has anyone tried to setup NiFi to get real-time CloudWatch logs somehow?
>> 
>> I can export CloudWatch logs to S3, but it might take up to 12 hours for 
>> them to become available. I suspect the only other option is to go through 
>> AWS Kinesis Firehose to stream to S3 and have NiFi pick up the logs there?
>> 
>> Any ideas/comments/suggestions are highly appreciated :)

Reply via email to