Re: ListS3 question

Laurens, Just to add slightly to this question: > Will ListS3 keep state correctly here for all 3 subdirectories? The answer is yes - ListS3 will keep state correctly for all 3 subdirectories. For example, if you setup a new ListS3 processor, give it a bucket and prefix, and start the

Re: ListS3 question

Yes, that's my understanding too. On Tue, Aug 8, 2017 at 1:14 PM, Laurens Vets wrote: > Thank you for this information. There's no internal notion of directories > in S3, only objects, so I suspect I'm good if I only set the bucketname? > > On 2017-08-08 09:55, Joe Skora

Re: ListS3 question

Thank you for this information. There's no internal notion of directories in S3, only objects, so I suspect I'm good if I only set the bucketname? On 2017-08-08 09:55, Joe Skora wrote: > Laurens, > > The S3 User Guide Working with Folders [1] page explains how S3 provides a > conceptual

Re: ListS3 question

Laurens, The S3 User Guide Working with Folders page explains how S3 provides a conceptual directory hierarchy using key name prefixes but that buckets really just hold a flat collection of objects. ListS3 will query S3 for

Re: ListS3 question

Laurens, ListS3 tracks S3 object keys within your bucket+prefix. ListS3 primarily works on a last read timestamp, but tracks multiple keys when the timestamps are equal. Directories are something of a hazy concept in S3. Thanks, James On Tue, Aug 8, 2017 at 8:22 AM, Laurens Vets

ListS3 question

Hi list, Does the ListS3 processor keep state of multiple directories in a bucket? For instance, suppose I have a directory "logs" with subdirectories "host1", "host2" & "host3". Each directory contains logfiles which are added dailty. Will ListS3 keep state correctly here for all 3