Re: ListS3 processor?

Kyle, Processors exist to Put, Fetch, and Delete S3Objects, but ListS3 is in the backlog on ticket NIFI-840 at the moment. It should fit the List/Fetch metaphor like the List/Fetch processors pairs for xFile, xHDFS, xSFTP, etc. Regards, Joe Skora

Re: ListS3 processor?

Kyle Let us know if that doesn't get you what you need. We have a decent set of templates but I didn't see one that demonstrates interaction with amazon services. Thanks Joe On Jan 30, 2016 12:56 PM, "Joey Frazee" wrote: > Kyle, > > I think you can do what you want

ListS3 processor?

All, I'm trying to get Nifi set up to a move data around S3. My first attempt is to just monitor a S3 folder where json files are placed and then copy the file, convert it to Avro, and the drop it in a different S3 folder. The documentation is pretty slim for working with S3. I can't seem to

Re: ListS3 processor?

Ha! Insert jaw-drop-emoticon-here. Perfect timing and very well written Adam. Thanks On Sun, Jan 31, 2016 at 1:57 AM, Adam Lamar wrote: > Kyle/Joe, > > I've been meaning to document this process myself, and just finished a post > with some details: >

Re: Split header from CSV and use for JSON

Ian Makes sense. Happy to help put together a template to see if we can get you closer. Working on some 050 release items at the moment but will flag this to come back Thanks Joe On Fri, Jan 29, 2016 at 8:43 AM, Hellstroem Christian (AE/PJ-ASC) wrote: > Hi,

Re: ListS3 processor?

Kyle/Joe, I've been meaning to document this process myself, and just finished a post with some details: https://adamlamar.github.io/2016-01-30-monitoring-an-s3-bucket-in-apache-nifi/ Hope that helps, Adam On 1/30/16 9:29 PM, Joe Witt wrote: Kyle, The ideal case for communicating how to do