Re: Push x Pull ETL

2016-10-13 Thread Jeff
Great to hear, Marcio! On Thu, Oct 13, 2016 at 9:26 PM Márcio Faria wrote: > Jeff, > > Many thanks. I'm now more confident NiFi could be a good fit for us. > > Marcio > > > On Wednesday, October 12, 2016 9:06 PM, Jeff wrote: > > > Hello Marcio, > > You're asking on the right list! > > Based on

Re: Push x Pull ETL

2016-10-13 Thread Márcio Faria
Jeff, Many thanks. I'm now more confident NiFi could be a good fit for us. Marcio On Wednesday, October 12, 2016 9:06 PM, Jeff wrote: Hello Marcio, You're asking on the right list! Based on the scenario you described, I think NiFi would suit your needs.  To address your 3 major steps o

Re: Push x Pull ETL

2016-10-12 Thread Jeff
Hello Marcio, You're asking on the right list! Based on the scenario you described, I think NiFi would suit your needs. To address your 3 major steps of your workflow: 1) Processors can run based on a timer-based or cron-based schedule. GenerateTableFetch is a processor that can be used to creat

Push x Pull ETL

2016-10-11 Thread Márcio Faria
Hi, Potential NiFi user here. I'm trying to figure out if NiFi could be a good choice to replace our existent homemade ETL system, which roughly works like this: 1) Either on demand or at periodic instants, fetch fresh rows from one or more tables in the source database and insert or update th