Re: How do I atomically increment a variable in NiFi ?

2017-03-01 Thread Márcio Faria
apCacheClient.java On Sun, Feb 26, 2017 at 5:19 PM, Afonso Murakami <murakam...@icloud.com> wrote: > The question is How do I create my own specialized controller service ? I > have no idea how to do that . > > On Feb 26, 2017, at 1:48 PM, Márcio Faria <faria.mar...@ymail.co

How do I atomically increment a variable in NiFi ?

2017-02-26 Thread Márcio Faria
Hi, I need to generate unique numbers globally across NiFi nodes in an atomic, persistent way. Ideally, something like a sequence but with no actual database involved. Maybe I'm missing something here, but I don't think a Distributed Map Cache, like described in Use of Sequence in Nifi without

Re: Push x Pull ETL

2016-10-13 Thread Márcio Faria
l free to ask any questions!  Much of the information above is fairly high-level, and NiFi offers a lot of processors to meet your data flow needs. - Jeff  On Tue, Oct 11, 2016 at 5:18 PM Márcio Faria <faria.mar...@ymail.com> wrote: Hi, Potential NiFi user here. I'm trying to figure out i

Processor using Apache Thrift ?

2017-03-02 Thread Márcio Faria
easiest to hardest). Good luck.  Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69 On Feb 14, 2017, at 6:24 PM, Márcio Faria <faria.mar...@ymail.com> wrote: > >Dear NiFi users, > >Does anybody

NiFi 1.3: Simplest way possible of creating CSV files from SQL queries

2017-07-24 Thread Márcio Faria
Hi, I'm looking for the simplest way possible of creating CSV files from SQL queries using Apache NiFi 1.3.  The flow I currently have (the files are to be SFTP'ed to a remote server): ExecuteSQL -> UpdateAttribute -> ConversionRecord [3 CSs] -> PutSFTP The concept of SchemaRegistry is new to

Re: Issues with QueryDatabaseTable processor's State

2018-03-13 Thread Márcio Faria
Matt,  Just curious: Why is it necessary to identify that global state using catalog, schema, table or column names? Those are database concepts. As a user, I'd prefer to have some flexibility here. Surely the component needs to know how to identify the database object, but beyond that, we