Re: nifi refresh with restapi

2019-01-18 Thread mohammed shambakey
Hi Bryan I mean 'refresh nifi' after 'update' because it seems the updated parameters does not apply instantly. For example, when I update the 'destination' in a remote process group using restapi, then get a reference to the remote process group using restapi, the reference may not have the

Re: nifi refresh with restapi

2019-01-18 Thread Bryan Bende
Hello, What exactly do you mean by "refresh"? If you mean update, then yes, anything you can update in the UI, you can update through the REST API. Thanks, Bryan On Fri, Jan 18, 2019 at 1:29 PM mohammed shambakey wrote: > > Hi > > Is it possible to use NIFI restapi to refresh all, or

nifi refresh with restapi

2019-01-18 Thread mohammed shambakey
Hi Is it possible to use NIFI restapi to refresh all, or specific parts (e.g., specific (remote) process groups), of a dataflow? Regards -- Mohammed

Re: CaptureChangeMySQL and Triggers

2019-01-18 Thread Boris Tyukin
Hi Vitaly, I do not work for a CDC vendor but there are many reasons why CDC tools exist and no NiFi processor will ever beat the benefits of these commercial tools. If timestamps are reliable, extracts are fast and you can handle inserts, updates, delete and primary keys updates without

Re: CaptureChangeMySQL and Triggers

2019-01-18 Thread Matt Burgess
Vitaly, There has been a PR [1] around for a while to add SQL Server CDC support, I'm not sure what shape it's in now. For Oracle you might be able to use QueryDatabaseTable to access LogMiner tables (if LogMiner is installed). Speaking of installation, unless there's a product installed at the

RE: CaptureChangeMySQL and Triggers

2019-01-18 Thread Vitaly Krivoy
This is a follow-on question to Apache/HortonWorks, rather than an answer to the question posted by Marcelo. Outside of CaptureChangeMySQL, are there plans underway to add similar processors for other databases? I realize that a database would have to produce a capture data change log for this

Re: process group name reverts back to initial value if I do a nifi registry "Change version"

2019-01-18 Thread Bryan Bende
There is now a JIRA and PR that should address this issue: https://issues.apache.org/jira/browse/NIFI-5961 Thanks. On Mon, Jan 14, 2019 at 2:23 AM wrote: > > Thanks Chad for confirming it. > > @Bryan Bende: how shall we continue here? I understand that it isn't a high > prio issue, however it

Re: Ingesting golden gate messages to Hbase using Nifi

2019-01-18 Thread Boris Tyukin
glad it is working for you, Faisal. I am sure you already know that current_ts timestamp value will change every time you reprocess GG trail files in case of GG server failure, checkpoint rollbacks or when you reposition GG with a command like ALTER REPLICAT xxx, EXTSEQNO 5, EXTRBA 0 or ALTER