Re: CaptureChangeMySQL cannot capture INSERT,UPDATE,DELETE

2020-01-03 Thread DC Gong
Hello Lei, I changed binlog format to the row. It works well. Thank you very much. Best regards, Dongcheol Gong 2020년 1월 3일 (금) 오후 6:09, wangl...@geekplus.com.cn 님이 작성: > > Make sure you have turn on the row format binlog. > In my case, the insert statement will have the following bin log res

Re: Adding a Row Number to Records

2020-01-03 Thread Joe Witt
Mike, Shawn What if someone had an attribute named record.index already? Would they not be able to access it? Thanks On Fri, Jan 3, 2020 at 7:26 PM Mike Thomsen wrote: > Shawn, I reviewed and it LGTM so I just merged it after checking that it > built on both Jenkins pipelines. > > On Fri, Ja

Re: Adding a Row Number to Records

2020-01-03 Thread Mike Thomsen
Shawn, I reviewed and it LGTM so I just merged it after checking that it built on both Jenkins pipelines. On Fri, Jan 3, 2020 at 1:32 PM James McMahon wrote: > It would be very useful indeed. Thanks very much for your comments. > > On Fri, Jan 3, 2020 at 1:29 PM Joe Witt wrote: > >> because spl

Re: Need help for TLS implementation with CA signed certificates

2020-01-03 Thread Andy LoPresto
You will likely want to read the TLS Toolkit Guide [1] closely, especially the section for using an external CA [2] or externally-signed certificates [3]. Whether generated using the TLS Toolkit or provided from an external source (i.e. your organization generates signed certificates per NiFi no

Re: SSLContextService configuration

2020-01-03 Thread Andy LoPresto
I am not sure I follow all of the issues you are describing, but I will try to address them as I understand them. In the 1.10.0 release, parameters [1] were introduced, which allow any component property to use a reference to externally-defined values (this does not rely on Expression Language

SSLContextService configuration

2020-01-03 Thread Etienne Jouvin
Hello all. Those last days, I spent some times to deploy process to my client, using a Template. In the template, I have many InvokeHTTP processors, and some services related to the SSLContextService. My client have 3 environments, and for two of them, I can not configure the SSLContextService, b

Re: Adding a Row Number to Records

2020-01-03 Thread James McMahon
It would be very useful indeed. Thanks very much for your comments. On Fri, Jan 3, 2020 at 1:29 PM Joe Witt wrote: > because splitting them just to achieve this means creating potentially > thousands of flowfiles rather than playing the data as it lies and in its > most efficient form. > > The i

Re: Adding a Row Number to Records

2020-01-03 Thread Joe Witt
because splitting them just to achieve this means creating potentially thousands of flowfiles rather than playing the data as it lies and in its most efficient form. The idea to enable certain automatically managed things which one could inject into their records like record number (relative to th

Re: Adding a Row Number to Records

2020-01-03 Thread James McMahon
I was wondering why SplitContent or SegmentContent are bad ideas to approach this requirement? Each gives us a fragment.index attribute that potentially could be prepended to any content. Would such an approach be impractical for very large flow files, and so perhaps would impose excessive demands

Re: Adding a Row Number to Records

2020-01-03 Thread Shawn Weeks
Created https://github.com/apache/nifi/pull/3955 with a potential version of this change. The French Travis check is failing to run. Is this approach ok? If there is another way to pass the count from AbstractRecordProcessor without adding a new variable I can do it that way I'm just not sure ho

Re: Adding a Row Number to Records

2020-01-03 Thread Shawn Weeks
Adding an additional attribute to UpdateRecord sounds pretty straight forward only thing I'm not sure about is where to store the state between each calls to UpdateRecord.process. It will also would be nicer if UpdateRecord could update schema but I think there is already a Jira for that. Thank

Re: CaptureChangeMySQL cannot capture INSERT,UPDATE,DELETE

2020-01-03 Thread DC Gong
Thank you. I will try and reply soon. Best Regards, Dongcheol Gong 2020년 1월 3일 (금) 오후 6:09, wangl...@geekplus.com.cn 님이 작성: > > Make sure you have turn on the row format binlog. > In my case, the insert statement will have the following bin log result: > > ### INSERT INTO `athena`.`t_api_msg`

Re: CaptureChangeMySQL cannot capture INSERT,UPDATE,DELETE

2020-01-03 Thread wangl...@geekplus.com.cn
Make sure you have turn on the row format binlog. In my case, the insert statement will have the following bin log result: ### INSERT INTO `athena`.`t_api_msg` ### SET ### @1=40265204 ### @2=NULL ### @3='W001' ### @4='WMS' Thanks, Lei From: DC Gong Date: 2020-01-03 13:51 To: users S