Re: How can datetime to month conversion failed in french language?

2017-04-12 Thread prabhu Mahendran
Jeff, yes my data contains English names for month. Andre, It would be more interesting for specify locale argument with Expression language. After discussing,Are you will create task for it or not? On Thu, Apr 13, 2017 at 2:33 AM, Andre wrote: > Hi, > > I suspect that

Re: How can datetime to month conversion failed in french language?

2017-04-12 Thread Andre
Hi, I suspect that at the moment the conversion between locales needs to be done manualy. It may be worth discussing with the community the ability to specify the locale argument when calling the Expression Language functions you referred to. Meanwhile, IF your other flows and processors allow,

Re: How can datetime to month conversion failed in french language?

2017-04-12 Thread Jeff
Prabhu, Are you saying that the data you're working with contains the English names for the months? On Wed, Apr 12, 2017 at 6:03 AM prabhu Mahendran wrote: > output of the breakdown of the functions is 'Mai'.But in my local file > contains 'May'. while processing

Re: Change data capture processor

2017-04-12 Thread Jeremy Farbota
Thanks for the response. This is great stuff. On Wed, Apr 12, 2017 at 11:38 AM, Matt Burgess wrote: > I believe for the upcoming release only MySQL will be supported. True CDC > involves interacting "underneath" the database/JDBC layer in many cases, > often retrieving

Re: Change data capture processor

2017-04-12 Thread Matt Burgess
I believe for the upcoming release only MySQL will be supported. True CDC involves interacting "underneath" the database/JDBC layer in many cases, often retrieving records from the transaction logs themselves. Each of the vendors has their own API and/or clients, each with their own

Re: Change data capture processor

2017-04-12 Thread Jeremy Farbota
Wow, this is really exciting! Combine this with the Kafka producer and you have something really great there. I see Postgres on the ticket. Is Postgres functionality going to ship with 1.2.0? On Wed, Apr 12, 2017 at 10:01 AM, Buntu Dev wrote: > Thanks, exciting stuff!! > >

Re: Avoiding Forced Refreshes that Result in Lost Changes

2017-04-12 Thread James McMahon
Understood. Thanks very much Juan. On Wed, Apr 12, 2017 at 1:24 PM, Juan Sequeiros wrote: > We currently have a solid dev / prod environment and when ready we import > the template from dev in to prod. > We also have updated central processors that can't be replaced by a >

Re: Avoiding Forced Refreshes that Result in Lost Changes

2017-04-12 Thread Juan Sequeiros
We currently have a solid dev / prod environment and when ready we import the template from dev in to prod. We also have updated central processors that can't be replaced by a template with rest calls. But in general NIFI 1 is a massive upgrade to U/I, and this feature and user policies from a

Re: Avoiding Forced Refreshes that Result in Lost Changes

2017-04-12 Thread James McMahon
Okay thanks Joe. And I apologize: it seems you have mentioned that before. On Wed, Apr 12, 2017 at 1:09 PM, Joe Witt wrote: > Hello > > This has been addressed in NiFi 1.x. You can have multiple writers to > various things in parallel and it handles it nicely. > > Thanks >

authenticating for google cloud rest calls

2017-04-12 Thread Frank Maritato
Hey all, I'm trying to see if it's possible to create a workflow that uses InvokeHTTP to call the google cloud rest apis directly instead of creating a new custom processor for each new thing that comes up. Before I can call any of the actual services, I need to authenticate to get a token. Long

Re: Avoiding Forced Refreshes that Result in Lost Changes

2017-04-12 Thread Joe Witt
Hello This has been addressed in NiFi 1.x. You can have multiple writers to various things in parallel and it handles it nicely. Thanks Joe On Wed, Apr 12, 2017 at 12:03 PM, James McMahon wrote: > We have multiple people working is separate distinct processor groups

Avoiding Forced Refreshes that Result in Lost Changes

2017-04-12 Thread James McMahon
We have multiple people working is separate distinct processor groups under a common NiFi instance. As would be expected, they are often making changes to their processor group workflows concurrently. There are long periods of time where Betty loses any attempted changes including reposition of

Re: Aw: ReplaceTextWithMapping how to regex

2017-04-12 Thread Mika Borner
Thanks, will take a look at it! On 04/12/2017 06:43 PM, Uwe Geercken wrote: Hi, you might want to use the ExecuteRuleEngine processor I wrote. It allows you to do very complex checks on the data and then also update it. In other scenarios the MergeTemplate processor might work as well. have

Re: ReplaceTextWithMapping how to regex

2017-04-12 Thread Andy LoPresto
Mika, Apologies, that autocorrected to “Mike”. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Apr 12, 2017, at 9:46 AM, Andy LoPresto wrote: > > Hi Mike, > > If you want to replace

Re: ReplaceTextWithMapping how to regex

2017-04-12 Thread Andy LoPresto
Hi Mike, If you want to replace “value1” only when it is preceded by “key=“ and have the result be “key=replacementvalue1”, try this pair of configuration values: regex: (?<=key=)(\S+) matching group: 1 The (?<=…) construction is a lookbehind, so the provided sequence will only match if it

Aw: ReplaceTextWithMapping how to regex

2017-04-12 Thread Uwe Geercken
Hi,   you might want to use the ExecuteRuleEngine processor I wrote. It allows you to do very complex checks on the data and then also update it.   In other scenarios the MergeTemplate processor might work as well.   have a look at: https://github.com/uwegeercken/nifi_processors   rgds,  

ReplaceTextWithMapping how to regex

2017-04-12 Thread Mika Borner
Hi all I'm not sure I understand how the ReplaceTextWithMapping processor works. Let's say my flowfile content looks like: xyz key=value1 foo bar value1 My mapping file looks like: value1replacementvalue1 value2replacementvalue2 I just want to replace the occurrence of

Re: MaxFileSize in timeBasedFileNamingAndTriggeringPolicy not work?

2017-04-12 Thread Jeff
Prabhu, You're right, NiFi has been using logback 1.1.3 for quite a while now. Looks like we need to investigate upgrading. I created a JIRA to address this issue: https://issues.apache.org/jira/browse/NIFI-3699 On Wed, Apr 12, 2017 at 7:25 AM prabhu Mahendran wrote:

Re: EvaluateJSONPath dynamic properties to support Expression Language

2017-04-12 Thread James Wing
EvaluateJSONPath does not support expression language in properties. But you could use an ExecuteScript processor to read the "97" from an attribute and use it to index the JSON content. Thanks, James On Wed, Apr 12, 2017 at 6:14 AM, Guillaume Pool wrote: > Hi, > > > > Has

EvaluateJSONPath dynamic properties to support Expression Language

2017-04-12 Thread Guillaume Pool
Hi, Has anyone found a way around this? I have a JSON document, {noformat} { "97": { "SystemEvent": 20, "SystemEventDescription": " Regular Position ", "CustDescription": "Trip start " }, "1794": { "SystemEvent": 30, "SystemEventDescription": " Regular Position ",

Re: Change data capture processor

2017-04-12 Thread Andrew Grande
Yes, it's in 1.2.0. However, it's unreleased yet. Should be soon, you can track progress by following the 1.2.0 release email thread on tbe dev list. Andrew On Wed, Apr 12, 2017, 1:55 AM Buntu Dev wrote: > Is the new CaptureChangeMySQL processor available in 1.2 and is

Re: MaxFileSize in timeBasedFileNamingAndTriggeringPolicy not work?

2017-04-12 Thread prabhu Mahendran
For your information,I have try that same procedure in NiFi-1.1.1 also. In that also NiFi have logback-classic-1.1.3 and logback-core-1.1.3 jar only present. In conf\logback.xml MaxFileSize and maxHistory in *TimeBasedRollingPolicy* not work. On Wed, Apr 12, 2017 at 3:58 PM, prabhu Mahendran

4 Processors for NiFi: SplitToAttribute, MergeTemplate, ExecuteRuleEngine, GenerateData

2017-04-12 Thread Uwe Geercken
Hello everybody,   I have released (Apache License) my NiFi processors at:   https://github.com/uwegeercken/nifi_processors   Further below is a summary for the processors. I would like to invite everybody to test, look at the source code and send me any feedback that you have.   I have

Re: MaxFileSize in timeBasedFileNamingAndTriggeringPolicy not work?

2017-04-12 Thread prabhu Mahendran
Jeff, Thanks for your mail. I need to use log back 1.1.7 in NiFi-0.6.1 . Can you suggest any way to change 1.1.3 into 1.1.7? On Wed, Apr 12, 2017 at 9:42 AM, Jeff wrote: > Hello Prabhu, > > I think you're running into a logback bug [1] that is fixed with 1.1.7. >

Re: How can datetime to month conversion failed in french language?

2017-04-12 Thread prabhu Mahendran
output of the breakdown of the functions is 'Mai'.But in my local file contains 'May'. while processing 'May'(English) could be converted as 'Mai'(French). Is there is any expression language to convert French language into English? On Mon, Apr 10, 2017 at 8:02 PM, prabhu Mahendran