Re: Past month data insertion is possible

In that case, Extract the 'month' and 'year' using ExtractText. Followed by RouteOnAttribute to send all months except January to an updateAttribute processor that would decrement the month. previous_month: ${month:minus(1):toRadix(10,2)}, and set year_prime as the year The exception is Januar

Re: Past month data insertion is possible

Lee, This case may not be work for me. Actually I want like this: Input given - Output Expected 01-2017 - 12-2016 05-2017 - 04-2017 If my input is the current month with year, output expected is the last month cross checked with the year(have to consider the year also, for

Re: Past month data insertion is possible

Prabhu, Using epoch time might end up being a simpler comparison. If the converted date is less than 1483254000 (midnight of first day of current month), it is the previous month (for my timezone).Thanks, Lee On Thu, Jan 26, 2017 at 10:42 PM, prabhu Mahendran wrote: > Hi Andy, > > i have alr

Re: nifi at AWS

Hi Mohammed, For users who are trying to connect between localhost and AWS, I wrote a post on "How to send file from localhost to AWS EC2 using NiFi Site-to-Site?" http://ijokarumawak.github.io/nifi/2017/01/27/nifi-s2s-local-to-aws/ There must be some configuration or environmental difference, ho

Re: Past month data insertion is possible

Hi Andy, i have already tried with your alternative solution. "UpdateAttribute to add a new attribute with the previous month value, and then RouteOnAttribute to determine if the flowfile should be inserted " i have used below expression language in RouteOnAttribute, *${literal('Jan,Feb,Mar,Apr

Re: Past month data insertion is possible

Prabhu, I answered this question with an ExecuteScript example which will do what you are looking for on Stack Overflow [1]. [1] http://stackoverflow.com/a/41887397/70465 Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D

Past month data insertion is possible

Hi All, I have data in which i need to compare month of data if it is previous month then it should be insert otherwise not. *Example:* *23.12.2016 12:02:23,Koji,24* 22.01.2016 01:21:22,Mahi,24 Now i need to get first column of data (23.12.2016 12:02:23) and then get month (12) on it. Compared

Re: Convert xls to csv in Nifi.

Jeremy,Thanks for your information. i think you will make effort to HSSF implementation in PR for convert (XLS into CSV). Is it right? Many thanks, prabhu On Wed, Jan 25, 2017 at 7:01 PM, Jeremy Dyer wrote: > Prabhu - NIFI-2613 is currently only able to convert .xlxs documents to > csv. The pr

Re: NiFi 1.1.0 stuck starting, no errors

Hi Peter, Can you provide a thread dump of the process? You should be able to do this via the jcmd tool [1]. [1] https://docs.oracle.com/javase/8/docs/technotes/guides/troubleshoot/tooldescr006.html#BABEHABG

Re: Asynchronous Request/Response Data Flows

In that case, maybe you can use PutDistributedMapCache and FetchDistributedMapCache? Although, you might need to modify PutDistributedMapCache so that it allowed caching attributes, currently it only uses flow file content as the thing to cache. On Thu, Jan 26, 2017 at 3:48 PM, Benjamin Janssen

Re: Asynchronous Request/Response Data Flows

What if the bulk of the data is what is coming back from the remote processing? So I really want a pattern like this: Store a couple of attributes. Send small request off for additional processing. Receive response from remote processing. Append to that response the originally saved off attribute

NiFi 1.1.0 stuck starting, no errors

I'm looking for help in troubleshooting my NiFi 1.1.0 install. It's been running stably for some time, but I restarted it this morning when I deployed an updated custom NAR. Now it gets stuck at startup, see logs at the end. There are no error messages, and the processes don't die. The process j

Re: Asynchronous Request/Response Data Flows

Ben, To elaborate on NIFI-190... this ticket introduced two new processors (Wait and Notify) that use the DistributedMapCacheServer to communicate. They aren't released yet, but are in the master branch. One example of using these processors is something like the following: - Lets say we have a

Re: Asynchronous Request/Response Data Flows

Ben, One way to approach this is using the sort of capabilities this opens up: https://issues.apache.org/jira/browse/NIFI-190 Certainly is a good case/idea to work through. Doable and increasingly seems to be an ask. Thanks Joe On Thu, Jan 26, 2017 at 3:10 PM, Benjamin Janssen wrote: > Hello

Asynchronous Request/Response Data Flows

Hello all, I've got a use case where I get some data, I want to fork a portion of that data off to an external service for asynchronous processing, and when that external service has finished processing the data, I want to take its output, marry it up with the original data, and pass the whole thi

Re: Scientific Notation conversion?

Sven, Are your values Strings or numbers? Meaning does the JSON look like: { "a": "2.1234567891E10" } or { "a" : 2.1234567891E10 } If the latter, would the output field ("a" or "new_a" or whatever) have to remain a number, or is a String ok? I think most applications/libraries will default the

Re: InvokeHTTP and SocketTimeoutException

Hello Giovanni, The InvokeHTTP processor only adds attributes in the event that the request actually gets a response. This is primarily due to the fact that the attributes that are written (status codes, status message, etc.) are only available if we get back a response. The exception you're hitti

Scientific Notation conversion?

I have a json object the SOMETIMES contains a scientific notation for the value. I want to have a nice or "human readable" number w/ thousands separator. example values: 1 2.23456789E6 2.1234567891E10 15.123456789E7 what i thought of doing was checking for the existance of E. then forking it

Re: nifi at AWS

Thank you all for your help I'm using nifi 1.1.1 and the HTTP protocol. I can access the remote instance in AWS in my local browser, but I'm trying to upload a local file to this remote instance (using GetFile processor), then it fails to make the transaction. Regards On Wed, Jan 25, 2017 at 9:5

RE: InvokeHTTP and SocketTimeoutException

Hi Andy, Thanks for chiming in. I've gathered some info down here: The LogAttribute before InvokeHTTP: 2017-01-26 09:15:10,373 INFO [Timer-Driven Process Thread-4] o.a.n.processors.standard.LogAttribute LogAttribute[id=d9d45caf-0159-1000-d4a6-5127a fdeaf64] logging for flow file StandardFlowF