Re: how to sort json array in dataflow

2016-01-10 Thread Joe Witt
Hello Roland I don't believe we have out of the box support for that but it would make for likely a well scoped custom processor. You mention support for sort syntax. Can you share what that might look like? Thanks Joe On Sun, Jan 10, 2016 at 9:45 PM, 彭光裕 wrote: > Hi,

how to sort json array in dataflow

2016-01-10 Thread 彭光裕
Hi, I have a json array flowfile and would like to sort the json array by some certain value (let’s say price). Is it possible sort json array within nifi dataflow? I have tried EvaluateJsonPath processor, but jsonpath doesn’t support sort syntax. I still can’t figure it out how to do

One-time Processors

2016-01-10 Thread Lars Francke
Hi, I'm just getting started with Nifi and understand that I probably still have some misconceptions :) For various reasons I'd love to use NiFi for one-time actions/processors which I'd like to trigger as needed from the UI. I've seen the various scheduling strategies and the closest I've come

Re: Nifi cluster features - Questions

2016-01-10 Thread Joe Witt
Chakri, Would love to hear what you've learned and how that differed from the docs themselves. Site-to-site has proven difficult to setup so we're clearly not there yet in having the right operator/admin experience. Thanks Joe On Sun, Jan 10, 2016 at 3:41 PM, Chakrader Dewaragatla

Re: One-time Processors

2016-01-10 Thread Lars Francke
Joe, thanks for the welcome and the (really quick) reply. My use-case (and again I may use NiFi for things it wasn't intended to) is for a one-time/initial-import scenario. I have a Processor that I'd like to start that then calls a Web service and pages through all results creating FlowFiles

Re: One-time Processors

2016-01-10 Thread Joe Witt
Lars, First, welcome to NiFi. So you'll initiate the flow from NiFi through some manual trigger and that part makes sense/sounds straightforward. But then the question is 'once the flow is done' I'd like it to shut down. What are the processors/things that begin the flow? We've recently had

Re: Nifi cluster features - Questions

2016-01-10 Thread Chakrader Dewaragatla
Bryan – Thanks – I am trying to setup site-to-site. I have two slaves and one NCM. My properties as follows : On both Slaves: nifi.remote.input.socket.port=10880 nifi.remote.input.secure=false On NCM: nifi.remote.input.socket.port=10880 nifi.remote.input.secure=false When I try drop remote

Re: Nifi cluster features - Questions

2016-01-10 Thread Chakrader Dewaragatla
Bryan – Here are the logs : I have 5 sec flow file. On primary node (No data coming in) 2016-01-10 22:52:36,322 INFO [Clustering Tasks Thread-1] org.apache.nifi.cluster.heartbeat Heartbeat created at 2016-01-10 22:52:36,146 and sent at 2016-01-10 22:52:36,322; send took 0 millis 2016-01-10

Re: Nifi cluster features - Questions

2016-01-10 Thread Bryan Bende
Chakri, Glad you got site-to-site working. Regarding the data distribution, I'm not sure why it is behaving that way. I just did a similar test running ncm, node1, and node2 all on my local machine, with GenerateFlowFile running every 10 seconds, and Input Port going to a LogAttribute, and I see