Restarting NiFi causing SiteToSiteBulletinReportingTask to fail

2018-04-12 Thread Woodhead, Chad
I am running HDF 3.0.1.1 which comes with NiFi 1.2.0.3.0.1.1-5. We are using SiteToSiteBulletinReportingTask to monitor bulletins (for things like Disk Usage and Memory Usage). When we restart NiFi via Ambari (either with a Restart or Stop and then Start), when NiFi comes back up the SiteToSite

ExecuteScript Javascript flowFile.getAttributes()

2018-04-12 Thread Nick Carenza
Hey users, I am having trouble getting attributes from my flowfiles as described here https://community.hortonworks.com/articles/75032/executescript-cookbook-part-1.html . Does anyone have a working example they could share of getting and iterating through all of a flowfile's attributes in javasc

Re: ExecuteScript Javascript flowFile.getAttributes()

2018-04-12 Thread Matt Burgess
Nick, Here's a example slightly modified from my cookbook example (I'm not sure that works with the array brackets, might need to use .get() instead), this one is a full working script to log each attribute: var flowFile = session.get() if (flowFile != null) { var attrs = flowFile.getAttribut

Re: ExecuteScript Javascript flowFile.getAttributes()

2018-04-12 Thread Nick Carenza
Great, thank you. That does work. On Thu, Apr 12, 2018 at 11:53 AM, Matt Burgess wrote: > Nick, > > Here's a example slightly modified from my cookbook example (I'm not > sure that works with the array brackets, might need to use .get() > instead), this one is a full working script to log each a

Re: Multi Domains Nifi connection and UI acces

2018-04-12 Thread Koji Kawamura
Hello, NiFi 1.6.0 has been released and it adds new nifi.property to whitelist multiple hosts so that NiFi can be accessed by different hostnames. Please see NIFI-4761 for details. I recommend updating to 1.6.0. https://issues.apache.org/jira/browse/NIFI-4761 Thanks, Koji On Wed, Apr 11, 2018 at

Re: MergeRecord

2018-04-12 Thread Koji Kawamura
Hello, I checked your template. Haven't run the flow since I don't have sample input XML files. However, when I looked at the MergeRecord processor configuration, I found that: Minimum Number of Records = 2 Max Bin Age = 10 sec By briefly looked at MergeRecord source code, it expires a bin th

Fine-grained control over when a NiFi processor can run

2018-04-12 Thread Tim Dean
Hello, I have a custom NiFi processor that invokes an external HTTP endpoint. That endpoint will be hosted by services running at customer sites, and those customer sites require the ability to define when the service can be called by my processor. Their goal is to prevent calls from coming in

Re: MergeRecord

2018-04-12 Thread DEHAY Aurelien
Hello. Thanks for the answer. The 20k is just the last test, I’ve tested with 100,1000, with an input queue of 10k, and it doesn’t change anything. I will try to simplify the test case and to not use the inferred schema. Regards > Le 13 avr. 2018 à 04:50, Koji Kawamura a écrit : > > He

Re: Fine-grained control over when a NiFi processor can run

2018-04-12 Thread Koji Kawamura
Hello Tim, If I'd understand your requirement correctly, I'd first try using following flow using the existing processors: FetchDistributedMapCache -> RouteOnAttribute -- permit --> InvokeHTTP -- unmatched --> WhateverAlternativeRoute Assuming input FlowFiles have a timestamp denoting when

RE: USB Camera support with MiNiFi 0.4.0 in Rasp3?

2018-04-12 Thread Mendez Veiga, Iyan
Hi Mark, Andy, I was able to compile TensorFlow in the rasp3 using gcc 4.8.5, bazel 0.10.1 and TensorFlow 1.6.0 (other combinations failed at some point). However, when I try to build MiNiFi C++ 0.4.0 with -DENABLE_TENSORFLOW=TRUE, it fails to find it. Should I define some env variables or do s