Re: Automated Testing of Nifi Flow by injecting data into Processors

2019-03-06 Thread Bronislav Jitnikov
I think, you can use https://pypi.org/project/nipyapi/ to create test scenario for integration testing of complete flow without access data in source system. I work on template for similar task, but only in start of my way. As an idea Create Python script that 1. deploy flow from Bucket to testing

Re: SSLHandshake Exception from Site-to-Site

2019-03-06 Thread Koji Kawamura
Hi Nadeem, > nifi.remote.input.host= This property is used for how S2S server introduces itself to S2S clients for further network communication. For example, let's say if the server has 2 ip addresses, private and public, and the public ip is bounded to a fqdn. hostnames for the server would be:

Re: Unable to use Github as flowPersistenceProvider for NiFi Registry

2019-03-06 Thread Andy LoPresto
Remember to re-enable TLS verification on your git clients if you disabled it during debugging. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Mar 6, 2019, at 8:43 AM, S Bhandiwad, Satwik (Nokia - IN/Bangalo

Re: Using Vault with NiFi

2019-03-06 Thread Andy LoPresto
It’s meant to provide a common interface and supporting implementations from which to retrieve and use secrets in components. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Mar 5, 2019, at 9:28 AM, Mike Thom

Re: jni with Apache Nifi

2019-03-06 Thread Marc Parisi
Brett, You can take a look at what we do in Apache NiFi MiNiFi C++ -- https://github.com/apache/nifi-minifi-cpp/tree/master/extensions/jni In this package you can see the Java code that links in the logger. In the class we use to launch NiFI processors [1] we first obtain the logger class

jni with Apache Nifi

2019-03-06 Thread Brett Tiplitz
I'm trying to make a call from C++ into the Apache Nifi Logger. I see an abstract logger class, but nothing static. I also look at all the class methods, and nothing is appearing to be an external callable method. Any suggestions? brett

Re: Automated Testing of Nifi Flow by injecting data into Processors

2019-03-06 Thread Andrew Psaltis
Hi Alexei, If you're talking about testing your flow with simulated data as if it's deployed, basically not unit tests. I've seen this done in several different ways: 1. Using the GenerateFlowFile processor and adding in custom text. At first, that may seem obvious, however, if you think about it i

Automated Testing of Nifi Flow by injecting data into Processors

2019-03-06 Thread Zenin, Alexei
Hi, Is there any way in Nifi to test out your whole flow without having the source systems online and running. I need this kind of capability to run automated integration tests which tests if the flow behaves as expected. None of the tools or libraries I have seen accomplish this and the Nifi A

RE: Unable to use Github as flowPersistenceProvider for NiFi Registry

2019-03-06 Thread S Bhandiwad, Satwik (Nokia - IN/Bangalore)
Hi all, I hosted registry on my windows machine and connected to my home network and the flows are getting saved in github. I ran service firewalld status and it showed inactive on office vms. Looks like there is some issue in office network. Thank you all for replying. Regards, Satwik -

RE: Unable to use Github as flowPersistenceProvider for NiFi Registry

2019-03-06 Thread S Bhandiwad, Satwik (Nokia - IN/Bangalore)
I'm running on RHEL 7 and the firewall is disabled. -Original Message- From: Kevin Doran Sent: Wednesday, March 6, 2019 8:36 PM To: dev@nifi.apache.org Subject: Re: Unable to use Github as flowPersistenceProvider for NiFi Registry What platform are you running on? I've heard of some i

Re: SSLHandshake Exception from Site-to-Site

2019-03-06 Thread Mohammed Nadeem
Thank you so much Koji for replying, This issue of SSL Handshake we see is for a single node cluster instance, where our NiFi application has been deployed in Kubernetes container, Here is the below configuration we did for site-to-site in nifi.properties file for a single cluster node. # Site

Re: Unable to use Github as flowPersistenceProvider for NiFi Registry

2019-03-06 Thread Kevin Doran
What platform are you running on? I've heard of some issues when trying to use the GitFLowPersistenceProvider on Windows. Technically, only Linux is a supported platform for NiFi Registry. On Wed, Mar 6, 2019 at 7:57 AM Denes Arvay wrote: > > Hi Satwik, > > Don't you have a firewall running which

4 Apache Events in 2019: DC Roadshow soon; next up Chicago, Las Vegas, and Berlin!

2019-03-06 Thread Rich Bowen
Dear Apache Enthusiast, (You’re receiving this because you are subscribed to one or more user mailing lists for an Apache Software Foundation project.) TL;DR: * Apache Roadshow DC is in 3 weeks. Register now at https://apachecon.com/usroadshowdc19/ * Registration for Apache Roadshow Chicago is

Re: Unable to use Github as flowPersistenceProvider for NiFi Registry

2019-03-06 Thread Denes Arvay
Hi Satwik, Don't you have a firewall running which doesn't let the http requests through from java processes? Denes On Wed, Mar 6, 2019 at 1:35 PM S Bhandiwad, Satwik (Nokia - IN/Bangalore) < satwik.s_bhandi...@nokia.com> wrote: > Hi Mike, > > Tried the command that you mentioned and restarted

RE: Unable to use Github as flowPersistenceProvider for NiFi Registry

2019-03-06 Thread S Bhandiwad, Satwik (Nokia - IN/Bangalore)
Hi Mike, Tried the command that you mentioned and restarted the nifi registry. I am getting the same error. My .git/config file: [core] repositoryformatversion = 0 filemode = true bare = false logallrefupdates = true [remote "origin"] url = https://github

Re: Unable to use Github as flowPersistenceProvider for NiFi Registry

2019-03-06 Thread Mike Thomsen
Try running this to see if it resolves the underlying ConnectException: > git config http.sslVerify false On Wed, Mar 6, 2019 at 7:15 AM S Bhandiwad, Satwik (Nokia - IN/Bangalore) < satwik.s_bhandi...@nokia.com> wrote: > Hi Denes, > > I tried pushing from command line and it works. > > Below are

RE: Unable to use Github as flowPersistenceProvider for NiFi Registry

2019-03-06 Thread S Bhandiwad, Satwik (Nokia - IN/Bangalore)
Hi Denes, I tried pushing from command line and it works. Below are the error logs: 019-03-06 06:06:32,110 ERROR [GitFlowMetaData Push thread] o.a.n.r.p.flow.git.GitFlowMetaData Failed to push commits to origin due to org.eclipse.jgit.api.errors.TransportException: https://github.com/satwikb32

Re: Unable to use Github as flowPersistenceProvider for NiFi Registry

2019-03-06 Thread Denes Arvay
Hi Satwik, Have you tried pushing from command line? Does it work? Aren't there more lines in the stack trace, one more "caused by" section? It could contain more hints to identify the root cause. Best, denes On Wed, Mar 6, 2019 at 7:47 AM S Bhandiwad, Satwik (Nokia - IN/Bangalore) < satwik.s_bh