RE: [EXTERNAL] - Re: Login Identity Provider
Thank you Bryan. Appreciate it. -Original Message- From: Bryan Bende [mailto:bbe...@gmail.com] Sent: Tuesday, November 14, 2017 1:35 PM To: dev@nifi.apache.org Subject: [EXTERNAL] - Re: Login Identity Provider Jamie, You can definitely implement your own LoginIdentityProvider... It should work just like any other extension point, meaning you build a NAR with your extension in it and drop it in the lib directory. We don't have an archetype for this, but you could probably start with the processor archetype and then rename the services file in META-INF accordingly, and change the example processor to a LoginIdentityProvider. After that you drop your NAR into the lib directory, add your config section to login-identity-providers.xml, and reference the id in nifi.properties, just like any of the others. The LDAP and Kerberos providers both are setup like this so you can take a look at their code: https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_nifi_tree_master_nifi-2Dnar-2Dbundles_nifi-2Dldap-2Diaa-2Dproviders-2Dbundle&d=DwIFaQ&c=ZgVRmm3mf2P1-XDAyDsu4A&r=TauVD_Op4rvIkArzdRrvTf-yuf4tmnM8R0LshdIDMbA&m=FyJ2KM0rSEFy5gh3iqIKRrtrHSMJ-PIf26eIrwqCGqY&s=-6LiVAO49CckQqrCCrlPqF7iR96DptS2uZWAkPq5Znw&e= https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_nifi_blob_master_nifi-2Dnar-2Dbundles_nifi-2Dldap-2Diaa-2Dproviders-2Dbundle_nifi-2Dldap-2Diaa-2Dproviders_src_main_resources_META-2DINF_services_org.apache.nifi.authentication.LoginIdentityProvider&d=DwIFaQ&c=ZgVRmm3mf2P1-XDAyDsu4A&r=TauVD_Op4rvIkArzdRrvTf-yuf4tmnM8R0LshdIDMbA&m=FyJ2KM0rSEFy5gh3iqIKRrtrHSMJ-PIf26eIrwqCGqY&s=qODzc1nWLvrc3v726ruDUpntW7Yd7E5Iv1_Bpc-e4NY&e= https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_nifi_blob_master_nifi-2Dnar-2Dbundles_nifi-2Dldap-2Diaa-2Dproviders-2Dbundle_nifi-2Dldap-2Diaa-2Dproviders_src_main_java_org_apache_nifi_ldap_LdapProvider.java&d=DwIFaQ&c=ZgVRmm3mf2P1-XDAyDsu4A&r=TauVD_Op4rvIkArzdRrvTf-yuf4tmnM8R0LshdIDMbA&m=FyJ2KM0rSEFy5gh3iqIKRrtrHSMJ-PIf26eIrwqCGqY&s=7VdbMbZ4_lmPHiy93uA5B9cCWp3oG5Ew0mDswk0Pv5c&e= Thanks, Bryan On Tue, Nov 14, 2017 at 4:10 PM, Jamie Wang wrote: > Hi, > > In NiFi 1.4.0, I see login for LDAP and Kerberos are supported. I am > integrating nifi as part of our systems of products to interoperable with > each other. We want to use our product's built-in login facility as the > authentication mechanism. Since LoginIdentityProvider is a pluggable > component, is there any API support for us to develop our own pluggable > LoginIdentifyProvider? If so, is there any example or how do I proceed with > this? Appreciate any input or pointers you may have. > > p.s. Sometimes ago, I asked the group if anyone had load the Nifi into their > own process and I didn't get any answer. I assumed no one tried Anyway, > it is possible to load nifi into your own process and we have done that. The > login is one another thing we want to integrate with our product. > > Thanks. > Jamie
Re: Login Identity Provider
Jamie, You can definitely implement your own LoginIdentityProvider... It should work just like any other extension point, meaning you build a NAR with your extension in it and drop it in the lib directory. We don't have an archetype for this, but you could probably start with the processor archetype and then rename the services file in META-INF accordingly, and change the example processor to a LoginIdentityProvider. After that you drop your NAR into the lib directory, add your config section to login-identity-providers.xml, and reference the id in nifi.properties, just like any of the others. The LDAP and Kerberos providers both are setup like this so you can take a look at their code: https://github.com/apache/nifi/tree/master/nifi-nar-bundles/nifi-ldap-iaa-providers-bundle https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-ldap-iaa-providers-bundle/nifi-ldap-iaa-providers/src/main/resources/META-INF/services/org.apache.nifi.authentication.LoginIdentityProvider https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-ldap-iaa-providers-bundle/nifi-ldap-iaa-providers/src/main/java/org/apache/nifi/ldap/LdapProvider.java Thanks, Bryan On Tue, Nov 14, 2017 at 4:10 PM, Jamie Wang wrote: > Hi, > > In NiFi 1.4.0, I see login for LDAP and Kerberos are supported. I am > integrating nifi as part of our systems of products to interoperable with > each other. We want to use our product's built-in login facility as the > authentication mechanism. Since LoginIdentityProvider is a pluggable > component, is there any API support for us to develop our own pluggable > LoginIdentifyProvider? If so, is there any example or how do I proceed with > this? Appreciate any input or pointers you may have. > > p.s. Sometimes ago, I asked the group if anyone had load the Nifi into their > own process and I didn't get any answer. I assumed no one tried Anyway, > it is possible to load nifi into your own process and we have done that. The > login is one another thing we want to integrate with our product. > > Thanks. > Jamie
Login Identity Provider
Hi, In NiFi 1.4.0, I see login for LDAP and Kerberos are supported. I am integrating nifi as part of our systems of products to interoperable with each other. We want to use our product's built-in login facility as the authentication mechanism. Since LoginIdentityProvider is a pluggable component, is there any API support for us to develop our own pluggable LoginIdentifyProvider? If so, is there any example or how do I proceed with this? Appreciate any input or pointers you may have. p.s. Sometimes ago, I asked the group if anyone had load the Nifi into their own process and I didn't get any answer. I assumed no one tried Anyway, it is possible to load nifi into your own process and we have done that. The login is one another thing we want to integrate with our product. Thanks. Jamie
Re: Problems running Minifi with an SSL Context
Hi Dave, We are due for a release. I'll start a separate thread to get that conversation going. There have been a number of new components added so, from that point, would make a good candidate for an 0.3.0. On Tue, Nov 14, 2017 at 1:19 PM, davidrsmith wrote: > Hi Aldrin > > Thanks for the prompt reply, I saw the PR, will it be a patch that will be > issued or will it be a minor version change? > Do you an idea when the solution will be available to download? > > Many thanks > Dave > > > > > Sent from Samsung tablet > > > > Original message > From Aldrin Piri > Date: 13/11/2017 14:24 (GMT+00:00) > To dev ,DAVID SMITH > Subject Re: Problems running Minifi with an SSL Context > > > Hi David, > > Sorry for your troubles, this is a bug I am addressing in MINIFI-408 [1]. > I am finishing up some testing and refactoring but hope to have a PR up in > the next couple hours. There are some additional details on the ticket. > > [1] https://issues.apache.org/jira/browse/MINIFI-408 > > On Mon, Nov 13, 2017 at 9:20 AM, DAVID SMITH > wrote: > >> Hi >> In my work dev environment I have a VM that is running NiFi v1.3, I am >> using this to create a flow template for a Minifi (v0.2.0 Java ) instance >> (initially on the same VM). >> My flow has a listenHttp which I am listening on port 1 using an >> sslContext which I have set up in NiFi, I zip the file and then use a >> postHttp to post the file to another NiFi (on a second VM) on port 4726 >> also using the same sslContext. >> In Nifi everything is fine and my flow works, I have taken a template of >> the flow, and used the Minifi toolkit to create the config.yml. I have >> edited the yaml file to ensure the keystore variables are set in the >> controller service section. >> When I start Minifi I get the following error message: >> [error] o.apache.nifi.controller.FlowController Unable to start >> ListenHTTP [id=1234.] due to java.lang.IllegalStateException: >> Processor ListenHttp is not in a valid state due to [ 'SSL Context Service' >> validated against '968df5a-dfd5-39ad--000' is invalid >> because StandardSSLContextService - 0.2.0 from org.apache.nifi.minifi - >> minifi-ssl-context-service-nar is not compatible with SSLContextService - >> unversioned from default - system] >> Can anyone give me a pointer as to what may be wrong here please? >> Many thanksDave > > >
Re: Problems running Minifi with an SSL Context
Hi Aldrin Thanks for the prompt reply, I saw the PR, will it be a patch that will be issued or will it be a minor version change? Do you an idea when the solution will be available to download? Many thanks Dave Sent from Samsung tablet Original message From Aldrin Piri Date: 13/11/2017 14:24 (GMT+00:00) To dev ,DAVID SMITH Subject Re: Problems running Minifi with an SSL Context Hi David, Sorry for your troubles, this is a bug I am addressing in MINIFI-408 [1]. I am finishing up some testing and refactoring but hope to have a PR up in the next couple hours. There are some additional details on the ticket. [1] https://issues.apache.org/jira/browse/MINIFI-408 On Mon, Nov 13, 2017 at 9:20 AM, DAVID SMITH wrote: Hi In my work dev environment I have a VM that is running NiFi v1.3, I am using this to create a flow template for a Minifi (v0.2.0 Java ) instance (initially on the same VM). My flow has a listenHttp which I am listening on port 1 using an sslContext which I have set up in NiFi, I zip the file and then use a postHttp to post the file to another NiFi (on a second VM) on port 4726 also using the same sslContext. In Nifi everything is fine and my flow works, I have taken a template of the flow, and used the Minifi toolkit to create the config.yml. I have edited the yaml file to ensure the keystore variables are set in the controller service section. When I start Minifi I get the following error message: [error] o.apache.nifi.controller.FlowController Unable to start ListenHTTP [id=1234.] due to java.lang.IllegalStateException: Processor ListenHttp is not in a valid state due to [ 'SSL Context Service' validated against '968df5a-dfd5-39ad--000' is invalid because StandardSSLContextService - 0.2.0 from org.apache.nifi.minifi - minifi-ssl-context-service-nar is not compatible with SSLContextService - unversioned from default - system] Can anyone give me a pointer as to what may be wrong here please? Many thanksDave
Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson
Congrats Andy! On Tue, Nov 14, 2017 at 11:21 AM, Jeremy Dyer wrote: > Good to have you Andy! > > Sent from my iPhone > > > On Nov 14, 2017, at 11:06 AM, Scott Aslan wrote: > > > > Congrats > > > >> On Tue, Nov 14, 2017 at 8:11 AM, Marc wrote: > >> > >> Congrats > >> > >> On Nov 14, 2017 1:29 AM, "Pierre Villard" > >> wrote: > >> > >> Congrats! > >> > >> Le 14 nov. 2017 04:16, "Jeff" a écrit : > >> > >>> Congrats, Andy! > >>> > >>> On Mon, Nov 13, 2017 at 9:44 PM Kevin Doran > >>> wrote: > >>> > Congrats, Andy! Thanks for all the hard work on MiNiFi CPP! > > On 11/13/17, 19:39, "Tony Kurc" wrote: > > On behalf of the Apache NiFI PMC, I am very pleased to announce > >> that > Andy > has accepted the PMC's invitation to become a committer on the > >> Apache > NiFi > project. We greatly appreciate all of Andy's hard work and generous > contributions to the project. We look forward to his continued > involvement > in the project. > > In addition to contributing significant code to MiNiFi CPP, Andy > >> has > been > leading discussions and been the focal point for several major > improvements. His engagement with the community has been top notch, > >>> and > we're excited he accepted the PMC's invitation. > > Andy, Welcome and congratulations! > Tony > > > > > >>> > >> >
Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson
Good to have you Andy! Sent from my iPhone > On Nov 14, 2017, at 11:06 AM, Scott Aslan wrote: > > Congrats > >> On Tue, Nov 14, 2017 at 8:11 AM, Marc wrote: >> >> Congrats >> >> On Nov 14, 2017 1:29 AM, "Pierre Villard" >> wrote: >> >> Congrats! >> >> Le 14 nov. 2017 04:16, "Jeff" a écrit : >> >>> Congrats, Andy! >>> >>> On Mon, Nov 13, 2017 at 9:44 PM Kevin Doran >>> wrote: >>> Congrats, Andy! Thanks for all the hard work on MiNiFi CPP! On 11/13/17, 19:39, "Tony Kurc" wrote: On behalf of the Apache NiFI PMC, I am very pleased to announce >> that Andy has accepted the PMC's invitation to become a committer on the >> Apache NiFi project. We greatly appreciate all of Andy's hard work and generous contributions to the project. We look forward to his continued involvement in the project. In addition to contributing significant code to MiNiFi CPP, Andy >> has been leading discussions and been the focal point for several major improvements. His engagement with the community has been top notch, >>> and we're excited he accepted the PMC's invitation. Andy, Welcome and congratulations! Tony >>> >>
Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson
Congrats On Tue, Nov 14, 2017 at 8:11 AM, Marc wrote: > Congrats > > On Nov 14, 2017 1:29 AM, "Pierre Villard" > wrote: > > Congrats! > > Le 14 nov. 2017 04:16, "Jeff" a écrit : > > > Congrats, Andy! > > > > On Mon, Nov 13, 2017 at 9:44 PM Kevin Doran > > wrote: > > > > > Congrats, Andy! Thanks for all the hard work on MiNiFi CPP! > > > > > > On 11/13/17, 19:39, "Tony Kurc" wrote: > > > > > > On behalf of the Apache NiFI PMC, I am very pleased to announce > that > > > Andy > > > has accepted the PMC's invitation to become a committer on the > Apache > > > NiFi > > > project. We greatly appreciate all of Andy's hard work and generous > > > contributions to the project. We look forward to his continued > > > involvement > > > in the project. > > > > > > In addition to contributing significant code to MiNiFi CPP, Andy > has > > > been > > > leading discussions and been the focal point for several major > > > improvements. His engagement with the community has been top notch, > > and > > > we're excited he accepted the PMC's invitation. > > > > > > Andy, Welcome and congratulations! > > > Tony > > > > > > > > > > > > > > >
Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson
Congrats On Nov 14, 2017 1:29 AM, "Pierre Villard" wrote: Congrats! Le 14 nov. 2017 04:16, "Jeff" a écrit : > Congrats, Andy! > > On Mon, Nov 13, 2017 at 9:44 PM Kevin Doran > wrote: > > > Congrats, Andy! Thanks for all the hard work on MiNiFi CPP! > > > > On 11/13/17, 19:39, "Tony Kurc" wrote: > > > > On behalf of the Apache NiFI PMC, I am very pleased to announce that > > Andy > > has accepted the PMC's invitation to become a committer on the Apache > > NiFi > > project. We greatly appreciate all of Andy's hard work and generous > > contributions to the project. We look forward to his continued > > involvement > > in the project. > > > > In addition to contributing significant code to MiNiFi CPP, Andy has > > been > > leading discussions and been the focal point for several major > > improvements. His engagement with the community has been top notch, > and > > we're excited he accepted the PMC's invitation. > > > > Andy, Welcome and congratulations! > > Tony > > > > > > > > >
Current state of Kafka processors
Hi, I saw the following notice on the current documentation for the PublishKafka and ConsumeKafka processors: "Please note there are cases where the publisher can get into an indefinite stuck state. We are closely monitoring how this evolves in the Kafka community and will take advantage of those fixes as soon as we can. In the mean time it is possible to enter states where the only resolution will be to restart the JVM NiFi runs on.” I was unable to find related and unresolved JIRA issues and was wondering if this is still an issue in NiFi 1.4.0? Could somebody provide more insights into the current state? Thanks, Janosch
