Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson

[Pierre Villard]

Congrats!

Le 14 nov. 2017 04:16, "Jeff"  a écrit :

> Congrats, Andy!
>
> On Mon, Nov 13, 2017 at 9:44 PM Kevin Doran 
> wrote:
>
> > Congrats, Andy! Thanks for all the hard work on MiNiFi CPP!
> >
> > On 11/13/17, 19:39, "Tony Kurc"  wrote:
> >
> > On behalf of the Apache NiFI PMC, I am very pleased to announce that
> > Andy
> > has accepted the PMC's invitation to become a committer on the Apache
> > NiFi
> > project. We greatly appreciate all of Andy's hard work and generous
> > contributions to the project. We look forward to his continued
> > involvement
> > in the project.
> >
> > In addition to contributing significant code to MiNiFi CPP, Andy has
> > been
> > leading discussions and been the focal point for several major
> > improvements. His engagement with the community has been top notch,
> and
> > we're excited he accepted the PMC's invitation.
> >
> > Andy, Welcome and congratulations!
> > Tony
> >
> >
> >
> >
>

Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson

[Jeff]

Congrats, Andy!

On Mon, Nov 13, 2017 at 9:44 PM Kevin Doran  wrote:

> Congrats, Andy! Thanks for all the hard work on MiNiFi CPP!
>
> On 11/13/17, 19:39, "Tony Kurc"  wrote:
>
> On behalf of the Apache NiFI PMC, I am very pleased to announce that
> Andy
> has accepted the PMC's invitation to become a committer on the Apache
> NiFi
> project. We greatly appreciate all of Andy's hard work and generous
> contributions to the project. We look forward to his continued
> involvement
> in the project.
>
> In addition to contributing significant code to MiNiFi CPP, Andy has
> been
> leading discussions and been the focal point for several major
> improvements. His engagement with the community has been top notch, and
> we're excited he accepted the PMC's invitation.
>
> Andy, Welcome and congratulations!
> Tony
>
>
>
>

Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson

[Kevin Doran]

Congrats, Andy! Thanks for all the hard work on MiNiFi CPP!

On 11/13/17, 19:39, "Tony Kurc"  wrote:

On behalf of the Apache NiFI PMC, I am very pleased to announce that Andy
has accepted the PMC's invitation to become a committer on the Apache NiFi
project. We greatly appreciate all of Andy's hard work and generous
contributions to the project. We look forward to his continued involvement
in the project.

In addition to contributing significant code to MiNiFi CPP, Andy has been
leading discussions and been the focal point for several major
improvements. His engagement with the community has been top notch, and
we're excited he accepted the PMC's invitation.

Andy, Welcome and congratulations!
Tony

Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson

[Mike Hogue]

Congrats, Andy!
On Mon, Nov 13, 2017 at 20:36 Joe Witt  wrote:

> andy. congrats.  exciting stuff with minifi!
>
> On Nov 13, 2017 7:53 PM, "Matt Burgess"  wrote:
>
> > Congrats and welcome aboard Andy!
> >
> > On Mon, Nov 13, 2017 at 7:39 PM, Tony Kurc  wrote:
> > > On behalf of the Apache NiFI PMC, I am very pleased to announce that
> Andy
> > > has accepted the PMC's invitation to become a committer on the Apache
> > NiFi
> > > project. We greatly appreciate all of Andy's hard work and generous
> > > contributions to the project. We look forward to his continued
> > involvement
> > > in the project.
> > >
> > > In addition to contributing significant code to MiNiFi CPP, Andy has
> been
> > > leading discussions and been the focal point for several major
> > > improvements. His engagement with the community has been top notch, and
> > > we're excited he accepted the PMC's invitation.
> > >
> > > Andy, Welcome and congratulations!
> > > Tony
> >
>

Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson

[Joe Witt]

andy. congrats.  exciting stuff with minifi!

On Nov 13, 2017 7:53 PM, "Matt Burgess"  wrote:

> Congrats and welcome aboard Andy!
>
> On Mon, Nov 13, 2017 at 7:39 PM, Tony Kurc  wrote:
> > On behalf of the Apache NiFI PMC, I am very pleased to announce that Andy
> > has accepted the PMC's invitation to become a committer on the Apache
> NiFi
> > project. We greatly appreciate all of Andy's hard work and generous
> > contributions to the project. We look forward to his continued
> involvement
> > in the project.
> >
> > In addition to contributing significant code to MiNiFi CPP, Andy has been
> > leading discussions and been the focal point for several major
> > improvements. His engagement with the community has been top notch, and
> > we're excited he accepted the PMC's invitation.
> >
> > Andy, Welcome and congratulations!
> > Tony
>

Re: [ANNOUNCE] New Apache NiFi Committer Andy Christianson

[Matt Burgess]

Congrats and welcome aboard Andy!

On Mon, Nov 13, 2017 at 7:39 PM, Tony Kurc  wrote:
> On behalf of the Apache NiFI PMC, I am very pleased to announce that Andy
> has accepted the PMC's invitation to become a committer on the Apache NiFi
> project. We greatly appreciate all of Andy's hard work and generous
> contributions to the project. We look forward to his continued involvement
> in the project.
>
> In addition to contributing significant code to MiNiFi CPP, Andy has been
> leading discussions and been the focal point for several major
> improvements. His engagement with the community has been top notch, and
> we're excited he accepted the PMC's invitation.
>
> Andy, Welcome and congratulations!
> Tony

[ANNOUNCE] New Apache NiFi Committer Andy Christianson

[Tony Kurc]

On behalf of the Apache NiFI PMC, I am very pleased to announce that Andy
has accepted the PMC's invitation to become a committer on the Apache NiFi
project. We greatly appreciate all of Andy's hard work and generous
contributions to the project. We look forward to his continued involvement
in the project.

In addition to contributing significant code to MiNiFi CPP, Andy has been
leading discussions and been the focal point for several major
improvements. His engagement with the community has been top notch, and
we're excited he accepted the PMC's invitation.

Andy, Welcome and congratulations!
Tony

Anyone else getting this error when building?

[Mike Thomsen]

[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
(default) on project nifi-standard-processors: Error resolving project
artifact: Could not transfer artifact
com.martiansoftware:macnificent:pom:0.2.0 from/to central (
https://repo1.maven.org/maven2): Host name 'repo1.maven.org' does not match
the certificate subject provided by the peer (CN=repo.maven.apache.org,
O="Sonatype, Inc", L=Fulton, ST=MD, C=US) for project
com.martiansoftware:macnificent:jar:0.2.0

Re: Custom properties file for environmental promotion

[Bryan Bende]

In general that approach should work, there were a few community
efforts that did something like this in the past [1][2].

For the RPG, you may need to substitute another value as well, because
I believe the template also contains the UUID of the ports it is
connected to, which will be different depending on the target URI, but
I don't remember exactly how this part works, maybe others can chime
in.

Thanks,

Bryan

[1] https://github.com/aperepel/nifi-api-deploy
[2] https://github.com/hermannpencole/nifi-config

On Mon, Nov 13, 2017 at 1:47 PM, wildo  wrote:
> If you guys would please entertain one more question:
>
> Unfortunately the site is currently limited to Nifi 1.2, and this
> effectively renders the custom properties file useless as it relates to the
> PutHDFS kerberos principal/keytab. I was thinking about this as I exported
> the template in order to put into source control.
>
> Is there any reason that I couldn't modify the xml template to replace these
> values before uploading the template into the new environment?
>
> 
> Kerberos Principal
> d...@mydomain.com
> 
>
> 
> Kerberos Keytab
> /my/path/to/keytabs/dev.keytab
> 
>
>
> Similarly, when it comes to the remote process group, is there any reason
> that I can't just modify these uris before uploading the template to the new
> environment?
>
> https://dev001.mydomain.com:1234/nifi
> https://dev001.mydomain.com:1234/nifi,https://dev002.mydomain.com:1234/nifi
>
>
> It would be quite simple to write a script that does a simple substitution
> on these values. But is there any reason that that wouldn't work? I imagine
> I'm hardly the first to think about editing the template xml itself...
>
>
>
> --
> Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: Custom properties file for environmental promotion

[wildo]

If you guys would please entertain one more question:

Unfortunately the site is currently limited to Nifi 1.2, and this
effectively renders the custom properties file useless as it relates to the
PutHDFS kerberos principal/keytab. I was thinking about this as I exported
the template in order to put into source control.

Is there any reason that I couldn't modify the xml template to replace these
values before uploading the template into the new environment?


Kerberos Principal
d...@mydomain.com



Kerberos Keytab
/my/path/to/keytabs/dev.keytab



Similarly, when it comes to the remote process group, is there any reason
that I can't just modify these uris before uploading the template to the new
environment?

https://dev001.mydomain.com:1234/nifi
https://dev001.mydomain.com:1234/nifi,https://dev002.mydomain.com:1234/nifi


It would be quite simple to write a script that does a simple substitution
on these values. But is there any reason that that wouldn't work? I imagine
I'm hardly the first to think about editing the template xml itself...



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: Nifi ExecuteScript slow performance

[Mike Thomsen]

Vyshali,

Another trick you can do that works very well if you have a lot of
flowfiles to process is use session.get(int) to grab a batch. Obviously,
keep the volume you grab tuned to reasonable memory limits and all that,
but you can use that to make the script do a lot more work in one single
run. I have a flow that ends up processing millions of JSON files, and
grabbing 500 of them at once and merging them into a JSON array to create a
record batch really helps.

On Mon, Nov 13, 2017 at 12:23 PM, Vyshali  wrote:

> Thank you so much Matt.
> I will try the solutions provided and come back in case of questions.
>
> Thanks,
> Vyshali
>
>
>
> --
> Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/
>

Re: Nifi ExecuteScript slow performance

[Vyshali]

Thank you so much Matt.
I will try the solutions provided and come back in case of questions.

Thanks,
Vyshali



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: Custom properties file for environmental promotion

[wildo]

Thanks Matt! I was just coming back to update. I found the 1.4 docs that
indicated that it was available there. We are currently using 1.2. I should
have researched better... Thanks again!



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: Custom properties file for environmental promotion

[Matt Burgess]

It looks like the HDFS ones were added in NiFi 1.4.0 [1] [2], and the
ListenTCP EL support for Port has an open Jira [3].

Regards,
Matt

[1] https://issues.apache.org/jira/browse/NIFI-2923
[2] https://issues.apache.org/jira/browse/NIFI-4010
[3] https://issues.apache.org/jira/browse/NIFI-4458


On Mon, Nov 13, 2017 at 11:08 AM, wildo  wrote:
> Oh no! I just realized that the Kerberos Principle and Keytab fields in
> PutHDFS do *not* support expression language. Oy. This is a nonstarter...
>
> Bryan- is there some way to submit an enhancement request for EL support on
> these fields? Same goes for the port number on ListenTCP- no EL support.
> Sorry- I'm not aware of the protocol for submitting such an enhancement.
>
>
>
> --
> Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: Custom properties file for environmental promotion

[wildo]

Oh no! I just realized that the Kerberos Principle and Keytab fields in
PutHDFS do *not* support expression language. Oy. This is a nonstarter...

Bryan- is there some way to submit an enhancement request for EL support on
these fields? Same goes for the port number on ListenTCP- no EL support.
Sorry- I'm not aware of the protocol for submitting such an enhancement.



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: Problems running Minifi with an SSL Context

[Aldrin Piri]

Hi David,

Sorry for your troubles, this is a bug I am addressing in MINIFI-408 [1].
I am finishing up some testing and refactoring but hope to have a PR up in
the next couple hours.  There are some additional details on the ticket.

[1] https://issues.apache.org/jira/browse/MINIFI-408

On Mon, Nov 13, 2017 at 9:20 AM, DAVID SMITH 
wrote:

> Hi
> In my work dev environment I have a VM that is running NiFi v1.3, I am
> using this to create a flow template for a Minifi (v0.2.0 Java ) instance
> (initially on the same VM).
> My flow has a listenHttp which I am listening on port 1 using an
> sslContext which I have set up in NiFi, I zip the file and then use a
> postHttp to post the file to another NiFi (on a second VM) on port 4726
> also using the same sslContext.
> In Nifi everything is fine and my flow works, I have taken a template of
> the flow, and used the Minifi toolkit to create the config.yml. I have
> edited the yaml file to ensure the keystore variables are set in the
> controller service section.
> When I start Minifi I get the following error message:
> [error] o.apache.nifi.controller.FlowController Unable to start
> ListenHTTP [id=1234.] due to java.lang.IllegalStateException:
> Processor ListenHttp is not in a valid state due to [ 'SSL Context Service'
> validated against '968df5a-dfd5-39ad--000' is invalid because
> StandardSSLContextService - 0.2.0 from org.apache.nifi.minifi -
> minifi-ssl-context-service-nar is not compatible with SSLContextService -
> unversioned from default - system]
> Can anyone give me a pointer as to what may be wrong here please?
> Many thanksDave