[RESULT][VOTE] Release Apache NiFi MiNiFI 0.2.0

[Aldrin Piri]

Hello,

The release passes with:

7   +1  (binding) votes
7   +1  (non-binding) votes
0   -1  votes

Thanks to all who helped make this release possible.

Here is the PMC vote thread: https://s.apache.org/nifi-minifi-vote-020 




signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: Site-to-Site load balancing

[Bryan Rosander]

Hey Mark,

The Site-to-Site client attempts to load balance based on the number of
flow files each node is currently processing combined with some randomness.
[1]

Thanks,
Bryan

[1]
https://github.com/apache/nifi/blob/master/nifi-commons/nifi-site-to-site-client/src/main/java/org/apache/nifi/remote/client/PeerSelector.java#L159

On Thu, May 18, 2017 at 9:41 AM, Mark Bean  wrote:

> How is load balancing across a cluster performed in Site-to-Site? Is it the
> responsibility of the Cluster Coordinator to inform the remote site-to-site
> client which Node to push data to? Is the Node determination simply
> round-robin? or total per Node FlowFile count or byte count? or based on
> some more specific load statistics of the host system?
>
> Thanks,
> Mark
>

Site-to-Site load balancing

[Mark Bean]

How is load balancing across a cluster performed in Site-to-Site? Is it the
responsibility of the Cluster Coordinator to inform the remote site-to-site
client which Node to push data to? Is the Node determination simply
round-robin? or total per Node FlowFile count or byte count? or based on
some more specific load statistics of the host system?

Thanks,
Mark

Re: Duplicated processors when using nifi processors dependency

[Bryan Bende]

Hi Robert,

It sounds like your NAR is including nifi-aws-processors, and so is
the regular AWS NAR. Previously it wasn't obvious this was happening,
and when NiFi started up it was finding those processors in one of the
NARs and skipping the other one. With component versioning it is now
more specific as to where the processors are coming from.

The preferred solution here would be to create a utility project
like"nifi-aws-utils" underneath nifi-nar-bundles/nifi-extension-utils:

https://github.com/apache/nifi/tree/master/nifi-nar-bundles/nifi-extension-utils

This project would then contain the abstract processor, then your
custom processors and the regular AWS processors could both depend on
and include this JAR.

If you wanted to submit a PR/patch that created this utility project,
we'd be happy to help get it reviewed/merged, although I realize you
would have to be dependent on the latest code in master until a
release occurred with the change.

Hope that helps.

Thanks,

Bryan



On Thu, May 18, 2017 at 2:58 AM, Robert  wrote:
> For my custom processor I am extending AbstractS3Processor. For that I use
> nifi-aws-processors as a dependency.
> With upgrade to 1.2.0, Nifi now loads also all aws processors that are
> packed in nar as a depencency. Is there any way to avoid duplicated
> processors that get loaded in that way?
>
>
>
> --
> View this message in context: 
> http://apache-nifi-developer-list.39713.n7.nabble.com/Duplicated-processors-when-using-nifi-processors-dependency-tp15902.html
> Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.

Re: [ANNOUNCE] New Apache NiFi PMC Member - Yolanda Davis

[Bryan Rosander]

Congrats Yolanda!

On Thu, May 18, 2017 at 9:04 AM, Kevin Doran 
wrote:

> Congratulations, Yolanda! As everyone has said, very well deserved! Thanks
> for all you do for the NiFi project and community.
>
> Kevin
>
> On 5/17/17, 22:11, "Tony Kurc"  wrote:
>
> On behalf of the Apache NiFi PMC, I am pleased to announce that Yolanda
> Davis has accepted the PMC's invitation to join the Apache NiFi PMC.
> We
> greatly appreciate all of Yolanda's hard work and generous
> contributions to
> the project. We look forward to continued involvement in the project.
>
> I know many people have interacted with Yolanda maybe at one of her
> conference talks, or had the pleasure of working with her on reviews,
> or
> used some of the features she's contributed and put a lot of work into
> making them well tested and easy to use. If so, I think you'd agree it
> is
> hard to interact with Yolanda and not get excited about not only NiFi
> but
> the entire Apache way. If not, you're in for a treat when you get the
> chance!
>
> Please join us in congratulating and welcoming Yolanda to the Apache
> NiFi
> PMC.
>
> Congratulations and welcome, Yolanda!
>
> -- Tony
>
>
>
>

Re: How to use ConvertRecord Processor

[Matt Burgess]

The CSVReader, if using "Use String Fields From Header" as the Schema
Access Strategy, will treat all fields as Strings since there is no
good way of knowing what value(s) the records/rows will contain for
each column. In that case you'd need to know the schema(s) of the
possible CSV files coming in, add them to an AvroSchemaRegistry
instance, and use a different Schema Access Strategy.

If there is a way to tell from the filename or something in the
content which schema corresponds to it, you could use RouteOnAttribute
and/or RouteOnContent to send the different CSV files down different
paths, where you could set the "avro.schema" attribute to the schema
explicitly, or if they are all in the AvroSchemaRegistry you could set
the "schema.name" attribute to the corresponding name in the
AvroSchemaRegistry. Then all the paths could join back up to a single
ConvertRecord, or each branch could have its own. In either case, the
attribute you set would correspond to the Schema Access Strategy you
select in your CSVReader.

Regards,
Matt


On Thu, May 18, 2017 at 2:10 AM, suman@cuddle.ai
 wrote:
> Hi,
> Thanks for your help . It worked.
>
> I used the following processors
> GetFile-->PutDatabaseRecord-->PutFile
>
> Only doubt i have is how to specify particular dataType for a column.
>
> For Eg: I have file like below and want to insert into the table with City
> as Varchar and Count as Integer in Postgres.
>
> City,Count
> Mumbai,10
> Mumbai,10
> Pune,10
> Pune,10
>
>
>
> --
> View this message in context: 
> http://apache-nifi-developer-list.39713.n7.nabble.com/How-to-use-ConvertRecord-Processor-tp15873p15901.html
> Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.

Re: [ANNOUNCE] New Apache NiFi PMC Member - Yolanda Davis

[Kevin Doran]

Congratulations, Yolanda! As everyone has said, very well deserved! Thanks for 
all you do for the NiFi project and community.

Kevin

On 5/17/17, 22:11, "Tony Kurc"  wrote:

On behalf of the Apache NiFi PMC, I am pleased to announce that Yolanda
Davis has accepted the PMC's invitation to join the Apache NiFi PMC.  We
greatly appreciate all of Yolanda's hard work and generous contributions to
the project. We look forward to continued involvement in the project.

I know many people have interacted with Yolanda maybe at one of her
conference talks, or had the pleasure of working with her on reviews, or
used some of the features she's contributed and put a lot of work into
making them well tested and easy to use. If so, I think you'd agree it is
hard to interact with Yolanda and not get excited about not only NiFi but
the entire Apache way. If not, you're in for a treat when you get the
chance!

Please join us in congratulating and welcoming Yolanda to the Apache NiFi
PMC.

Congratulations and welcome, Yolanda!

-- Tony

Re: [ANNOUNCE] New Apache NiFi PMC Member - Yolanda Davis

[Scott Aslan]

In all seriousness though, Yolanda you are a true professional and I must
say I have the greatest respect for you and all that you do for our
community. Thank you and congrats again!

On Thu, May 18, 2017 at 8:33 AM, Matt Burgess  wrote:

> Congratulations Yolanda!  Very well deserved, looking forward to more
> of your awesome contributions and community involvement!
>
> On Wed, May 17, 2017 at 10:11 PM, Tony Kurc  wrote:
> > On behalf of the Apache NiFi PMC, I am pleased to announce that Yolanda
> > Davis has accepted the PMC's invitation to join the Apache NiFi PMC.  We
> > greatly appreciate all of Yolanda's hard work and generous contributions
> to
> > the project. We look forward to continued involvement in the project.
> >
> > I know many people have interacted with Yolanda maybe at one of her
> > conference talks, or had the pleasure of working with her on reviews, or
> > used some of the features she's contributed and put a lot of work into
> > making them well tested and easy to use. If so, I think you'd agree it is
> > hard to interact with Yolanda and not get excited about not only NiFi but
> > the entire Apache way. If not, you're in for a treat when you get the
> > chance!
> >
> > Please join us in congratulating and welcoming Yolanda to the Apache NiFi
> > PMC.
> >
> > Congratulations and welcome, Yolanda!
> >
> > -- Tony
>



-- 
*Scott Aslan = new WebDeveloper(*
*{"location": {"city": "Saint Cloud","state": "FL",
"zip": "34771"},"contact": {"email":
"scottyas...@gmail.com ","linkedin":
"http://www.linkedin.com/in/scottyaslan
"}});*

Re: [ANNOUNCE] New Apache NiFi PMC Member - Yolanda Davis

[Matt Burgess]

Congratulations Yolanda!  Very well deserved, looking forward to more
of your awesome contributions and community involvement!

On Wed, May 17, 2017 at 10:11 PM, Tony Kurc  wrote:
> On behalf of the Apache NiFi PMC, I am pleased to announce that Yolanda
> Davis has accepted the PMC's invitation to join the Apache NiFi PMC.  We
> greatly appreciate all of Yolanda's hard work and generous contributions to
> the project. We look forward to continued involvement in the project.
>
> I know many people have interacted with Yolanda maybe at one of her
> conference talks, or had the pleasure of working with her on reviews, or
> used some of the features she's contributed and put a lot of work into
> making them well tested and easy to use. If so, I think you'd agree it is
> hard to interact with Yolanda and not get excited about not only NiFi but
> the entire Apache way. If not, you're in for a treat when you get the
> chance!
>
> Please join us in congratulating and welcoming Yolanda to the Apache NiFi
> PMC.
>
> Congratulations and welcome, Yolanda!
>
> -- Tony

Re: [ANNOUNCE] New Apache NiFi PMC Member - Yolanda Davis

[Scott Aslan]

Yolanda,

GRRRL SMH!!!

Congratulations and very much deserved! Thanks for all you do!

-Scotty

On Thu, May 18, 2017 at 7:41 AM, Marc  wrote:

>  Very awesome, Yolanda! Congrats!
>
> On Thu, May 18, 2017 at 6:45 AM, Joe Skora  wrote:
>
> > Congrats Yolanda!  Very much deserved.
> >
> > On Wed, May 17, 2017 at 10:11 PM, Tony Kurc  wrote:
> >
> > > On behalf of the Apache NiFi PMC, I am pleased to announce that Yolanda
> > > Davis has accepted the PMC's invitation to join the Apache NiFi PMC.
> We
> > > greatly appreciate all of Yolanda's hard work and generous
> contributions
> > to
> > > the project. We look forward to continued involvement in the project.
> > >
> > > I know many people have interacted with Yolanda maybe at one of her
> > > conference talks, or had the pleasure of working with her on reviews,
> or
> > > used some of the features she's contributed and put a lot of work into
> > > making them well tested and easy to use. If so, I think you'd agree it
> is
> > > hard to interact with Yolanda and not get excited about not only NiFi
> but
> > > the entire Apache way. If not, you're in for a treat when you get the
> > > chance!
> > >
> > > Please join us in congratulating and welcoming Yolanda to the Apache
> NiFi
> > > PMC.
> > >
> > > Congratulations and welcome, Yolanda!
> > >
> > > -- Tony
> > >
> >
>



-- 
*Scott Aslan = new WebDeveloper(*
*{"location": {"city": "Saint Cloud","state": "FL",
"zip": "34771"},"contact": {"email":
"scottyas...@gmail.com ","linkedin":
"http://www.linkedin.com/in/scottyaslan
"}});*

Re: [ANNOUNCE] New Apache NiFi PMC Member - Yolanda Davis

[Marc]

 Very awesome, Yolanda! Congrats!

On Thu, May 18, 2017 at 6:45 AM, Joe Skora  wrote:

> Congrats Yolanda!  Very much deserved.
>
> On Wed, May 17, 2017 at 10:11 PM, Tony Kurc  wrote:
>
> > On behalf of the Apache NiFi PMC, I am pleased to announce that Yolanda
> > Davis has accepted the PMC's invitation to join the Apache NiFi PMC.  We
> > greatly appreciate all of Yolanda's hard work and generous contributions
> to
> > the project. We look forward to continued involvement in the project.
> >
> > I know many people have interacted with Yolanda maybe at one of her
> > conference talks, or had the pleasure of working with her on reviews, or
> > used some of the features she's contributed and put a lot of work into
> > making them well tested and easy to use. If so, I think you'd agree it is
> > hard to interact with Yolanda and not get excited about not only NiFi but
> > the entire Apache way. If not, you're in for a treat when you get the
> > chance!
> >
> > Please join us in congratulating and welcoming Yolanda to the Apache NiFi
> > PMC.
> >
> > Congratulations and welcome, Yolanda!
> >
> > -- Tony
> >
>

Re: How to use ConvertRecord Processor

[suman....@cuddle.ai]

Hi,
Thanks for your help . It worked.

I used the following processors
GetFile-->PutDatabaseRecord-->PutFile

Only doubt i have is how to specify particular dataType for a column.

For Eg: I have file like below and want to insert into the table with City
as Varchar and Count as Integer in Postgres.

City,Count
Mumbai,10
Mumbai,10
Pune,10
Pune,10



--
View this message in context: 
http://apache-nifi-developer-list.39713.n7.nabble.com/How-to-use-ConvertRecord-Processor-tp15873p15901.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.

Re: [ANNOUNCE] New Apache NiFi PMC Member - Yolanda Davis

[Joe Skora]

Congrats Yolanda!  Very much deserved.

On Wed, May 17, 2017 at 10:11 PM, Tony Kurc  wrote:

> On behalf of the Apache NiFi PMC, I am pleased to announce that Yolanda
> Davis has accepted the PMC's invitation to join the Apache NiFi PMC.  We
> greatly appreciate all of Yolanda's hard work and generous contributions to
> the project. We look forward to continued involvement in the project.
>
> I know many people have interacted with Yolanda maybe at one of her
> conference talks, or had the pleasure of working with her on reviews, or
> used some of the features she's contributed and put a lot of work into
> making them well tested and easy to use. If so, I think you'd agree it is
> hard to interact with Yolanda and not get excited about not only NiFi but
> the entire Apache way. If not, you're in for a treat when you get the
> chance!
>
> Please join us in congratulating and welcoming Yolanda to the Apache NiFi
> PMC.
>
> Congratulations and welcome, Yolanda!
>
> -- Tony
>

Re: [ANNOUNCE] New Apache NiFi PMC Member - Yolanda Davis

[Andre]

Yolanda,

Congratulations and it is great to have you onboard!

Cheers

On Thu, May 18, 2017 at 12:11 PM, Tony Kurc  wrote:

> On behalf of the Apache NiFi PMC, I am pleased to announce that Yolanda
> Davis has accepted the PMC's invitation to join the Apache NiFi PMC.  We
> greatly appreciate all of Yolanda's hard work and generous contributions to
> the project. We look forward to continued involvement in the project.
>
> I know many people have interacted with Yolanda maybe at one of her
> conference talks, or had the pleasure of working with her on reviews, or
> used some of the features she's contributed and put a lot of work into
> making them well tested and easy to use. If so, I think you'd agree it is
> hard to interact with Yolanda and not get excited about not only NiFi but
> the entire Apache way. If not, you're in for a treat when you get the
> chance!
>
> Please join us in congratulating and welcoming Yolanda to the Apache NiFi
> PMC.
>
> Congratulations and welcome, Yolanda!
>
> -- Tony
>

Re: [ANNOUNCE] New Apache NiFi PMC Member - Yolanda Davis

[Aldrin Piri]

Congrats!

> On May 18, 2017, at 00:50, Pierre Villard  wrote:
> 
> Congrats Yolanda! Thanks for your amazing work ;)
> 
> 2017-05-18 6:14 GMT+02:00 Joe Percivall :
> 
>> Glad to have you joining the PMC Yolanda, very well deserved!
>> 
>>> On Thu, May 18, 2017 at 12:02 AM, Jeff  wrote:
>>> 
>>> Congrats Yolanda!
>>> 
>>> On Wed, May 17, 2017 at 10:43 PM Yolanda Davis <
>> yolanda.m.da...@gmail.com>
>>> wrote:
>>> 
 Thank you everyone! It has been my pleasure to continue to contribute
>> to
 and support this awesome community. Definitely looking forward to all
>> the
 great things ahead!
 
 On Wed, May 17, 2017 at 10:32 PM, Koji Kawamura <
>> ijokaruma...@gmail.com>
 wrote:
 
> Congratulations Yolanda, well deserved! I have a great respect for
> your excellent work.
> 
> On Thu, May 18, 2017 at 11:15 AM, Andy LoPresto <
>> alopre...@apache.org>
> wrote:
>> Congratulations Yolanda. Well deserved and very excited for your
> continued
>> excellent contributions to all aspects of the project.
>> 
>> Andy LoPresto
>> alopre...@apache.org
>> alopresto.apa...@gmail.com
>> PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69
>> 
>> On May 17, 2017, at 7:14 PM, Joe Witt  wrote:
>> 
>> Agree very much with Tony's excellent writeup.
>> 
>> Congrats and thank you Yolanda!
>> 
>> On Wed, May 17, 2017 at 10:11 PM, Tony Kurc 
>>> wrote:
>> 
>> On behalf of the Apache NiFi PMC, I am pleased to announce that
>>> Yolanda
>> Davis has accepted the PMC's invitation to join the Apache NiFi
>> PMC.
 We
>> greatly appreciate all of Yolanda's hard work and generous
 contributions
> to
>> the project. We look forward to continued involvement in the
>> project.
>> 
>> I know many people have interacted with Yolanda maybe at one of her
>> conference talks, or had the pleasure of working with her on
>> reviews,
 or
>> used some of the features she's contributed and put a lot of work
>>> into
>> making them well tested and easy to use. If so, I think you'd agree
>>> it
 is
>> hard to interact with Yolanda and not get excited about not only
>> NiFi
 but
>> the entire Apache way. If not, you're in for a treat when you get
>> the
>> chance!
>> 
>> Please join us in congratulating and welcoming Yolanda to the
>> Apache
 NiFi
>> PMC.
>> 
>> Congratulations and welcome, Yolanda!
>> 
>> -- Tony
>> 
>> 
> 
 
 
 
 --
 --
 yolanda.m.da...@gmail.com
 @YolandaMDavis
 
>>> 
>> 
>> 
>> 
>> --
>> *Joe Percivall*
>> linkedin.com/in/Percivall
>> e: jperciv...@apache.com
>> 

Duplicated processors when using nifi processors dependency

[Robert]

For my custom processor I am extending AbstractS3Processor. For that I use
nifi-aws-processors as a dependency.
With upgrade to 1.2.0, Nifi now loads also all aws processors that are
packed in nar as a depencency. Is there any way to avoid duplicated
processors that get loaded in that way?



--
View this message in context: 
http://apache-nifi-developer-list.39713.n7.nabble.com/Duplicated-processors-when-using-nifi-processors-dependency-tp15902.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.