RE: Authorization problems of NiFi secured cluster

Hi Mark, Thanks for your reply and the new suggestion. I will try it, too! -Original Message- From: Mark Bean [mailto:mark.o.b...@gmail.com] Sent: Wednesday, June 28, 2017 9:13 PM To: dev@nifi.apache.org Subject: Re: Authorization problems of NiFi secured cluster This is correct. And,

Re: NiFi Assembly NOTICE/LICENSE Maintenance

Yes my wording for #2 was confusing. Yes for all things bundled in a given nar its license and notice should cover all things in that nar and further the assembly L should cover it too. That is for binary dependencies. If we have source dependencies/inclusions which we take as-is or modify then

Re: NiFi Assembly NOTICE/LICENSE Maintenance

Joe et al., I was helping Mike out of band on this and think we got a bit confused, mainly I think because of the current nifi-assembly NOTICE and seemingly including things that I think you said shouldn't be (per your 2nd point). Also, some of the phrasing you used was a little bit confusing and

Re: NiFi Assembly NOTICE/LICENSE Maintenance

Joe, Thanks much for the detailed response. That's really helpful in determining what i should and shouldn't do w.r.t LICENSEs and NOTICEs. I'll capture this in the contributor guide as well. Thanks again, Mike On Wed, Jun 28, 2017 at 1:44 PM Mike Hogue wrote: > Not a

Re: NiFi Assembly NOTICE/LICENSE Maintenance

Not a problem, assuming i'm able to edit the contributor's guide. On Wed, Jun 28, 2017 at 1:43 PM Tony Kurc wrote: > Mike, > while it is fresh in your head, any chance you have cycles to synthesize > this and put this up on the contributor's guide? > > Tony > > On Wed, Jun 28,

Re: NiFi Assembly NOTICE/LICENSE Maintenance

Mike, while it is fresh in your head, any chance you have cycles to synthesize this and put this up on the contributor's guide? Tony On Wed, Jun 28, 2017 at 11:33 AM, Joe Witt wrote: > Michael, > > Thanks for being so diligent on the L considerations. > > For the binary

Re: NiFi processor with custom UI

Will do. Thank you! On 6/28/17, 12:51 PM, "Matt Gilman" wrote: >Yuri, > >There is no maven archetype but there is some documentation in the >Developer Guide [1] with links to examples. Let us know if you have any >specific questions. > >Thanks! > >Matt > >[1]

Re: NiFi processor with custom UI

Yuri, There is no maven archetype but there is some documentation in the Developer Guide [1] with links to examples. Let us know if you have any specific questions. Thanks! Matt [1] https://nifi.apache.org/docs/nifi-docs/html/developer-guide.html#ui-extensions On Wed, Jun 28, 2017 at 12:48

NiFi processor with custom UI

Hi Everyone, I am looking into developing a custom processor with custom UI. I am currently reviewing UpdateAttribute processor as an example of this. Could anyone please advise whether there's a maven archetype for generating boilerplate structure and files to support this type of processor?

Re: NiFi Assembly NOTICE/LICENSE Maintenance

Michael, Thanks for being so diligent on the L considerations. For the binary dependencies you're listing here I'd take the following approach: 1) For google rpc dependency that is a new version but appears to be the same LICENSE text I'd simply update this line [1] to say The binary

Re: Example Load Profile

James, Sorry, I let this slip through the cracks. Just took a look at the template that you attached. What you're doing here should certainly work okay with NiFi. However, the pattern that you are using is to take a large XML file, split it into small chunks, process each chunk individually,

Re: Example Load Profile

Hi everyone, I am also starting to do some performance testing of a similar nature. Did anyone find a good load profile/xml flow to use for this? Regards, Stephen - From: James Farrington Date: Mon, Jun 19,

Re: File Filter regular expression - GetFile

Thanks James, It's working fine. Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/File-Filter-regular-expression-GetFile-tp16279p16291.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.

Re: Not able to start nifi nodes when clustered

Hello, We see in the attached log the following line: 2017-06-28 18:44:20,894 ERROR [main] o.a.z.server.quorum.QuorumPeerConfig does not have the form host:port or host:port:port or host:port:port:type The code in ZooKeeper that produces this line looks like this: } else if

Not able to start nifi nodes when clustered

I am trying to set up a fresh nifi cluster with 2 nodes.Details below:- OS-104-Ubuntu Nifi version 1.3.0 jdk - Oracle jdk-1.8.0_131 I tried to start the nifi nodes in a non clustered mode and both of them started up fine. After that,I have been trying to set up the 2 node nifi cluster and it

Re: File Filter regular expression - GetFile

Hello Shankha, Give the below a try: ab\.[\w]* That should match any files that start with "ab." (with any word character in the extension). Please let me know if that works for you. Best Regards, Yolanda On Wed, Jun 28, 2017 at 5:55 AM, shankhamajumdar < shankha.majum...@lexmark.com>

Re: File Filter regular expression - GetFile

The .* in your regular expression is allowing all characters. You can escape this and specify a literal dot with a backslash, like \. Try [ab]+\..* for example. On Wed, Jun 28, 2017 at 2:55 AM, shankhamajumdar < shankha.majum...@lexmark.com> wrote: > Hi, > > Just a small modification, I am

Re: conversion from AVRO file format to Parquet file format

Rohith, Can you share more details about how you have configured PutParquet? What Record Reader are you using and what Schema Access Strategy? If your data is already in Avro then you would need to set the Record Reader to an AvroRecordReader. The AvroRecordReader can be configured to use the

conversion from AVRO file format to Parquet file format

Hello Team, We the team are in need to convert the data flow file from AVRO to PARQUET. We found two processors to do that. 1. Get_Parquet 2. Put_Parquet is it possible to convert binary file format of AVRO to parquet. The source schema is not getting automatically generated for parquet.

File Filter regular expression - GetFile

Hi, I want to get the list of files from a directory where file name starts with a. I am using File Filter regular expression where default value is [^\.].*. But using this value I am getting all the files. Please let me know what I need to use in the File Filter regular expression section so

Re: Does PostHTTP support Multipart/form-data ?

Makes perfect sense, thanks ! Best, Luc -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Does-PostHTTP-support-Multipart-form-data-tp16259p16282.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.

Re: Getting reviews on two pull requests

Hey Mike, I should be able to have a look at 1948. I already pulled a Mongo image on my docker and I should have something running in the afternoon. Pierre 2017-06-28 14:03 GMT+02:00 Mark Payne : > Hey Mike, > > I think I can review 1945 today. I don't have much knowledge

Re: Authorization problems of NiFi secured cluster

This is correct. And, there is an alternative to adding the cluster Nodes as "Node Identity" in the authorizers.xml file. Instead, you can use a legacy authorized-users.xml file specifying the file location/name in the "Legacy Authorized Users File" property. In this file, each cluster Node should

Re: Getting reviews on two pull requests

Hey Mike, I think I can review 1945 today. I don't have much knowledge of Mongo but did a lot of the work on the record stuff. Hopefully I can find a good Mongo docker container for testing. If nobody else has reviewed the other one when I finish 1945 then I may have a chance to review that

Getting reviews on two pull requests

Hi, I put out two pull requests for the Mongo bundle based on use cases we ran into when doing bulk ingestion with Mongo. https://github.com/apache/nifi/pull/1948 This one allows GetMongo to bundle results into a large JSON array in a flowfile based on user-defined limits. We needed it because