NiFi Support and Queries

2023-04-07 Thread surendranath pulagora
Hi Team,



We need your support for the following questions if possible ,



1) Non-Technical:

Ø  Do you have any license which we can purchase for our  enterprise usage.
If yes then can you please share the same and contact details to work on
the same.

Ø  If no license then what are the legal requirements we need to consider
for enterprise usage. Please guide us on the same.

Ø  How we can set up a call to get more details .



2) Technical :

Ø  We need your help if possible in setting up a robust system  in our
environment to handle huge data loads.

Ø  If yes can you please share the contact details to discuss the same .



Regards,

Surendranath

Integration Architect


Re: [VOTE] Release Apache NiFi 1.21.0 (RC2)

2023-04-07 Thread Joe Witt
+1 (binding)

On Thu, Apr 6, 2023 at 11:48 AM Emilio Setiadarma
 wrote:
>
> +1 (non-binding)
>
> Verified signature and SHA256/512 hashes of the release.
> OS: MacOS Ventura 13.2.1
> Java version: OpenJDK version 11.0.18
> Ran the build, and booted up NiFi with no issues, and was able to start up
> a simple flow
>
>
>
> On Thu, Apr 6, 2023 at 9:19 AM Michael Moser  wrote:
>
> > +1 (binding)
> >
> > Verified checksums and signature of source release
> > Built (with empty local repo) on CentOS Linux release 7.9.2009
> > Apache Maven 3.8.6
> > Java version: 1.8.0_362, vendor: Red Hat, Inc., runtime:
> > /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre
> > Default locale: en_US, platform encoding: UTF-8
> > OS name: "linux", version: "3.10.0-1160.76.1.el7.x86_64", arch: "amd64",
> > family: "unix"
> >
> > Ran NiFi and NiFi Registry with no issues.
> >
> > Hello again team!
> >
> > -- Mike
> >
> > On Thu, Apr 6, 2023 at 9:47 AM Paul Grey  wrote:
> >
> > > +1 (non-binding)
> > >
> > > - Verified signatures and hashes of [
> > > https://dist.apache.org/repos/dist/dev/nifi/nifi-1.21.0/] binaries
> > >
> > > - Build of source successful (macOS 12 / Azul Java 1.8.0_322)
> > > - Application startup successful
> > > - Verified successful flow of data using known good flows (Kafka,
> > PutSlack)
> > > - verify NIFI-4890 - OIDC refactor (backport) (Okta dev account)
> > >
> > > - Application startup successful (set-single-user-credentials, three node
> > > dev cluster)
> > > - Verified successful flow of data using known good flows (Kafka,
> > PutSlack)
> > > - Testing of cluster disconnect / offload / connect operations
> > >
> > > - Build of source successful (Debian 10.13 / OpenJDK 1.8.0_362)
> > > - Application startup successful
> > > - Verified successful flow of data using known good flows (PutSlack)
> > >
> > > - Captured test failure (Linux) as NIFI-11391 to investigate.
> > >
> > > On Thu, Apr 6, 2023 at 8:31 AM Gábor Gyimesi 
> > wrote:
> > >
> > > > +1 (non-binding)
> > > >
> > > > Verified signatures and hashes
> > > > Built NiFi on ubuntu 22.04
> > > > Ran a simple flow and a flow integrated with MiNiFi C++ through
> > > InvokeHTTP
> > > >
> > > > LGTM
> > > >
> > > > Thanks Joe!
> > > >
> > > > BR,
> > > > Gabor
> > > >
> > > > On Thu, 6 Apr 2023 at 14:15, Martin Zink 
> > wrote:
> > > >
> > > > > +1 (non-binding)
> > > > >
> > > > > Went through the helper guide verified signatures and hashes.
> > > > > I've also verified that integration with the latest MiNiFi C++ works
> > as
> > > > > expected (InvokeHTTP based flows)
> > > > >
> > > > > Everything looks good
> > > > >
> > > > > Thanks Joe for RMing!
> > > > >
> > > > > On Thu, Apr 6, 2023 at 9:47 AM Ferenc Kis 
> > > > wrote:
> > > > >
> > > > > > +1 (non-binding)
> > > > > >
> > > > > > - Went through the helper guide, full clean build with contrib
> > check,
> > > > > > verified signatures and hashes
> > > > > >   Maven home: /Users/fkis/.sdkman/candidates/maven/current
> > > > > >   Java version: 11.0.18, vendor: Eclipse Adoptium, runtime:
> > > > > > /Users/fkis/.sdkman/candidates/java/11.0.18-tem
> > > > > >   Default locale: en_HU, platform encoding: UTF-8
> > > > > >   OS name: "mac os x", version: "13.2.1", arch: "aarch64", family:
> > > > "mac"
> > > > > > - Started NiFi, created a simple flow with ListenHTTP
> > > > > > - Started Nifi Registry, set up integration with NiFi, and saved
> > the
> > > > > > previous flow to NiFi Registry
> > > > > > - Started MiNiFi Java:
> > > > > >   * created a simple GenerateFlowFile -> InvokeHttp flow and pushed
> > > to
> > > > > > MiNiFi via C2 protocol
> > > > > >   * managed to push data from MiNiFi to NiFi
> > > > > >
> > > > > > Thanks Joe for RMing!
> > > > > >
> > > > > > Regards
> > > > > > Ferenc
> > > > > >
> > > > > > On Thu, Apr 6, 2023 at 9:06 AM Pierre Villard <
> > > > > pierre.villard...@gmail.com
> > > > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > +1 binding
> > > > > > >
> > > > > > > Went through the usual steps. Deployed a 3 node secured cluster
> > on
> > > > GCP
> > > > > > with
> > > > > > > a secure NiFi Registry. Tested some flows. All good.
> > > > > > >
> > > > > > > Thanks Joe for taking care of the release!
> > > > > > >
> > > > > > > Le jeu. 6 avr. 2023 à 05:11, Mark Bean  a
> > > > > écrit :
> > > > > > >
> > > > > > > > +1 (non-binding)
> > > > > > > >
> > > > > > > > Verified signatures and hashes.
> > > > > > > > Performed full build with -Pcontrib-check using maven 3.6.3 and
> > > > Java
> > > > > > > > 11.0.18 on Ubuntu 20.04.1.
> > > > > > > > Installed and ran NiFi again using Java 11.0.18. Executed some
> > > > basic
> > > > > > > flows.
> > > > > > > >
> > > > > > > >
> > > > > > > > On Mon, Apr 3, 2023 at 8:11 PM Joe Witt 
> > > > wrote:
> > > > > > > >
> > > > > > > > > Hello,
> > > > > > > > >
> > > > > > > > > I am pleased to be calling this vote for the source release
> > of
> > > > > Apache
> > > > > > > > > NiFi 1.21.0.
> > > > > > > > 

Re: [VOTE] Release Apache NiFi 1.21.0 (RC2)

2023-04-07 Thread Mark Payne
+1 (binding)

Performed full build with contrib-check profile successfully
Ran all system tests successfully
Verified signature
Verified hash
Tested several specific flows in registry, around using embedded PG’s, some 
versioned and some not.

I did encounter a bug that I filed a Jira [1]  for. It was fairly minor as its 
scope is quite narrow and there’s a simple enough work around. Not concerning 
enough to change my vote.

Thanks for performing the RM Joe!

-Mark


[1] https://issues.apache.org/jira/browse/NIFI-11394

On Apr 6, 2023, at 2:48 PM, Emilio Setiadarma  
wrote:

+1 (non-binding)

Verified signature and SHA256/512 hashes of the release.
OS: MacOS Ventura 13.2.1
Java version: OpenJDK version 11.0.18
Ran the build, and booted up NiFi with no issues, and was able to start up
a simple flow



On Thu, Apr 6, 2023 at 9:19 AM Michael Moser  wrote:

+1 (binding)

Verified checksums and signature of source release
Built (with empty local repo) on CentOS Linux release 7.9.2009
Apache Maven 3.8.6
Java version: 1.8.0_362, vendor: Red Hat, Inc., runtime:
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "3.10.0-1160.76.1.el7.x86_64", arch: "amd64",
family: "unix"

Ran NiFi and NiFi Registry with no issues.

Hello again team!

-- Mike

On Thu, Apr 6, 2023 at 9:47 AM Paul Grey  wrote:

+1 (non-binding)

- Verified signatures and hashes of [
https://dist.apache.org/repos/dist/dev/nifi/nifi-1.21.0/] binaries

- Build of source successful (macOS 12 / Azul Java 1.8.0_322)
- Application startup successful
- Verified successful flow of data using known good flows (Kafka,
PutSlack)
- verify NIFI-4890 - OIDC refactor (backport) (Okta dev account)

- Application startup successful (set-single-user-credentials, three node
dev cluster)
- Verified successful flow of data using known good flows (Kafka,
PutSlack)
- Testing of cluster disconnect / offload / connect operations

- Build of source successful (Debian 10.13 / OpenJDK 1.8.0_362)
- Application startup successful
- Verified successful flow of data using known good flows (PutSlack)

- Captured test failure (Linux) as NIFI-11391 to investigate.

On Thu, Apr 6, 2023 at 8:31 AM Gábor Gyimesi 
wrote:

+1 (non-binding)

Verified signatures and hashes
Built NiFi on ubuntu 22.04
Ran a simple flow and a flow integrated with MiNiFi C++ through
InvokeHTTP

LGTM

Thanks Joe!

BR,
Gabor

On Thu, 6 Apr 2023 at 14:15, Martin Zink 
wrote:

+1 (non-binding)

Went through the helper guide verified signatures and hashes.
I've also verified that integration with the latest MiNiFi C++ works
as
expected (InvokeHTTP based flows)

Everything looks good

Thanks Joe for RMing!

On Thu, Apr 6, 2023 at 9:47 AM Ferenc Kis 
wrote:

+1 (non-binding)

- Went through the helper guide, full clean build with contrib
check,
verified signatures and hashes
 Maven home: /Users/fkis/.sdkman/candidates/maven/current
 Java version: 11.0.18, vendor: Eclipse Adoptium, runtime:
/Users/fkis/.sdkman/candidates/java/11.0.18-tem
 Default locale: en_HU, platform encoding: UTF-8
 OS name: "mac os x", version: "13.2.1", arch: "aarch64", family:
"mac"
- Started NiFi, created a simple flow with ListenHTTP
- Started Nifi Registry, set up integration with NiFi, and saved
the
previous flow to NiFi Registry
- Started MiNiFi Java:
 * created a simple GenerateFlowFile -> InvokeHttp flow and pushed
to
MiNiFi via C2 protocol
 * managed to push data from MiNiFi to NiFi

Thanks Joe for RMing!

Regards
Ferenc

On Thu, Apr 6, 2023 at 9:06 AM Pierre Villard <
pierre.villard...@gmail.com

wrote:

+1 binding

Went through the usual steps. Deployed a 3 node secured cluster
on
GCP
with
a secure NiFi Registry. Tested some flows. All good.

Thanks Joe for taking care of the release!

Le jeu. 6 avr. 2023 à 05:11, Mark Bean  a
écrit :

+1 (non-binding)

Verified signatures and hashes.
Performed full build with -Pcontrib-check using maven 3.6.3 and
Java
11.0.18 on Ubuntu 20.04.1.
Installed and ran NiFi again using Java 11.0.18. Executed some
basic
flows.


On Mon, Apr 3, 2023 at 8:11 PM Joe Witt 
wrote:

Hello,

I am pleased to be calling this vote for the source release
of
Apache
NiFi 1.21.0.

The source zip, including signatures, digests, etc. can be
found
at:


https://repository.apache.org/content/repositories/orgapachenifi-1226

The source being voted upon and the convenience binaries can
be
found
at:
https://dist.apache.org/repos/dist/dev/nifi/nifi-1.21.0/

A helpful reminder on how the release candidate verification
process
works:








https://cwiki.apache.org/confluence/display/NIFI/How+to+help+verify+an+Apache+NiFi+release+candidate

The Git tag is nifi-1.21.0-RC2
The Git commit ID is 892f822107da84ca0dcfefdb5c91c5bc11dc3dc1








https://gitbox.apache.org/repos/asf?p=nifi.git;a=commit;h=892f822107da84ca0dcfefdb5c91c5bc11dc3dc1

Checksums of nifi-1.21.0-source-release.zip:
SHA256:

[RESULT][VOTE] Release Apache NiFi 1.21.0 (RC2)

2023-04-07 Thread Joe Witt
Apache NiFi Community,

I am pleased to announce that the 1.21.0 release of Apache NiFi passes with
8 +1 (binding) votes
11 +1 (non-binding) votes
0 0 votes
0 -1 votes

Thanks to all who helped make this release possible.

Here is the PMC vote thread:
https://lists.apache.org/thread/fkpvjqnf48ghb025clq4sxzy2zzkh362

On Fri, Apr 7, 2023 at 8:17 AM Mark Payne  wrote:
>
> +1 (binding)
>
> Performed full build with contrib-check profile successfully
> Ran all system tests successfully
> Verified signature
> Verified hash
> Tested several specific flows in registry, around using embedded PG’s, some 
> versioned and some not.
>
> I did encounter a bug that I filed a Jira [1]  for. It was fairly minor as 
> its scope is quite narrow and there’s a simple enough work around. Not 
> concerning enough to change my vote.
>
> Thanks for performing the RM Joe!
>
> -Mark
>
>
> [1] https://issues.apache.org/jira/browse/NIFI-11394
>
> On Apr 6, 2023, at 2:48 PM, Emilio Setiadarma  
> wrote:
>
> +1 (non-binding)
>
> Verified signature and SHA256/512 hashes of the release.
> OS: MacOS Ventura 13.2.1
> Java version: OpenJDK version 11.0.18
> Ran the build, and booted up NiFi with no issues, and was able to start up
> a simple flow
>
>
>
> On Thu, Apr 6, 2023 at 9:19 AM Michael Moser  wrote:
>
> +1 (binding)
>
> Verified checksums and signature of source release
> Built (with empty local repo) on CentOS Linux release 7.9.2009
> Apache Maven 3.8.6
> Java version: 1.8.0_362, vendor: Red Hat, Inc., runtime:
> /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "3.10.0-1160.76.1.el7.x86_64", arch: "amd64",
> family: "unix"
>
> Ran NiFi and NiFi Registry with no issues.
>
> Hello again team!
>
> -- Mike
>
> On Thu, Apr 6, 2023 at 9:47 AM Paul Grey  wrote:
>
> +1 (non-binding)
>
> - Verified signatures and hashes of [
> https://dist.apache.org/repos/dist/dev/nifi/nifi-1.21.0/] binaries
>
> - Build of source successful (macOS 12 / Azul Java 1.8.0_322)
> - Application startup successful
> - Verified successful flow of data using known good flows (Kafka,
> PutSlack)
> - verify NIFI-4890 - OIDC refactor (backport) (Okta dev account)
>
> - Application startup successful (set-single-user-credentials, three node
> dev cluster)
> - Verified successful flow of data using known good flows (Kafka,
> PutSlack)
> - Testing of cluster disconnect / offload / connect operations
>
> - Build of source successful (Debian 10.13 / OpenJDK 1.8.0_362)
> - Application startup successful
> - Verified successful flow of data using known good flows (PutSlack)
>
> - Captured test failure (Linux) as NIFI-11391 to investigate.
>
> On Thu, Apr 6, 2023 at 8:31 AM Gábor Gyimesi 
> wrote:
>
> +1 (non-binding)
>
> Verified signatures and hashes
> Built NiFi on ubuntu 22.04
> Ran a simple flow and a flow integrated with MiNiFi C++ through
> InvokeHTTP
>
> LGTM
>
> Thanks Joe!
>
> BR,
> Gabor
>
> On Thu, 6 Apr 2023 at 14:15, Martin Zink 
> wrote:
>
> +1 (non-binding)
>
> Went through the helper guide verified signatures and hashes.
> I've also verified that integration with the latest MiNiFi C++ works
> as
> expected (InvokeHTTP based flows)
>
> Everything looks good
>
> Thanks Joe for RMing!
>
> On Thu, Apr 6, 2023 at 9:47 AM Ferenc Kis 
> wrote:
>
> +1 (non-binding)
>
> - Went through the helper guide, full clean build with contrib
> check,
> verified signatures and hashes
>  Maven home: /Users/fkis/.sdkman/candidates/maven/current
>  Java version: 11.0.18, vendor: Eclipse Adoptium, runtime:
> /Users/fkis/.sdkman/candidates/java/11.0.18-tem
>  Default locale: en_HU, platform encoding: UTF-8
>  OS name: "mac os x", version: "13.2.1", arch: "aarch64", family:
> "mac"
> - Started NiFi, created a simple flow with ListenHTTP
> - Started Nifi Registry, set up integration with NiFi, and saved
> the
> previous flow to NiFi Registry
> - Started MiNiFi Java:
>  * created a simple GenerateFlowFile -> InvokeHttp flow and pushed
> to
> MiNiFi via C2 protocol
>  * managed to push data from MiNiFi to NiFi
>
> Thanks Joe for RMing!
>
> Regards
> Ferenc
>
> On Thu, Apr 6, 2023 at 9:06 AM Pierre Villard <
> pierre.villard...@gmail.com
>
> wrote:
>
> +1 binding
>
> Went through the usual steps. Deployed a 3 node secured cluster
> on
> GCP
> with
> a secure NiFi Registry. Tested some flows. All good.
>
> Thanks Joe for taking care of the release!
>
> Le jeu. 6 avr. 2023 à 05:11, Mark Bean  a
> écrit :
>
> +1 (non-binding)
>
> Verified signatures and hashes.
> Performed full build with -Pcontrib-check using maven 3.6.3 and
> Java
> 11.0.18 on Ubuntu 20.04.1.
> Installed and ran NiFi again using Java 11.0.18. Executed some
> basic
> flows.
>
>
> On Mon, Apr 3, 2023 at 8:11 PM Joe Witt 
> wrote:
>
> Hello,
>
> I am pleased to be calling this vote for the source release
> of
> Apache
> NiFi 1.21.0.
>
> The source zip, including signatures, digests, etc. can be
> found
> at:
>
>
> 

[ANNOUNCE] Apache NiFi 1.21.0 release.

2023-04-07 Thread Joe Witt
Hello

The Apache NiFi team would like to announce the release of Apache NiFi 1.21.0.

Apache NiFi is an easy to use, powerful, and reliable system to
process and distribute data.  Apache NiFi was made for dataflow.  It
supports highly configurable directed graphs of data routing,
transformation, and system mediation logic.

More details on Apache NiFi can be found here:
https://nifi.apache.org/

The release artifacts can be downloaded from here:
https://nifi.apache.org/download.html

Maven artifacts have been made available and mirrored as per normal
ASF artifact processes.

Issues closed/resolved for this list can be found here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020=12352899

Release note highlights can be found here:
https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.21.0

Thank you
The Apache NiFi team