Handling of the contents of the failure result in the python FlowFileTransform API

[Ferenc Gerlits]

Hello NiFi community,

We have implemented NiFi's FlowFileTransform API for Python processors
in MiNiFi C++, and we have written a few processors using it. We have
noticed that the "failure" relationship works like this: if the
transform() method returns
FlowFileTransformResult(relationship="failure",
contents=some_contents, attributes=some_attributes), then
 - some_contents are discarded,
 - some_attributes are merged with the attributes of the original flow file,
 - and then the original flow file with the merged attributes is
routed to the failure relationship. [1]

The fact that the contents are discarded was unexpected to me, and it
is not documented in the developer guide [2]. We could add this to the
developer guide, but I think it would make more sense if the failure
result worked in the same way as the success result: if contents is
None, then we use the original contents, but if contents is not None,
then it becomes the new contents of the flow file which is routed to
the failure relationship.

What do you think?
Ferenc

[1] 
https://github.com/apache/nifi/blob/main/nifi-extension-bundles/nifi-py4j-bundle/nifi-py4j-bridge/src/main/java/org/apache/nifi/python/processor/FlowFileTransformProxy.java
[2] 
https://github.com/apache/nifi/blob/main/nifi-docs/src/main/asciidoc/python-developer-guide.adoc

Re: Drop unused features from MiNiFi C++

[Ferenc Gerlits]

I also agree with the removal of the stale/unmaintained components
listed by Marton.

It would be nice if we could use a NiFi processor via JNI in a pinch
if there is no native equivalent, until a C++ alternative becomes
available.  On the other hand, this does not work right now, it would
be a lot of work to achieve it, and no user has asked for it.  On
balance, I would keep JNI for now, but I'm not strongly opposed to
removing it.

Thanks,
Ferenc

On Tue, Jun 11, 2024 at 7:15 PM Martin Zink  wrote:
>
> Hey Marton,
>
> I strongly support this, and I also agree with Gábor that JNI should
> be dropped as well.
> Minifi java is in a really good shape so if anybody wants to use the
> java processors I can't see a reason why would they bother with the
> C++ agent with JNI since the whole point of the C++ agent goes out the
> windows (since you have to have JVM with all of its bells and
> whistles), and since its not really maintained I don't expect it to
> work that well anyways.
>
> And due to the unique nature of JNI implementation, I always felt like
> that's the extension that hinders our refactor efforts the most
>
> BR,
> Martin
>
> On Tue, Jun 11, 2024 at 6:29 PM Gábor Gyimesi  wrote:
> >
> > Hi Marton,
> >
> > I also support removing all of these unused extensions, thanks for
> > starting the discussion about this!
> >
> > I think we could also discuss if JNI extension could be removed. It's
> > a special extension for running Java processors in MiNiFi C++, but as
> > MiNiFi Java is also available for this purpose, and I'm not aware of
> > any users that are using Java processors in MiNiFi C++ maybe that
> > could be removed as well. Similarly to the other extensions it hasn't
> > been tested or maintained for years.
> >
> > Regards,
> > Gabor
> >
> > On Tue, 11 Jun 2024 at 17:42, Arpad Boda  wrote:
> > >
> > > Marton,
> > >
> > > Thanks for bringing this up, I'm +1, too!
> > >
> > > Cheers,
> > > Arpad
> > >
> > > On Tue, Jun 11, 2024 at 5:05 PM Joe Witt  wrote:
> > >
> > > > Marton
> > > >
> > > > I strongly support this. The path needs to be maintainable and keeping
> > > > things around that dont get the love create many challenges.
> > > >
> > > > Thanks
> > > >
> > > > On Tue, Jun 11, 2024 at 7:48 AM Marton Szasz  wrote:
> > > >
> > > > > Hi community,
> > > > >
> > > > > We're considering to drop certain features from MiNiFi C++ that seem 
> > > > > to
> > > > > be unused, and not worth maintaining. If you would like to keep some 
> > > > > of
> > > > > them, please share your opinion and your use case for them!
> > > > >
> > > > > To be removed:
> > > > > 1. CoAP C2: not used anywhere as far as I'm aware, and not well
> > > > > maintained. C2 over HTTP would remain unchanged.
> > > > > 2. nanofi: This was an initiative around 2019-2020 to rewrite about 
> > > > > half
> > > > > of minifi in a C library form for integration to other software. There
> > > > > was no development on it since early 2020, and I'm not aware of any
> > > > users.
> > > > > 3. pcap extension: not well tested or maintained, probably not used by
> > > > > anyone
> > > > > 4. usb camera extension: same as pcap
> > > > > 5. sensors extension: same as pcap
> > > > > 6. openwsman extension: same as pcap
> > > > >
> > > > > As we progress towards the new major versions, now is our best
> > > > > opportunity to remove unused code, so the codebase becomes easier to
> > > > > maintain, and this hopefully unlocks new feature possibilities. Let me
> > > > > know what you think!
> > > > >
> > > > > Thanks,
> > > > > Marton
> > > > >
> > > > >
> > > >

Re: [VOTE] Release Apache NiFi MiNiFi C++ 0.99.0 (RC4)

[Ferenc Gerlits]

+1 (non-binding)

verified signature and hashes
installed the Windows MSI and ran the service on Windows
compiled on Fedora 40 and ran ExecuteScript with lua

It mostly worked as expected. I found two minor issues:
https://issues.apache.org/jira/browse/MINIFICPP-2374,
https://issues.apache.org/jira/browse/MINIFICPP-2375, but neither of
these is a showstopper, we'll fix them in the next release.

Thank you for RMing!
Ferenc

Re: [VOTE] Release Apache NiFi MiNiFi C++ 0.15.0

[Ferenc Gerlits]

+1 (non-binding)

Verified hashes and signature on the source tarball, checked git
commit hash and tag.
Built on Windows 10 with 64-bit VS 2019, installed the msi package and
ran a simple CWEL -> LogAttribute flow.

I ran into some issues during the build, but none of them are showstoppers:
 - the release helper guide should make it clear that win_build_vs.bat
defaults to 32-bit and you have to
 add /64 to the command line if you want a 64-bit build (should we
make 64-bit the default?);
 - win_build_vs.bat fails if the build directory path contains spaces;
 - the cpack command in win_build_vs.bat found chocolatey on my
computer instead of CMake's cpack;
 - the installer does not start the service (I don't know if it used
to, but I think it should).

Thank you,
Ferenc

Re: [DISCUSS] MiNiFi C++ 0.15.0 release

[Ferenc Gerlits]

+1

Thanks for RMing!

Re: [VOTE] Release Apache NiFi MiNiFi C++ 0.14.0

[Ferenc Gerlits]

+1 (non-binding)

Verified signatures and hashes, compared the source to the git tag.
Built from source on Ubuntu Linux 22.04 and Windows.
Ran the convenience binary on Ubuntu Linux 22.04 with a simple
ConsumeJournald -> PublishKafka flow.
Installed and ran the binary built from the source on Windows with a
simple ConsumeWindowsEventLog -> PublishKafka flow.
Everything worked fine.

Thanks,
Ferenc

[ANNOUNCE] Apache NiFi MiNiFi C++ 0.13.0 release

[Ferenc Gerlits]

Hello,

The Apache NiFi team would like to announce the release of Apache NiFi
MiNiFi C++ 0.13.0.

New features in this release:

- New processors:
  - ListenTCP

  - PutTCP

  - PostElasticSearch

  - CollectKubernetesPodMetrics


- Warn on SSL certificates about to expire
- Fix cron-based scheduling
- Improve metrics reporting and add support for Prometheus
- Improve the performance of several processors (ListenHTTP, AWS, Azure, GCS)
- Support swapping out flow files from memory to disk
- Support low-memory use cases with FileSystemRepository
- Improve the MQTT processors
- Improve communication with C2, eg. add alert capability
- Fix support of native packages in Python scripting
- Fix Python scripting on Windows
- Add SSL support to the ListenSyslog and ListenTCP processors
- Fix the 32-bit build on Windows
- Support POST/PUT of large files in InvokeHTTP
- Implement communication between process groups through ports
- Plus upgrade libraries, fix issues reported by clang-tidy, fix
memory leaks etc

MiNiFi—a subproject of Apache NiFi—is a complementary data collection
approach that supplements the core tenets of NiFi in dataflow management,
focusing on the collection of data at the source of its creation.

Specific goals for the initial thrust of the MiNiFi effort comprise:

   - Small size and low resource consumption
   - Central management of agents
   - Generation of data provenance (full chain of custody of information)
   - Integration with NiFi for follow-on dataflow management

More details on Apache NiFi MiNiFi can be found here:
https://nifi.apache.org/minifi

The release artifacts can be downloaded from here:
https://nifi.apache.org/minifi/download.html

Issues closed/resolved for this list can be found here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12321520&version=12351771

Release note highlights can be found here:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=65145325#ReleaseNotesMiNiFi(C++)-Versioncpp-0.13.0

Thank you,
The Apache NiFi team

[RESULT][VOTE] Release Apache NiFi MiNiFi C++ 0.13.0

[Ferenc Gerlits]

Apache NiFi Community,

I am pleased to announce that the 0.13.0 release of Apache NiFi MiNiFi C++
passes with
  3 +1 (binding) votes
  3 +1 (non-binding) votes
  0 0 votes
  0 -1 votes

Thanks to all who helped make this release possible.

Here is the PMC vote thread:
https://lists.apache.org/thread/623tsytcy8mbjwns947th2hklon62vtn

Re: [VOTE] Release Apache NiFi MiNiFi C++ 0.13.0 (RC2)

[Ferenc Gerlits]

On Mon, Dec 5, 2022 at 2:29 PM John McGinn wrote:

>  Just a note, but the issues closed/resolved list is inaccessible to the
> public. Not sure if it is meant to be that way or not.
>
> The release notes link right below it is accessible though.
>
>  Thanks for raising this!  It seems to be some weirdness in Jira.  We may
have to use the simpler "tickets closed in this release" page:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12321520&version=12351771
in future release emails -- that one seems to be accessible by anonymous
users.

Thanks,
Ferenc

[VOTE] Release Apache NiFi MiNiFi C++ 0.13.0 (RC2)

[Ferenc Gerlits]

Hello,

I am pleased to be calling this vote for the source release of Apache NiFi
MiNiFi C++ 0.13.0.

The code and the binary package are identical to RC1, I have fixed a
problem with the source package.  Sorry about the extra work.

The source tarball, the binary build, plus signatures and digests can be
found at:
https://dist.apache.org/repos/dist/dev/nifi/nifi-minifi-cpp/0.13.0/

The Git tag is minifi-cpp-0.13.0-RC2
The Git commit ID is 4389b9ac05e43e1dbf908e9014787d07c8a9cd05
https://github.com/apache/nifi-minifi-cpp/commit/4389b9ac05e43e1dbf908e9014787d07c8a9cd05

Checksums of nifi-minifi-cpp-0.13.0-source.tar.gz:
SHA256: a0c4bf28d3a7e761951027c572f7716abac326a84da4c4a7c8a35e0aea10067f
SHA512:
86637bbfbe910f076279174f102328bef4471852cfa8af67fda208dcd4ec4086986ea6eddce30f8f432f573f7b36ed40fa9d8270670e126d69efe235469c3170

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/fgerlits.asc

KEYS file available here:
https://dist.apache.org/repos/dist/release/nifi/KEYS

85 issues were closed/resolved for this release:
https://issues.apache.org/jira/projects/MINIFICPP/versions/12351771

Release note highlights can be found here:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=65145325#ReleaseNotesMiNiFi(C++)-Versioncpp-0.13.0

The vote will be open for 72 hours.

Please download the release candidate and evaluate the necessary items
including checking hashes, signatures, build from source, and test. Then
please vote:

[ ] +1 Release this package as nifi-minifi-cpp-0.13.0
[ ] +0 no opinion
[ ] -1 Do not release this package because...

Re: [VOTE] Release Apache NiFi MiNiFi C++ 0.13.0 (RC1)

[Ferenc Gerlits]

> It seems to me that the convenience binary found its way into the source
archive.

Good catch!  It has indeed, unfortunately.  Sorry about that.  RC2 coming
up soon.

Thanks,
Ferenc

On Fri, Dec 2, 2022 at 2:25 PM Adam Debreceni  wrote:

> -1 (non-binding)
>
> It seems to me that the convenience binary found its way into the source
> archive.
>

Apache NiFi MiNiFi C++ 0.13.0 RC1 Release Helper Guide

[Ferenc Gerlits]

Hello Apache NiFi community,

Please find the associated guidance to help those interested in
validating/verifying the release so they can vote.

# Download latest KEYS file:
https://dist.apache.org/repos/dist/release/nifi/KEYS

# Import keys file:
gpg --import KEYS

# Download the nifi-minifi-cpp-0.13.0 source release artifacts for review:

wget
https://dist.apache.org/repos/dist/dev/nifi/nifi-minifi-cpp/0.13.0/nifi-minifi-cpp-0.13.0-source.tar.gz
wget
https://dist.apache.org/repos/dist/dev/nifi/nifi-minifi-cpp/0.13.0/nifi-minifi-cpp-0.13.0-source.tar.gz.asc
wget
https://dist.apache.org/repos/dist/dev/nifi/nifi-minifi-cpp/0.13.0/nifi-minifi-cpp-0.13.0-source.tar.gz.sha256
wget
https://dist.apache.org/repos/dist/dev/nifi/nifi-minifi-cpp/0.13.0/nifi-minifi-cpp-0.13.0-source.tar.gz.sha512

# Verify the signature
gpg --verify nifi-minifi-cpp-0.13.0-source.tar.gz.asc

# Verify that the hashes (sha256, sha512) match the source and what was
provided in the vote email thread
sha256sum nifi-minifi-cpp-0.13.0-source.tar.gz
sha512sum nifi-minifi-cpp-0.13.0-source.tar.gz

# Extract nifi-minifi-cpp-0.13.0-source.tar.gz
tar xvzf nifi-minifi-cpp-0.13.0-source.tar.gz

# Verify the build works including tests and linter checks
cd nifi-minifi-cpp-0.13.0-source
mkdir build && cd build && cmake .. && make package && make test && make
linter
# or:
# ./bootstrap.sh && cd build && make package && make test && make linter

# On Windows:
# Install dependencies as documented:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=139627733
# cd nifi-minifi-cpp-0.13.0-source
# win_build_vs.bat build /P

# Verify the contents contain a good README.md, NOTICE, and LICENSE.

# Verify the git commit ID is correct

# Verify the RC was branched off the correct git commit ID

# Look at the resulting convenience binary as found in
build/nifi-minifi-cpp-0.13.0-bin.tar.gz

# Make sure the README.md, NOTICE, and LICENSE are present and correct

# Run the resulting convenience binary and make sure it works as expected

# Send a response to the vote thread indicating a +1, 0, -1 based on your
findings.

Thank you for your time and effort to validate the release!

[VOTE] Release Apache NiFi MiNiFi C++ 0.13.0 (RC1)

[Ferenc Gerlits]

Hello,

I am pleased to be calling this vote for the source release of Apache NiFi
MiNiFi C++ 0.13.0.

The source tarball, the binary build, plus signatures and digests can be
found at:
https://dist.apache.org/repos/dist/dev/nifi/nifi-minifi-cpp/0.13.0/

The Git tag is minifi-cpp-0.13.0-RC1
The Git commit ID is 4389b9ac05e43e1dbf908e9014787d07c8a9cd05
https://github.com/apache/nifi-minifi-cpp/commit/4389b9ac05e43e1dbf908e9014787d07c8a9cd05

Checksums of nifi-minifi-cpp-0.13.0-source.tar.gz:
SHA256: 9cbc37cb841dbd2b53412ded7ba59cd571181b659f647b9d35c3f3ac985337c1
SHA512:
3a69ef1894e4fdc2b2e4d7cd77f46debd86c52a70cfd1a7a76445ae976cfe12bd176cfad3a6aacda2a01aa2ff5810faf2e3d3a8e8ff0de5e460ae19f63db

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/fgerlits.asc

KEYS file available here:
https://dist.apache.org/repos/dist/release/nifi/KEYS

85 issues were closed/resolved for this release:
https://issues.apache.org/jira/projects/MINIFICPP/versions/12351771

Release note highlights can be found here:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=65145325#ReleaseNotesMiNiFi(C++)-Versioncpp-0.13.0

The vote will be open for 72 hours.

Please download the release candidate and evaluate the necessary items
including checking hashes, signatures, build from source, and test. Then
please vote:

[ ] +1 Release this package as nifi-minifi-cpp-0.13.0
[ ] +0 no opinion
[ ] -1 Do not release this package because...

[DISCUSS] MiNiFi C++ 0.13.0 release

[Ferenc Gerlits]

Hi community,

I'd like to initiate a discussion about the next release of MiNiFi C++. The
last release was almost six months ago, and there have been many new
features,
bug fixes and stability improvements committed to the development branch
since then: 80 tickets closed, over 100 commits.

I would be happy to take on RM duties for this release.

New features since the 0.12.0 release:

- New processors:
  * ListenTCP
  * PutTCP
  * PostElasticSearch
  * CollectKubernetesPodMetrics
- Warn on SSL certificates about to expire
- Fix cron-based scheduling
- Improve metrics reporting and add support for Prometheus
- Improve the performance of several processors (ListenHTTP, AWS, Azure,
GCS)
- Support swapping out flow files from memory to disk
- Support low-memory use cases with FileSystemRepository
- Improve the MQTT processors and add support for MQTT v5.0
- Improve communication with C2, eg. add alert capability
- Fix support of native packages in Python scripting
- Fix Python scripting on Windows
- Add SSL support to the ListenSyslog and ListenTCP processors
- Fix the 32-bit build on Windows
- Support POST/PUT of large files in InvokeHTTP
- Plus upgrade libraries, fix issues reported by clang-tidy, fix memory
leaks etc

The core API is still not mature enough to be able to commit to it, so
in line with previous discussions I suggest releasing it as 0.13.0.

Do you agree it is time for a new release? Are there any blockers that we
should definitely include in this release?

Thanks,
Ferenc

Re: [VOTE] Release Apache NiFi MiNiFi C++ 0.12.0 (RC1)

[Ferenc Gerlits]

+1 (non-binding)

I have
* verified the checksums and signatures
* compared the contents of the source tarball to the minifi-cpp-0.12.0-RC1
tag in git
* ran the binary with a simple GenerateFlowFile -> LogAttribute flow, with
heartbeat logging on
* connected to C2

Everything worked correctly.

Thanks,
Ferenc

Re: [VOTE] Release Apache NiFi MiNiFi C++ 0.11.0 RC2

[Ferenc Gerlits]

+1 (non-binding)

- checked signatures and hashes
- compared the source to the tag in the repo
- connected to C2 using TLS
- ran a simple GetFile -> HashContent -> LogAttribute flow

Everything worked as expected.

Thanks,
Ferenc

Re: [VOTE] Release Apache NiFi MiNiFi C++ 0.11.0 (RC1)

[Ferenc Gerlits]

+1 (non-binding)

- verified hashes and signatures
- compiled sources, ran unit tests
- ran convenience binary with a Generate Flow File -> Log Attribute flow
using C2 with TLS

Everything worked as expected.

Thanks,
Ferenc

Re: [DISCUSS] MiNiFi C++ 0.11.0 release

[Ferenc Gerlits]

Yes, it's definitely time for a new release, and 0.11.0 sounds good.
Thanks for RMing!

Ferenc


On Wed, Nov 17, 2021 at 12:09 PM Marton Szasz  wrote:

> I agree that it's time for a new release, thank you for taking the RM
> duties. I'm not aware of any blockers at the moment.
>
> Thanks,
> Marton
>
> On Wed, 17 Nov 2021 at 10:28, Adam Debreceni 
> wrote:
> >
> > Hi community,
> >
> > I'd like to initiate a discussion about the next release of MiNiFi C++.
> The
> > last release was five months ago, and there have been many new features,
> > bug fixes and stability improvements committed to the development branch
> > since.
> > I would be happy to take on RM duties for this release.
> >
> > New features since the 0.10.0 release:
> > - new processors:
> >* AttributesToJson
> >* DefragmentText
> >* PutAzureDataLakeStorage
> >* ReplaceText
> >* RouteText
> > - support for funnels
> > - shared rocksdb repository
> > - repository encryption (flow-file, content)
> > - support for Azure managed identity
> > - modularization of extensions
> > - ConsumeKafka security protocol
> > - platform independent AppendHostInfo
> > - agent configuration checksum in the c2 heartbeat
> >
> > We now use C++17 throughout the codebase and C++20 wherever possible.
> >
> > The core API is still not mature enough to be able to commit to it, so
> > in line with previous discussions I suggest releasing it as 0.11.0.
> >
> > Do you agree it is time for a new release?  Are there any blockers that
> we
> > should definitely include in this release?
> >
> > Thanks,
> > Adam
>

[ANNOUNCE] Apache NiFi MiNiFi C++ 0.10.0 release

[Ferenc Gerlits]

Hello,

The Apache NiFi team would like to announce the release of Apache NiFi
MiNiFi C++ 0.10.0.

New features since the last release:
- new processors:
   * ListS3
   * PutAzureBlobStorage
   * ConsumeKafka
   * PerformanceDataMonitor
   * ConsumeJournald
- add resource consumption data to heartbeats
- build with Visual Studio 2019 on Windows.

A few of the improvements and fixes:
- revive SQL processors
- fix expression language support in PublishKafka
- implement FollowRedirects and SendBody properties in InvokeHTTP
- add Initial Starting Position property to TailFile
- support credential refresh in AWSCredentialsService
- change default C2 protocol to REST
- plus bugfixes, compiler warning fixes etc.

MiNiFi - a subproject of Apache NiFi - is a complementary data collection
approach that supplements the core tenets of NiFi in dataflow management,
focusing on the collection of data at the source of its creation.

Specific goals for the initial thrust of the MiNiFi effort comprise:
 - Small size and low resource consumption
 - Central management of agents
 - Generation of data provenance (full chain of custody of information)
 - Integration with NiFi for follow-on dataflow management.

More details on Apache NiFi - MiNiFi C++ can be found here:
https://nifi.apache.org/minifi

The release artifacts can be downloaded from here:
https://nifi.apache.org/minifi/download.html

Issues closed/resolved for this list can be found here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12321520&version=12349956

Release note highlights can be found here:
https://cwiki.apache.org/confluence/display/MINIFI/Release+Notes#ReleaseNotes-Versioncpp-0.10.0

Thank you,
The Apache NiFi team

[RESULT][VOTE] Release Apache NiFi MiNiFi C++ 0.10.0

[Ferenc Gerlits]

Apache NiFi Community,

I am pleased to announce that the 0.10.0 release of Apache NiFi MiNiFi C++
passes with
  4 +1 (binding) votes
  5 +1 (non-binding) votes
  0 -1 votes
  0 0 votes
  0 -1 votes

Thanks to all who helped make this release possible.

Here is the PMC vote thread:
https://lists.apache.org/thread.html/r36b8df9d320736ec2819b96482cd14dcafe4954014a6ae8783d74fa1%40%3Cdev.nifi.apache.org%3E

[VOTE] Release Apache NiFi MiNiFi C++ (RC2)

[Ferenc Gerlits]

Hello,

I am pleased to be calling this vote for the source release of Apache NiFi
MiNiFi C++ 0.10.0.

The source tarball, some binary builds, plus signatures and digests can be
found at:
https://dist.apache.org/repos/dist/dev/nifi/nifi-minifi-cpp/0.10.0/

The Git tag is minifi-cpp-0.10.0-RC2
The Git commit ID is 60d5bc70b567fa7c6689f313a75be17fe7c94080
https://git-wip-us.apache.org/repos/asf?p=nifi-minifi-cpp.git;a=commit;h=60d5bc70b567fa7c6689f313a75be17fe7c94080

Checksums of nifi-minifi-cpp-0.10.0-source.tar.gz:
SHA256: f7dc86ef6e35ea0d9c9c39891ea281a9851b1e6fc382b16d3a5931814f5ebc22
SHA512:
484d3196d087e7c1acb5d703b827929edf0d8dae295878e1f79232ab8de4fd358f12fa223201c92e0cd9e0c59f2314da9001ac12eb91eabeda751e5d46c4f6b7

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/fgerlits.asc

KEYS file available here:
https://dist.apache.org/repos/dist/release/nifi/KEYS

67 issues were closed/resolved for this release:
https://issues.apache.org/jira/projects/MINIFICPP/versions/12349956

Release note highlights can be found here:
https://cwiki.apache.org/confluence/display/MINIFI/Release+Notes#ReleaseNotes-Versioncpp-0.10.0

The vote will be open for 72 hours.
Please download the release candidate and evaluate the necessary items
including checking hashes, signatures, build
from source, and test. Then please vote:

[ ] +1 Release this package as nifi-minifi-cpp-0.10.0
[ ] +0 no opinion
[ ] -1 Do not release this package because...

Re: [VOTE] Release Apache NiFi MiNiFi C++ 0.10.0 (RC1)

[Ferenc Gerlits]

Thanks Adam!  I think that is a serious problem, so I am cancelling RC1.
Stay tuned for RC2 coming shortly.

Ferenc


On Fri, Jun 4, 2021 at 4:59 PM Adam Debreceni  wrote:

> -1 (non-binding)
>
> On Windows, ConsumeKafkaTests.cpp build fails as the enumerator
> TRANSACTION_COMMIT seems
> to conflict with a Windows specific macro.
>
> On Wed, Jun 2, 2021 at 4:06 PM Ferenc Gerlits  wrote:
>
> > Hello,
> >
> > I am pleased to be calling this vote for the source release of Apache
> NiFi
> > MiNiFi C++ 0.10.0.
> >
> > The source tarball, some binary builds, plus signatures and digests can
> be
> > found at:
> > https://dist.apache.org/repos/dist/dev/nifi/nifi-minifi-cpp/0.10.0/
> >
> > The Git tag is minifi-cpp-0.10.0-RC1
> > The Git commit ID is 4f63efca758784bb48fd0ea55fc7c3e111635a01
> >
> >
> https://git-wip-us.apache.org/repos/asf?p=nifi-minifi-cpp.git;a=commit;h=4f63efca758784bb48fd0ea55fc7c3e111635a01
> >
> > Checksums of nifi-minifi-cpp-0.10.0-source.tar.gz:
> > SHA256: 341d98d71c9bce4be3091f06e66bababe47054dff69689bac702fb097f40ab8d
> > SHA512:
> >
> >
> f561d20f4ef9e16da54cd7323e7009878c3620ba968298496cef8f914f4babb293f6da6bc2e589be9016fe85f10a5bb623c253cbd6857ecc9f5d2da230d0a66e
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/fgerlits.asc
> >
> > KEYS file available here:
> > https://dist.apache.org/repos/dist/release/nifi/KEYS
> >
> > 57 issues were closed/resolved for this release:
> > https://issues.apache.org/jira/projects/MINIFICPP/versions/12349956
> >
> > Release note highlights can be found here:
> >
> >
> https://cwiki.apache.org/confluence/display/MINIFI/Release+Notes#ReleaseNotes-Versioncpp-0.10.0
> >
> > The vote will be open for 72 hours.  Please download the release
> candidate
> > and evaluate the necessary items including checking hashes, signatures,
> > build from source, and test.  Then please vote:
> >
> > [ ] +1 Release this package as nifi-minifi-cpp-0.10.0
> > [ ] +0 No opinion
> > [ ] -1 Do not release this package because...
> >
>

Apache NiFi MiNiFi C++ 0.10.0 RC1 Release Helper Guide

[Ferenc Gerlits]

Hello Apache NiFi community,

Please find the associated guidance to help those interested in
validating/verifying the release so they can vote.

# Download latest KEYS file:
https://dist.apache.org/repos/dist/release/nifi/KEYS

# Import keys file:
gpg --import KEYS

# Pull down nifi-minifi-cpp-0.10.0 source release artifacts for review:

wget
https://dist.apache.org/repos/dist/dev/nifi/nifi-minifi-cpp/0.10.0/nifi-minifi-cpp-0.10.0-source.tar.gz
wget
https://dist.apache.org/repos/dist/dev/nifi/nifi-minifi-cpp/0.10.0/nifi-minifi-cpp-0.10.0-source.tar.gz.asc
wget
https://dist.apache.org/repos/dist/dev/nifi/nifi-minifi-cpp/0.10.0/nifi-minifi-cpp-0.10.0-source.tar.gz.sha1
wget
https://dist.apache.org/repos/dist/dev/nifi/nifi-minifi-cpp/0.10.0/nifi-minifi-cpp-0.10.0-source.tar.gz.sha256

# Verify the signature
gpg --verify nifi-minifi-cpp-0.10.0-source.tar.gz.asc

# Verify the hashes (sha1, sha256) match the source and what was provided
in the vote email thread
sha1sum nifi-minifi-cpp-0.10.0-source.tar.gz
sha256sum nifi-minifi-cpp-0.10.0-source.tar.gz

# Extract nifi-minifi-cpp-0.10.0-source.tar.gz
tar xvzf nifi-minifi-cpp-0.10.0-source.tar.gz

# Verify the build works including tests and linter checks
cd nifi-minifi-cpp-0.10.0-source
mkdir build && cd build && cmake .. && make package && make test && make
linter
# or:
# ./bootstrap.sh && cd build && make package && make test && make linter

# On Windows:
# Install dependencies as documented:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=139627733
# cd nifi-minifi-cpp-0.10.0-source
# win_build_vs.bat build /P

# Verify the contents contain a good README, NOTICE, and LICENSE.

# Verify the git commit ID is correct

# Verify the RC was branched off the correct git commit ID

# Look at the resulting convenience binary as found in
build/nifi-minifi-cpp-0.10.0-bin.tar.gz

# Make sure the README, NOTICE, and LICENSE are present and correct

# Run the resulting convenience binary and make sure it works as expected

# Send a response to the vote thread indicating a +1, 0, -1 based on your
findings.

Thank you for your time and effort to validate the release!

[VOTE] Release Apache NiFi MiNiFi C++ 0.10.0 (RC1)

[Ferenc Gerlits]

Hello,

I am pleased to be calling this vote for the source release of Apache NiFi
MiNiFi C++ 0.10.0.

The source tarball, some binary builds, plus signatures and digests can be
found at:
https://dist.apache.org/repos/dist/dev/nifi/nifi-minifi-cpp/0.10.0/

The Git tag is minifi-cpp-0.10.0-RC1
The Git commit ID is 4f63efca758784bb48fd0ea55fc7c3e111635a01
https://git-wip-us.apache.org/repos/asf?p=nifi-minifi-cpp.git;a=commit;h=4f63efca758784bb48fd0ea55fc7c3e111635a01

Checksums of nifi-minifi-cpp-0.10.0-source.tar.gz:
SHA256: 341d98d71c9bce4be3091f06e66bababe47054dff69689bac702fb097f40ab8d
SHA512:
f561d20f4ef9e16da54cd7323e7009878c3620ba968298496cef8f914f4babb293f6da6bc2e589be9016fe85f10a5bb623c253cbd6857ecc9f5d2da230d0a66e

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/fgerlits.asc

KEYS file available here:
https://dist.apache.org/repos/dist/release/nifi/KEYS

57 issues were closed/resolved for this release:
https://issues.apache.org/jira/projects/MINIFICPP/versions/12349956

Release note highlights can be found here:
https://cwiki.apache.org/confluence/display/MINIFI/Release+Notes#ReleaseNotes-Versioncpp-0.10.0

The vote will be open for 72 hours.  Please download the release candidate
and evaluate the necessary items including checking hashes, signatures,
build from source, and test.  Then please vote:

[ ] +1 Release this package as nifi-minifi-cpp-0.10.0
[ ] +0 No opinion
[ ] -1 Do not release this package because...

[DISCUSS] MiNiFi C++ 0.10.0 release

[Ferenc Gerlits]

Hi community,

I'd like to initiate a discussion about the next release of MiNiFi C++.  The
last release was three months ago, and there have been many new features,
bug fixes and stability improvements committed to the development branch
since
then.  I would be happy to take on RM duties for this release.

New features since the 0.9.0 release:
- new processors:
   * ListS3
   * PutAzureBlobStorage
   * ConsumeKafka
   * PerformanceDataMonitor
   * ConsumeJournald
- add resource consumption data to heartbeats
- build with Visual Studio 2019 on Windows.

A few of the improvements and fixes:
- revive SQL processors
- fix expression language support in PublishKafka
- implement FollowRedirects and SendBody properties in InvokeHTTP
- add Initial Starting Position property to TailFile
- support credential refresh in AWSCredentialsService
- change default C2 protocol to REST
- plus bug fixes, compiler warning fixes etc.

I suggest we call this release 0.10.0 (rather than 1.0.0).  The code base is
starting to stabilize and we're getting closer to a 1.0 milestone, but the
extension API is not quite ready yet.  Staying on a 0.x release allows us
more
flexibility until we have an API we can commit to support in the long term.

Do you agree it is time for a new release?  Are there any blockers that we
should definitely include in this release?

Thanks,
Ferenc

Re: [VOTE] Release Apache NiFi MiNiFi C++ 0.9.0 (RC2)

[Ferenc Gerlits]

+1 (non-binding)

Verified hashes and signatures.
Built on (a Docker container running) Ubuntu 20.04, enabling everything
except TensorFlow and JNI.
Ran the binary using a simple InvokeHTTP -> LogAttribute flow yaml config;
it worked as expected.

Thanks,
Ferenc

Re: [VOTE] Release Apache NiFi MiNiFi C++ 0.9.0 (RC1)

[Ferenc Gerlits]

+1 (non-binding)

Verified hashes and the signature on the source bundle.  Suggestion: the
format of the hash file could be changed to " *" so one
can run eg. 'sha256 -c ...'.
Built on (a Docker container running) Ubuntu 20.04, enabling everything
except
* TensorFlow, because I could not find an Ubuntu package for libtensorflow;
* and JNI -- this built without error, but then I had to disable it because
it caused a runtime error at startup.  I don't think this is a showstopper.
Ran the binary using a simple InvokeHTTP -> LogAttribute flow yaml config;
it worked as expected.

Thanks,
Ferenc

On Tue, Feb 16, 2021 at 4:23 PM Adam Debreceni 
wrote:

> +1 (non-binding)
>
> Verified checksums and signatures.
> Built on Windows 10 with kafka. Can connect to c2 server and receive
> updates.
> Can process windows event logs in various JSON formats and send them to
> kafka
> through SSL, in a multi broker setup.
>
> On Tue, Feb 16, 2021 at 9:50 AM Marton Szasz  wrote:
>
> > Hello,
> >
> > I am pleased to be calling this vote for the source release of Apache
> > NiFi MiNiFi C++ 0.9.0
> >
> > The source tarball, including signatures, digests, etc. can be found at:
> > https://dist.apache.org/repos/dist/dev/nifi/nifi-minifi-cpp/0.9.0/
> >
> > The Git tag is minifi-cpp-0.9.0
> > The Git commit ID is a52faa5136031abfcc321a44fbcd954ee0f73764
> >
> >
> https://git-wip-us.apache.org/repos/asf?p=nifi-minifi-cpp.git;a=commit;h=a52faa5136031abfcc321a44fbcd954ee0f73764
> >
> > Checksums of nifi-minifi-cpp-0.9.0-source.tar.gz:
> > SHA256: 40fa837c86707e3bf0e8f0aca5bc279d813205cd326edf809e7785af7282
> > SHA512:
> >
> 43490ba823d7846c3cc323a634d756a0a33828f5c82a623d19b77c4ddfe3248aa524245ee2c47a7fd04f41c3611758972307e221fa0a254e0aa5831c4f9b03f2
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/szaszm.asc
> >
> > KEYS file available here:
> > https://dist.apache.org/repos/dist/release/nifi/KEYS
> >
> > 200 issues were closed/resolved for this release:
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12321520&version=12345444
> >
> > Release note highlights can be found here:
> >
> >
> https://cwiki.apache.org/confluence/display/MINIFI/Release+Notes#ReleaseNotes-Versioncpp-0.9.0
> >
> > The vote will be open for 72 hours.
> > Please download the release candidate and evaluate the necessary items
> > including checking hashes, signatures, build from source, and test.
> > Then please vote:
> >
> > [ ] +1 Release this package as nifi-minifi-cpp-0.9.0
> > [ ] +0 no opinion
> > [ ] -1 Do not release this package because...
> >
>

Re: [VOTE] Release Apache NiFi Registry 0.8.0

[Ferenc Gerlits]

+1 (non-binding)

Verified the signature and sha256/512 of the tar.gz binary, and run it.
Used it with efm + minifi-c++ to create and modify flows.

Ferenc


On Wed, Oct 14, 2020 at 5:26 PM Pierre Villard 
wrote:

> Hello,
>
> I am pleased to be calling this vote for the source release of Apache NiFi
> Registry 0.8.0.
>
> The source zip, including signatures, digests, etc. can be found at:
> https://repository.apache.org/content/repositories/orgapachenifi-1174
>
> The source being voted upon and the convenience binaries can be found at:
>
> https://dist.apache.org/repos/dist/dev/nifi/nifi-registry/nifi-registry-0.8.0/
>
> A helpful reminder on how the release candidate verification process works:
>
> https://cwiki.apache.org/confluence/display/NIFI/How+to+help+verify+an+Apache+NiFi+release+candidate
>
> The Git tag is nifi-registry-0.8.0-RC1
> The Git commit ID is 74c7435386b1118ed0b545efea7343deec6f4b29
>
> https://gitbox.apache.org/repos/asf?p=nifi-registry.git;a=commit;h=74c7435386b1118ed0b545efea7343deec6f4b29
>
> Checksums of nifi-registry-0.8.0-source-release.zip:
> SHA256: afa4409a6b82aabd25fece787ba5eba1496313a3370bdf503c29d24f1d0b5a2c
> SHA512:
>
> 9c6e516f24b61b11dd889a5ea14950e7498801b7a51bdc14e4a8c091e9b834db213968bce8ee360882da9ee1c29aa8062eb6b9d9ec99c62b2f332c84aefe110f
>
> Release artifacts are signed with the key F92A93B30C07C6D5. The KEYS file
> is available here:
> https://dist.apache.org/repos/dist/release/nifi/KEYS
>
> 19 issues were closed/resolved for this release:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12348583&projectId=12320920
>
> Release note highlights can be found here:
>
> https://cwiki.apache.org/confluence/display/NIFIREG/Release+Notes#ReleaseNotes-NiFiRegistry0.8.0
>
> The vote will be open for 72 hours.
> Please download the release candidate and evaluate the necessary items
> including checking hashes, signatures, build from source, and test. Then
> please vote:
>
> [ ] +1 Release this package as nifi-registry-0.8.0
> [ ] +0 no opinion
> [ ] -1 Do not release this package because...
>