Re: [VOTE] Release Apache NiFi 2.0.0-M1 (RC4)
-1 (non-binding) Thank you David for handling the release! - Verified binary hashes and signatures - Successfully built NiFi with contrib-check using: - Apache Maven 3.6.3 - Java 21 2023-09-19 LTS - Ubuntu 22.04 6.2.0-36-generic - Ran some simple flows successfully - Tested minifi-c2 server successfully with MiNiFi C++ (using a draft of the change conforming the new header requirements https://issues.apache.org/jira/browse/MINIFICPP-2244) One issue I encountered: Built a docker image using the nifi-docker/dockerhub/Dockerfile dockerfile and the binaries provided at https://dist.apache.org/repos/dist/dev/nifi/nifi-2.0.0-M1/ but the NiFi startup failed with the following error: "Failed to communicate with Python Controller". The PythonBridge class may have some dependency that is missing from the docker image for handling the python processors. As this issue may block the release of the new docker image on Docker Hub it may be worth investigating before releasing this version. Best Regards, Gabor On Mon, 20 Nov 2023 at 18:01, David Handermann wrote: > Team, > > I am pleased to be calling this vote for the source release of Apache > NiFi 2.0.0-M1. > > Please review the following guide for how to verify a release candidate > build: > > > https://cwiki.apache.org/confluence/display/NIFI/Release+Candidate+Verification > > The source being voted on the and the convenience binaries are > available on the Apache Distribution Repository: > > https://dist.apache.org/repos/dist/dev/nifi/nifi-2.0.0-M1 > > The build artifacts are available on the Apache Nexus Repository: > > https://repository.apache.org/content/repositories/orgapachenifi-1246 > > Git Tag: nifi-2.0.0-M1-RC4 > Git Commit ID: 99f13a89c1b49624e225e53f91d6ae8f3a2a4ab9 > GitHub Commit Link: > > https://github.com/apache/nifi/commit/99f13a89c1b49624e225e53f91d6ae8f3a2a4ab9 > > Checksums of nifi-2.0.0-M1-source-release.zip > > SHA256: a0b59a66d2f781608775b286ccb08f26d373c7342bd148f4a86f5f5dac841b47 > SHA512: > eec87f959037df8620fe314ab8468aac2bfa0ec146c1ed1eabfff999deb3dbd2d416511bf3d8f32aa9f5e7b9343817d5ff08e9784febba7f87e29ea493e4fa6b > > Release artifacts are signed with the following key: > > https://people.apache.org/keys/committer/exceptionfactory.asc > > KEYS file is available on the Apache Distribution Repository: > > https://dist.apache.org/repos/dist/release/nifi/KEYS > > Issues resolved for this version: 948 > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020=12339599 > > Release note highlights can be found on the project wiki: > > > https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version2.0.0-M1 > > The vote will be open for 72 hours. > > Please download the release candidate and evaluate the necessary items > including checking hashes, signatures, build from source, and test. > Then please vote: > > [] +1 Release this package as nifi-2.0.0-M1 > [] +0 no opinion > [] -1 Do not release this package because... >
Re: [VOTE] Release Apache NiFi 1.24.0 (RC4)
+1 (non-binding) - Verified signatures and hashes - Ran build using Maven 3.9.5 - Ran build on macOS 12.6.7 with AdoptOpenJDK build 1.8.0_275-b01, unit tests passed Verified a simple flow using YAML record reader (NIFI-11197). Thanks for RM'ing, Pierre! Krisztina On Tue, Nov 21, 2023 at 8:11 PM Andrew Lim wrote: > +1 (binding) > > -Ran full clean install on macOS (Ventura 13.0.1, OpenJDK version > 1.8.0_372) > -Verified Core UI and Documentation changes > -Ran basic flows successfully > > Drew > > > On Nov 20, 2023, at 2:12 PM, Pierre Villard > wrote: > > > > Team, > > > > I am pleased to be calling this vote for the source release of Apache > NiFi > > 1.24.0. > > > > Please review the following guide for how to verify a release candidate > > build: > > > > > https://cwiki.apache.org/confluence/display/NIFI/Release+Candidate+Verification > > > > The source being voted on the and the convenience binaries are available > on > > the Apache Distribution Repository: > > > > https://dist.apache.org/repos/dist/dev/nifi/nifi-1.24.0 > > > > The build artifacts are available on the Apache Nexus Repository: > > > > https://repository.apache.org/content/repositories/orgapachenifi-1247 > > > > Git Tag: nifi-1.24.0-RC4 > > Git Commit ID: 6029cd00c032c0596f0d4211c206762895de120b > > GitHub Commit Link: > > > https://github.com/apache/nifi/commit/6029cd00c032c0596f0d4211c206762895de120b > > > > Checksums of nifi-1.24.0-source-release.zip > > > > SHA256: 1c2d7d94abf7586cc014cea041852796882bd41ced449e950481a0033e8e3abc > > SHA512: > > > 121cd42b61100e170cd2f3716077aaf099d1e2759355432d949239e6ccd1ee25aa6b06d306a4bc1318f9717b838687127594d223b448cae994680a23d2a2f04c > > > > Release artifacts are signed with the following key: > > > > https://people.apache.org/keys/committer/pvillard.asc > > > > KEYS file is available on the Apache Distribution Repository: > > > > https://dist.apache.org/repos/dist/release/nifi/KEYS > > > > Issues resolved for this version: 283 > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020=12353443 > > > > Release note highlights can be found on the project wiki: > > > > > https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.24.0 > > > > The vote will be open for 72 hours. > > > > Please download the release candidate and evaluate the necessary items > > including checking hashes, signatures, build from source, and test. Then > > please vote: > > > > [] +1 Release this package as nifi-1.24.0 > > [] +0 no opinion > > [] -1 Do not release this package because... > >
[VOTE] Release Apache NiFi 2.0.0-M1 (RC5)
Team, I am pleased to be calling this vote for the source release of Apache NiFi 2.0.0-M1. Please review the following guide for how to verify a release candidate build: https://cwiki.apache.org/confluence/display/NIFI/Release+Candidate+Verification The source being voted on the and the convenience binaries are available on the Apache Distribution Repository: https://dist.apache.org/repos/dist/dev/nifi/nifi-2.0.0-M1 The build artifacts are available on the Apache Nexus Repository: https://repository.apache.org/content/repositories/orgapachenifi-1248 Git Tag: nifi-2.0.0-M1-RC5 Git Commit ID: f81a3597d40f3fe6df93d55347a11474ee6af2c8 GitHub Commit Link: https://github.com/apache/nifi/commit/f81a3597d40f3fe6df93d55347a11474ee6af2c8 Checksums of nifi-2.0.0-M1-source-release.zip SHA256: 217096b30c211b8fb6bd069832416b507b258f335d7301772a8c047f470a4b30 SHA512: 949849c59d2d8a2d0a441fd14c718f97cfb86c72fdd2de9a954a5829eebad6f9ad60622ecc6db200e246f77f771530be20f47793b3a8a18d2ceed252223139ee Release artifacts are signed with the following key: https://people.apache.org/keys/committer/exceptionfactory.asc KEYS file is available on the Apache Distribution Repository: https://dist.apache.org/repos/dist/release/nifi/KEYS Issues resolved for this version: 958 https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020=12339599 Release note highlights can be found on the project wiki: https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version2.0.0-M1 The vote will be open for 72 hours. Please download the release candidate and evaluate the necessary items including checking hashes, signatures, build from source, and test. Then please vote: [] +1 Release this package as nifi-2.0.0-M1 [] +0 no opinion [] -1 Do not release this package because...
Re: [VOTE] Release Apache NiFi 2.0.0-M1 (RC4)
Gabor, Thanks for finding and highlighting this problem. I confirmed the same issue and the resolution you noted. The Dockerfile for the dockermaven module includes the package, but unfortunately the dockerhub module is out of alignment, resulting in the problem. I submitted a pull request [1] to include the python3-venv package. Although it might be considered a build issue that could be resolved for release, it is early enough in the vote that I am cancelling this release candidate and will publish another after the resolution is merged. Regards, David Handermann [1] https://github.com/apache/nifi/pull/8056 On Tue, Nov 21, 2023 at 9:21 AM Gábor Gyimesi wrote: > > It seems the missing dependency is the "python3-venv" package from the > nifi-docker/dockerhub/Dockerfile, adding the package solves the problem and > NiFi starts without a problem inside the container. > > BR, > Gabor > > On Tue, 21 Nov 2023 at 13:44, Gábor Gyimesi wrote: > > > -1 (non-binding) > > > > Thank you David for handling the release! > > > > - Verified binary hashes and signatures > > - Successfully built NiFi with contrib-check using: > > - Apache Maven 3.6.3 > > - Java 21 2023-09-19 LTS > > - Ubuntu 22.04 6.2.0-36-generic > > - Ran some simple flows successfully > > - Tested minifi-c2 server successfully with MiNiFi C++ (using a draft of > > the change conforming the new header requirements > > https://issues.apache.org/jira/browse/MINIFICPP-2244) > > > > One issue I encountered: > > Built a docker image using the nifi-docker/dockerhub/Dockerfile dockerfile > > and the binaries provided at > > https://dist.apache.org/repos/dist/dev/nifi/nifi-2.0.0-M1/ but the NiFi > > startup failed with the following error: "Failed to communicate with Python > > Controller". > > The PythonBridge class may have some dependency that is missing from the > > docker image for handling the python processors. As this issue may block > > the release of the new docker image on Docker Hub it may be worth > > investigating before releasing this version. > > > > Best Regards, > > Gabor > > > > > > > > On Mon, 20 Nov 2023 at 18:01, David Handermann < > > exceptionfact...@apache.org> wrote: > > > >> Team, > >> > >> I am pleased to be calling this vote for the source release of Apache > >> NiFi 2.0.0-M1. > >> > >> Please review the following guide for how to verify a release candidate > >> build: > >> > >> > >> https://cwiki.apache.org/confluence/display/NIFI/Release+Candidate+Verification > >> > >> The source being voted on the and the convenience binaries are > >> available on the Apache Distribution Repository: > >> > >> https://dist.apache.org/repos/dist/dev/nifi/nifi-2.0.0-M1 > >> > >> The build artifacts are available on the Apache Nexus Repository: > >> > >> https://repository.apache.org/content/repositories/orgapachenifi-1246 > >> > >> Git Tag: nifi-2.0.0-M1-RC4 > >> Git Commit ID: 99f13a89c1b49624e225e53f91d6ae8f3a2a4ab9 > >> GitHub Commit Link: > >> > >> https://github.com/apache/nifi/commit/99f13a89c1b49624e225e53f91d6ae8f3a2a4ab9 > >> > >> Checksums of nifi-2.0.0-M1-source-release.zip > >> > >> SHA256: a0b59a66d2f781608775b286ccb08f26d373c7342bd148f4a86f5f5dac841b47 > >> SHA512: > >> eec87f959037df8620fe314ab8468aac2bfa0ec146c1ed1eabfff999deb3dbd2d416511bf3d8f32aa9f5e7b9343817d5ff08e9784febba7f87e29ea493e4fa6b > >> > >> Release artifacts are signed with the following key: > >> > >> https://people.apache.org/keys/committer/exceptionfactory.asc > >> > >> KEYS file is available on the Apache Distribution Repository: > >> > >> https://dist.apache.org/repos/dist/release/nifi/KEYS > >> > >> Issues resolved for this version: 948 > >> > >> > >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020=12339599 > >> > >> Release note highlights can be found on the project wiki: > >> > >> > >> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version2.0.0-M1 > >> > >> The vote will be open for 72 hours. > >> > >> Please download the release candidate and evaluate the necessary items > >> including checking hashes, signatures, build from source, and test. > >> Then please vote: > >> > >> [] +1 Release this package as nifi-2.0.0-M1 > >> [] +0 no opinion > >> [] -1 Do not release this package because... > >> > >
Re: [VOTE] Release Apache NiFi 1.24.0 (RC4)
+1 (non-binding) - Verified binary hashes and signatures - Successfully built NiFi with contrib-check using: - Apache Maven 3.6.3 - openjdk version "11.0.20.1" 2023-08-24 - Ubuntu 22.04 6.2.0-36-generic - Designed and ran some simple flows successfully - Tested minifi-c2 server heartbeats and flow update successfully with MiNiFi C++ - Tested communication between MiNiFi C++ and NiFi using InvokeHTTP - ListenHTTP processors and using Site 2 Site functionality with RemoteProcessGroup Thanks Pierre! BR, Gabor On Mon, 20 Nov 2023 at 20:13, Pierre Villard wrote: > Team, > > I am pleased to be calling this vote for the source release of Apache NiFi > 1.24.0. > > Please review the following guide for how to verify a release candidate > build: > > > https://cwiki.apache.org/confluence/display/NIFI/Release+Candidate+Verification > > The source being voted on the and the convenience binaries are available on > the Apache Distribution Repository: > > https://dist.apache.org/repos/dist/dev/nifi/nifi-1.24.0 > > The build artifacts are available on the Apache Nexus Repository: > > https://repository.apache.org/content/repositories/orgapachenifi-1247 > > Git Tag: nifi-1.24.0-RC4 > Git Commit ID: 6029cd00c032c0596f0d4211c206762895de120b > GitHub Commit Link: > > https://github.com/apache/nifi/commit/6029cd00c032c0596f0d4211c206762895de120b > > Checksums of nifi-1.24.0-source-release.zip > > SHA256: 1c2d7d94abf7586cc014cea041852796882bd41ced449e950481a0033e8e3abc > SHA512: > > 121cd42b61100e170cd2f3716077aaf099d1e2759355432d949239e6ccd1ee25aa6b06d306a4bc1318f9717b838687127594d223b448cae994680a23d2a2f04c > > Release artifacts are signed with the following key: > > https://people.apache.org/keys/committer/pvillard.asc > > KEYS file is available on the Apache Distribution Repository: > > https://dist.apache.org/repos/dist/release/nifi/KEYS > > Issues resolved for this version: 283 > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020=12353443 > > Release note highlights can be found on the project wiki: > > > https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.24.0 > > The vote will be open for 72 hours. > > Please download the release candidate and evaluate the necessary items > including checking hashes, signatures, build from source, and test. Then > please vote: > > [] +1 Release this package as nifi-1.24.0 > [] +0 no opinion > [] -1 Do not release this package because... >
Re: [VOTE] Release Apache NiFi 2.0.0-M1 (RC4)
It seems the missing dependency is the "python3-venv" package from the nifi-docker/dockerhub/Dockerfile, adding the package solves the problem and NiFi starts without a problem inside the container. BR, Gabor On Tue, 21 Nov 2023 at 13:44, Gábor Gyimesi wrote: > -1 (non-binding) > > Thank you David for handling the release! > > - Verified binary hashes and signatures > - Successfully built NiFi with contrib-check using: > - Apache Maven 3.6.3 > - Java 21 2023-09-19 LTS > - Ubuntu 22.04 6.2.0-36-generic > - Ran some simple flows successfully > - Tested minifi-c2 server successfully with MiNiFi C++ (using a draft of > the change conforming the new header requirements > https://issues.apache.org/jira/browse/MINIFICPP-2244) > > One issue I encountered: > Built a docker image using the nifi-docker/dockerhub/Dockerfile dockerfile > and the binaries provided at > https://dist.apache.org/repos/dist/dev/nifi/nifi-2.0.0-M1/ but the NiFi > startup failed with the following error: "Failed to communicate with Python > Controller". > The PythonBridge class may have some dependency that is missing from the > docker image for handling the python processors. As this issue may block > the release of the new docker image on Docker Hub it may be worth > investigating before releasing this version. > > Best Regards, > Gabor > > > > On Mon, 20 Nov 2023 at 18:01, David Handermann < > exceptionfact...@apache.org> wrote: > >> Team, >> >> I am pleased to be calling this vote for the source release of Apache >> NiFi 2.0.0-M1. >> >> Please review the following guide for how to verify a release candidate >> build: >> >> >> https://cwiki.apache.org/confluence/display/NIFI/Release+Candidate+Verification >> >> The source being voted on the and the convenience binaries are >> available on the Apache Distribution Repository: >> >> https://dist.apache.org/repos/dist/dev/nifi/nifi-2.0.0-M1 >> >> The build artifacts are available on the Apache Nexus Repository: >> >> https://repository.apache.org/content/repositories/orgapachenifi-1246 >> >> Git Tag: nifi-2.0.0-M1-RC4 >> Git Commit ID: 99f13a89c1b49624e225e53f91d6ae8f3a2a4ab9 >> GitHub Commit Link: >> >> https://github.com/apache/nifi/commit/99f13a89c1b49624e225e53f91d6ae8f3a2a4ab9 >> >> Checksums of nifi-2.0.0-M1-source-release.zip >> >> SHA256: a0b59a66d2f781608775b286ccb08f26d373c7342bd148f4a86f5f5dac841b47 >> SHA512: >> eec87f959037df8620fe314ab8468aac2bfa0ec146c1ed1eabfff999deb3dbd2d416511bf3d8f32aa9f5e7b9343817d5ff08e9784febba7f87e29ea493e4fa6b >> >> Release artifacts are signed with the following key: >> >> https://people.apache.org/keys/committer/exceptionfactory.asc >> >> KEYS file is available on the Apache Distribution Repository: >> >> https://dist.apache.org/repos/dist/release/nifi/KEYS >> >> Issues resolved for this version: 948 >> >> >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020=12339599 >> >> Release note highlights can be found on the project wiki: >> >> >> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version2.0.0-M1 >> >> The vote will be open for 72 hours. >> >> Please download the release candidate and evaluate the necessary items >> including checking hashes, signatures, build from source, and test. >> Then please vote: >> >> [] +1 Release this package as nifi-2.0.0-M1 >> [] +0 no opinion >> [] -1 Do not release this package because... >> >
[CANCEL][VOTE] Release Apache NiFi 2.0.0-M1 (RC4)
Team, I am cancelling RC4 based on this finding. Regards, David Handermann On Tue, Nov 21, 2023 at 9:25 AM David Handermann wrote: > > Gabor, > > Thanks for finding and highlighting this problem. I confirmed the same > issue and the resolution you noted. The Dockerfile for the dockermaven > module includes the package, but unfortunately the dockerhub module is > out of alignment, resulting in the problem. > > I submitted a pull request [1] to include the python3-venv package. > > Although it might be considered a build issue that could be resolved > for release, it is early enough in the vote that I am cancelling this > release candidate and will publish another after the resolution is > merged. > > Regards, > David Handermann > > [1] https://github.com/apache/nifi/pull/8056 > > On Tue, Nov 21, 2023 at 9:21 AM Gábor Gyimesi wrote: > > > > It seems the missing dependency is the "python3-venv" package from the > > nifi-docker/dockerhub/Dockerfile, adding the package solves the problem and > > NiFi starts without a problem inside the container. > > > > BR, > > Gabor > > > > On Tue, 21 Nov 2023 at 13:44, Gábor Gyimesi wrote: > > > > > -1 (non-binding) > > > > > > Thank you David for handling the release! > > > > > > - Verified binary hashes and signatures > > > - Successfully built NiFi with contrib-check using: > > > - Apache Maven 3.6.3 > > > - Java 21 2023-09-19 LTS > > > - Ubuntu 22.04 6.2.0-36-generic > > > - Ran some simple flows successfully > > > - Tested minifi-c2 server successfully with MiNiFi C++ (using a draft of > > > the change conforming the new header requirements > > > https://issues.apache.org/jira/browse/MINIFICPP-2244) > > > > > > One issue I encountered: > > > Built a docker image using the nifi-docker/dockerhub/Dockerfile dockerfile > > > and the binaries provided at > > > https://dist.apache.org/repos/dist/dev/nifi/nifi-2.0.0-M1/ but the NiFi > > > startup failed with the following error: "Failed to communicate with > > > Python > > > Controller". > > > The PythonBridge class may have some dependency that is missing from the > > > docker image for handling the python processors. As this issue may block > > > the release of the new docker image on Docker Hub it may be worth > > > investigating before releasing this version. > > > > > > Best Regards, > > > Gabor > > > > > > > > > > > > On Mon, 20 Nov 2023 at 18:01, David Handermann < > > > exceptionfact...@apache.org> wrote: > > > > > >> Team, > > >> > > >> I am pleased to be calling this vote for the source release of Apache > > >> NiFi 2.0.0-M1. > > >> > > >> Please review the following guide for how to verify a release candidate > > >> build: > > >> > > >> > > >> https://cwiki.apache.org/confluence/display/NIFI/Release+Candidate+Verification > > >> > > >> The source being voted on the and the convenience binaries are > > >> available on the Apache Distribution Repository: > > >> > > >> https://dist.apache.org/repos/dist/dev/nifi/nifi-2.0.0-M1 > > >> > > >> The build artifacts are available on the Apache Nexus Repository: > > >> > > >> https://repository.apache.org/content/repositories/orgapachenifi-1246 > > >> > > >> Git Tag: nifi-2.0.0-M1-RC4 > > >> Git Commit ID: 99f13a89c1b49624e225e53f91d6ae8f3a2a4ab9 > > >> GitHub Commit Link: > > >> > > >> https://github.com/apache/nifi/commit/99f13a89c1b49624e225e53f91d6ae8f3a2a4ab9 > > >> > > >> Checksums of nifi-2.0.0-M1-source-release.zip > > >> > > >> SHA256: a0b59a66d2f781608775b286ccb08f26d373c7342bd148f4a86f5f5dac841b47 > > >> SHA512: > > >> eec87f959037df8620fe314ab8468aac2bfa0ec146c1ed1eabfff999deb3dbd2d416511bf3d8f32aa9f5e7b9343817d5ff08e9784febba7f87e29ea493e4fa6b > > >> > > >> Release artifacts are signed with the following key: > > >> > > >> https://people.apache.org/keys/committer/exceptionfactory.asc > > >> > > >> KEYS file is available on the Apache Distribution Repository: > > >> > > >> https://dist.apache.org/repos/dist/release/nifi/KEYS > > >> > > >> Issues resolved for this version: 948 > > >> > > >> > > >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020=12339599 > > >> > > >> Release note highlights can be found on the project wiki: > > >> > > >> > > >> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version2.0.0-M1 > > >> > > >> The vote will be open for 72 hours. > > >> > > >> Please download the release candidate and evaluate the necessary items > > >> including checking hashes, signatures, build from source, and test. > > >> Then please vote: > > >> > > >> [] +1 Release this package as nifi-2.0.0-M1 > > >> [] +0 no opinion > > >> [] -1 Do not release this package because... > > >> > > >
Re: [VOTE] Release Apache NiFi 1.24.0 (RC4)
+1 (binding) -Ran full clean install on macOS (Ventura 13.0.1, OpenJDK version 1.8.0_372) -Verified Core UI and Documentation changes -Ran basic flows successfully Drew > On Nov 20, 2023, at 2:12 PM, Pierre Villard > wrote: > > Team, > > I am pleased to be calling this vote for the source release of Apache NiFi > 1.24.0. > > Please review the following guide for how to verify a release candidate > build: > > https://cwiki.apache.org/confluence/display/NIFI/Release+Candidate+Verification > > The source being voted on the and the convenience binaries are available on > the Apache Distribution Repository: > > https://dist.apache.org/repos/dist/dev/nifi/nifi-1.24.0 > > The build artifacts are available on the Apache Nexus Repository: > > https://repository.apache.org/content/repositories/orgapachenifi-1247 > > Git Tag: nifi-1.24.0-RC4 > Git Commit ID: 6029cd00c032c0596f0d4211c206762895de120b > GitHub Commit Link: > https://github.com/apache/nifi/commit/6029cd00c032c0596f0d4211c206762895de120b > > Checksums of nifi-1.24.0-source-release.zip > > SHA256: 1c2d7d94abf7586cc014cea041852796882bd41ced449e950481a0033e8e3abc > SHA512: > 121cd42b61100e170cd2f3716077aaf099d1e2759355432d949239e6ccd1ee25aa6b06d306a4bc1318f9717b838687127594d223b448cae994680a23d2a2f04c > > Release artifacts are signed with the following key: > > https://people.apache.org/keys/committer/pvillard.asc > > KEYS file is available on the Apache Distribution Repository: > > https://dist.apache.org/repos/dist/release/nifi/KEYS > > Issues resolved for this version: 283 > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020=12353443 > > Release note highlights can be found on the project wiki: > > https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.24.0 > > The vote will be open for 72 hours. > > Please download the release candidate and evaluate the necessary items > including checking hashes, signatures, build from source, and test. Then > please vote: > > [] +1 Release this package as nifi-1.24.0 > [] +0 no opinion > [] -1 Do not release this package because...
RecordReader/Writer with nested json resulting in MapRecord[] statement
Hello,
I'm trying to use the record writer/writers to take a json defined event
and write it to postgres database. The event follows the CloudEvent
definition and has a data element that is JSON structured:
{
"data" : {
"message_type" : "V5",
"message_time" : "1614597071000",
"file_ingest_time": "1682018983320"
},
"spec_version" : "1.0.2",
"subject" : "1969",
"data_schema" : "URI://something",
"id" : "80e12364-831e-446a-a260-86bccc469f25",
"source" : "service",
"time" : "2023-11-22T00:03:03Z",
"type" : "V5",
"data_content_type" : "application/json"
}
I'm trying to write into a postgres db table that has each field as a
column and data as a JSON type column.
When I try to write the the database with PutDatabaseRecord, I'm getting
MapRecord sting that is trying to be written into the data column:
MapRecord[{message_type=V5,
message_time=1614597071000,file_ingest_time=1682018983320}]
I _think_ the issue is with the schema I'm defining:
{
"type": "record",
"name": "eventSchema0",
"fields" : [
{"name":"data", "type": "string"},
{"name":"spec_version", "type": "string"},
{"name":"subject", "type": "string"},
{"name":"data_schema", "type": "string"},
{"name":"id", "type": "string"},
{"name":"source", "type": "string"},
{"name":"time", "type": "string"},
{"name":"type", "type": "string"},
{"name":"data_content_type", "type": "string"}
]
}
What do I need to change so the JSON structure in the "data" field can be
properly written using a record based processor?
Thanks for the help.
-Aaron
Re: [VOTE] Release Apache NiFi 1.24.0 (RC4)
+1 binding - Verified signatures and hashes - Ran build using Maven Wrapper 3.9.5 - Ran build on macOS 14.1.1 with Azul Zulu JDK 1.8.0-392 AArch64 - Ran build on macOS 14.1.1 with Azul Zulu JDK 17.0.9 AArch64 - Ran build on Ubuntu 22.04 with Azul Zulu JDK 17.0.9 x86_64 - Ran NiFi on macOS 14.1.1 with Azul Zulu JDK 17.0.9 AArch64 - Ran NiFi Registry on macOS 14.1.1 with Azul Zulu JDK 17.0.9 AArch64 - Verified NiFi OpenID Connect integration with Okta - Verified NiFi SAML integration with Okta - Verified Registry Bucket operations - Verified Registry Flow Version Control - NIFI-1874 Verified IdentityMimeType character set detection - NIFI-11303 Verified go to component link from Provenance view - NIFI-11874 Verified updated layout of Process Group settings - NIFI-12033 Verified EncryptContentAge and DecryptContentAge Processors - NIFI-12093 Verified EncryptContent Processor marked as deprecated - NIFI-12115 Verified ListenOTLP receiving Logs and Traces over HTTP/2 as JSON - NIFI-12153 Verified Max String Length configurable in JSON Tree Reader - NIFI-12219 Verified Flow Configuration History search and filter - NIFI-12239 Verified system information printed to nifi-bootstrap.log - NIFI-12287 Verified Sources and Java Documentation JAR binaries skipped for NAR packages - NIFI-12311 Verified Custom Class Transform not supported for Jolt Advanced interface - NIFI-12373 Verified LICENSE and NOTICE included in nifi-standard-shared-nar - NIFI-12377 Verified Jython Script Engine marked as deprecated - NIFI-12392 Verified Additional Details linked in component documentation Thanks Pierre! Regards, David Handermann On Mon, Nov 20, 2023 at 1:13 PM Pierre Villard wrote: > > Team, > > I am pleased to be calling this vote for the source release of Apache NiFi > 1.24.0. > > Please review the following guide for how to verify a release candidate > build: > > https://cwiki.apache.org/confluence/display/NIFI/Release+Candidate+Verification > > The source being voted on the and the convenience binaries are available on > the Apache Distribution Repository: > > https://dist.apache.org/repos/dist/dev/nifi/nifi-1.24.0 > > The build artifacts are available on the Apache Nexus Repository: > > https://repository.apache.org/content/repositories/orgapachenifi-1247 > > Git Tag: nifi-1.24.0-RC4 > Git Commit ID: 6029cd00c032c0596f0d4211c206762895de120b > GitHub Commit Link: > https://github.com/apache/nifi/commit/6029cd00c032c0596f0d4211c206762895de120b > > Checksums of nifi-1.24.0-source-release.zip > > SHA256: 1c2d7d94abf7586cc014cea041852796882bd41ced449e950481a0033e8e3abc > SHA512: > 121cd42b61100e170cd2f3716077aaf099d1e2759355432d949239e6ccd1ee25aa6b06d306a4bc1318f9717b838687127594d223b448cae994680a23d2a2f04c > > Release artifacts are signed with the following key: > > https://people.apache.org/keys/committer/pvillard.asc > > KEYS file is available on the Apache Distribution Repository: > > https://dist.apache.org/repos/dist/release/nifi/KEYS > > Issues resolved for this version: 283 > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020=12353443 > > Release note highlights can be found on the project wiki: > > https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.24.0 > > The vote will be open for 72 hours. > > Please download the release candidate and evaluate the necessary items > including checking hashes, signatures, build from source, and test. Then > please vote: > > [] +1 Release this package as nifi-1.24.0 > [] +0 no opinion > [] -1 Do not release this package because...
