Re: Apache NiFi compatibility with SQL Server 2008 R2
Frank, Yes NiFi is compatible with MSSQL 2008, there's even a specific database adapter in some processors to generate the correct SQL for it (it's called "MSSQL2008DatabaseAdapter"). Regards, Matt On Thu, Aug 24, 2023 at 11:23 AM Frank Mansilla wrote: > > Dear Apache NiFi Community, > > I am interested in using Apache NiFi to manage data streams involving SQL > Server 2008 R2. > Could you confirm if NiFi is compatible with this database engine? > I would greatly appreciate your guidance on this. > > Thanks and regards! > > Frank Mansilla > frankmansilla1...@gmail.com > Bolivar, Buenos Aires, Argentina
RE: Re: NiFi 1.19.1 MSSQL issue with RH9 when using crypto policies = DEFAULT
David,
We have notified the SQL server admin to upgrade their key off SHA1. Prior to
this, we thought we had something in NiFi that uses SHA1 as the log does not
say where the issue is coming from.
Will find out soon for the next step when they are ready.
Thanks,
Martin.
On 2023/08/23 15:41:59 David Handermann wrote:
> Martin,
>
> Thanks for providing the detailed background.
>
> Based on the error message and configuration, it sounds like the MS
> SQL server has a certificate signed with SHA-1.
>
> SHA-1 is not secure for cryptographic operations, provisioning a new
> database server certificate and restoring the default Java security
> policy is highly recommended.
>
> Regards,
> David Handermann
>
> On Wed, Aug 23, 2023 at 10:34 AM Martin Fong wrote:
> >
> > We have an MS SQL connection that worked fine with RH7.
> >
> > Once we upgraded to RH9 and the crypto policies=DEFAULT
> > (https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9/html/considerations_in_adopting_rhel_9/assembly_security_considerations-in-adopting-rhel-9)
> >
> > We are getting the following errors:
> >
> > Failed to establish Database Connection: java.sql.SQLException: Cannot
> > create PoolableConnectionFactory ("encrypt" property is set to "true" and
> > "trustServerCertificate" property is set to "true" but the driver could not
> > establish a secure connection to SQL Server by using Secure Sockets Layer
> > (SSL) encryption: Error: Certificates do not conform to algorithm
> > constraints. ClientConnectionId:b844ea35-c351-43e7-8645-5c676d2b3cce)
> >
> > From the log java trace got this at the end:
> > Caused by: java.security.cert.CertPathValidatorException: Algorithm
> > constraints check failed on signature algorithm: SHA1withRSA
> >
> > We have searched many areas and found similar issue:
> > https://github.com/keycloak/keycloak/issues/19185
> >
> > People are saying to put SHA1 back to
> > /etc/crypto-policies/back-ends/java.config
> >
> > When we set crypto policies = LEGACY, NiFi SQL connection worked again.
> > Meaning SHA1 is back.
> >
> > We have set the following in NiFi:
> > nifi.web.https.ciphersuites.include=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
> >
> > Also verified the keystore/truststore that NiFi uses is SHA256.
> >
> > The SQL driver we are using: mssql-jdbc-12.4.0.jre8.jar
> >
> > Is there a way to find out where that SHA1withRSA is coming from?
> >
> > Please advise,
> > Martin Fong
> > Enterprise Technical Support Specialist, Infrastructure & Platform (IAG)
> > Technology Services Division, Technology Infrastructure Services
> > City of Toronto
> > 703 Don Mills Road, 2nd Floor
> > Toronto, ON
> > M3C 3N3
> > Tel: 416-397-7565
> > e-mail: martin.f...@toronto.ca
> >
> > This e-mail message is confidential and subject to copyright. Any
> > unauthorized use or disclosure is prohibited. If you have received this
> > email and are not the intended recipient, please advise and delete it.
> > Thank you.
> >
>
Re: [DISCUSS] MiNiFi C++ 0.15.0 release
+1 Thanks for RMing!
Re: [DISCUSS] MiNiFi C++ 0.15.0 release
+1 On Thu, Aug 24, 2023 at 5:22 PM Gábor Gyimesi wrote: > +1 > > On Thu, 24 Aug 2023 at 17:15, David Handermann > wrote: > > > > +1 > > > > On Thu, Aug 24, 2023 at 10:14 AM Marton Szasz wrote: > > > > > > +1. I'm not aware of any blockers. Thanks for taking on RM duties. > > > > > > On Thu, Aug 24, 2023 at 5:04 PM Joe Witt wrote: > > > > > > > > +1 a lot of nice things in there! > > > > > > > > On Thu, Aug 24, 2023 at 7:52 AM Martin Zink > wrote: > > > > > > > > > Hi community, > > > > > > > > > > I'd like to initiate a discussion about the next release of MiNiFi > C++. The > > > > > last release was more than four months ago, and there have been > many new > > > > > features, bug fixes and stability improvements committed to the > development > > > > > branch > > > > > since then: 71 tickets closed, over 96 commits as of today. > > > > > > > > > > I would be happy to take on RM duties for this release. > > > > > > > > > > Notable features and improvements since the 0.14.0 release: > > > > > > > > > > - ConsumeWindowsEventLog can work from log files > > > > > - ConsumeWindowsEventLog resolve Security/UserID attribute > > > > > - TLS v1.3 support > > > > > - PutS3Object multipart upload support > > > > > - Use systemd service management on Linux > > > > > - Add ProcessContext::getStateManager to Lua/Python > > > > > - Reworked GetTCP to be more inline with ListenTCP > > > > > - SSL support for Prometheus reporter > > > > > - Documentation improvements > > > > > - Multiarch docker support > > > > > - RFC3339 parsing with expression language > > > > > - Reworked Minifi controller > > > > > - gcc-13 support > > > > > > > > > > - Fix for waking up prematurely after processor yields > > > > > - Fix system certificate store usage in SSLContextService on Linux > > > > > - Fix inconsistent naming in C2 machineArch > > > > > - Fix default CA path for S3 on CentOS > > > > > - Removed CronScheduler locale requirements > > > > > > > > > > We've upgraded our third party dependencies (notable mentions) > > > > > - Replaced LibreSSL with OpenSSL 3.1.1 > > > > > - Upgraded RocksDB to v8.1.1 > > > > > - Upgraded LibCurl to v8.1.0 > > > > > - Upgraded CivetWeb to v1.16 > > > > > - Upgraded OpenCV to v4.7.0 > > > > > - Upgraded GoogleCloud SDK to v2.10.1 > > > > > - Upgraded Azure SDK to v12.7.0 > > > > > > > > > > The core API is still not mature enough to be able to commit to > it, so > > > > > in line with previous discussions I suggest releasing it as 0.15.0. > > > > > > > > > > Do you agree it is time for a new release? Are there any blockers > that we > > > > > should definitely include in this release? > > > > > > > > > > Thanks, > > > > > Martin > > > > > >
Apache NiFi compatibility with SQL Server 2008 R2
Dear Apache NiFi Community, I am interested in using Apache NiFi to manage data streams involving SQL Server 2008 R2. Could you confirm if NiFi is compatible with this database engine? I would greatly appreciate your guidance on this. Thanks and regards! Frank Mansilla frankmansilla1...@gmail.com Bolivar, Buenos Aires, Argentina
Re: [DISCUSS] MiNiFi C++ 0.15.0 release
+1 On Thu, 24 Aug 2023 at 17:15, David Handermann wrote: > > +1 > > On Thu, Aug 24, 2023 at 10:14 AM Marton Szasz wrote: > > > > +1. I'm not aware of any blockers. Thanks for taking on RM duties. > > > > On Thu, Aug 24, 2023 at 5:04 PM Joe Witt wrote: > > > > > > +1 a lot of nice things in there! > > > > > > On Thu, Aug 24, 2023 at 7:52 AM Martin Zink wrote: > > > > > > > Hi community, > > > > > > > > I'd like to initiate a discussion about the next release of MiNiFi C++. > > > > The > > > > last release was more than four months ago, and there have been many new > > > > features, bug fixes and stability improvements committed to the > > > > development > > > > branch > > > > since then: 71 tickets closed, over 96 commits as of today. > > > > > > > > I would be happy to take on RM duties for this release. > > > > > > > > Notable features and improvements since the 0.14.0 release: > > > > > > > > - ConsumeWindowsEventLog can work from log files > > > > - ConsumeWindowsEventLog resolve Security/UserID attribute > > > > - TLS v1.3 support > > > > - PutS3Object multipart upload support > > > > - Use systemd service management on Linux > > > > - Add ProcessContext::getStateManager to Lua/Python > > > > - Reworked GetTCP to be more inline with ListenTCP > > > > - SSL support for Prometheus reporter > > > > - Documentation improvements > > > > - Multiarch docker support > > > > - RFC3339 parsing with expression language > > > > - Reworked Minifi controller > > > > - gcc-13 support > > > > > > > > - Fix for waking up prematurely after processor yields > > > > - Fix system certificate store usage in SSLContextService on Linux > > > > - Fix inconsistent naming in C2 machineArch > > > > - Fix default CA path for S3 on CentOS > > > > - Removed CronScheduler locale requirements > > > > > > > > We've upgraded our third party dependencies (notable mentions) > > > > - Replaced LibreSSL with OpenSSL 3.1.1 > > > > - Upgraded RocksDB to v8.1.1 > > > > - Upgraded LibCurl to v8.1.0 > > > > - Upgraded CivetWeb to v1.16 > > > > - Upgraded OpenCV to v4.7.0 > > > > - Upgraded GoogleCloud SDK to v2.10.1 > > > > - Upgraded Azure SDK to v12.7.0 > > > > > > > > The core API is still not mature enough to be able to commit to it, so > > > > in line with previous discussions I suggest releasing it as 0.15.0. > > > > > > > > Do you agree it is time for a new release? Are there any blockers that > > > > we > > > > should definitely include in this release? > > > > > > > > Thanks, > > > > Martin > > > >
Re: [DISCUSS] MiNiFi C++ 0.15.0 release
+1 On Thu, Aug 24, 2023 at 10:14 AM Marton Szasz wrote: > > +1. I'm not aware of any blockers. Thanks for taking on RM duties. > > On Thu, Aug 24, 2023 at 5:04 PM Joe Witt wrote: > > > > +1 a lot of nice things in there! > > > > On Thu, Aug 24, 2023 at 7:52 AM Martin Zink wrote: > > > > > Hi community, > > > > > > I'd like to initiate a discussion about the next release of MiNiFi C++. > > > The > > > last release was more than four months ago, and there have been many new > > > features, bug fixes and stability improvements committed to the > > > development > > > branch > > > since then: 71 tickets closed, over 96 commits as of today. > > > > > > I would be happy to take on RM duties for this release. > > > > > > Notable features and improvements since the 0.14.0 release: > > > > > > - ConsumeWindowsEventLog can work from log files > > > - ConsumeWindowsEventLog resolve Security/UserID attribute > > > - TLS v1.3 support > > > - PutS3Object multipart upload support > > > - Use systemd service management on Linux > > > - Add ProcessContext::getStateManager to Lua/Python > > > - Reworked GetTCP to be more inline with ListenTCP > > > - SSL support for Prometheus reporter > > > - Documentation improvements > > > - Multiarch docker support > > > - RFC3339 parsing with expression language > > > - Reworked Minifi controller > > > - gcc-13 support > > > > > > - Fix for waking up prematurely after processor yields > > > - Fix system certificate store usage in SSLContextService on Linux > > > - Fix inconsistent naming in C2 machineArch > > > - Fix default CA path for S3 on CentOS > > > - Removed CronScheduler locale requirements > > > > > > We've upgraded our third party dependencies (notable mentions) > > > - Replaced LibreSSL with OpenSSL 3.1.1 > > > - Upgraded RocksDB to v8.1.1 > > > - Upgraded LibCurl to v8.1.0 > > > - Upgraded CivetWeb to v1.16 > > > - Upgraded OpenCV to v4.7.0 > > > - Upgraded GoogleCloud SDK to v2.10.1 > > > - Upgraded Azure SDK to v12.7.0 > > > > > > The core API is still not mature enough to be able to commit to it, so > > > in line with previous discussions I suggest releasing it as 0.15.0. > > > > > > Do you agree it is time for a new release? Are there any blockers that we > > > should definitely include in this release? > > > > > > Thanks, > > > Martin > > >
Re: [DISCUSS] MiNiFi C++ 0.15.0 release
+1 Le jeu. 24 août 2023 à 17:04, Joe Witt a écrit : > +1 a lot of nice things in there! > > On Thu, Aug 24, 2023 at 7:52 AM Martin Zink wrote: > > > Hi community, > > > > I'd like to initiate a discussion about the next release of MiNiFi C++. > The > > last release was more than four months ago, and there have been many new > > features, bug fixes and stability improvements committed to the > development > > branch > > since then: 71 tickets closed, over 96 commits as of today. > > > > I would be happy to take on RM duties for this release. > > > > Notable features and improvements since the 0.14.0 release: > > > > - ConsumeWindowsEventLog can work from log files > > - ConsumeWindowsEventLog resolve Security/UserID attribute > > - TLS v1.3 support > > - PutS3Object multipart upload support > > - Use systemd service management on Linux > > - Add ProcessContext::getStateManager to Lua/Python > > - Reworked GetTCP to be more inline with ListenTCP > > - SSL support for Prometheus reporter > > - Documentation improvements > > - Multiarch docker support > > - RFC3339 parsing with expression language > > - Reworked Minifi controller > > - gcc-13 support > > > > - Fix for waking up prematurely after processor yields > > - Fix system certificate store usage in SSLContextService on Linux > > - Fix inconsistent naming in C2 machineArch > > - Fix default CA path for S3 on CentOS > > - Removed CronScheduler locale requirements > > > > We've upgraded our third party dependencies (notable mentions) > > - Replaced LibreSSL with OpenSSL 3.1.1 > > - Upgraded RocksDB to v8.1.1 > > - Upgraded LibCurl to v8.1.0 > > - Upgraded CivetWeb to v1.16 > > - Upgraded OpenCV to v4.7.0 > > - Upgraded GoogleCloud SDK to v2.10.1 > > - Upgraded Azure SDK to v12.7.0 > > > > The core API is still not mature enough to be able to commit to it, so > > in line with previous discussions I suggest releasing it as 0.15.0. > > > > Do you agree it is time for a new release? Are there any blockers that we > > should definitely include in this release? > > > > Thanks, > > Martin > > >
Re: [DISCUSS] MiNiFi C++ 0.15.0 release
+1. I'm not aware of any blockers. Thanks for taking on RM duties. On Thu, Aug 24, 2023 at 5:04 PM Joe Witt wrote: > > +1 a lot of nice things in there! > > On Thu, Aug 24, 2023 at 7:52 AM Martin Zink wrote: > > > Hi community, > > > > I'd like to initiate a discussion about the next release of MiNiFi C++. The > > last release was more than four months ago, and there have been many new > > features, bug fixes and stability improvements committed to the development > > branch > > since then: 71 tickets closed, over 96 commits as of today. > > > > I would be happy to take on RM duties for this release. > > > > Notable features and improvements since the 0.14.0 release: > > > > - ConsumeWindowsEventLog can work from log files > > - ConsumeWindowsEventLog resolve Security/UserID attribute > > - TLS v1.3 support > > - PutS3Object multipart upload support > > - Use systemd service management on Linux > > - Add ProcessContext::getStateManager to Lua/Python > > - Reworked GetTCP to be more inline with ListenTCP > > - SSL support for Prometheus reporter > > - Documentation improvements > > - Multiarch docker support > > - RFC3339 parsing with expression language > > - Reworked Minifi controller > > - gcc-13 support > > > > - Fix for waking up prematurely after processor yields > > - Fix system certificate store usage in SSLContextService on Linux > > - Fix inconsistent naming in C2 machineArch > > - Fix default CA path for S3 on CentOS > > - Removed CronScheduler locale requirements > > > > We've upgraded our third party dependencies (notable mentions) > > - Replaced LibreSSL with OpenSSL 3.1.1 > > - Upgraded RocksDB to v8.1.1 > > - Upgraded LibCurl to v8.1.0 > > - Upgraded CivetWeb to v1.16 > > - Upgraded OpenCV to v4.7.0 > > - Upgraded GoogleCloud SDK to v2.10.1 > > - Upgraded Azure SDK to v12.7.0 > > > > The core API is still not mature enough to be able to commit to it, so > > in line with previous discussions I suggest releasing it as 0.15.0. > > > > Do you agree it is time for a new release? Are there any blockers that we > > should definitely include in this release? > > > > Thanks, > > Martin > >
Re: [DISCUSS] MiNiFi C++ 0.15.0 release
+1 a lot of nice things in there! On Thu, Aug 24, 2023 at 7:52 AM Martin Zink wrote: > Hi community, > > I'd like to initiate a discussion about the next release of MiNiFi C++. The > last release was more than four months ago, and there have been many new > features, bug fixes and stability improvements committed to the development > branch > since then: 71 tickets closed, over 96 commits as of today. > > I would be happy to take on RM duties for this release. > > Notable features and improvements since the 0.14.0 release: > > - ConsumeWindowsEventLog can work from log files > - ConsumeWindowsEventLog resolve Security/UserID attribute > - TLS v1.3 support > - PutS3Object multipart upload support > - Use systemd service management on Linux > - Add ProcessContext::getStateManager to Lua/Python > - Reworked GetTCP to be more inline with ListenTCP > - SSL support for Prometheus reporter > - Documentation improvements > - Multiarch docker support > - RFC3339 parsing with expression language > - Reworked Minifi controller > - gcc-13 support > > - Fix for waking up prematurely after processor yields > - Fix system certificate store usage in SSLContextService on Linux > - Fix inconsistent naming in C2 machineArch > - Fix default CA path for S3 on CentOS > - Removed CronScheduler locale requirements > > We've upgraded our third party dependencies (notable mentions) > - Replaced LibreSSL with OpenSSL 3.1.1 > - Upgraded RocksDB to v8.1.1 > - Upgraded LibCurl to v8.1.0 > - Upgraded CivetWeb to v1.16 > - Upgraded OpenCV to v4.7.0 > - Upgraded GoogleCloud SDK to v2.10.1 > - Upgraded Azure SDK to v12.7.0 > > The core API is still not mature enough to be able to commit to it, so > in line with previous discussions I suggest releasing it as 0.15.0. > > Do you agree it is time for a new release? Are there any blockers that we > should definitely include in this release? > > Thanks, > Martin >
[DISCUSS] MiNiFi C++ 0.15.0 release
Hi community, I'd like to initiate a discussion about the next release of MiNiFi C++. The last release was more than four months ago, and there have been many new features, bug fixes and stability improvements committed to the development branch since then: 71 tickets closed, over 96 commits as of today. I would be happy to take on RM duties for this release. Notable features and improvements since the 0.14.0 release: - ConsumeWindowsEventLog can work from log files - ConsumeWindowsEventLog resolve Security/UserID attribute - TLS v1.3 support - PutS3Object multipart upload support - Use systemd service management on Linux - Add ProcessContext::getStateManager to Lua/Python - Reworked GetTCP to be more inline with ListenTCP - SSL support for Prometheus reporter - Documentation improvements - Multiarch docker support - RFC3339 parsing with expression language - Reworked Minifi controller - gcc-13 support - Fix for waking up prematurely after processor yields - Fix system certificate store usage in SSLContextService on Linux - Fix inconsistent naming in C2 machineArch - Fix default CA path for S3 on CentOS - Removed CronScheduler locale requirements We've upgraded our third party dependencies (notable mentions) - Replaced LibreSSL with OpenSSL 3.1.1 - Upgraded RocksDB to v8.1.1 - Upgraded LibCurl to v8.1.0 - Upgraded CivetWeb to v1.16 - Upgraded OpenCV to v4.7.0 - Upgraded GoogleCloud SDK to v2.10.1 - Upgraded Azure SDK to v12.7.0 The core API is still not mature enough to be able to commit to it, so in line with previous discussions I suggest releasing it as 0.15.0. Do you agree it is time for a new release? Are there any blockers that we should definitely include in this release? Thanks, Martin
