Queries regarding Nifi custom processor for Azure Data Explorer

Hi Team, We at Microsoft opensource, are developing a custom for Azure Data Explorer sink connector for Apache Nifi. What we want to achieve is transactionality with data ingestion. The source of the processor can be TBs of telemetry data as well as CDC logs. What that means is in case of any f

Re: [VOTE] Release Apache NiFi 1.18.0 (RC3)

+1 (binding) Running with openjdk version "11.0.16" 2022-07-19 LTS: I tested this RC with a 3 node cluster with an external Zookeeper, and a test flow and found things to be working fine. Also tested authentication with LDAP, SAML, OIDC and X509. Thanks for the release work! Nathan On Fri, Sep

Re: [VOTE] Release Apache NiFi 1.18.0 (RC3)

+1 (binding) -Ran full clean install on OS X (Catalina 10.15.7, OpenJDK version 1.8.0_252) -Tested secure NiFi with secure NiFi Registry -Ran basic flows successfully; tested basic versioned flow functionality -Reviewed/tested Core UI enhancements/fixes and documentation updates Drew > On Sep 29

Re: [VOTE] Release Apache NiFi 1.18.0 (RC3)

Downloaded source and verified keys and signatures Performed full build including contrib-check using: OpenJDK Runtime Environment (build 1.8.0_342-8u342-b07-0ubuntu1~22.04-b07) OpenJDK Runtime Environment (build 11.0.16+8-post-Ubuntu-0ubuntu122.04) OpenJDK Runtime Environment (build 17.0.4+8

Re: [VOTE] Release Apache NiFi 1.18.0 (RC3)

+1 (binding) - Verified signatures and hashes - Ran build using Maven 3.8.6 - Ran build on Ubuntu 22.04 with Azul Zulu JDK 1.8.0-345 AMD64 - Ran build on macOS 12.6 with Azul Zulu JDK 17.0.4 AArch64 - Ran stateless and system tests on macOS 12.6 with Azul Zulu JDK 17.0.4 AArch64 - Ran NiFi on mac

Maven Enforcer Plugin does not fail build with use of banDuplicatePomDependencyVersions rule when there are duplicates between top level parent pom and children poms

Has anyone ever used Maven Enforcer Plugin with rule banDuplicatePomDependencyVersions? I identified duplicate dependencies and wrote ticket NIFI-10565 . I added the banDuplicatePomDependencyVersions to the list of Enforcer rules on a branch that s

Re: [VOTE] Release Apache NiFi 1.18.0 (RC3)

+1 ( non-binding) ran through release steps Apache Maven 3.8.6 (84538c9988a25aec085021c365c560670ad80f63) Maven home: /usr/local/Cellar/maven/3.8.6/libexec Java version: 1.8.0_292, vendor: AdoptOpenJDK, runtime: /Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre Default locale

Re: [VOTE] Release Apache NiFi 1.18.0 (RC3)

+1 (non-binding) - Went through the helper guide steps - Verified signatures and hashes - Started NiFi, created a flow with the new GetZendesk processor. Was able to fetch data from Zendesk successfully - Started MiNiFi, turned on GZIP compression for C2 requests. Managed to communicate with C2 ser

Re: Duplicated dependencies

I found this article https://www.baeldung.com/maven-duplicate-dependencies which discusses how to detect duplicate dependencies and how to enforce unique dependencies. On Thu, Sep 29, 2022 at 8:37 PM David Handermann < exceptionfact...@apache.org> wrote: > Dan, > > The initial removal of duplicat

Re: [VOTE] Release Apache NiFi 1.18.0 (RC3)

+1 (non-binding) Ran through the build steps, and tested all the new parameter providers, including some scenarios involving adding, removing, and updating parameters from the external source, as well as several referencing component scenarios. Apache Maven 3.8.1 (05c21c65bdfed0f71a2f2ada8b84da59

Re: [VOTE] Release Apache NiFi 1.18.0 (RC3)

+1 (non-binding) I went through the normal steps. I also started and executed some basic scenarios about the recent registry related changes. Build on macOS Catalina 10.15.7 Maven: 3.6.3 Java version: 11.0.15, vendor: Azul Systems, Inc. Default locale: en_GB, platform encoding: UTF-8 OS name: "