Re: How to upgrade custom nar version

2020-06-19 Thread Etienne Jouvin
So simple, just drag the new version, restart and everything is updated. Nice, thanks. Le ven. 19 juin 2020 à 18:53, Bryan Bende a écrit : > If you don't need to run processors from 1.0 and 1.1 at the same time, > then you can stop NiFi and remove the old NAR and add the new one, then > start a

Re: How to upgrade custom nar version

2020-06-19 Thread Bryan Bende
If you don't need to run processors from 1.0 and 1.1 at the same time, then you can stop NiFi and remove the old NAR and add the new one, then start again, and all the existing processors would be auto-upgraded. If you need some on 1.0 and some on 1.1, you can add the 1.1 NAR to the lib directory

How to upgrade custom nar version

2020-06-19 Thread Etienne Jouvin
Hello all. Imagine I have a custom nar, with custom processors, installed in version 1.0. Then I release a new version 1.1. How do I migrate existing processes to take the new version 1.1 ? Should I delete the nar in version 1.0 and just push the 1.1 ? Should I go to each process ? In fact, there

Re: ConsumeKafkaRecord Performance Issue

2020-06-19 Thread Mark Payne
Josef, Glad you were able to get past this hurdle. The reason for the consumer yielding is a bit complex. NiFi issues an async request to Kafka to retrieve messages. Then, NiFi performs a long-poll to get those messages from the Kafka client. If the client returns 0 messages from the long-poll,

Re: Custom service in NAR generation failure

2020-06-19 Thread Bryan Bende
I haven't fully evaluated the fix, at a quick glance it seems correct, but I'm trying to figure out if something else is not totally correct in your poms because many other projects are using the latest NAR plugin and not having this issue, so there must be some difference that makes it work in som

Re: Custom service in NAR generation failure

2020-06-19 Thread Juan Pablo Gardella
I am facing a similar problem and the workaround I used was installing the dependency in local repository. On Fri, 19 Jun 2020 at 10:30, Etienne Jouvin wrote: > My parent pom has this as declaration : > > > org.apache.nifi > nifi-nar-bundles > 1.11.4 > > > When

Re: Custom service in NAR generation failure

2020-06-19 Thread Etienne Jouvin
My parent pom has this as declaration : org.apache.nifi nifi-nar-bundles 1.11.4 When I studied the maven plugin, I found the following in class org.apache.nifi.extension.definition.extraction.ExtensionClassLoaderFactory.java private String determineProvidedEn

Re: Custom service in NAR generation failure

2020-06-19 Thread Bryan Bende
If you are not using nifi-nar-bundles as your parent (which is fine), then you should be explicitly setting versions for nifi-api and nifi-framework-api. Otherwise how would it know to use 1.11.4 ? On Fri, Jun 19, 2020 at 9:09 AM Etienne Jouvin wrote: > Ok, will try to just post simple thing.

Re: ConsumeKafkaRecord Performance Issue

2020-06-19 Thread Pierre Villard
In addition to Mark's questions: - what version of NiFi are you using? Regarding the number of concurrent threads to use, this should be set according to the number of partitions and I recommend reading this great blog: https://bryanbende.com/development/2016/09/15/apache-nifi-and-apache-kafka No

Re: Custom service in NAR generation failure

2020-06-19 Thread Etienne Jouvin
Ok, will try to just post simple thing. The project has the following : http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd";> 4.0.0 ch

Re: NIFI JMS consuler : AMQP 1.0 trouble

2020-06-19 Thread Peter Turcsanyi
Hi Olivier, You can use Apache Qpid Proton AMQP client library [1] as recommended in the ActiveMQ AMQP configuration docs [2]. You'll want to download Qpid JMS (AMQP 1.0) and use the jars from the lib folder of the tarball. The JNDI Initial Context Factory Class needs to be configured: org.apache.

Re: Custom service in NAR generation failure

2020-06-19 Thread Mike Thomsen
Without seeing your POM(s), it could be several things. Try posting your POMs here or as a GitHub gist. On Fri, Jun 19, 2020 at 3:36 AM Etienne Jouvin wrote: > Hello all. > > Do not know where to post the message, guide me if I should send to > another mailing list. > A simple summary in first s

NIFI JMS consuler : AMQP 1.0 trouble

2020-06-19 Thread GAQUIERE, Olivier
Hi all I try to use NIFI to consume AMQP 1.0 messages from a ActiveMQ Topic. Did anyone manage to implement the JMS consumer to consume AMQP messages ? If yes, which client librairies did you use ? Thanks in advance Regards Olivier This message contains information that may be privileged or con

Re: Custom service in NAR generation failure

2020-06-19 Thread Etienne Jouvin
Just for information, and for me to remember. Found here : https://github.com/apache/nifi-maven/blob/master/src/main/java/org/apache/nifi/extension/definition/extraction/ExtensionClassLoaderFactory.java private String determineProvidedEntityVersion(final Set > artifacts, final String groupId

Custom service in NAR generation failure

2020-06-19 Thread Etienne Jouvin
Hello all. Do not know where to post the message, guide me if I should send to another mailing list. A simple summary in first step. I created a simple project to build a new service. I extend the nifi-nar-bundles artifact with version 1.11.4. My project version is currently 0.0.1-SNAPSHOT. Durin