Re: Need help to create avro schema for arrays with tags

2021-07-28 Thread Etienne Jouvin
Hello. What you can do, is to write the expected JSON. Then do a process with convert record, with a JSON tree reader and a writer. On the writer, specify that you want to write the schema in property. Like this, yo uwil have the wanted schema. Etienne Le mer. 28 juil. 2021 à 14:51, Jens M.

Re: Need help to create avro schema for arrays with tags

2021-07-28 Thread Jens M. Kofoed
The problem is with the XML Reader converting xml tags and field contents at the same time. I tried to use the example: Tags with Attributes from the XML Reader additional details help page:

XML Reader: Tags with Attributes not working

2021-07-28 Thread Jens M. Kofoed
Hi I'm trying to convert some xml data, and struggle with xml attributes and field content. Therefore I tried the example in the documentation for the XML Reader but this doesn't work either. By using the data and settings from the example I only get the content value not the data from the tag.

Re: Sensitive context parameter from ExecuteScript

2021-07-28 Thread Etienne Jouvin
Hello all. Finally what I did. Because, I just needed access sensitive parameters from a Groovy Script, I wrote a custom service that give access to specific properties. >From the groovy script, I request the value from the service and that's it. Etienne Le mer. 21 juil. 2021 à 12:16, sanjeet

Re: Re: No Load Balancing since 1.13.2

2021-07-28 Thread Jens M. Kofoed
hi I can see that you have configured nifi.cluster.load.balance.address=0.0.0.0 Have your tried to set the correct ip adress? node1: nifi.cluster.load.balance.address=192.168.1.10 node2: nifi.cluster.load.balance.address=192.168.1.11 node3: nifi.cluster.load.balance.address=192.168.1.12 regards

Re: Re: Re: No Load Balancing since 1.13.2

2021-07-28 Thread Axel Schwarz
I've tried every single combination of values for nifi.cluster.load.balance.host and nifi.cluster.load.balance.address. But again, the problem described in Nifi-8643 is not what happens to us. The port always binds to the correct IP and NOT to localhost. As seen in the netstat-excerpts from my

Q: kafka nifi / max.poll.record on KafkaConsume component

2021-07-28 Thread Ran Lupovich
Hello, why when setting max.poll.records to 1 on KafkaConsume component it does not honors this parameter and seems to buffer the records up to couple of thousands before moving on the flow? Any pointers would be appreciated? Thanks, I tried looking for a resource to read about this and did not

Re: Re: No Load Balancing since 1.13.2

2021-07-28 Thread Axel Schwarz
Just tried Java 11. But still does not work. Nothing changed. :( --- Ursprüngliche Nachricht --- Von: Jorge Machado Datum: 27.07.2021 13:08:55 An: users@nifi.apache.org, Axel Schwarz Betreff: Re: No Load Balancing since 1.13.2 > Did you tried java 11 ? I have a client running a similar setup

Re: Provenance for SplitRecord has a wrong output claim file

2021-07-28 Thread Pierre Villard
Hi, I believe this is expected. If you have one XML file split into 10 JSON files, what would you expect for the output claim? You can use the provenance event to get the child flow files, and retrieve the claims from there. Also note that one claim file can contain multiple flow files but with

Re: Re: No Load Balancing since 1.13.2

2021-07-28 Thread Joe Gresock
Also, make sure to use nifi.cluster.load.balance.host instead of .address if you're still running 1.14.0. Virus-free. www.avast.com

Re: Execute Script Processor is not working some random times

2021-07-28 Thread Joe Gresock
Hi Vibhath, Yes, though not recommended you can still disable the default security features in 1.14.0. The administration guide [1] has examples of enabling https, so you could do the opposite. However, can you describe the use case that requires you to use http? Since 1.1.40 comes secured by

Re: Provenance for SplitRecord has a wrong output claim file

2021-07-28 Thread Jens M. Kofoed
Thanks Pierre your are right, I didn't think of that. what should the output claim file be if there are multiple outputs. The output claim file is off course the original file :-) silly me regards Jens M. Kofoed Den ons. 28. jul. 2021 kl. 11.10 skrev Pierre Villard <

Provenance for SplitRecord has a wrong output claim file

2021-07-28 Thread Jens M. Kofoed
Hi I use a SplitRecord with a XMLReader and a JSONRecord Set writer. When looking at provenance date for the process the output claim file is equal to the input claim file which mean that both files are xml files. This is wrong, the output claim file should be the json file. If using a

Re: Re: Re: Re: No Load Balancing since 1.13.2

2021-07-28 Thread Axel Schwarz
Ok, so we played with these parameters again and got different results almost each time. Once we actually had a functioning balancing cluster, but just once. This was with Version 1.14.0 and .host set to 0.0.0.0. In this state NifiHost1 (Primary Node) had 8 connecctions established. 4 to each

RE:Need help to create avro schema for arrays with tags

2021-07-28 Thread Jens M. Kofoed
If I use the following schema: { "name":"object","type":["null",{ "name":"objectRecord","type":"record","fields":[{ "name": objectDetails","type": {"name": "objectDetails","type": "record","fields": [{ "name": additionalInfo","type": {"type": "array","items": {"name": "additionalInfo","type":

Re: Execute Script Processor is not working some random times

2021-07-28 Thread Mark Payne
Vibhath, You can change the configuration to be http based instead of https. But I would high recommend against doing so. Thanks -Mark On Jul 27, 2021, at 10:46 PM, Vibhath Ileperuma mailto:vibhatharunapr...@gmail.com>> wrote: Hi Mark, As you mentioned I tried to use NIFI 1.14.0. However,

Need help to create avro schema for arrays with tags

2021-07-28 Thread Jens M. Kofoed
Dear community I'm struggling with transforming some xml data into a json format using an avro schema. The data which I can't get to work looks something like this: value1 value2 value3 1 objType If I set the type for additionalInfo