To create a REST server

2021-02-04 Thread Ralph Vercauteren
Hi all, Not sure if I need to ask this in this mailing list or the list of the developers. I want to create a REST server with NIFI. I have a Kafka queue storing messages. When something is connected to the REST server, the Kafka queue has to be read and all waiting messages should be collected

Re: To create a REST server

2021-02-04 Thread David Handermann
Hi Ralph, If you are looking to create a REST service for receiving and processing messages in NiFi, take a look at the ListenHTTP processor, as well as the HandleHttpRequest and HandleHttpResponse processors. The ListenHTTP processor supports receiving HTTP requests and sending the contents to

Re: To create a REST server

2021-02-04 Thread Ralph Vercauteren
Thanks, Chris, This is the same problem I figured, Is it possible to create an executeScript reading Kafka? With regards, Mit freundlichem Gruß, Met vriendelijke groet, *Ralph Vercauteren* Technical Architect QAD Automation Solutions Mobile NL: +31 6 5397 7230 r...@qad.com This e-mail may

Re: To create a REST server

2021-02-04 Thread Ralph Vercauteren
Hi David, Thanks for responding. I understand that part, still have the issue to see how we get the kafka messages from a topic. [image: image.png] With regards, Mit freundlichem Gruß, Met vriendelijke groet, *Ralph Vercauteren* Technical Architect QAD Automation Solutions Mobile NL: +31 6

Re: To create a REST server

2021-02-04 Thread Chris Sampson
Suspect the problem there would be that the ConsumeKafka processors (according to the documentation) don't accept incoming connections, so you've no way of sending the FlowFile from InvokeHttp/HandleHttpRequest to ConsumeKafka to fetch the messages (which you'd possibly then want to

Re: To create a REST server

2021-02-04 Thread David Handermann
Thanks Chris, after looking more closely at the ConsumeKafka processors, I realized that they don't accept incoming flow files. It makes the flow more complex, and subject to potential queuing volume concerns, but another option might be to use the Wait and Notify processors. At a basic level,

Active Directory authentication with InvokeHTTP

2021-02-04 Thread Marc Recht
Hi, Is there an “out-of-the-box” solution to use AD authentication with InvokeHTTP? Best, Marc

Re: To create a REST server

2021-02-04 Thread David Handermann
Ralph, Thanks for the reply and additional details. I may be misunderstanding, but just for clarification, in your diagram, are you expecting NiFi to act as the REST server? If that is the case, then you should be able to use one of the ConsumeKafka processors to retrieve messages and return

Better approach to run SQL and load it as attribute

2021-02-04 Thread Jairo Henao
Hi all, I need in several cases of my process to execute a SQL that counts and averages data from a table. This is a SQL with two columns and one row that I always need to load as an attribute, so I use: ExecuteSQL -> RouteOnAttribute (To check the executesql.row.count != 0) -> ConvertAvroTOJSON

Re: To create a REST server

2021-02-04 Thread Bryan Bende
I'd also keep in mind how partitioning of kafka topics works with consumers, and whether or not you have a clustered nifi (most people would for production). If you have a topic with 1 partition and 3 nifi nodes, only one of the nifi nodes has a consumer assigned to this partition (assuming 1