Hi all,
Not sure if I need to ask this in this mailing list or the list of the
developers.
I want to create a REST server with NIFI.
I have a Kafka queue storing messages. When something is connected to the
REST server, the Kafka queue has to be read and all waiting messages should
be collected
Hi Ralph,
If you are looking to create a REST service for receiving and processing
messages in NiFi, take a look at the ListenHTTP processor, as well as the
HandleHttpRequest and HandleHttpResponse processors. The ListenHTTP
processor supports receiving HTTP requests and sending the contents to
Thanks, Chris,
This is the same problem I figured,
Is it possible to create an executeScript reading Kafka?
With regards,
Mit freundlichem Gruß,
Met vriendelijke groet,
*Ralph Vercauteren*
Technical Architect QAD Automation Solutions
Mobile NL: +31 6 5397 7230
r...@qad.com
This e-mail may
Hi David,
Thanks for responding.
I understand that part, still have the issue to see how we get the kafka
messages from a topic.
[image: image.png]
With regards,
Mit freundlichem Gruß,
Met vriendelijke groet,
*Ralph Vercauteren*
Technical Architect QAD Automation Solutions
Mobile NL: +31 6
Suspect the problem there would be that the ConsumeKafka processors
(according to the documentation) don't accept incoming connections, so
you've no way of sending the FlowFile from InvokeHttp/HandleHttpRequest to
ConsumeKafka to fetch the messages (which you'd possibly then want to
Thanks Chris, after looking more closely at the ConsumeKafka processors, I
realized that they don't accept incoming flow files.
It makes the flow more complex, and subject to potential queuing volume
concerns, but another option might be to use the Wait and Notify
processors. At a basic level,
Hi,
Is there an “out-of-the-box” solution to use AD authentication with InvokeHTTP?
Best,
Marc
Ralph,
Thanks for the reply and additional details. I may be misunderstanding,
but just for clarification, in your diagram, are you expecting NiFi to act
as the REST server? If that is the case, then you should be able to use
one of the ConsumeKafka processors to retrieve messages and return
Hi all,
I need in several cases of my process to execute a SQL that counts and
averages data from a table. This is a SQL with two columns and one row that
I always need to load as an attribute, so I use: ExecuteSQL ->
RouteOnAttribute (To check the executesql.row.count != 0) ->
ConvertAvroTOJSON
I'd also keep in mind how partitioning of kafka topics works with
consumers, and whether or not you have a clustered nifi (most people would
for production).
If you have a topic with 1 partition and 3 nifi nodes, only one of the nifi
nodes has a consumer assigned to this partition (assuming 1
10 matches
Mail list logo