[
https://issues.apache.org/jira/browse/NIFI-900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933816#comment-14933816
]
Mark Payne commented on NIFI-900:
---------------------------------
Initially I went down the path of adding support for AMQP 1.0 to the JMS
Processors. This worked okay for Putting, but only if there was a single
message per transaction, as Event Hub does not allow for transacted sessions.
It had a significant limitation for receiving, because the Destination Name
that we would have to use would be <queue name>/ConsumerGroups/<consumer group
name>/Partitions/<partition name>
This doesn't work well, as we'd need N processors for N partitions.
As a result, I created a new nifi-azure-nar and used the eventhubs-client.
Since i had already done the work to support AMQP 1.0, I left that in so that
we can communicate with other AMQP-enabled JMS Providers, though.
As-is, the GetAzureEventHub processor will resume reading only from "this point
on" when you start it. It functions similar to a "tail" on a file and does not
distribute state, so if run in a cluster will need to be run on primary node
only. It does, however, pull from all partitions with a single Processor.
Suggest we use this processor as it is now for the time being and implement a
more full-featured capability after the NiFi State Management feature proposal
has been tackled to supply the ability to easily share state across all nodes
in a cluster as well as assign partitions to individual nodes.
> Add support for sending/receiving data with Azure Event Hub
> -----------------------------------------------------------
>
> Key: NIFI-900
> URL: https://issues.apache.org/jira/browse/NIFI-900
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Extensions
> Reporter: Joseph Witt
> Fix For: 0.4.0
>
> Attachments:
> 0001-NIFI-900-Added-Azure-nar-added-support-for-AMQP-1.0-.patch
>
>
> Azure event hubs appears to support AMQP. If so then perhaps we only need to
> build a processor to get/put via AMQP. Needs research and determination of
> best path forward. But there is clearly an interest to interact with Azure
> as a hosting platform and Azure Event hub for messaging.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
