[
https://issues.apache.org/jira/browse/NIFI-2835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16256902#comment-16256902
]
Eric Ulicny commented on NIFI-2835:
-----------------------------------
Hello Koji
When I attempt to build from the azure nar file path I am getting the following
error.
[ERROR] Failed to execute goal on project nifi-azure-processors: Could not
resolve dependencies for project
org.apache.nifi:nifi-azure-processors:jar:1.5.0-SNAPSHOT: The following
artifacts could not be resolved: org.apache.nifi:nifi-mock:jar:1.5.0-SNAPSHOT,
org.apache.nifi:nifi-processor-utils:jar:1.5.0-SNAPSHOT: Could not find
artifact org.apache.nifi:nifi-mock:jar:1.5.0-SNAPSHOT in apache.snapshots
(http://repository.apache.org/snapshots) -> [Help 1]
[ERROR]
command: mvn clean install
Maven version: Apache Maven 3.5.0 (ff8f5e7444045639af65f6095c62210b5713f426;
2017-04-03T15:39:06-04:00)
Maven home: C:\Projects\nifi\maven\bin\..
Java version: 1.8.0_102, vendor: Oracle Corporation
> GetAzureEventHub processor should leverage partition offset to better handle
> restarts
> -------------------------------------------------------------------------------------
>
> Key: NIFI-2835
> URL: https://issues.apache.org/jira/browse/NIFI-2835
> Project: Apache NiFi
> Issue Type: Improvement
> Reporter: Joseph Percivall
> Assignee: Eric Ulicny
>
> The GetAzureEventHub processor utilizes the Azure client that consists of
> receivers for each partition. The processor stores them in a map[1] that gets
> cleared every time the processor is stopped[2]. These receivers have
> partition offsets which keep track of which message it's currently on and
> which it should receive next. So currently, when the processor is
> stopped/restarted, any tracking of which message is next to be received is
> lost.
> If instead of clearing the map each time, we hold onto the receivers, or kept
> track of the partitionId/Offsets when stopping, (barring any relevant
> configuration changes) the processor would restart exactly where it left off
> with no loss of data.
> This would work very well with NIFI-2826.
> [1]https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-azure-bundle/nifi-azure-processors/src/main/java/org/apache/nifi/processors/azure/eventhub/GetAzureEventHub.java#L122
> [2]
> https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-azure-bundle/nifi-azure-processors/src/main/java/org/apache/nifi/processors/azure/eventhub/GetAzureEventHub.java#L229
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
