[
https://issues.apache.org/jira/browse/NIFI-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965352#comment-14965352
]
ASF GitHub Bot commented on NIFI-1021:
--------------------------------------
Github user joewitt commented on the pull request:
https://github.com/apache/nifi/pull/102#issuecomment-149624628
Oleg and I had a nice discussion about NiFi, EIP, FBP, and other concepts.
His idea for enabling very low latency/real-time streaming access to provenance
data is excellent. I think we as a community need to work with Oleg and others
interested in doing this to enable such features in a way that aligns with NiFi
features and intended user-focused/application experience. Oleg's idea likely
means we should update or enable ReportingTasks to have immediate access to
live streams of provenance data rather than once it is indexed as it is today.
There are likely many ways to tackle this. Oleg's first PR demonstrated the
idea. We now need to take that and ensure it is fully available but through
the same managed classloader/lifecycle as other extension points.
Thanks Oleg! Look forward to working with you and the community to fold
this in. Let's use the JIRA to keep the discussion going.
> Expose strategy to subscribe to provenance events
> -------------------------------------------------
>
> Key: NIFI-1021
> URL: https://issues.apache.org/jira/browse/NIFI-1021
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Core Framework
> Affects Versions: 0.3.0
> Reporter: Oleg Zhurakousky
> Assignee: Oleg Zhurakousky
> Attachments: nifi-provenance-stream-1.0.0-SNAPSHOT.jar
>
>
> Currently access to the provenance events is exposed thru ReportingTask which
> is scheduled and therefore provides a "near-real-time" access to provenance
> events.
> There are several valid use cases where such events may need to be streamed
> in "real-time" for variety of real time analytics.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
