[
https://issues.apache.org/jira/browse/NIFI-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003079#comment-15003079
]
Mark Payne commented on NIFI-1132:
----------------------------------
[~bbende] - we could update the standard prov even to do the same thing. I
thought it unnecessary, since the lineage identifiers are populated from the
flowfile itself (if the flowfile limits it to 100 then the prov event is
implicitly limited to 100). It's probably a good "defensive programming"
technique to explicitly cap it though.
> FlowFile and Provenance Events hold an unbounded number of "lineage
> identifiers" which causes OutOfMemoryError when merging many objects
> ----------------------------------------------------------------------------------------------------------------------------------------
>
> Key: NIFI-1132
> URL: https://issues.apache.org/jira/browse/NIFI-1132
> Project: Apache NiFi
> Issue Type: Bug
> Reporter: Mark Payne
> Assignee: Mark Payne
> Priority: Critical
> Fix For: 0.4.0
>
> Attachments:
> 0001-NIFI-1132-Limited-number-of-Lineage-Identifiers-held.patch
>
>
> Currently, FlowFile and Provenance Event hold a collection of "lineage
> identifiers." I.e., the UUID of every FlowFile that was used to make up
> 'this' FlowFile. However, this is not really used and is currently unbounded.
> Since we already have this information via the Provenance JOIN Events, we
> should get rid of these methods all together. This cannot happen until the
> next Major Release, though, in order to maintain backward compatibility. For
> the time being, will limit number of UUID's stored and deprecate the methods.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
