[
https://issues.apache.org/jira/browse/NIFI-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002334#comment-15002334
]
Bryan Bende commented on NIFI-1132:
-----------------------------------
Been reviewing this... should StandardProvenanceEventRecord also be updated so
that setLineageIdentifiers in it's builder does something similar to
StandardFlowFileRecord? I'm only asking because FlowFile and
ProvenanceEventRecord were both updated to say that getLineageIdentifiers would
only return 100 ids.
> FlowFile and Provenance Events hold an unbounded number of "lineage
> identifiers" which causes OutOfMemoryError when merging many objects
> ----------------------------------------------------------------------------------------------------------------------------------------
>
> Key: NIFI-1132
> URL: https://issues.apache.org/jira/browse/NIFI-1132
> Project: Apache NiFi
> Issue Type: Bug
> Reporter: Mark Payne
> Assignee: Mark Payne
> Priority: Critical
> Fix For: 0.4.0
>
> Attachments:
> 0001-NIFI-1132-Limited-number-of-Lineage-Identifiers-held.patch
>
>
> Currently, FlowFile and Provenance Event hold a collection of "lineage
> identifiers." I.e., the UUID of every FlowFile that was used to make up
> 'this' FlowFile. However, this is not really used and is currently unbounded.
> Since we already have this information via the Provenance JOIN Events, we
> should get rid of these methods all together. This cannot happen until the
> next Major Release, though, in order to maintain backward compatibility. For
> the time being, will limit number of UUID's stored and deprecate the methods.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
