Mark Payne created NIFI-3356:
--------------------------------
Summary: Provide a newly refactored provenance repository
Key: NIFI-3356
URL: https://issues.apache.org/jira/browse/NIFI-3356
Project: Apache NiFi
Issue Type: Task
Components: Core Framework
Reporter: Mark Payne
Assignee: Mark Payne
Fix For: 1.2.0
The Persistent Provenance Repository has been redesigned a few different times
over several years. The original design for the repository was to provide
storage of events and sequential iteration over those events via a Reporting
Task. After that, we added the ability to compress the data so that it could be
held longer. We then introduced the notion of indexing and searching via
Lucene. We've since made several more modifications to try to boost performance.
At this point, however, the repository is still the bottleneck for many flows
that handle large volumes of small FlowFiles. We need a new implementation that
is based around the current goals for the repository and that can provide
better throughput.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
