Hi All,
In some parts of the NiFi documentation, it is stated that a provenance
event is emitted for each flowfile for each processor. However elsewhere
it is stated that no provenance-event is generated for a flowfile sent
to the “success” output of a processor - which is true?
And are there mechanisms for reducing the number of provenance events
generated by a NiFi flow? When a dataflow is processing large numbers of
events, it would seem to me that the generation of provenance events
will be the limiting factor for performance. When processing 1 million
records per day, generating 1 million provenance events (or worse) is
not helpful..
Thanks in advance,
Simon
- Provenance Event performance simon
-