[
https://issues.apache.org/jira/browse/NIFI-5231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489046#comment-16489046
]
ASF GitHub Bot commented on NIFI-5231:
--------------------------------------
Github user MikeThomsen commented on the issue:
https://github.com/apache/nifi/pull/2737
Not sure if I like that approach. The beauty of what we did was it just
puts the data into the provenance repository and there aren't that many
flowfiles to track. Maybe a few hundred thousand over the entire data set if we
use appropriately-sized batches from `GetMongo`. NiFi handles that like a champ
and s2s prov reporting has no probably rapid-fire sending it over to our
tracking instance of NiFi.
> Record stats processor
> ----------------------
>
> Key: NIFI-5231
> URL: https://issues.apache.org/jira/browse/NIFI-5231
> Project: Apache NiFi
> Issue Type: New Feature
> Reporter: Mike Thomsen
> Assignee: Mike Thomsen
> Priority: Major
>
> Should the following:
>
> # Take a record reader.
> # Count the # of records and add a record_count attribute to the flowfile.
> # Allow user-defined properties that do the following:
> ## Map attribute name -> record path.
> ## Provide aggregate value counts for each record path statement.
> ## Provide total count for record path operation.
> ## Put those values on the flowfile as attributes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
