[
https://issues.apache.org/jira/browse/NIFI-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063769#comment-16063769
]
ASF GitHub Bot commented on NIFI-4122:
--------------------------------------
GitHub user MikeThomsen reopened a pull request:
https://github.com/apache/nifi/pull/1943
NIFI-4122 Added the ability to combine multiple Mongo result document…
https://issues.apache.org/jira/browse/NIFI-4122
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/MikeThomsen/nifi NIFI-4122
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/nifi/pull/1943.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1943
----
commit b1ecbe33a99f684a9ae0a649ae2069852f688d9e
Author: Mike Thomsen <[email protected]>
Date: 2017-06-26T15:06:35Z
NIFI-4122 Added the ability to combine multiple Mongo result documents into
a single output JSON array.
----
> GetMongo should be able to group results into a set of flowfiles
> ----------------------------------------------------------------
>
> Key: NIFI-4122
> URL: https://issues.apache.org/jira/browse/NIFI-4122
> Project: Apache NiFi
> Issue Type: Improvement
> Reporter: Mike Thomsen
> Priority: Minor
> Labels: getmongo, mongodb, nifi
>
> GetMongo should be able to take a user-defined limit and group results by
> that size into flowfiles rather than having only the ability to do a 1:1
> relationship between result and flowfile.
> For example, if the user specifies 100, 100 results should be grouped
> together and turned into a JSON array that can be broken up later as needed.
> This need arose when doing a bulk data ingestion from Mongo. We had shy of
> 400k documents, and the 1:1 generation of flowfiles blew right through our
> limits on the content repository. Adding this feature would make it feasible
> to control that sort of behavior more thoroughly for events like bulk
> ingestion.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
