[
https://issues.apache.org/jira/browse/NIFI-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16473287#comment-16473287
]
Mike Thomsen commented on NIFI-4964:
------------------------------------
The HBase service can use a lot of Gets at once to do that, but the other ones
don't have any good way that I can think of to make one bulk request to the
external system that won't confuse things badly.
> Add bulk lookup feature in LookupRecord
> ---------------------------------------
>
> Key: NIFI-4964
> URL: https://issues.apache.org/jira/browse/NIFI-4964
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Extensions
> Reporter: Pierre Villard
> Priority: Major
>
> When having a flow file with a large number of records it would be much more
> efficient to parse the whole flow file once to list all the coordinates to
> look for, then call a new method (lookupAll?) in the lookup service to get
> all the results, and then parse the file one more time to update the records.
> It should be added in the CS description/annotations that this approach could
> hold in memory a large number of objects but could result in better
> performances for lookup services accessing external systems (Mongo, HBase,
> etc).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
