[
https://issues.apache.org/jira/browse/NIFI-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Turcsanyi updated NIFI-6945:
----------------------------------
Description: When ReportLineageToAtlas queries the entities from Atlas, the
AtlasEntityWithExtInfo response object also contains all the referred entities
with all their data by default which leads to huge data transfers between Atlas
and NiFi. On the other hand, this extended data of the related entities are not
used by the reporting task, so they could be excluded from the query (using
{{minExtInfo=true}} parameter) in order to reduce the response size. (was:
When ReportLineageToAtlas queries the entities from Atlas, the
AtlasEntityWithExtInfo response object also contains all the referred entities
by default which leads to huge data transfers between Atlas and NiFi. On the
other hand, these related entities are not used by the reporting task, so they
could be excluded from the query (using {{minExtInfo=true}} parameter) in order
to reduce the response size.)
> Use minExtInfo=true to reduce the amount of data queried from Atlas
> -------------------------------------------------------------------
>
> Key: NIFI-6945
> URL: https://issues.apache.org/jira/browse/NIFI-6945
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Extensions
> Reporter: Peter Turcsanyi
> Assignee: Peter Turcsanyi
> Priority: Major
>
> When ReportLineageToAtlas queries the entities from Atlas, the
> AtlasEntityWithExtInfo response object also contains all the referred
> entities with all their data by default which leads to huge data transfers
> between Atlas and NiFi. On the other hand, this extended data of the related
> entities are not used by the reporting task, so they could be excluded from
> the query (using {{minExtInfo=true}} parameter) in order to reduce the
> response size.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
