[
https://issues.apache.org/jira/browse/NIFI-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
endzeit updated NIFI-12609:
---------------------------
Description:
The {{ListedEntityTracker}} has no option to enforce a strong limit on cachable
entities.
This can result in both, 1.) an arbitrary amount of entities listed, and 2.) an
arbitrary amount of cache entries stored in the DistributedMapCache.
This may lead to long response times of the cache as well as an overload of the
NiFi instance with FlowFiles.
The ListedEntityTracker should support the (optional) enforcement of an upper
limit on listable entities during the time window.
Given an configured upper limit of N, no more than N entries should be
supported in the entity tracking cache simultaneously and listed by the
processor during the configured time window.
This limit is designed to prohibit abuse and reduce of consequences of load
peaks. Thus a warning bulletin should be shown to the user whenever the limit
is reached, to make the unusual usage visible.
Additionally, no listing should be executed against the source system as long
as the cache is full, to avoid undesired and unnecessary load.
was:TODO
> Introduce an "Cached Entity Limit" to ListedEntityTracker
> ---------------------------------------------------------
>
> Key: NIFI-12609
> URL: https://issues.apache.org/jira/browse/NIFI-12609
> Project: Apache NiFi
> Issue Type: New Feature
> Reporter: endzeit
> Priority: Major
>
> The {{ListedEntityTracker}} has no option to enforce a strong limit on
> cachable entities.
> This can result in both, 1.) an arbitrary amount of entities listed, and 2.)
> an arbitrary amount of cache entries stored in the DistributedMapCache.
> This may lead to long response times of the cache as well as an overload of
> the NiFi instance with FlowFiles.
> The ListedEntityTracker should support the (optional) enforcement of an upper
> limit on listable entities during the time window.
> Given an configured upper limit of N, no more than N entries should be
> supported in the entity tracking cache simultaneously and listed by the
> processor during the configured time window.
> This limit is designed to prohibit abuse and reduce of consequences of load
> peaks. Thus a warning bulletin should be shown to the user whenever the limit
> is reached, to make the unusual usage visible.
> Additionally, no listing should be executed against the source system as long
> as the cache is full, to avoid undesired and unnecessary load.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
