[
https://issues.apache.org/jira/browse/NIFI-6219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845612#comment-16845612
]
Koji Kawamura commented on NIFI-6219:
-------------------------------------
Hi [~peterr] thanks for reporting this. I tried reproducing the issue with the
attached flow.xml. But UpdateCounter processor successfully processed all
queued 1,000,000 FlowFiles.
!processed-all-flowfiles.png|width=300!
While I was testing, following messages were logged.
{code}
2019-05-22 16:22:55,275 INFO [FileSystemRepository Workers Thread-4]
o.a.n.c.repository.FileSystemRepository Successfully archived 10 Resource
Claims for Container default in 8 millis
2019-05-22 16:22:55,966 INFO [Timer-Driven Process Thread-7]
o.a.n.c.r.WriteAheadFlowFileRepository Repository updated to reflect that 10000
FlowFiles were swapped in to
FlowFileQueue[id=26a73ec1-016a-1000-be52-ffe5e199e18a]
{code}
If you encountered issue at multiple of 10000 FlowFiles, then something might
have happened when FlowFiles were swapped in. Were there any ERR or suspicious
log messages in nifi-app.log?
> Unprocessable queues with remaining size a multiple of 10000
> ------------------------------------------------------------
>
> Key: NIFI-6219
> URL: https://issues.apache.org/jira/browse/NIFI-6219
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.9.2
> Reporter: Peter Radden
> Priority: Critical
> Attachments: flow.xml, processed-all-flowfiles.png, queue.jpg
>
>
> This is using all default NiFi settings.
> The problem is easy to reproduce with the attached flow:
> * Start the GenerateFlowFile processor and allow the queue to build (to say
> 100000).
> * Stop the GenerateFlowFile processor.
> * Start the UpdateCounter process.
> * Observe that it stops processing after 19999 FlowFiles. Stop the processor
> * Attempt to clear the queue.
> * Observe that the queue is left with an exact multiple of 10000 FlowFiles.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
