Milan Das created NIFI-4715:
-------------------------------
Summary: ListS3 list duplicate files when incoming file
throughput to S3 is high
Key: NIFI-4715
URL: https://issues.apache.org/jira/browse/NIFI-4715
Project: Apache NiFi
Issue Type: Bug
Components: Core Framework
Affects Versions: 1.4.0, 1.3.0, 1.2.0
Environment: All
Reporter: Milan Das
ListS3 state is implemented using HashSet. HashSet is not thread safe. When
ListS3 operates in multi threaded mode, sometimes it tries to list same file
from S3 bucket. Seems like HashSet data is getting corrupted.
currentKeys = new HashSet<>(); // need to be implemented Thread Safe like
currentKeys = //ConcurrentHashMap.newKeySet();
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
