[
https://issues.apache.org/jira/browse/NIFI-5786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742510#comment-16742510
]
Milan Das commented on NIFI-5786:
-
I have added it in my GitHub. Feel free to use. Eventually I will
[
https://issues.apache.org/jira/browse/NIFI-5786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734530#comment-16734530
]
Milan Das commented on NIFI-5786:
-
I have a working copy using it. I will make it available over this
Milan Das created NIFI-5786:
---
Summary: Add nifi-hazelcast-bundle processor to communicate with
Hazlecast
Key: NIFI-5786
URL: https://issues.apache.org/jira/browse/NIFI-5786
Project: Apache NiFi
[
https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Milan Das updated NIFI-4715:
Description:
ListS3 state is implemented using HashSet. HashSet is not thread safe. When
ListS3 operates in
[
https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310030#comment-16310030
]
Milan Das commented on NIFI-4715:
-
There is one more flavor of same defect.
Suppose: file1 is modified at
[
https://issues.apache.org/jira/browse/NIFI-4533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302656#comment-16302656
]
Milan Das commented on NIFI-4533:
-
I think the fix will very similar to NIFI-4715. maxTimestamp should be
[
https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Milan Das updated NIFI-4715:
Description:
ListS3 state is implemented using HashSet. HashSet is not thread safe. When
ListS3 operates in
[
https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Milan Das updated NIFI-4715:
Description:
ListS3 state is implemented using HashSet. HashSet is not thread safe. When
ListS3 operates in
[
https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299200#comment-16299200
]
Milan Das commented on NIFI-4715:
-
Root cause is:
When the file gets uploaded to S3 simultaneously when
[
https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299147#comment-16299147
]
Milan Das commented on NIFI-4715:
-
yes. Agree multi thread doesn't exist. Root cause is different.
>
[
https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298529#comment-16298529
]
Milan Das edited comment on NIFI-4715 at 12/20/17 1:53 PM:
---
[~joewitt] Now I am
[
https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298529#comment-16298529
]
Milan Das edited comment on NIFI-4715 at 12/20/17 1:52 PM:
---
[~joewitt] Now I am
[
https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298529#comment-16298529
]
Milan Das commented on NIFI-4715:
-
[~joewitt] Now I am able to fix the bug using DetectDuplicate. But seems
[
https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298522#comment-16298522
]
Milan Das edited comment on NIFI-4715 at 12/20/17 1:45 PM:
---
Flow Templates &
[
https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Milan Das updated NIFI-4715:
Attachment: screenshot-1.png
> ListS3 list duplicate files when incoming file throughput to S3 is high
>
[
https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Milan Das updated NIFI-4715:
Attachment: List-S3-dup-issue.xml
Flow Templates
> ListS3 list duplicate files when incoming file
[
https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298478#comment-16298478
]
Milan Das commented on NIFI-4715:
-
Additional logs after enabling log4j on ListS3:
AWS Last Modified Times
[
https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298473#comment-16298473
]
Milan Das commented on NIFI-4715:
-
[~joewitt]
Steps to reproduce (I can reproduce and upload the fiow
Milan Das created NIFI-4715:
---
Summary: ListS3 list duplicate files when incoming file
throughput to S3 is high
Key: NIFI-4715
URL: https://issues.apache.org/jira/browse/NIFI-4715
Project: Apache NiFi
19 matches
Mail list logo