[jira] [Commented] (NIFI-4715) ListS3 list duplicate files when incoming file throughput to S3 is high

2017-12-23 Thread Adam Lamar (JIRA)
[ https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302646#comment-16302646 ] Adam Lamar commented on NIFI-4715: -- [~dmilan77] I was able to reproduce the issue you described. ListS3

[jira] [Commented] (NIFI-4715) ListS3 list duplicate files when incoming file throughput to S3 is high

2017-12-20 Thread Milan Das (JIRA)
[ https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299200#comment-16299200 ] Milan Das commented on NIFI-4715: - Root cause is: When the file gets uploaded to S3 simultaneously when

[jira] [Commented] (NIFI-4715) ListS3 list duplicate files when incoming file throughput to S3 is high

2017-12-20 Thread Milan Das (JIRA)
[ https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299147#comment-16299147 ] Milan Das commented on NIFI-4715: - yes. Agree multi thread doesn't exist. Root cause is different. >

[jira] [Commented] (NIFI-4715) ListS3 list duplicate files when incoming file throughput to S3 is high

2017-12-20 Thread Joseph Witt (JIRA)
[ https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298534#comment-16298534 ] Joseph Witt commented on NIFI-4715: --- I'm not familiar enough with this specific processor but am

[jira] [Commented] (NIFI-4715) ListS3 list duplicate files when incoming file throughput to S3 is high

2017-12-20 Thread Milan Das (JIRA)
[ https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298529#comment-16298529 ] Milan Das commented on NIFI-4715: - [~joewitt] Now I am able to fix the bug using DetectDuplicate. But seems

[jira] [Commented] (NIFI-4715) ListS3 list duplicate files when incoming file throughput to S3 is high

2017-12-20 Thread Joseph Witt (JIRA)
[ https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298517#comment-16298517 ] Joseph Witt commented on NIFI-4715: --- i'm not questioning whether duplicate listings are possible. When

[jira] [Commented] (NIFI-4715) ListS3 list duplicate files when incoming file throughput to S3 is high

2017-12-20 Thread Milan Das (JIRA)
[ https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298478#comment-16298478 ] Milan Das commented on NIFI-4715: - Additional logs after enabling log4j on ListS3: AWS Last Modified Times

[jira] [Commented] (NIFI-4715) ListS3 list duplicate files when incoming file throughput to S3 is high

2017-12-20 Thread Milan Das (JIRA)
[ https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298473#comment-16298473 ] Milan Das commented on NIFI-4715: - [~joewitt] Steps to reproduce (I can reproduce and upload the fiow

[jira] [Commented] (NIFI-4715) ListS3 list duplicate files when incoming file throughput to S3 is high

2017-12-19 Thread Joseph Witt (JIRA)
[ https://issues.apache.org/jira/browse/NIFI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297848#comment-16297848 ] Joseph Witt commented on NIFI-4715: --- [~dmilan77] ListS3 is annotated with TriggerSerially. This means