[ 
https://issues.apache.org/jira/browse/NIFI-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15869630#comment-15869630
 ] 

ASF GitHub Bot commented on NIFI-3213:
--------------------------------------

Github user trixpan commented on the issue:

    https://github.com/apache/nifi/pull/1335
  
    @ijokarumawak my bad. I was just running a extra set of compilations and I 
noticed that under certain conditions there seems to be a race condition 
affecting 
    
    ```
    Tests run: 12, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 5.66 sec 
<<< FAILURE! - in org.apache.nifi.processors.standard.TestListFile
    testFilterAge(org.apache.nifi.processors.standard.TestListFile)  Time 
elapsed: 1.212 sec  <<< FAILURE!
    org.junit.ComparisonFailure: expected:<age[2].txt> but was:<age[1].txt>
        at org.junit.Assert.assertEquals(Assert.java:115)
        at org.junit.Assert.assertEquals(Assert.java:144)
        at 
org.apache.nifi.processors.standard.TestListFile.testFilterAge(TestListFile.java:223)
    
    ```
    
    Do you want to have a look at it?


> ListFile always skips files with the latest timestamp in an iteration even if 
> the files have existed a while ago
> ----------------------------------------------------------------------------------------------------------------
>
>                 Key: NIFI-3213
>                 URL: https://issues.apache.org/jira/browse/NIFI-3213
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>    Affects Versions: 1.0.0, 0.5.0, 0.6.0, 0.5.1, 0.7.0, 0.6.1, 1.1.0, 0.7.1
>            Reporter: Koji Kawamura
>            Assignee: Koji Kawamura
>
> NIFI-1484 add few lines of code to avoid files to be emitted if those have 
> the latest timestamp within an iteration of listing, because it may still be 
> written at the same time.
> While it doesn't affect much if ListFiles processor is scheduled with a short 
> period of time, such as few ms, but it does affect negatively if an user 
> scheduled it with longer run schedule such as "1 day" or with cron scheduler. 
> For example, user would expect to process list of files per daily basis. Even 
> if a file is saved few hours ago, the processor will skip this, because the 
> file has the latest timestamp within the iteration.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to