[ 
https://issues.apache.org/jira/browse/APEXMALHAR-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chandni Singh updated APEXMALHAR-1600:
--------------------------------------
    Assignee:     (was: Chandni Singh)

> Investigate if we can seek efficiently to the correct location when we 
> restart after failure for ftp and fs scan operators
> --------------------------------------------------------------------------------------------------------------------------
>
>                 Key: APEXMALHAR-1600
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-1600
>             Project: Apache Apex Malhar
>          Issue Type: Improvement
>            Reporter: Pramod Immaneni
>
> Currently when the fs scan operator fails and restarts it seeks to the 
> starting location by asking for the previous entries and discarding them. Can 
> this be done in a more efficient manner in a case-by-case basis, for example 
> a sub class of the operator can keep a count of the file read offset after 
> returning an entry and that can be used to seek directly to checkpointed 
> offset.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to