[ https://issues.apache.org/jira/browse/APEXMALHAR-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chandni Singh updated APEXMALHAR-1600: -------------------------------------- Assignee: (was: Chandni Singh) > Investigate if we can seek efficiently to the correct location when we > restart after failure for ftp and fs scan operators > -------------------------------------------------------------------------------------------------------------------------- > > Key: APEXMALHAR-1600 > URL: https://issues.apache.org/jira/browse/APEXMALHAR-1600 > Project: Apache Apex Malhar > Issue Type: Improvement > Reporter: Pramod Immaneni > > Currently when the fs scan operator fails and restarts it seeks to the > starting location by asking for the previous entries and discarding them. Can > this be done in a more efficient manner in a case-by-case basis, for example > a sub class of the operator can keep a count of the file read offset after > returning an entry and that can be used to seek directly to checkpointed > offset. -- This message was sent by Atlassian JIRA (v6.3.4#6332)