Steve Loughran created HADOOP-14736:
---------------------------------------
Summary: S3AInputStream to implement an efficient skip() call
through seeking
Key: HADOOP-14736
URL: https://issues.apache.org/jira/browse/HADOOP-14736
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/s3
Reporter: Steve Loughran
Priority: Minor
{{S3AInputStream}} implements skip() naively through the byte class: Reading
and discarding all data. Efficient on classic "sequential" reads, provided the
forward skip is <1MB. For larger skip values or on random IO, seek() should be
used.
After some range checks/handling past-EOF skips to seek (EOF-1), a seek()
should handle the skip file.
*there are no FS contract tests for skip semantics*
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
