[
https://issues.apache.org/jira/browse/HADOOP-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran reassigned HADOOP-18792:
---------------------------------------
Assignee: Steve Loughran
> s3a prefetching to use split start/end options to limit prefetch range
> ----------------------------------------------------------------------
>
> Key: HADOOP-18792
> URL: https://issues.apache.org/jira/browse/HADOOP-18792
> Project: Hadoop Common
> Issue Type: Sub-task
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
>
> the bundled hadoop record readers pass the split start/end down to openFile()
> -these can be used by the prefetching stream as hints as to where to start
> and stop prefetching.
> Hints only as
> * records can extend past split end; that last record will still be read when
> split end < EOF
> * for formats with footers which get read, caching that footer is important
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
