[
https://issues.apache.org/jira/browse/HADOOP-18221?focusedWorklogId=767903&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767903
]
ASF GitHub Bot logged work on HADOOP-18221:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 09/May/22 13:13
Start Date: 09/May/22 13:13
Worklog Time Spent: 10m
Work Description: ahmarsuhail opened a new pull request, #4294:
URL: https://github.com/apache/hadoop/pull/4294
### Description of PR
If close the prefetching input stream before prefetched blocks have finished
reading the S3 input stream, the sdk repeatedly complains "Not all bytes were
read from the S3ObjectInputStream". This happened on `S3AInputStream` as well,
see [this](https://github.com/aws/aws-sdk-java/issues/1211) issue for more
details.
Closing the stream before draining it will abort the connection, so to
allow for connection reuse we drain it asynchronously.
### How was this patch tested?
Tested in eu-west-1 by running
`mvn -Dparallel-tests -DtestsThreadCount=16 clean verify`
Issue Time Tracking
-------------------
Worklog Id: (was: 767903)
Remaining Estimate: 0h
Time Spent: 10m
> stream warns Not all bytes were read from the S3ObjectInputStream when closed
> -----------------------------------------------------------------------------
>
> Key: HADOOP-18221
> URL: https://issues.apache.org/jira/browse/HADOOP-18221
> Project: Hadoop Common
> Issue Type: Sub-task
> Reporter: Ahmar Suhail
> Assignee: Ahmar Suhail
> Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Issue: [https://github.com/aws/aws-sdk-java/issues/1211] has resurfaced in
> the prefetching stream when it is closed before reading for blocks is
> complete. This can be fixed by draining the stream before closingÂ
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
