[
https://issues.apache.org/jira/browse/HADOOP-18182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17519771#comment-17519771
]
Steve Loughran commented on HADOOP-18182:
-----------------------------------------
as long as the s3 object reference lifespan is > than that of the stream's use,
all is well.
when unbuffer() is called we would want to clean this all up. some long lived
apps (e.g impala) do that to let them hold onto streams without having to
reopen the files when they want to read on them in later queries/parts of the
same query.
> S3File to store reference to active S3Object in a field.
> --------------------------------------------------------
>
> Key: HADOOP-18182
> URL: https://issues.apache.org/jira/browse/HADOOP-18182
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.4.0
> Reporter: Steve Loughran
> Priority: Major
>
> HADOOP-17338 showed us how recent {{S3Object.finalize()}} can call
> stream.close() and so close an active stream if a GC happens during a read.
> replicate the same fix here.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
