[
https://issues.apache.org/jira/browse/HDFS-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yongtao Yang updated HDFS-9641:
-------------------------------
Description: when writing a file, an {{IOException}} may be raised in
{{DFSOutputStream.DataStreamer.run()}}, then '{{streamerClosed}}' may be set to
{{true}}, then {{closeInternal()}} will be invoked, where
{{DFSOutputStream.closed}} will be set to be {{true}}. That is to say,
'{{closed}}' is true before {{DFSOutputStream.close()}} is invoked, then
{{dfsClient.endFileLease(fileId)}} will not be executed. The references of the
{{DFSOutputStream}} objects will still be hold in
{{DFSClient.filesBeingWritten}} untill the client quits. The related resources
will not be released. HDFS-4504 is a related issue. (was: when writing a file,
an {{IOException}} may be raised in DFSOutputStream.DataStreamer.run(), then
'streamerClosed' may be set to true, then closeInternal() will be invoked,
where DFSOutputStream.closed will be set to be true. That is to say, 'closed'
is true before DFSOutputStream.close() is invoked, then
dfsClient.endFileLease(fileId) will not be executed. The references of the
DFSOutputStream objects will still be hold in DFSClient.filesBeingWritten
untill the client quits. The related resources will not be released. HDFS-4504
is a related issue.)
> IOException in hdfs write process causes file leases not released
> -----------------------------------------------------------------
>
> Key: HDFS-9641
> URL: https://issues.apache.org/jira/browse/HDFS-9641
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: hdfs-client
> Affects Versions: 2.6.0, 2.6.1, 2.6.2, 2.6.3
> Environment: hadoop 2.6.0,
> Reporter: Yongtao Yang
>
> when writing a file, an {{IOException}} may be raised in
> {{DFSOutputStream.DataStreamer.run()}}, then '{{streamerClosed}}' may be set
> to {{true}}, then {{closeInternal()}} will be invoked, where
> {{DFSOutputStream.closed}} will be set to be {{true}}. That is to say,
> '{{closed}}' is true before {{DFSOutputStream.close()}} is invoked, then
> {{dfsClient.endFileLease(fileId)}} will not be executed. The references of
> the {{DFSOutputStream}} objects will still be hold in
> {{DFSClient.filesBeingWritten}} untill the client quits. The related
> resources will not be released. HDFS-4504 is a related issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
