Takanobu Asanuma created HDFS-16068:
---------------------------------------
Summary: WebHdfsFileSystem has a possible connection leak in
connection with HttpFS
Key: HDFS-16068
URL: https://issues.apache.org/jira/browse/HDFS-16068
Project: Hadoop HDFS
Issue Type: Bug
Reporter: Takanobu Asanuma
Assignee: Takanobu Asanuma
When we use WebHdfsFileSystem for HttpFS, some connections remain for a while
after the filesystems are closed until GC runs. After investigating it for a
while, I found that there is a potential connection leak in WebHdfsFileSystem.
{code:java}
// Close both the InputStream and the connection.
@VisibleForTesting
void closeInputStream(RunnerState rs) throws IOException {
if (in != null) {
IOUtils.close(cachedConnection);
in = null;
}
cachedConnection = null;
runnerState = rs;
}
{code}
In the above code, if the variable of {{in}} is null and {{cachedConnection}}
is not null, {{cachedConnection}} doesn't close and the connection remains. I
think this is the cause of our problem.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
