[
https://issues.apache.org/jira/browse/HDFS-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13133865#comment-13133865
]
Uma Maheswara Rao G commented on HDFS-2494:
-------------------------------------------
In DatanodeWebHdfsMethods.java,
Looks we are using the DFSInputStream in StreamingOutput#write method
{code}
final StreamingOutput streaming = new StreamingOutput() {
@Override
public void write(final OutputStream out) throws IOException {
final Long n = length.getValue();
if (n == null) {
IOUtils.copyBytes(in, out, b);
} else {
IOUtils.copyBytes(in, out, n, false);
}
}
};
{code}
Here we dont have the handle to clean them and the invokation of this write API
will come from the provider latter. So, we can not clean it before return in
get api.
Since the complete content flush is happening from IOUtils.copyBytes, one work
around would be to clen them in write method itself. But i am not sure this
approach is correct in this case.
Thanks
Uma
> [webhdfs] When Getting the file using OP=OPEN with DN http address,
> ESTABLISHED sockets are growing.
> ----------------------------------------------------------------------------------------------------
>
> Key: HDFS-2494
> URL: https://issues.apache.org/jira/browse/HDFS-2494
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.24.0
> Reporter: Uma Maheswara Rao G
> Assignee: Uma Maheswara Rao G
>
> As part of the reliable test,
> Scenario:
> Initially check the socket count. ---there are aroud 42 sockets are there.
> open the file with DataNode http address using op=OPEN request parameter
> about 500 times in loop.
> Wait for some time and check the socket count. --- There are thousands of
> ESTABLISHED sockets are growing. ~2052
> Here is the netstat result:
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> This count is not coming down.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
