[
https://issues.apache.org/jira/browse/HDFS-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13494171#comment-13494171
]
Suresh Srinivas commented on HDFS-4161:
---------------------------------------
+1 for the change.
> HDFS keeps a thread open for every file writer
> ----------------------------------------------
>
> Key: HDFS-4161
> URL: https://issues.apache.org/jira/browse/HDFS-4161
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: hdfs client
> Affects Versions: 1.0.0
> Reporter: Suresh Srinivas
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: h4161_20121108_b-1.patch
>
>
> In 1.0 release DFSClient uses a thread per file writer. In some use cases
> (dynamic partions in hive) that use a large number of file writers a large
> number of threads are created. The file writer thread has the following stack:
> {noformat}
> at java.lang.Thread.sleep(Native Method)
> at org.apache.hadoop.hdfs.DFSClient$LeaseChecker.run(DFSClient.java:1462)
> at java.lang.Thread.run(Thread.java:662)
> {noformat}
> This problem has been fixed in later releases. This jira will post a
> consolidated patch from various jiras that addresses the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
