Suresh Srinivas created HDFS-4161:
-------------------------------------
Summary: HDFS keeps a thread open for every file writer
Key: HDFS-4161
URL: https://issues.apache.org/jira/browse/HDFS-4161
Project: Hadoop HDFS
Issue Type: Bug
Components: hdfs client
Affects Versions: 1.0.0
Reporter: Suresh Srinivas
In 1.0 release DFSClient uses a thread per file writer. In some use cases
(dynamic partions in hive) that use a large number of file writers a large
number of threads are created. The file writer thread has the following stack:
{noformat}
at java.lang.Thread.sleep(Native Method)
at org.apache.hadoop.hdfs.DFSClient$LeaseChecker.run(DFSClient.java:1462)
at java.lang.Thread.run(Thread.java:662)
{noformat}
This problem has been fixed in later releases. This jira will post a
consolidated patch from various jiras that addresses the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
