[ 
https://issues.apache.org/jira/browse/HDFS-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16397738#comment-16397738
 ] 

Erik Krogen commented on HDFS-13265:
------------------------------------

Attaching v000 patch (trunk & branch-2) which incorporates HDFS-13272 and 
HADOOP-15311, and it sets lowered values (including reducing default number of 
storages to 1 from 2 because there are a number of threads which are started 
per-storage) for _all_ MiniDFSClusters. Mainly just want to get a Jenkins run 
to see if this improves things, and also see how many tests break... 

> MiniDFSCluster should set reasonable defaults to reduce resource consumption
> ----------------------------------------------------------------------------
>
>                 Key: HDFS-13265
>                 URL: https://issues.apache.org/jira/browse/HDFS-13265
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode, namenode, test
>            Reporter: Erik Krogen
>            Assignee: Erik Krogen
>            Priority: Major
>         Attachments: HDFS-13265-branch-2.000.patch, HDFS-13265.000.patch, 
> TestMiniDFSClusterThreads.java
>
>
> MiniDFSCluster takes its defaults from {{DFSConfigKeys}} defaults, but many 
> of these are not suitable for a unit test environment. For example, the 
> default handler thread count of 10 is definitely more than necessary for 
> (almost?) any unit test. We should set reasonable, lower defaults unless a 
> test specifically requires more.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to