[ 
https://issues.apache.org/jira/browse/YARN-8315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479673#comment-16479673
 ] 

Eric Yang edited comment on YARN-8315 at 5/17/18 9:37 PM:
----------------------------------------------------------

[~hlhu...@us.ibm.com] Apache Hadoop community is not responsible for HDP 
issues.  However, I would suggest to look at the following configuration for 
yarn-site.xml:

{code}
<property>
    <name>yarn.scheduler.capacity.schedule-asynchronously.enable</name>
    <value>true</value>
  </property>
{code}

In addition to that, Hadoop 2.9.0/3.0.0 Yarn support specify multiple thread 
(by default is 1) to allocate containers.

{code}
  <property>
    <name>yarn.scheduler.capacity.schedule-asynchronously.maximum-threads</name>
    <value>4</value>
  </property>
{code}

If the threads to schedule container is set to 1 or not enabled, it may cause 
delay on container scheduling.


was (Author: eyang):
[~hlhu...@us.ibm.com] Apache Hadoop community is not responsible for HDP 
issues.  However, I would suggest to look at the following configuration for 
yarn-site.xml:

{code}
<property>
    <name>yarn.scheduler.capacity.schedule-asynchronously.enable</name>
    <value>true</value>
  </property>
{code}

In addition to that, the 2.9.0/3.0.0 Yarn support specify multiple thread (by 
default is 1) to allocate containers.

{code}
  <property>
    <name>yarn.scheduler.capacity.schedule-asynchronously.maximum-threads</name>
    <value>4</value>
  </property>
{code}

If the threads to schedule container is set to 1 or not enabled, it may cause 
delay on container scheduling.

> HDP 3.0.0 perfromance is slower than HDP 2.6.4
> ----------------------------------------------
>
>                 Key: YARN-8315
>                 URL: https://issues.apache.org/jira/browse/YARN-8315
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: yarn
>    Affects Versions: 3.0.0
>         Environment: I have a HDP 2.6.4 cluster and HDP 3.0.0 cluster,  I set 
> up to have the same settings for these two cluster such as java heap size, 
> container size etc.  They are both 4 node cluster with 3 data nodes.   I took 
> almost all the default setting on HDP 3.0.0 except that I modify the minimum 
> container size to 64MB instead of 1024MB in both cluster.  
>  
>            Reporter: Hsin-Liang Huang
>            Priority: Major
>
> I can't find the button to delete this, so I just removed the text to avoid 
> sensitive information in the previous posting. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

Reply via email to