[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13483196#comment-13483196
]
Hudson commented on YARN-140:
-
Integrated in Hadoop-Hdfs-trunk #1205 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1205/])
YARN-181. Fixed eclipse settings broken by capacity-scheduler.xml move via
YARN-140. Contributed by Siddharth Seth. (Revision 1401504)
Result = FAILURE
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1401504
Files :
*
/hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-yarn-dist.xml
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/conf/capacity-scheduler.xml
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/conf
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/conf/capacity-scheduler.xml
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/pom.xml
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Fix For: 2.0.3-alpha
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch,
YARN-140_rev6_onlyForJenkins.patch, YARN-140_rev6.patch,
YARN-140_rev7_onlyForJenkins.patch, YARN-140_rev8_onlyForJenkins.patch,
YARN-140_rev9.patch, YARN-140_rev9_svn_mv.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13483241#comment-13483241
]
Hudson commented on YARN-140:
-
Integrated in Hadoop-Mapreduce-trunk #1235 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1235/])
YARN-181. Fixed eclipse settings broken by capacity-scheduler.xml move via
YARN-140. Contributed by Siddharth Seth. (Revision 1401504)
Result = SUCCESS
vinodkv :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1401504
Files :
*
/hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-yarn-dist.xml
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/conf/capacity-scheduler.xml
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/conf
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/conf/capacity-scheduler.xml
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/pom.xml
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Fix For: 2.0.3-alpha
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch,
YARN-140_rev6_onlyForJenkins.patch, YARN-140_rev6.patch,
YARN-140_rev7_onlyForJenkins.patch, YARN-140_rev8_onlyForJenkins.patch,
YARN-140_rev9.patch, YARN-140_rev9_svn_mv.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13480740#comment-13480740
]
Hudson commented on YARN-140:
-
Integrated in Hadoop-Mapreduce-trunk #1231 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1231/])
YARN-140. Add capacity-scheduler-default.xml to provide a default set of
configurations for the capacity scheduler. (ahmed via tucu) (Revision 1400335)
Result = SUCCESS
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1400335
Files :
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/conf/capacity-scheduler.xml
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/pom.xml
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/resources/capacity-scheduler.xml
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacityScheduler.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestLeafQueue.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestParentQueue.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestQueueParsing.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySched.java
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Fix For: 2.0.3-alpha
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch,
YARN-140_rev6_onlyForJenkins.patch, YARN-140_rev6.patch,
YARN-140_rev7_onlyForJenkins.patch, YARN-140_rev8_onlyForJenkins.patch,
YARN-140_rev9.patch, YARN-140_rev9_svn_mv.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13480463#comment-13480463
]
Hadoop QA commented on YARN-140:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12550024/YARN-140_rev9.patch
against trunk revision .
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/103//console
This message is automatically generated.
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch,
YARN-140_rev6_onlyForJenkins.patch, YARN-140_rev6.patch,
YARN-140_rev7_onlyForJenkins.patch, YARN-140_rev8_onlyForJenkins.patch,
YARN-140_rev9.patch, YARN-140_rev9_svn_mv.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13480519#comment-13480519
]
Hudson commented on YARN-140:
-
Integrated in Hadoop-trunk-Commit #2901 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/2901/])
YARN-140. Add capacity-scheduler-default.xml to provide a default set of
configurations for the capacity scheduler. (ahmed via tucu) (Revision 1400335)
Result = SUCCESS
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1400335
Files :
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/conf/capacity-scheduler.xml
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/pom.xml
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/resources/capacity-scheduler.xml
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacityScheduler.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestLeafQueue.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestParentQueue.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestQueueParsing.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebApp.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySched.java
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Fix For: 2.0.3-alpha
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch,
YARN-140_rev6_onlyForJenkins.patch, YARN-140_rev6.patch,
YARN-140_rev7_onlyForJenkins.patch, YARN-140_rev8_onlyForJenkins.patch,
YARN-140_rev9.patch, YARN-140_rev9_svn_mv.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13479248#comment-13479248
]
Hadoop QA commented on YARN-140:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12549555/YARN-140_rev6_onlyForJenkins.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-common-project/hadoop-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestQueueParsing
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-YARN-Build/97//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/97//console
This message is automatically generated.
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch,
YARN-140_rev6_onlyForJenkins.patch, YARN-140_rev6.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13479271#comment-13479271
]
Ahmed Radwan commented on YARN-140:
---
I am looking into this test failure.
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch,
YARN-140_rev6_onlyForJenkins.patch, YARN-140_rev6.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13479363#comment-13479363
]
Ahmed Radwan commented on YARN-140:
---
Comment Race again. Thanks Vinod! I'll check that. Please ignore my latest
patch then.
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch,
YARN-140_rev6_onlyForJenkins.patch, YARN-140_rev6.patch,
YARN-140_rev7_onlyForJenkins.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13479428#comment-13479428
]
Hadoop QA commented on YARN-140:
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12549765/YARN-140_rev8_onlyForJenkins.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 7 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-YARN-Build/99//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/99//console
This message is automatically generated.
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch,
YARN-140_rev6_onlyForJenkins.patch, YARN-140_rev6.patch,
YARN-140_rev7_onlyForJenkins.patch, YARN-140_rev8_onlyForJenkins.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13479449#comment-13479449
]
Alejandro Abdelnur commented on YARN-140:
-
+1. Ahmed, would you please upload a script+patch based on the lastest patch?
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch,
YARN-140_rev6_onlyForJenkins.patch, YARN-140_rev6.patch,
YARN-140_rev7_onlyForJenkins.patch, YARN-140_rev8_onlyForJenkins.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478273#comment-13478273
]
Vinod Kumar Vavilapalli commented on YARN-140:
--
Comment race. So YARN-140_rev6_onlyForJenkins.patch is the correct patch?
YARN-140_rev6.patch doesn't apply on trunk for me.
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch,
YARN-140_rev6_onlyForJenkins.patch, YARN-140_rev6.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478280#comment-13478280
]
Ahmed Radwan commented on YARN-140:
---
Yes :) Thanks Vinod! YARN-140_rev6.patch requires the mv script to run before
it. YARN-140_rev6_onlyForJenkins.patch is the combined patch including the mv
then the patch changes.
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch,
YARN-140_rev6_onlyForJenkins.patch, YARN-140_rev6.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13472496#comment-13472496
]
Alejandro Abdelnur commented on YARN-140:
-
Ahmed, overall looks good, there is one last change I'd do, where you add the
check *if (capacity == UNDEFINED queue.equals(root))* it should be *if
(capacity == UNDEFINED || queue.equals(root))*, as for ROOT it should always
be 100.
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13472594#comment-13472594
]
Alejandro Abdelnur commented on YARN-140:
-
the thing is ... root.capacity is not a config property, that is why we removed
it from the c-s.xml. it should ALWAYS be 100, I'd use an OR and I'd invert the
order to check first for queue=='root'
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13470281#comment-13470281
]
Arun C Murthy commented on YARN-140:
Ahmed, thanks, this is close - some feedback:
bq. To return the queue root.default as a child for root if no children are
defined for root.
I wouldn't do this. If someone has not defined root.child.queues it is a
serious mis-configuration - let's error out (as it happens today) and not try
to 'guess'.
bq. To return a capacity of 100.0f for the queue root.default if it exists
but no capacity is specified for it.
Again, for same reason as above, this represents a serious mis-configuration
and I wouldn't try to 'guess' capacities - error out is the right answer.
One more nit: Rather than delete/add capacity-scheduler.xml let's just do an
'svn mv' to preserve history.
Furthermore, please add a test-case to TestCapacitySchedulerConf to test for
defaults.
It seems to me that the additional defaults are necessary only for unit tests -
in which case the correct fix is to make a copy of capacity-scheduler.xml into
a test/resources folder and get it on the classpath for our tests.
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13470601#comment-13470601
]
Ahmed Radwan commented on YARN-140:
---
Thanks Arun!
bq. It seems to me that the additional defaults are necessary only for unit
tests - in which case the correct fix is to make a copy of
capacity-scheduler.xml into a test/resources folder and get it on the classpath
for our tests.
Yes, those additional ones are only for tests. I'll move the xml to a
test/resources and have it in the classpath for tests per you recommendation.
bq. Furthermore, please add a test-case to TestCapacitySchedulerConf to test
for defaults.
The only remaining newly added default is the 100% capacity for root queue. I
already modified the TestCapapcityScheduler to verify that, and I'll check if
any other tests are needed.
I'll upload an updated version of the patch.
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13470909#comment-13470909
]
Hadoop QA commented on YARN-140:
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12548080/YARN-140_rev5_onlyForJenkins.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-YARN-Build/72//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/72//console
This message is automatically generated.
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch,
YARN-140_rev3.patch, YARN-140_rev4.patch, YARN-140_rev5_onlyForJenkins.patch,
YARN-140_rev5.patch, YARN-140_rev5_svn_mv.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13469735#comment-13469735
]
Alejandro Abdelnur commented on YARN-140:
-
Ahmed, looks good, the only NIT is that we should remove the ...root.capacity
entry from the c-s.xml as this is always 100; having it there would give the
impression to users that they can globally reduce the capacity to a percentage
of the total one, which is not true.
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13469832#comment-13469832
]
Alejandro Abdelnur commented on YARN-140:
-
+1 pending jenkins
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch, YARN-140_rev3.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13470012#comment-13470012
]
Hadoop QA commented on YARN-140:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12547845/YARN-140_rev3.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-common-project/hadoop-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestQueueParsing
org.apache.hadoop.yarn.server.resourcemanager.TestResourceManager
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationCleanup
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationACLs
org.apache.hadoop.yarn.server.resourcemanager.TestResourceTrackerService
org.apache.hadoop.yarn.server.resourcemanager.applicationsmanager.TestAMRMRPCNodeUpdates
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationMasterLauncher
org.apache.hadoop.yarn.server.resourcemanager.TestRM
org.apache.hadoop.yarn.server.resourcemanager.security.TestApplicationTokens
org.apache.hadoop.yarn.server.resourcemanager.applicationsmanager.TestAMRMRPCResponseId
org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization
org.apache.hadoop.yarn.server.resourcemanager.tools.TestGetGroups
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-YARN-Build/70//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/70//console
This message is automatically generated.
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch, YARN-140_rev2.patch, YARN-140_rev3.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-140) Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler.
[
https://issues.apache.org/jira/browse/YARN-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13467918#comment-13467918
]
Ahmed Radwan commented on YARN-140:
---
Thanks Arun, I have added more description in the comment above. The conf
exists in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/resources/capacity-scheduler.xml.
So my patch basically renames it to *-default.xml and modifies the
CapacitySchedulerConfiguration.java to load both. So now the
capacity-scheduler.xml resource (provide in the conf) complements the default
one. What do you think Arun?
Add capacity-scheduler-default.xml to provide a default set of configurations
for the capacity scheduler.
-
Key: YARN-140
URL: https://issues.apache.org/jira/browse/YARN-140
Project: Hadoop YARN
Issue Type: Bug
Components: capacityscheduler
Reporter: Ahmed Radwan
Assignee: Ahmed Radwan
Attachments: YARN-140.patch
When setting up the capacity scheduler users are faced with problems like:
{code}
FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
starting ResourceManager
java.lang.IllegalArgumentException: Illegal capacity of -1 for queue root
{code}
Which basically arises from missing basic configurations, which in many
cases, there is no need to explicitly provide, and a default configuration
will be sufficient. For example, to address the error above, the user need to
add a capacity of 100 to the root queue.
So, we need to add a capacity-scheduler-default.xml, this will be helpful to
provide the basic set of default configurations required to run the capacity
scheduler. The user can still override existing configurations or provide new
ones in capacity-scheduler.xml. This is similar to *-default.xml vs
*-site.xml for yarn, core, mapred, hdfs, etc.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
