[
https://issues.apache.org/jira/browse/YARN-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17389977#comment-17389977
]
Szilard Nemeth commented on YARN-10663:
---------------------------------------
Hi [~ananyo_rao],
Thanks for working on this.
Latest patch LGTM, committed to trunk.
One side note:
Please set up your code formatter rules in your IDE, I fixed some formatting
issues like missing spaces after for/while loop expressions, indentation level
fixes for multi-line expressions and such kind of things.
If you would like to get help for the rules I can help you offline.
For reference, these were the checkstyle issues reported by Jenkins:
{code}
./hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/nodemanager/NMSimulator.java:274:
&& !getNode().getRunningApps().contains(applicationId)) {: '&&' has
incorrect indentation level 6, expected level should be 8. [Indentation]
./hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/nodemanager/NMSimulator.java:278:
"Updated runningApps on this node are: {}",: '"Updated runningApps on
this node are: {}"' has incorrect indentation level 6, expected level should be
8. [Indentation]
./hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/nodemanager/NMSimulator.java:279:
applicationId, getNode().getNodeID(), getNode().getRunningApps());:
'applicationId' has incorrect indentation level 6, expected level should be 8.
[Indentation]
./hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/nodemanager/NMSimulator.java:315:
applicationId, getNode().getNodeID(), getNode().getRunningApps());:
'applicationId' has incorrect indentation level 8, expected level should be 10.
[Indentation]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/appmaster/TestAMSimulator.java:308:
app.appId = ApplicationId.newInstance(0l, 1);:43: Should use uppercase 'L'.
[UpperEll]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:114:
node1.addNewContainer(container1, 100000l, null);:39: Should use uppercase
'L'. [UpperEll]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:122:
node1.addNewContainer(container2, -1l, null);:40: Should use uppercase 'L'.
[UpperEll]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:147:
rm, -1f);: 'rm' has incorrect indentation level 6, expected level should
be 8. [Indentation]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:160:
GenericTestUtils.waitFor(new
org.apache.hadoop.thirdparty.com.google.common.base.Supplier<Boolean>() {: Line
is longer than 100 characters (found 106). [LineLength]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:168:
node.getNode().getRunningApps().size(), 0);: 'node' has incorrect
indentation level 6, expected level should be 8. [Indentation]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:175:
Resources.createResource(GB, 1), null, null);: 'Resources' has incorrect
indentation level 6, expected level should be 8. [Indentation]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:176:
node.addNewContainer(container, 100000l, appId);:37: Should use uppercase
'L'. [UpperEll]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:179:
node.getNode().getRunningApps().contains(appId));: 'node' has incorrect
indentation level 6, expected level should be 8. [Indentation]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:187:
node.getNode().getRunningApps().size(), 0);: 'node' has incorrect
indentation level 6, expected level should be 8. [Indentation]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:195:
rm, -1f);: 'rm' has incorrect indentation level 6, expected level should
be 8. [Indentation]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:208:
GenericTestUtils.waitFor(new
org.apache.hadoop.thirdparty.com.google.common.base.Supplier<Boolean>() {: Line
is longer than 100 characters (found 106). [LineLength]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:216:
node.getNode().getRunningApps().size(), 0);: 'node' has incorrect
indentation level 6, expected level should be 8. [Indentation]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:221:
Resources.createResource(GB, 1), null, null);: 'Resources' has incorrect
indentation level 6, expected level should be 8. [Indentation]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:222:
node.addNewContainer(container, 100000l, null);:37: Should use uppercase
'L'. [UpperEll]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:224:
node.getNode().getRunningApps().size(), 0);: 'node' has incorrect
indentation level 6, expected level should be 8. [Indentation]
./hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java:230:
node.getNode().getRunningApps().size(), 0);: 'node' has incorrect
indentation level 6, expected level should be 8. [Indentation]
{code}
> Add runningApps stats in SLS
> ----------------------------
>
> Key: YARN-10663
> URL: https://issues.apache.org/jira/browse/YARN-10663
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: yarn
> Reporter: VADAGA ANANYO RAO
> Assignee: VADAGA ANANYO RAO
> Priority: Major
> Attachments: YARN-10663.0001.patch, YARN-10663.0002.patch
>
>
> RMNodes in SLS don't keep a track of runningApps on each node. Due to this,
> graceful decommissioning logic takes a hit as the nodes will decommission if
> there are no running containers on the node but some shuffle data was present
> on the node.
> In this Jira, we will add runningApps functionality in SLS for improving
> decommissioning logic of each node. This will help with autoscaling
> simulations on SLS.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
