[
https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263893#comment-15263893
]
Bibin A Chundatt commented on YARN-4844:
----------------------------------------
[~leftnoteasy]
IIUC SLS udpate also is required
{noformat}
------------------------------------------------------------------------
BUILD FAILURE
------------------------------------------------------------------------
Total time: 3:11.802s
Finished at: Fri Apr 29 18:44:53 GMT+08:00 2016
Final Memory: 197M/616M
------------------------------------------------------------------------
] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on
project hadoop-sls: Compilation failure: Compilation failure:
]
/D:/Hadoop/trunk/hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java:[516,56]
incompatible types: long cannot be converted to java.lang.Integer
]
/D:/Hadoop/trunk/hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java:[528,66]
incompatible types: long cannot be converted to java.lang.Integer
]
/D:/Hadoop/trunk/hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java:[540,56]
incompatible types: long cannot be converted to java.lang.Integer
]
/D:/Hadoop/trunk/hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java:[552,66]
incompatible types: long cannot be converted to java.lang.Integer
]
/D:/Hadoop/trunk/hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/ResourceSchedulerWrapper.java:[539,66]
incompatible types: long cannot be converted to java.lang.Integer
]
/D:/Hadoop/trunk/hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/ResourceSchedulerWrapper.java:[551,76]
incompatible types: long cannot be converted to java.lang.Integer
]
/D:/Hadoop/trunk/hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/ResourceSchedulerWrapper.java:[563,66]
incompatible types: long cannot be converted to java.lang.Integer
]
/D:/Hadoop/trunk/hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/ResourceSchedulerWrapper.java:[575,76]
incompatible types: long cannot be converted to java.lang.Integer
{noformat}
> Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource
> --------------------------------------------------------------------
>
> Key: YARN-4844
> URL: https://issues.apache.org/jira/browse/YARN-4844
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: api
> Reporter: Wangda Tan
> Assignee: Wangda Tan
> Priority: Blocker
> Attachments: YARN-4844.1.patch, YARN-4844.2.patch, YARN-4844.3.patch
>
>
> We use int32 for memory now, if a cluster has 10k nodes, each node has 210G
> memory, we will get a negative total cluster memory.
> And another case that easier overflows int32 is: we added all pending
> resources of running apps to cluster's total pending resources. If a
> problematic app requires too much resources (let's say 1M+ containers, each
> of them has 3G containers), int32 will be not enough.
> Even if we can cap each app's pending request, we cannot handle the case that
> there're many running apps, each of them has capped but still significant
> numbers of pending resources.
> So we may possibly need to add getMemoryLong/getVirtualCoreLong to
> o.a.h.y.api.records.Resource.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
