[
https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sunil G updated YARN-6788:
--------------------------
Attachment: YARN-6788-YARN-3926.001.patch
A first cut to improve performance and some cleanup.
Few early calls:
# Instead of a map to keep resource information, a simple array is used.
(faster iteration and access with given index)
# Resource Information Index is stored in a map which will help to access the
above mentioned array (Kept in ResourceUtils class as a static single point of
access)
# Performance is within 3% delta with trunk on various runs.
# In Resource class, there are few impls for SimpleResource. I also had an
offline talk with [~vvasudev]. May be its better to move all resource related
impl from ResourcePBImpl to Resource class itself and can keep only proto
related changes in PBImpl class. So SimpleResource could look into memory and
cpu resource info objects.
# For now, I am using {{tmpResource}} available in Resource class to get index.
Once an initial round of review is done and a confirmation on last point above,
I ll update the second patch.
cc/[~leftnoteasy] [~templedf] and [~vvasudev]
> Improve performance of resource profile branch
> ----------------------------------------------
>
> Key: YARN-6788
> URL: https://issues.apache.org/jira/browse/YARN-6788
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: nodemanager, resourcemanager
> Reporter: Sunil G
> Assignee: Sunil G
> Priority: Blocker
> Attachments: YARN-6788-YARN-3926.001.patch
>
>
> Currently we could see a 15% performance delta with this branch.
> Few performance improvements to improve the same.
> Also this patch will handle
> [comments|https://issues.apache.org/jira/browse/YARN-6761?focusedCommentId=16075418&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16075418]
> from [~leftnoteasy].
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
