[
https://issues.apache.org/jira/browse/YARN-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp updated YARN-6679:
------------------------------
Attachment: YARN-6679.trunk.patch
# Add private {{SimpleResource}} object with longs for memory/vcores.
# {{ResourcePBImpl#getProto(Resource)}} converts to a PBImpl as necessary to
create a message
# Bulk of patch is regexp change of {{(ResourcePBImpl) r).getProto()}} to
{{ProtoUtils.convertToProtoFormat(r)}} or the local class conversion method.
# In a few places, just set the PB instead of creating and checking equality
before setting. Otherwise simple resources will be double converted.
Overall effect is resources via PBs will remain PB-based. The myriad of
internal resource instances used during calculations become lightweight and
converted to a PB iff necessary.
> Reduce Resource instance overhead via non-PBImpl
> ------------------------------------------------
>
> Key: YARN-6679
> URL: https://issues.apache.org/jira/browse/YARN-6679
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: resourcemanager
> Affects Versions: 2.8.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Attachments: YARN-6679.trunk.patch
>
>
> Creating and using transient PB-based Resource instances during scheduling is
> very expensive. The overhead can be transparently reduced by internally
> using lightweight non-PB based instances.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
