[ https://issues.apache.org/jira/browse/YARN-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daryn Sharp updated YARN-6679: ------------------------------ Attachment: YARN-6679.trunk.patch # Add private {{SimpleResource}} object with longs for memory/vcores. # {{ResourcePBImpl#getProto(Resource)}} converts to a PBImpl as necessary to create a message # Bulk of patch is regexp change of {{(ResourcePBImpl) r).getProto()}} to {{ProtoUtils.convertToProtoFormat(r)}} or the local class conversion method. # In a few places, just set the PB instead of creating and checking equality before setting. Otherwise simple resources will be double converted. Overall effect is resources via PBs will remain PB-based. The myriad of internal resource instances used during calculations become lightweight and converted to a PB iff necessary. > Reduce Resource instance overhead via non-PBImpl > ------------------------------------------------ > > Key: YARN-6679 > URL: https://issues.apache.org/jira/browse/YARN-6679 > Project: Hadoop YARN > Issue Type: Sub-task > Components: resourcemanager > Affects Versions: 2.8.0 > Reporter: Daryn Sharp > Assignee: Daryn Sharp > Attachments: YARN-6679.trunk.patch > > > Creating and using transient PB-based Resource instances during scheduling is > very expensive. The overhead can be transparently reduced by internally > using lightweight non-PB based instances. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org