[
https://issues.apache.org/jira/browse/YARN-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796705#comment-15796705
]
Arun Suresh commented on YARN-6041:
-----------------------------------
Thanks for taking a look [~kasha],
bq. Assuming MRJobConfig. MR_NUM_OPPORTUNISTIC_MAPS_PER_100 was not part of any
release. Can you confirm the same?
I confirm this hasn't seen light of day in any previous release :)
bq. Assuming the incompatible proto changes to yarn_server_common_protos and
yarn_server_common_service_protos are okay because the previous versions didn't
make it to a release. Can you confirm the same?
Ditto..
bq. Nit: For scheduler-related configs, should we use yarn.scheduler.* like
other scheduler configs? And, yarn.nodemanager.* for all node-specific
opportunistic container configs? Making sure the configs are consistent and
simple is a good exercise before we include these in a release.
Hmm... I guess you are referring to YARN-5646. Looks like the patch was
modified to incorporate your suggestions wrt the parameter names. Also, since
this doesn't affect the scheduler per se.. the RM side changes are all
yarn.resourcemanager.* and the nodemanager ones are yarn.nodemanager.*
Good catch on the method names... will update patch shortly
> Opportunistic containers : Combined patch for branch-2
> -------------------------------------------------------
>
> Key: YARN-6041
> URL: https://issues.apache.org/jira/browse/YARN-6041
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Arun Suresh
> Assignee: Arun Suresh
> Attachments: YARN-6041-branch-2.001.patch,
> YARN-6041-branch-2.002.patch
>
>
> This is a combined patch targeting branch-2 of the following JIRAs which have
> already been committed to trunk :
> YARN-5938. Refactoring OpportunisticContainerAllocator to use
> SchedulerRequestKey instead of Priority and other misc fixes
> YARN-5646. Add documentation and update config parameter names for scheduling
> of OPPORTUNISTIC containers.
> YARN-5982. Simplify opportunistic container parameters and metrics.
> YARN-5918. Handle Opportunistic scheduling allocate request failure when NM
> is lost.
> YARN-4597. Introduce ContainerScheduler and a SCHEDULED state to NodeManager
> container lifecycle.
> YARN-5823. Update NMTokens in case of requests with only opportunistic
> containers.
> YARN-5377. Fix
> TestQueuingContainerManager.testKillMultipleOpportunisticContainers.
> YARN-2995. Enhance UI to show cluster resource utilization of various
> container Execution types.
> YARN-5799. Fix Opportunistic Allocation to set the correct value of Node Http
> Address.
> YARN-5486. Update OpportunisticContainerAllocatorAMService::allocate method
> to handle OPPORTUNISTIC container requests.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
