[
https://issues.apache.org/jira/browse/YARN-9548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16911071#comment-16911071
]
zhoukang commented on YARN-9548:
--------------------------------
Great! We will also work on this at xiaomi
> [Umbrella] Make YARN work well in elastic cloud environments
> ------------------------------------------------------------
>
> Key: YARN-9548
> URL: https://issues.apache.org/jira/browse/YARN-9548
> Project: Hadoop YARN
> Issue Type: New Feature
> Reporter: Vinod Kumar Vavilapalli
> Priority: Major
>
> YARN works well in static environments but there isn't fundamentally broken
> in YARN to stop us from making it work well in dynamic environments like
> cloud (public or private) as well.
> There are few areas where we need to invest though
> # Autoscaling
> -- cluster level: add/remove nodes intelligently based on metrics and/or
> admin plugins
> -- node level: scale nodes up/down vertically?
> # Smarter scheduling
> -- to pack containers as opposed to spreading them around to account for
> nodes going away
> -- to account for speculative nodes like spot instances
> # Handling nodes going away better
> -- by decommissioning sanely
> -- dealing with auxiliary services data
> # And any installation helpers in this dynamic world - scripts, operators
> etc.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
