Vinod Kumar Vavilapalli created YARN-9548:
---------------------------------------------
Summary: [Umbrella] Make YARN work well in elastic cloud
environments
Key: YARN-9548
URL: https://issues.apache.org/jira/browse/YARN-9548
Project: Hadoop YARN
Issue Type: New Feature
Reporter: Vinod Kumar Vavilapalli
YARN works well in static environments but there isn't fundamentally broken in
YARN to stop us from making it work well in dynamic environments like cloud
(public or private) as well.
There are few areas where we need to invest though
# Autoscaling
-- cluster level: add/remove nodes intelligently based on metrics and/or admin
plugins
-- node level: scale nodes up/down vertically?
# Smarter scheduling
-- to pack containers as opposed to spreading them around to account for
nodes going away
-- to account for speculative nodes like spot instances
# Handling nodes going away better
-- by decommissioning sanely
-- dealing with auxiliary services data
# And any installation helpers in this dynamic world - scripts, operators etc.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
