Juan Pedro commented on MYRIAD-12:

Hi. Other ideas:

- Option to limit the scaling according to the time (window for batch jobs).
- Scale by zones, according to constraints, where long-lived processes may not 
need resources (night time).
- Scale on certain nodes, scaling nodes (according to constraints), where the 
need for resources varies depending on the time or workload.

> Implement auto scaling
> ----------------------
>                 Key: MYRIAD-12
>                 URL: https://issues.apache.org/jira/browse/MYRIAD-12
>             Project: Myriad
>          Issue Type: Improvement
>            Reporter: Santosh Marella
>            Assignee: Santosh Marella
> - Pluggable criteria to detect "YARN starvation".. some ideas:
>   - if all NMs are full and more than X number of resource requests waiting 
> in the queue
>   - if all NMs are full and more than Y number of apps are waiting in the 
> queue    
> - How to scale? i.e. "how many" NM instances are required to bring down the 
> starvation
>   -  "detect the extent of starvation" by querying the resource requests in 
> the pipieline and scale up accordingly

This message was sent by Atlassian JIRA

Reply via email to