[
https://issues.apache.org/jira/browse/SPARK-36057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang updated SPARK-36057:
--------------------------------
Description:
This is an umbrella issue for tracking the work for supporting Volcano &
Yunikorn on Kubernetes. These schedulers provide more YARN like features (such
as queues and minimum resources before scheduling jobs) that many folks want on
Kubernetes.
Yunikorn is an ASF project & Volcano is a CNCF project (sig-batch).
They've taken slightly different approaches to solving the same problem, but
from Spark's point of view we should be able to share much of the code.
See the initial brainstorming discussion in SPARK-35623.
DISCUSSION: [https://lists.apache.org/thread/zv3o62xrob4dvgkbftbv5w5wy75hkbxg]
VOTE: [https://lists.apache.org/thread/cz3cpp8q4pgmh7h35h6lvkwf6g3lwhcd]
VOTE Result: [https://lists.apache.org/thread/nvwfo0yo0q8997vs86o7wkjyby4tbp0m]
Design DOC:
[https://docs.google.com/document/d/1xgQGRpaHQX6-QH_J9YV2C2Dh6RpXefUpLM7KGkzL6Fg]
Recap slide: [https://lists.apache.org/thread/mwswfwkycj71npwz8gmv1r5nrvpwj77s]
was:
This is an umbrella issue for tracking the work for supporting Volcano &
Yunikorn on Kubernetes. These schedulers provide more YARN like features (such
as queues and minimum resources before scheduling jobs) that many folks want on
Kubernetes.
Yunikorn is an ASF project & Volcano is a CNCF project (sig-batch).
They've taken slightly different approaches to solving the same problem, but
from Spark's point of view we should be able to share much of the code.
See the initial brainstorming discussion in SPARK-35623.
Google DOC:
[https://docs.google.com/document/d/1xgQGRpaHQX6-QH_J9YV2C2Dh6RpXefUpLM7KGkzL6Fg]
> Support Customized Kubernetes Schedulers
> ----------------------------------------
>
> Key: SPARK-36057
> URL: https://issues.apache.org/jira/browse/SPARK-36057
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 3.3.0
> Reporter: Holden Karau
> Priority: Major
>
> This is an umbrella issue for tracking the work for supporting Volcano &
> Yunikorn on Kubernetes. These schedulers provide more YARN like features
> (such as queues and minimum resources before scheduling jobs) that many folks
> want on Kubernetes.
>
> Yunikorn is an ASF project & Volcano is a CNCF project (sig-batch).
>
> They've taken slightly different approaches to solving the same problem, but
> from Spark's point of view we should be able to share much of the code.
>
> See the initial brainstorming discussion in SPARK-35623.
>
> DISCUSSION: [https://lists.apache.org/thread/zv3o62xrob4dvgkbftbv5w5wy75hkbxg]
> VOTE: [https://lists.apache.org/thread/cz3cpp8q4pgmh7h35h6lvkwf6g3lwhcd]
> VOTE Result:
> [https://lists.apache.org/thread/nvwfo0yo0q8997vs86o7wkjyby4tbp0m]
> Design DOC:
> [https://docs.google.com/document/d/1xgQGRpaHQX6-QH_J9YV2C2Dh6RpXefUpLM7KGkzL6Fg]
> Recap slide:
> [https://lists.apache.org/thread/mwswfwkycj71npwz8gmv1r5nrvpwj77s]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
