[
https://issues.apache.org/jira/browse/SPARK-27941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shuheng Dai updated SPARK-27941:
--------------------------------
Description:
Public cloud providers have started offering serverless container services. For
example, AWS offers Fargate [https://aws.amazon.com/fargate/]
This opens up the possibility to run Spark workloads in a serverless manner.
Pluggable authentication
Pluggable scheduler
Pluggable shuffle storage and retrieval
Pluggable driver
was:
Public cloud providers have started offering serverless container services. For
example, AWS offers Fargate [https://aws.amazon.com/fargate/]
This opens up the possibility to run Spark workloads in a serverless manner.
Pluggable authentication
Pluggable scheduler
Pluggable shuffle storage and retrival
Pluggable driver
> Serverless Spark in the Cloud
> -----------------------------
>
> Key: SPARK-27941
> URL: https://issues.apache.org/jira/browse/SPARK-27941
> Project: Spark
> Issue Type: New Feature
> Components: Build, Deploy, Scheduler, Security, Shuffle, Spark Core
> Affects Versions: 3.0.0
> Reporter: Shuheng Dai
> Priority: Major
>
> Public cloud providers have started offering serverless container services.
> For example, AWS offers Fargate [https://aws.amazon.com/fargate/]
> This opens up the possibility to run Spark workloads in a serverless manner.
> Pluggable authentication
> Pluggable scheduler
> Pluggable shuffle storage and retrieval
> Pluggable driver
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
