[
https://issues.apache.org/jira/browse/LIVY-890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dexter Hu updated LIVY-890:
---------------------------
Description:
Currently, session restore is only supported for YARN, according to
[https://github.com/apache/incubator-livy/blob/4d8a912699683b973eee76d4e91447d769a0cb0d/server/src/main/scala/org/apache/livy/server/LivyServer.scala#L419]
Since *Serverless* Apache Spark service running on *OKE* (Oracle OCI), *EKS*
(AWS), *GKE* (GCP), *AKS* (Azure) are getting more popular as a cost-effective
alternative than YARN, it is needed to support session restore for k8s for both
batch and interactive sessions.
was:
Currently, session restore is only supported for YARN, according to
[https://github.com/apache/incubator-livy/blob/4d8a912699683b973eee76d4e91447d769a0cb0d/server/src/main/scala/org/apache/livy/server/LivyServer.scala#L419]
Since serverless Apache Spark running on OKE (Oracle OCI), EKS (AWS), GKE
(GCP), AKS (Azure) is getting more popular as a cost-effective alternative than
YARN, it is needed to support session restore for k8s for both batch and
interactive sessions.
> Support Livy session restore for k8s
> ------------------------------------
>
> Key: LIVY-890
> URL: https://issues.apache.org/jira/browse/LIVY-890
> Project: Livy
> Issue Type: Improvement
> Reporter: Dexter Hu
> Priority: Major
>
> Currently, session restore is only supported for YARN, according to
> [https://github.com/apache/incubator-livy/blob/4d8a912699683b973eee76d4e91447d769a0cb0d/server/src/main/scala/org/apache/livy/server/LivyServer.scala#L419]
> Since *Serverless* Apache Spark service running on *OKE* (Oracle OCI), *EKS*
> (AWS), *GKE* (GCP), *AKS* (Azure) are getting more popular as a
> cost-effective alternative than YARN, it is needed to support session restore
> for k8s for both batch and interactive sessions.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)