[ 
https://issues.apache.org/jira/browse/LIVY-890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dexter Hu updated LIVY-890:
---------------------------
    Description: 
Currently, session restore is only supported for YARN, according to

[https://github.com/apache/incubator-livy/blob/4d8a912699683b973eee76d4e91447d769a0cb0d/server/src/main/scala/org/apache/livy/server/LivyServer.scala#L419]

 

Since serverless Apache Spark running on EKS (AWS), GKE (GCP), OKE (Oracle OCI) 
is getting more popular as a cost-effective alternative than YARN, it is needed 
to support session restore for k8s for both batch and interactive sessions.  

  was:
Currently, session restore is only supported for YARN, according to

[https://github.com/apache/incubator-livy/blob/4d8a912699683b973eee76d4e91447d769a0cb0d/server/src/main/scala/org/apache/livy/server/LivyServer.scala#L419]

 

Since serverless Apache Spark running on EKS, GKS, OKE is getting more popular 
as a cost-effective alternative than YARN, it is needed to support session 
restore for k8s for both batch and interactive sessions.  


> Support Livy session restore for k8s
> ------------------------------------
>
>                 Key: LIVY-890
>                 URL: https://issues.apache.org/jira/browse/LIVY-890
>             Project: Livy
>          Issue Type: Improvement
>            Reporter: Dexter Hu
>            Priority: Major
>
> Currently, session restore is only supported for YARN, according to
> [https://github.com/apache/incubator-livy/blob/4d8a912699683b973eee76d4e91447d769a0cb0d/server/src/main/scala/org/apache/livy/server/LivyServer.scala#L419]
>  
> Since serverless Apache Spark running on EKS (AWS), GKE (GCP), OKE (Oracle 
> OCI) is getting more popular as a cost-effective alternative than YARN, it is 
> needed to support session restore for k8s for both batch and interactive 
> sessions.  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

Reply via email to