[ 
https://issues.apache.org/jira/browse/FLINK-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649327#comment-16649327
 ] 

ouyangzhe commented on FLINK-10534:
-----------------------------------

 [~gjy] ,  If I want to get job result back or run multi jobs in main method 
like shown below, detach mode is not suitable, 
{code:java}
xxx = resultDataSet.collect();
// use xxx to do something then sumbit another job 
env.execute("test");{code}
now, A session cluster will be started for this case, in CliFrontend.java:
{code:java}
final ClusterSpecification clusterSpecification = 
customCommandLine.getClusterSpecification(commandLine);
client = clusterDescriptor.deploySessionCluster(clusterSpecification);
{code}
the session cluster may not be shut down if user's main process killed, and 
will always be running in the yarn cluster.

> Add idle timeout for a flink session cluster
> --------------------------------------------
>
>                 Key: FLINK-10534
>                 URL: https://issues.apache.org/jira/browse/FLINK-10534
>             Project: Flink
>          Issue Type: New Feature
>          Components: Cluster Management
>    Affects Versions: 1.7.0
>            Reporter: ouyangzhe
>            Assignee: ouyangzhe
>            Priority: Major
>         Attachments: 屏幕快照 2018-10-12 上午10.24.08.png
>
>
> The flink session cluster on yarn will aways be running while has no jobs 
> running at all, it will occupy the yarn resources for no use.
> Taskmanagers will be released after an idle timeout, but jobmanager will keep 
> running.
> I propose to add a configuration to limit the idle timeout for jobmanager 
> too, if no job running after a specified timeout, the flink cluster auto 
> finish itself.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to