[jira] [Commented] (FLINK-6594) Implement Flink Dispatcher for Kubernetes
[ https://issues.apache.org/jira/browse/FLINK-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16404641#comment-16404641 ] Stavros Kontopoulos commented on FLINK-6594: Sure will do [~till.rohrmann] > Implement Flink Dispatcher for Kubernetes > - > > Key: FLINK-6594 > URL: https://issues.apache.org/jira/browse/FLINK-6594 > Project: Flink > Issue Type: New Feature > Components: Cluster Management >Reporter: Larry Wu >Assignee: Larry Wu >Priority: Major > Labels: Kubernetes > Original Estimate: 672h > Remaining Estimate: 672h > > This task is to implement Flink Dispatcher for Kubernetes, which is deployed > to Kubernetes cluster as a long-running pod. The Flink Dispatcher accepts job > submissions from Flink clients and asks Kubernetes API Server to create and > monitor a virtual cluster of Flink JobManager pod and Flink TaskManager Pods. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-6594) Implement Flink Dispatcher for Kubernetes
[ https://issues.apache.org/jira/browse/FLINK-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16404634#comment-16404634 ] Till Rohrmann commented on FLINK-6594: -- Hi [~skonto], there is currently no issue for an integration with K8. You're right that the first step would be to create a K8 {{ResourceManager}} which can launch new pods. A next step could be the implementation of an {{ClusterDescriptor}} to programmatically deploy Flink clusters. Would you be willing to create an umbrella issue for the K8 integration. We should also create a design for the integration. > Implement Flink Dispatcher for Kubernetes > - > > Key: FLINK-6594 > URL: https://issues.apache.org/jira/browse/FLINK-6594 > Project: Flink > Issue Type: New Feature > Components: Cluster Management >Reporter: Larry Wu >Assignee: Larry Wu >Priority: Major > Labels: Kubernetes > Original Estimate: 672h > Remaining Estimate: 672h > > This task is to implement Flink Dispatcher for Kubernetes, which is deployed > to Kubernetes cluster as a long-running pod. The Flink Dispatcher accepts job > submissions from Flink clients and asks Kubernetes API Server to create and > monitor a virtual cluster of Flink JobManager pod and Flink TaskManager Pods. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-6594) Implement Flink Dispatcher for Kubernetes
[ https://issues.apache.org/jira/browse/FLINK-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398419#comment-16398419 ] Stavros Kontopoulos commented on FLINK-6594: [~till.rohrmann] Is there a task for making the ResourceManager aware of Kubernetes? For example for starting new Taskmanagers. > Implement Flink Dispatcher for Kubernetes > - > > Key: FLINK-6594 > URL: https://issues.apache.org/jira/browse/FLINK-6594 > Project: Flink > Issue Type: New Feature > Components: Cluster Management >Reporter: Larry Wu >Assignee: Larry Wu >Priority: Major > Labels: Kubernetes > Original Estimate: 672h > Remaining Estimate: 672h > > This task is to implement Flink Dispatcher for Kubernetes, which is deployed > to Kubernetes cluster as a long-running pod. The Flink Dispatcher accepts job > submissions from Flink clients and asks Kubernetes API Server to create and > monitor a virtual cluster of Flink JobManager pod and Flink TaskManager Pods. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-6594) Implement Flink Dispatcher for Kubernetes
[ https://issues.apache.org/jira/browse/FLINK-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022506#comment-16022506 ] Till Rohrmann commented on FLINK-6594: -- I think this should be a subtask of FLINK-4897 because we first have to design the general dispatcher interface and then implement it for Kubernetes. > Implement Flink Dispatcher for Kubernetes > - > > Key: FLINK-6594 > URL: https://issues.apache.org/jira/browse/FLINK-6594 > Project: Flink > Issue Type: New Feature > Components: Cluster Management >Reporter: Larry Wu > Labels: Kubernetes > Original Estimate: 672h > Remaining Estimate: 672h > > This task is to implement Flink Dispatcher for Kubernetes, which is deployed > to Kubernetes cluster as a long-running pod. The Flink Dispatcher accepts job > submissions from Flink clients and asks Kubernetes API Server to create and > monitor a virtual cluster of Flink JobManager pod and Flink TaskManager Pods. -- This message was sent by Atlassian JIRA (v6.3.15#6346)