[jira] [Commented] (FLINK-14460) Active Kubernetes integration phase2 - Advanced Features
[
https://issues.apache.org/jira/browse/FLINK-14460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021755#comment-17021755
]
Yang Wang commented on FLINK-14460:
---
>> About the E2E:
1. Currently, we do not have a nightly build docker image. When the
release-1.10 is released, it will not be problem. Now you could use the
following simple dockerfile to build a image.
{code:java}
FROM flink:latest
RUN rm -rf /opt/flink/
COPY flink-1.10-SNAPSHOT /opt/flink
{code}
2. We do not support job cluster now. This is still in work[1]. We could make
it happen in release-1.11.
>> The add-ons
I think the add-ons is just out of the responsibility of Flink. It is really
the Kubernetes related concepts. And in most production Kubernetes cluster,
they will have their own default add-ons.
[1]. https://issues.apache.org/jira/browse/FLINK-10934
> Active Kubernetes integration phase2 - Advanced Features
>
>
> Key: FLINK-14460
> URL: https://issues.apache.org/jira/browse/FLINK-14460
> Project: Flink
> Issue Type: New Feature
> Components: Deployment / Kubernetes
>Reporter: Yang Wang
>Priority: Major
>
> This is phase2 of active kubernetes integration. It is a umbrella jira to
> track all the advanced features and make Flink on Kubernetes production ready.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (FLINK-14460) Active Kubernetes integration phase2 - Advanced Features
[ https://issues.apache.org/jira/browse/FLINK-14460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020505#comment-17020505 ] Rong Rong commented on FLINK-14460: --- Thanks for sharing [~fly_in_gis]. * FLINK-15671 seems like a GREAT idea!! huge +1 on this. * Regarding the documentation of the E2E: 1. I was actually having trouble running the quick instruction (it seems like the default image "flink:latest" was broken) which I have to dig into all the documents to find a solution - thus prompts me to think we can do some improvement. 2. We probably need to also provide a job-cluster E2E (I think this is a good start: [https://ci.apache.org/projects/flink/flink-docs-master/ops/deployment/kubernetes.html#flink-job-cluster-on-kubernetes] but we could definitely unified them and make it more easy to follow) * Regarding add-ons: Yes that's what I meant. I actually find some add-ons (like the [Dashboard|https://github.com/kubernetes/dashboard#kubernetes-dashboard]) very useful when trying the native K8S out. However on second thought I am not sure this fits in Flink's documentation, so let's leave it out of the discussion, what do you think? > Active Kubernetes integration phase2 - Advanced Features > > > Key: FLINK-14460 > URL: https://issues.apache.org/jira/browse/FLINK-14460 > Project: Flink > Issue Type: New Feature > Components: Deployment / Kubernetes >Reporter: Yang Wang >Priority: Major > > This is phase2 of active kubernetes integration. It is a umbrella jira to > track all the advanced features and make Flink on Kubernetes production ready. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-14460) Active Kubernetes integration phase2 - Advanced Features
[ https://issues.apache.org/jira/browse/FLINK-14460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019881#comment-17019881 ] Yang Wang commented on FLINK-14460: --- Thanks for all the enthusiasm of you guys. Very glad to see that so many people want to get involved and make contribution. I hope you guys could have a taste of the current implementation and give some feedback and requirements in the ML. In my opinion, we need to gather all the requirements first, and put them as subtasks here. Then we need to discuss the priorities and necessity of every tickets. If you want, please join the slack channel #flink-native-on-kubernetes(in workspace ASF). [~rongr], thanks for your nice suggestion. >> Add a e2e quick start We already have a document about how to run a Flink session cluster on Kubernetes natively[1]. It is step by step. If you have more thoughts, i think we could refine the doc to make it more clear. >> Build the custom Flink image Currently, we could use the official flink image directly. The community are trying to provide a one place for all the docker images[2]. We could benefit from this. >> what are the suggested add-ons we can run alongside Flink session cluster? I'm not sure what you real want. Do you mean the Kubernetes add-ons or something else? [1]. [https://ci.apache.org/projects/flink/flink-docs-master/ops/deployment/native_kubernetes.html#flink-kubernetes-session] [2]. https://issues.apache.org/jira/browse/FLINK-15671 > Active Kubernetes integration phase2 - Advanced Features > > > Key: FLINK-14460 > URL: https://issues.apache.org/jira/browse/FLINK-14460 > Project: Flink > Issue Type: New Feature > Components: Deployment / Kubernetes >Reporter: Yang Wang >Priority: Major > > This is phase2 of active kubernetes integration. It is a umbrella jira to > track all the advanced features and make Flink on Kubernetes production ready. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-14460) Active Kubernetes integration phase2 - Advanced Features
[ https://issues.apache.org/jira/browse/FLINK-14460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019642#comment-17019642 ] Rong Rong commented on FLINK-14460: --- Thanks [~fly_in_gis] for driving this. Really looking forward to native Flink on K8S. I briefly went through the document. I was wondering: should we have a JIRA log the work to "refine the documentation" ? One think I love to have is: * create an E2E "quick start" sections in the documentation? one for Job cluster and one for Session cluster that users can successfully start running without read through the remaining parts. Also we might be able to add an advance usage section, some of the ideas I have are: how to create custom session cluster Flink images; what are the suggested add-ons we can run alongside Flink session cluster? ... What do you think? > Active Kubernetes integration phase2 - Advanced Features > > > Key: FLINK-14460 > URL: https://issues.apache.org/jira/browse/FLINK-14460 > Project: Flink > Issue Type: New Feature > Components: Deployment / Kubernetes >Reporter: Yang Wang >Priority: Major > > This is phase2 of active kubernetes integration. It is a umbrella jira to > track all the advanced features and make Flink on Kubernetes production ready. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-14460) Active Kubernetes integration phase2 - Advanced Features
[ https://issues.apache.org/jira/browse/FLINK-14460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018831#comment-17018831 ] 喻兆靖 commented on FLINK-14460: - Can assign https://issues.apache.org/jira/browse/FLINK-15639 for me? And I want to support pullSecrets, ingress, scheduler, and dnsPolicy and dnsConfig to flink，Can Create this and assign for me? > Active Kubernetes integration phase2 - Advanced Features > > > Key: FLINK-14460 > URL: https://issues.apache.org/jira/browse/FLINK-14460 > Project: Flink > Issue Type: New Feature > Components: Deployment / Kubernetes >Reporter: Yang Wang >Priority: Major > > This is phase2 of active kubernetes integration. It is a umbrella jira to > track all the advanced features and make Flink on Kubernetes production ready. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-14460) Active Kubernetes integration phase2 - Advanced Features
[ https://issues.apache.org/jira/browse/FLINK-14460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018799#comment-17018799 ] duchen commented on FLINK-14460: Can assign https://issues.apache.org/jira/browse/FLINK-15642 for me ? > Active Kubernetes integration phase2 - Advanced Features > > > Key: FLINK-14460 > URL: https://issues.apache.org/jira/browse/FLINK-14460 > Project: Flink > Issue Type: New Feature > Components: Deployment / Kubernetes >Reporter: Yang Wang >Priority: Major > > This is phase2 of active kubernetes integration. It is a umbrella jira to > track all the advanced features and make Flink on Kubernetes production ready. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-14460) Active Kubernetes integration phase2 - Advanced Features
[ https://issues.apache.org/jira/browse/FLINK-14460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018787#comment-17018787 ] hippo commented on FLINK-14460: --- Can assign https://issues.apache.org/jira/browse/FLINK-15640 for me? > Active Kubernetes integration phase2 - Advanced Features > > > Key: FLINK-14460 > URL: https://issues.apache.org/jira/browse/FLINK-14460 > Project: Flink > Issue Type: New Feature > Components: Deployment / Kubernetes >Reporter: Yang Wang >Priority: Major > > This is phase2 of active kubernetes integration. It is a umbrella jira to > track all the advanced features and make Flink on Kubernetes production ready. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-14460) Active Kubernetes integration phase2 - Advanced Features
[ https://issues.apache.org/jira/browse/FLINK-14460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018782#comment-17018782 ] ptmagic commented on FLINK-14460: - [~fly_in_gis] ok > Active Kubernetes integration phase2 - Advanced Features > > > Key: FLINK-14460 > URL: https://issues.apache.org/jira/browse/FLINK-14460 > Project: Flink > Issue Type: New Feature > Components: Deployment / Kubernetes >Reporter: Yang Wang >Priority: Major > > This is phase2 of active kubernetes integration. It is a umbrella jira to > track all the advanced features and make Flink on Kubernetes production ready. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-14460) Active Kubernetes integration phase2 - Advanced Features
[ https://issues.apache.org/jira/browse/FLINK-14460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018774#comment-17018774 ] ouyangwulin commented on FLINK-14460: - I have try to implement sidecars and initcontainer in flink operator, So can assign https://issues.apache.org/jira/browse/FLINK-15641 and https://issues.apache.org/jira/browse/FLINK-15642 for me? > Active Kubernetes integration phase2 - Advanced Features > > > Key: FLINK-14460 > URL: https://issues.apache.org/jira/browse/FLINK-14460 > Project: Flink > Issue Type: New Feature > Components: Deployment / Kubernetes >Reporter: Yang Wang >Priority: Major > > This is phase2 of active kubernetes integration. It is a umbrella jira to > track all the advanced features and make Flink on Kubernetes production ready. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-14460) Active Kubernetes integration phase2 - Advanced Features
[ https://issues.apache.org/jira/browse/FLINK-14460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018107#comment-17018107 ] Yang Wang commented on FLINK-14460: --- [~ptmagic] Thanks for your kindly help. If you have some time, please help to test the session cluster deployment. After Flink 1.10 release, i will be focused on the phase 2. And let's try to make Flink run on Kubernetes in production. > Active Kubernetes integration phase2 - Advanced Features > > > Key: FLINK-14460 > URL: https://issues.apache.org/jira/browse/FLINK-14460 > Project: Flink > Issue Type: New Feature > Components: Deployment / Kubernetes >Reporter: Yang Wang >Priority: Major > > This is phase2 of active kubernetes integration. It is a umbrella jira to > track all the advanced features and make Flink on Kubernetes production ready. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-14460) Active Kubernetes integration phase2 - Advanced Features
[ https://issues.apache.org/jira/browse/FLINK-14460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017783#comment-17017783 ] ptmagic commented on FLINK-14460: - Is there anything I can help? > Active Kubernetes integration phase2 - Advanced Features > > > Key: FLINK-14460 > URL: https://issues.apache.org/jira/browse/FLINK-14460 > Project: Flink > Issue Type: New Feature > Components: Deployment / Kubernetes >Reporter: Yang Wang >Priority: Major > > This is phase2 of active kubernetes integration. It is a umbrella jira to > track all the advanced features and make Flink on Kubernetes production ready. -- This message was sent by Atlassian Jira (v8.3.4#803005)
