3043442162 commented on issue #16886: URL: https://github.com/apache/dolphinscheduler/issues/16886#issuecomment-2614708013
Hello, I looked up a lot of information and code, here is how to submit flink tasks to k8s cluster on ds and how to handle compatibility replies. Compatibility processing, through different command parameters to support different flink versions. I'm currently planning to support flink session clusters on kubernetes in this release. As for the k8s front and back end you talked about, I am not particularly clear about what is the k8s front end, is it by exposing the k8s objects applied in the k8s cluster, such as NodePort, Ngpress or other, I hope you can inform me We all know that external applications cannot access k8s internal applications directly, and the same is true of dolphinscheduler in non-K8S deployment environments. If we have a dolphinscheduler deployed on a host outside of k8s, to schedule flink applications inside k8s on that dolphinscheduler, we need to expose the cluster inside k8s, either by opening a port per machine, or through something like an nginx proxy This exposed location allows dolphinscheduler to access the flink cluster inside the k8s and deploy applications. That's what I think, too. I refer to this flink article: https://nightlies.apache.org/flink/flink-docs-release-1.20/zh/docs/deployment/resource-providers/standalone/kubernetes/ If the community has any questions and wants to let me know, I'd appreciate it. 您好，我查阅了很多资料和代码，这是怎么让在ds上提交flink任务到k8s集群和怎么处理兼容性的回复。 兼容性处理，通过不同的命令参数支持不同flink版本。目前我打算在这个版本上支持kubernetes上的flink session集群。 对于您说说的k8s前后端，我不是特别清楚什么是k8s前端，是通过暴露k8s集群内应用的k8s对象吗，如NodePort，Ngpress还是其他的，希望您能告知我 我们都知道外部应用无法直接访问k8s内部应用，同理dolphinscheduler在非k8s部署环境下也是如此。 如果我们在一个k8s外的主机部署了dolphinscheduler，要在这个dolphinscheduler上调度k8s内的flink应用，我们需要把k8s内部的集群暴露出来，或是在每个机器开放一个端口，或是通过类似nginx代理的方式 dolphinscheduler可以通过这个暴露出来的地方去访问k8s内部的flink集群，并部署应用。 这也是我的想法。我参考了flink的这篇文章：https://nightlies.apache.org/flink/flink-docs-release-1.20/zh/docs/deployment/resource-providers/standalone/kubernetes/ 如果社区有什么疑问希望能告知我，不胜感激。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
