Re: Error Starting PyFlink in Kubernetes Session Cluster "Could Not Get Rest Endpoint"

2021-03-11 Thread Yang Wang
What I mean is you could create a K8s deployment using the Flink image just like following. After then, you could use "kubectl exec -it {pod_name} bash" to tunnel in and submit the Flink python application to the existing session cluster. apiVersion: apps/v1 kind: Deployment metadata: name:

Re: Error Starting PyFlink in Kubernetes Session Cluster "Could Not Get Rest Endpoint"

2021-03-10 Thread Robert Cullen
Yang, "... This could be done by starting a pod as the Flink client." Do you have an example yaml you could share? On Sun, Mar 7, 2021 at 9:57 PM Yang Wang wrote: > I think you want to submit a Flink python job to the existing session > cluster. > Please ensure the session cluster is created

Re: Error Starting PyFlink in Kubernetes Session Cluster "Could Not Get Rest Endpoint"

2021-03-07 Thread Yang Wang
I think you want to submit a Flink python job to the existing session cluster. Please ensure the session cluster is created with proper service exposed type[1]. * LoadBalancer for the cloud environment * NodePort for self managed K8s cluster * ClusterIP for the K8s internal submission, which means

Error Starting PyFlink in Kubernetes Session Cluster "Could Not Get Rest Endpoint"

2021-03-05 Thread Robert Cullen
Trying to spin up a Python Flink instance in my Kubernetes cluster with this configuration ... sudo ./bin/flink run \ --target kubernetes-session \ -Dkubernetes.cluster-id=flink-python \ -Dkubernetes.namespace=cmdaa \ -Dkubernetes.container.image=cmdaa/pyflink:0.0.1 \ --pyModule word_count \