Query about `JdbcIO`

2024-02-22 Thread Vardhan Thigle via user
Hi, I had a small query about `JdbcIO`. As per the documentation `readWithPartitions` is supported for Long, DateTime

Beam portable runner setup for Flink + Python on Kubernetes

2024-02-22 Thread Jaehyeon Kim
Hello, I'm playing with the beam portable runner to read/write data from Kafka. I see a spark runner example on Kubernetes ( https://beam.apache.org/documentation/runners/spark/#kubernetes) but the flink runner section doesn't include such an example. Is there a resource that I can learn?

Re: Beam portable runner setup for Flink + Python on Kubernetes

2024-02-22 Thread Sam Bourne
I made this a few years ago to help people like yourself. https://github.com/sambvfx/beam-flink-k8s Hopefully it's insightful and I'm happy to accept any MRs to update any outdated information or to flesh it out more. On Thu, Feb 22, 2024 at 3:48 PM Jaehyeon Kim wrote: > Hello, > > I'm

Re: Beam portable runner setup for Flink + Python on Kubernetes

2024-02-22 Thread Jaehyeon Kim
Hi Sam Thanks for the GitHub repo link. In your example, the environment type is set to DOCKER and it requires a docker container running together with the task manager. Would you think it is acceptable in a production environment? Cheers, Jaehyeon On Fri, 23 Feb 2024 at 13:57, Sam Bourne