Re: Running Kubernetes on Flink with Savepoint

2020-06-17 Thread Matt Magsombol
ster/monitoring/rest_api.html#jobs-jobid-savepoints > > Best, > Robert > > > > On Wed, Jun 10, 2020 at 2:48 PM Matt Magsombol wrote: > > > We're currently using this template: > > https://github.com/docker-flink/examples/tree/master/helm/flink for > &g

Re: Challenges Deploying Flink With Savepoints On Kubernetes

2020-06-11 Thread Matt Magsombol
I'm not the original poster, but I'm running into this same issue. What you just described is exactly what I want. I presume you guys are using some variant of this helm https://github.com/docker-flink/examples/tree/master/helm/flink to configure your k8s cluster? I'm also assuming that this

Running Kubernetes on Flink with Savepoint

2020-06-10 Thread Matt Magsombol
We're currently using this template: https://github.com/docker-flink/examples/tree/master/helm/flink for running kubernetes flink for running a job specific cluster ( with a nit of specifying the class as the main runner for the cluster ). How would I go about setting up adding savepoints, so

Flink long state TTL Concerns

2020-03-19 Thread Matt Magsombol
Suppose I'm using state stored in-memory that has a TTL of 7 days max. Should I run into any issues with state this long other than potential OOM? Let's suppose I extend this such that we add rocksdb...any concerns with this with respect to maintenance? Most of the examples that I've been