Re: Dynamic Scaling: State Sharding

Hi Mazen, Flink does not support automatic scaling yet. Hence, the recommended way is to monitor a Flink job and to trigger rescaling by stopping the job with a savepoint and then to resume it with the adjusted parallelism. The community is working on auto scaling but there is no concrete date

Re: Dynamic Scaling: State Sharding

So what is the state of dynamic scaling (non static, set by the user in the code) for SLA gurantees now, is it already included in FLink, and is it still necessaru to stop/restart the job for dynamic scaling. Thanks. -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

Re: Dynamic Scaling: State Sharding

Sorry, my bad. Comments should work now. On Mon, Apr 4, 2016 at 3:51 PM, Aljoscha Krettek wrote: > Comments are not enabled. > > On Mon, 4 Apr 2016 at 13:58 Till Rohrmann wrote: > > > Hi Flink community, > > > > I recently started working on dynamic

Re: Dynamic Scaling: State Sharding

Comments are not enabled. On Mon, 4 Apr 2016 at 13:58 Till Rohrmann wrote: > Hi Flink community, > > I recently started working on dynamic scaling. As a first step we want to > introduce state sharding which is a requirement for partitioned state to be > re-distributable.

Dynamic Scaling: State Sharding

Hi Flink community, I recently started working on dynamic scaling. As a first step we want to introduce state sharding which is a requirement for partitioned state to be re-distributable. The following design doc [1] explains the ideas behind it. Any feedback is highly appreciated :-) [1]