Re: Global State and Scaling

Hi Elias, you're right, we currently don't support proper broadcast state. Hope to add support for this in the near future. The maximum parallelism only affects the keyed state because it defines how many key groups there are. The key groups are the smallest unit of state which can be

Re: Global State and Scaling

Looks like Gerard asked something along similar lines just last month and that there is a JIRA

Global State and Scaling

I am implementing a control stream. The stream communicates a global configuration value for the whole job. It uses DataStream.broadcast() to communicate this to all parallel operator instances. I would like to save this value in state so that it can be recovered when the job restarts/recovers.