Re: late element and expired state

2019-02-09 Thread Congxian Qiu
Hi, Aggarwal. Your strategy to limit the total state is right. And there did not have an API will give user the hint about cleared/expired state. I think you can associate every key with two states: one as the ttl-state, one as the “seen”-state(ValeState)—the “seen”-state will tell you

Re: late element and expired state

2019-02-06 Thread Yun Tang
e.org Subject: late element and expired state Hello, I have some questions regarding best practices to deal with ever expanding state with KeyBy(). In my input stream I will continue to see new keys. And I am using Keyed state. How do I keep the total state in limit? After reading the flink doc

late element and expired state

2019-02-05 Thread Aggarwal, Ajay
Hello, I have some questions regarding best practices to deal with ever expanding state with KeyBy(). In my input stream I will continue to see new keys. And I am using Keyed state. How do I keep the total state in limit? After reading the flink documentation and some blogs I am planning to