Hi Bowen, Thanks for updating the proposal. This looks pretty good (as I said before). There are a few areas, that are not yet fully fleshed out:
1. Where should the TTL code reside? In the state backend or in the operator? 2. How to get notified about state accesses? I guess this depends on 1. 3. How to avoid conflicts of TTL timers and user timers? @Stefan (in CC) might have some ideas on these issues as well. Cheers, Fabian 2018-04-22 21:14 GMT+02:00 Bowen <bowenl...@gmail.com>: > Hello community, > > We've come up with a completely new design for Flink state TTL, documented > here > <https://docs.google.com/document/d/1PPwHMDHGWMOO8YGv08BNi8Fqe_h7SjeALRzmW-ZxSfY/edit?usp=sharing>, > and have run it by a few Flink PMC/committers. > > What do you think? We'd love to hear feedbacks from you > > Thanks, > Bowen > > > On Wed, Feb 7, 2018 at 12:53 PM, Fabian Hueske <fhue...@gmail.com> wrote: > >> Hi Bowen, >> >> Thanks for the proposal! I think state TTL would be a great feature! >> Actually, we have implemented this for SQL / Table API [1]. >> I've added a couple of comments to the design doc. >> >> In principle, I'm not sure if this functionality should be added to the >> state backends. >> We could also use the existing timer service which would have a few nice >> benefits (see my comments in the docs). >> >> Best, Fabian >> >> [1] >> https://ci.apache.org/projects/flink/flink-docs-release-1.4/ >> dev/table/streaming.html#idle-state-retention-time >> >> 2018-02-06 8:26 GMT+01:00 Bowen Li <bowenl...@gmail.com>: >> >> > Hi guys, >> > >> > I want to propose a new FLIP -- FLIP-25 - Support User State TTL >> Natively >> > in Flink. This has been one of most handy and most frequently asked >> > features in Flink community. The jira ticket is FLINK-3089 >> > <https://issues.apache.org/jira/browse/FLINK-3089>. >> > >> > I've written a rough design >> > <https://docs.google.com/document/d/1qiFqtCC80n4oFmmfxBWXrCd37mYKc >> > uureyEr_nPAvSo/edit#> >> > doc >> > <https://docs.google.com/document/d/1qiFqtCC80n4oFmmfxBWXrCd37mYKc >> > uureyEr_nPAvSo/edit#>, >> > and developed prototypes for both heap and rocksdb state backends. >> > >> > My question is: shall we create a FLIP page for this? Can I be granted >> the >> > privileges of creating pages in >> > https://cwiki.apache.org/confluence/display/FLINK/ >> > Flink+Improvement+Proposals >> > ? >> > >> > Thanks, >> > Bowen >> > >> > >
