Hi all, We can use the origin thread, after a reply, you can see the thread. @wangwj
Best, Jingsong On Mon, Apr 1, 2024 at 7:47 PM yu zelin <[email protected]> wrote: > > Thanks wj. I would like to forward previous comments from Jingsong Li for > you: > ## API > > tag_time_retained => time_retained in Create Tag scope. > > It is not a separate option, we don't need a tag prefix. > > ## Expire > > We can expire all tags instead of only handling non auto-created tags. > > Actually, I think auto-created tags also have a requirement to expire > by retained time. > > TagNonAutoCreatedRetainManager => ExpireTags > > ## System table > > Add tag_create_time and tag_retain_time in the tag system table. > > On Mon, Apr 1, 2024 at 7:38 PM wj wang <[email protected]> wrote: > > > Hi devs: Sorry, as I didn't subscribe before and couldn't see replies, so I > > am sending a new one here. > > > > I would like to start a discussion of PIP-20: Introduce TTL for tags which > > are not auto-created. [1]. > > > > Currently, Paimon has automatic clearing mechanisms for tags created by > > TagAutoCreation, but not for other tags. It can't meet our demands. > > For example: > > 1、The current tag cleanup mechanism may lead to resource-wasting. > > 2、Tag does not support TTL, so it is not flexible to use. > > > > > > This PIP aims to s > > upport each Tag has its own TTL, so that the user can use the tag more > > flexibly and reduce the probability of resource waste. > > And Paimon keep up with other data lake products such as Iceberg. > > > > Looking forward to your feedback, thanks. > > > > > > [1] > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=300026341 > > < > > https://cwiki.apache.org/confluence/display/PAIMON/PIP-1%3A+Improve+Shared+Writer+Buffer+Pool+For+Sink > > > > > > > > > Best, wangwj > >
