Thanks Zhoufa! Looks good to me!
Best, Jingsong On Tue, Sep 23, 2025 at 4:42 PM 周伐 <zhou1172026...@gmail.com> wrote: > > Jingsong Li jingsongl...@gmail.com 通过 > <https://support.google.com/mail/answer/1311182?hl=zh-CN>“paimon.apache.org” > 15:03 (1小时前) > 发送至 dev > Hi jingsong, > > Thanks for your reminding, i have removed `chain-table.query.type` from > the doc. > For details, please check > https://cwiki.apache.org/confluence/display/PAIMON/PIP-37%3A+Introduce+Chain+Table > > Best, > zhoufa > > Jingsong Li <jingsongl...@gmail.com> 于2025年9月23日周二 15:03写道： > > > Hi zhoufa, > > > > You can just remove `chain-table.query.type`, PIP is for public API. > > > > Best, > > Jingsong > > > > On Tue, Sep 23, 2025 at 2:44 PM 周伐 <zhou1172026...@gmail.com> wrote: > > > > > > Thanks Jingsong, > > > > > > Very thanks for your review and pointing out the relevant issues, the > > > relevant issues have been updated according to your suggestions. > > > > > > 1. `chain-table.query.type` is merely an internal conf used to identify > > > the usage scenarios of snapshot and delta branch and is not exposed > > > externally. There are two usage scenarios for snapshot and delta branch, > > > independent use and combined use as chain branch. Some details are > > > different in different scenarios. Maybe it would be better to rename it > > to > > > `chain-table.branch.internal.usage.mode` . > > > 2. The usage of options have been updated in `Usage Method`. > > > 3. In the doc, `t$branch_xxx` has been uniformly used to represent the > > > branch. > > > > > > The doc has been updated. For specific information, please check > > > > > https://cwiki.apache.org/confluence/display/PAIMON/PIP-37%3A+Introduce+Chain+Table > > > > > > Best, > > > zhoufa > > > > > > Jingsong Li <jingsongl...@gmail.com> 于2025年9月23日周二 10:37写道： > > > > > > > You can just update to > > > > > > > > > > https://cwiki.apache.org/confluence/display/PAIMON/PIP-37%3A+Introduce+Chain+Table > > > > > > > > On Tue, Sep 23, 2025 at 10:36 AM Jingsong Li <jingsongl...@gmail.com> > > > > wrote: > > > > > > > > > > Thanks Zhoufa, > > > > > > > > > > Very thanks to you for starting this discussion! > > > > > > > > > > Overall looks good to me! > > > > > > > > > > 1. You have introduced `chain-table.query.type` in doc, can you > > > > > explain its usage? > > > > > 2. Can you update options in `Usage Method`? Looks inconsistent. > > > > > 3. You can use `set spark.paimon.branch=snapshot;`, but in this doc, > > > > > can you just use `T$branch_snapshot`? This is the more recommended > > > > > usage by the official. > > > > > > > > > > Best, > > > > > Jingsong > > > > > > > > > > On Sun, Sep 21, 2025 at 9:01 AM Aitozi <gjying1...@gmail.com> wrote: > > > > > > > > > > > > Hi, zhoufa, > > > > > > Thanks for bringing up this discussion, the chain table is a > > > > well-known > > > > > > solution in the > > > > > > data warehouse scene, It would be nice we can native support it in > > > > paimon, > > > > > > looking forward > > > > > > to this feature. > > > > > > > > > > > > Best, > > > > > > Aitozi. > > > > > > > > > > > > 周伐 <zhou1172026...@gmail.com> 于2025年9月19日周五 15:41写道： > > > > > > > > > > > > > Hi, Paimon Devs, I’d like to start a discussion about chain > > table on > > > > > > > paimon. > > > > > > > > > > > > > > Chain table is a new table type designed for data warehouse where > > > > full > > > > > > > data are stored periodically, but the incremental change between > > > > > > > periods is small. The primary benefits of using chain table > > include > > > > > > > incremental computation and storage、significant storage > > > > > > > savings、accelerated data pipelines etc. For more details, please > > > > > > > refer to the following link: > > > > > > > [1] > > > > > > > > > > > > > > > > > > > > https://docs.google.com/document/d/1vP3QRwqh5c3nn4-C0Q__3Fj6MmZKNBA0c5H2-ch2f6I/edit?tab=t.0#heading=h.a3460ir1b90e > > > > > > > > > > > > > > Look forward to your questions and suggestions. > > > > > > > > > > > > > > Best, > > > > > > > zhoufa > > > > > > > > > > > > >
