I want to add a requirement: Append table for queue supports fixed-partition. This is the very common case for Kafka.
Best, Jingsong On Wed, Jan 3, 2024 at 10:37 AM yejunhao <[email protected]> wrote: > > Hi Zelin, > > Can you explain Something about Lineage. Does that means, we can debug wrong > data in a more convenient way? > > > Best, Junhao Ye. > > > 2023年12月27日 下午5:21，Jingsong Li <[email protected]> 写道： > > > > Thanks zelin! > > > > Looks forward to 0.7! > > > > yu zelin <[email protected]>于2023年12月27日 周三16:58写道： > > > >> Hi devs, > >> > >> I’d like to start a discussion about 0.7 release and I volunteer to be the > >> Release Manager. > >> > >> I’ve collected some feature requests from user group and found some > >> functionalities that need to be tested, they are: > >> > >> Feature requests: > >> 1. Query Service > >> 2. Lineage > >> 3. Memory queue > >> 4. Flattening data based on foreign keys > >> 5. Enhancement and bug fix for Flink DELETE/UPDATE > >> 6. Lightweight file data loading based on Netty and Paimon API > >> 7. Support deduplicate collection agg > >> 8. Support point query based on LSM > >> 9. CDC enhancement: > >> 1) debezium-json: support database sync and enhance data type > >> parsing > >> 2) support PG cdc > >> 3) support sink to Append table > >> 4) support set watermark based on the binlog > >> > >> Functionalities need to be tested: > >> 1. Test Flink Lookup Join load optimization [1] > >> 2. Test Flink/Spark generic catalog > >> > >> If you have any other requests, we can discuss on this thread. And I want > >> to discuss with you about which features should be included in the release > >> 0.7. Look forward to your opinions! > >> > >> Best, > >> Zelin Yu > >> > >> [1] https://github.com/apache/incubator-paimon/pull/2539 > >> > >> > >> >
