Hi Paimon community, 

I would like to start a discussion on PIP-39: Introduce Lake-Stream Mode to 
Provide Second-Level Data Freshness for Paimon Tables. 

This PIP proposes a pluggable Stream Store integration for Paimon, with Fluss 
as the first implementation. Existing Paimon tables can enable lake-stream mode 
in place: Paimon continues to manage historical data, while the Stream Store 
provides second-level data freshness. 

The proposal defines the read and write semantics, the enablement and 
disablement procedures, and the corresponding Flink and Spark connector 
changes. 

Please find the proposal here: 
https://cwiki.apache.org/confluence/spaces/PAIMON/pages/398000424/PIP-39+Introduce+Lake-Stream+Mode+to+Provide+Second-Level+Data+Freshness+for+Paimon+Tables
 

Feedback and suggestions are welcome. 

Best regards, 
Yuxia 

Reply via email to