yunfengzhou-hub opened a new issue, #10690: URL: https://github.com/apache/paimon/issues/10690
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation This is the umbrella issue for [PIP-39: Introduce Lake-Stream Mode to Provide Second-Level Data Freshness for Paimon Tables](https://cwiki.apache.org/confluence/spaces/PAIMON/pages/398000424). Paimon serves reads from snapshots, so a table's freshness is measured in minutes. Lake-stream mode keeps the table's history in Paimon while a pluggable Lakestream Store serves its most recent writes, so a query can return data that is seconds old. The store's tiering service moves data into Paimon in the background, and the table keeps its name, its schema and its history. Fluss is the first store implementation, through [FIP-25: Support In-Place Promotion of Existing Paimon Tables to Datalake-Enabled Fluss Tables](https://cwiki.apache.org/confluence/spaces/FLUSS/pages/406623572/FIP-25+Support+In-Place+Promotion+of+Existing+Paimon+Tables+to+Datalake-Enabled+Fluss+Tables). ### Solution The store is resolved through each engine's own catalog and table-factory SPI, so Paimon takes on no dependency on any particular store implementation. The work therefore splits into an engine-neutral table-format contract — the options that turn a table into a lake-stream table, and the catalog operations that have to be rejected to keep the mapping to the store's table intact — plus the implementations for each engine. Each scope is tracked as a sub-issue linked below, and is delivered by its own PR so that it stays independently reviewable. ### Anything else? _No response_ ### Are you willing to submit a PR? - [ ] I'm willing to submit a PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
