GitHub user hpvd closed a discussion: Full automatic dynamic lakehouse sink

Flink just released a full dynamic sink for iceberg which makes writing Kafka 
to iceberg at scale really easy:
- automated schema evolution
- automated new topic recovery
- routing multiple types from one topic
...

see 
https://flink.apache.org/2025/11/11/from-stream-to-lakehouse-kafka-ingestion-with-the-flink-dynamic-iceberg-sink/

Are there plans to make something like this possible in combination with all 
the Fluss advantages?

Looks very adventurous to me especially in combination with [lance 
format](https://github.com/lance-format/lance) / lancedb, which easily allow 
evolution without data rewrite, fast point query and dealing with AI data of 
any modality...

GitHub link: https://github.com/apache/fluss/discussions/2011

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]

Reply via email to