GitHub user hpvd edited a discussion: Full automatic dynamic lakehouse sink
Flink just released a full dynamic sink for iceberg which makes writing Kafka to iceberg at scale really easy: - schema evolution - new topic recovery - routing multiple types from one topic ... see https://flink.apache.org/2025/11/11/from-stream-to-lakehouse-kafka-ingestion-with-the-flink-dynamic-iceberg-sink/ Are there plans to make something like this possible in combination with all the Fluss advantages? Looks very adventurous to me especially in combination with lance format, which easily allow evolution without data rewrite, fast point query and dealing with AI data of any modality... GitHub link: https://github.com/apache/fluss/discussions/2011 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
