+1
hongbo.xiao <[email protected]> 于2026年7月7日周二 18:23写道： > > +1 > > Best, > Hongbo > > > > 原始邮件 > 发件人：JUNHAO YE <[email protected]> > 发件时间：2026年7月7日 17:12 > 收件人：[email protected] <[email protected]> > 主题：Re: [DISCUSS] Apache Paimon 2.0.0 release > > > +1 > > Best, > Junhao > > > 2026年7月7日 15:50，wj wang <[email protected]> 写道： > > > > +1 for the proposal. Looking forward to Paimon 2.0! > > > > Best, > > wangwj > > > > On Tue, Jul 7, 2026 at 3:24 PM Yunfeng Zhou <[email protected]> > > wrote: > >> > >> Hi Jingsong, > >> > >> +1 for the proposal. Looking forward to Paimon 2.0! > >> > >> Best, > >> Yunfeng > >> > >>> 2026年7月7日 11:11，Jingsong Li <[email protected]> 写道： > >>> > >>> Hi everyone, > >>> > >>> I would like to start a discussion about preparing an Apache Paimon > >>> 2.0.0 release. > >>> > >>> Over the past release cycles, Paimon has evolved significantly. In > >>> addition to continuing improvements to the core lakehouse table > >>> engine, we have been building a broader storage foundation for > >>> streaming, analytics, and AI/multimodal workloads. > >>> > >>> Some major areas that have landed or are being stabilized include: > >>> > >>> 1. Data Evolution and row tracking > >>> > >>> Paimon now has a much stronger foundation for append tables with row > >>> tracking and data evolution. This enables efficient partial column > >>> updates, schema evolution, dedicated storage for special column types, > >>> and global-index-based retrieval without rewriting entire data files. > >>> > >>> 2. Multimodal table capabilities > >>> > >>> We have introduced multimodal table support, covering blob storage, > >>> vector storage, full-text content, and global indexes in one table > >>> abstraction. This allows Paimon tables to store and query structured > >>> data together with images, videos, audio, embeddings, and text > >>> content. > >>> > >>> 3. Global Index framework > >>> > >>> The global index framework has been extended to support multiple index > >>> types, including BTree, Bitmap, vector indexes, full-text indexes, and > >>> hybrid search. This provides a unified mechanism for scalar filtering, > >>> vector similarity search, text retrieval, and combined retrieval > >>> workflows. > >>> > >>> 4. Vector and full-text search > >>> > >>> We have added native vector index support, including paimon-vindex > >>> IVF-based indexes and Lumina DiskANN-based indexes, as well as native > >>> full-text search integration with BM25 scoring and tokenizer > >>> configuration. These features are important for RAG, recommendation, > >>> image retrieval, and other AI-native scenarios. > >>> > >>> 5. New storage formats and supporting components > >>> > >>> We have also made several supporting components available around > >>> Paimon, including Mosaic, paimon-vindex, and paimon-full-text-index. > >>> > >>> Mosaic provides a columnar-bucket hybrid file format optimized for > >>> wide tables and efficient column projection. paimon-vindex provides > >>> native vector indexing capabilities for Paimon. paimon-full-text-index > >>> provides the native full-text engine used by Paimon full-text global > >>> indexes. > >>> > >>> Together, these components make Paimon more capable as a storage layer > >>> for both traditional lakehouse workloads and emerging AI/multimodal > >>> workloads. > >>> > >>> 6. Ecosystem improvements > >>> > >>> We have continued to improve Flink, Spark, Python, Ray, and Daft > >>> integration, and have been adding more end-to-end coverage for > >>> Java/Python interoperability, global index creation and reading, > >>> vector data, full-text search, and data evolution workflows. > >>> > >>> Given the scope of these changes, I think it is a good time to discuss > >>> whether we should cut a 2.0.0 release. A 2.0 release would help > >>> communicate that Paimon has entered a new stage, with data evolution, > >>> multimodal storage, and global indexes becoming first-class parts of > >>> the project. > >>> > >>> Please share your thoughts, concerns, or any issues that you believe > >>> should block or be included in the 2.0.0 release. > >>> > >>> Best, > >>> Jingsong > >> > >
