Hi, all Lance format provides better support for machine learning. It can better support point lookup and wide columns to support vectorized data storage. And it can be used to build Rag pipelines
Do we have a plan to support this file format in Paimon? Reference: https://lancedb.github.io/lance/format https://blog.lancedb.com/lance-v2/ https://www.databricks.com/dataaisummit/session/building-production-scale-totally-private-oss-rag-pipeline-dbrx-spark
