On Tue, 18 Mar 2025 19:08:04 +0100 Alkis Evlogimenos <alkis.evlogime...@databricks.com.INVALID> wrote: > At the end it boils down to which dataset you think is more representative > of the world data.
This sentence does not even have a precise meaning. Data is plural, there is no "representative" dataset. If someone tells you that the average animal on Earth is 2 millimeters long, is that "representative" of the characteristics of mammals? In the end, the question is whether a new encoding brings enough benefits in *some* cases to justify including it in Parquet. You may care primarily about Databricks customers, but some people don't. This is not a Databricks project. Regards Antoine.
