Hi,

I noticed the following note regarding page sizes in the Parquet Format
documentation <https://github.com/apache/parquet-format#configurations>:
"We recommend 8KB for page sizes."

In the Java implementation
<https://github.com/apache/parquet-mr/blob/master/parquet-column/src/main/java/org/apache/parquet/column/ParquetProperties.java#L46>,
however, we have a default page size that is 128 times larger: "public
static final int DEFAULT_PAGE_SIZE = 1024 * 1024;"

Does anyone know the reason behind this? Should we update the docs? What
default values do other implementation use?

Thanks,

Zoltan

Reply via email to