(paimon) branch master updated: [core] Add parquet write page limit parameter (#4632)

[lzljs3620320]

This is an automated email from the ASF dual-hosted git repository.

lzljs3620320 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/paimon.git


The following commit(s) were added to refs/heads/master by this push:
     new 812ef057a0 [core] Add parquet write page limit parameter (#4632)
812ef057a0 is described below

commit 812ef057a08f3bded463d6391996bd2595f4bd38
Author: aiden.dong <782112...@qq.com>
AuthorDate: Wed Dec 4 21:33:32 2024 +0800

    [core] Add parquet write page limit parameter (#4632)
---
 .../apache/paimon/format/parquet/writer/RowDataParquetBuilder.java    | 4 ++++
 1 file changed, 4 insertions(+)

diff --git 
a/paimon-format/src/main/java/org/apache/paimon/format/parquet/writer/RowDataParquetBuilder.java
 
b/paimon-format/src/main/java/org/apache/paimon/format/parquet/writer/RowDataParquetBuilder.java
index da55f94942..6ec349c124 100644
--- 
a/paimon-format/src/main/java/org/apache/paimon/format/parquet/writer/RowDataParquetBuilder.java
+++ 
b/paimon-format/src/main/java/org/apache/paimon/format/parquet/writer/RowDataParquetBuilder.java
@@ -60,6 +60,10 @@ public class RowDataParquetBuilder implements 
ParquetBuilder<InternalRow> {
                                 conf.getInt(
                                         ParquetOutputFormat.PAGE_SIZE,
                                         ParquetWriter.DEFAULT_PAGE_SIZE))
+                        .withPageRowCountLimit(
+                                conf.getInt(
+                                        
ParquetOutputFormat.PAGE_ROW_COUNT_LIMIT,
+                                        
ParquetProperties.DEFAULT_PAGE_ROW_COUNT_LIMIT))
                         .withDictionaryPageSize(
                                 conf.getInt(
                                         
ParquetOutputFormat.DICTIONARY_PAGE_SIZE,