haohuaijin opened a new issue, #11339:
URL: https://github.com/apache/arrow-rs/issues/11339
### Is your feature request related to a problem or challenge?
`WriterProperties` currently supports configuring data page size limits both
globally and per column through `set_data_page_size_limit` and
`set_column_data_page_size_limit`. However, the data page row count limit can
only be configured globally through `set_data_page_row_count_limit`.
It would be useful to configure the row count limit independently for each
column.
### Describe the solution you'd like
Add a setter and a corresponding getter:
```rust
WriterPropertiesBuilder::set_column_data_page_row_count_limit(
self,
col: ColumnPath,
value: usize,
) -> Self;
WriterProperties::column_data_page_row_count_limit(
&self,
col: &ColumnPath,
) -> usize;
```
The column-specific value should take precedence over the global row count
limit. Columns without an override should continue using the global value.
The setting should retain the existing best-effort semantics, including
splitting repeated columns only at record boundaries.
### Describe alternatives you've considered
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
