JingsongLi opened a new pull request, #9248:
URL: https://github.com/apache/paimon/pull/9248

   ## Purpose
   
   Simplify the dynamic read batch sizing API introduced by #9243 before it is 
released.
   
   ## Changes
   
   - Rename `ReadBatchSizeController` to `ReadBatchSizer` and propagate the new 
name through the public read APIs.
   - Replace the initialized requested/max batch sizes with an optional 
`batchSize()` value, `setBatchSize(int)`, and `clearBatchSize()`.
   - Fall back to each reader's configured batch size while the sizer is unset 
or after it is cleared.
   - Keep one complete constructor for `FormatReaderContext`, 
`OrcFormatReaderContext`, `KeyValueFileReaderFactory`, 
`ChainKeyValueFileReaderFactory`, and `VectorizedParquetRecordReader`.
   - Update ORC and Parquet resizing, propagation tests, constructor call 
sites, and Java API documentation.
   
   Dynamic batch sizes remain allowed to grow above the configured default. The 
configured value is a fallback, not a maximum.
   
   ## Validation
   
   - Affected dependency-chain test compilation passed for common, core, 
format, and Flink common.
   - Targeted common/format batch-sizing tests passed (22 tests).
   - `ParquetReadWriteTest` passed (48 tests).
   - Targeted core propagation tests passed (7 tests).
   - `LookupCompactDiffReadTest` passed with the Flink 1 profile.
   - Non-fast Maven verification passed for common, core, and format, including 
Checkstyle, Spotless, Enforcer, and RAT.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to