wangzhigang1999 opened a new pull request, #10800:
URL: https://github.com/apache/paimon/pull/10800

   ### Purpose
   
   Fixes #10799.
   
   Use one Arrow `min_max` call instead of separate `min` and `max` calls when 
computing column statistics and primary-key sequence-number ranges in 
`DataWriter`. This reduces duplicate statistics computation while preserving 
null handling, unsupported-type guards, and the statistics fields. No 
dependency or configuration changes are needed.
   
   ### Tests
   
   On ARM64 / Python 3.12, the following existing tests passed with both 
PyArrow **16.0.0** and **22.0.0**: **173 passed, 29 skipped per version**. The 
skipped variants require the optional Rust backend or its dedicated test job.
   
   ```sh
   python -m pytest -q pypaimon/tests/write/table_write_test.py \
     pypaimon/tests/write/append_writer_lifecycle_test.py \
     pypaimon/tests/test_write_merge_buffer.py \
     pypaimon/tests/write/row_kind_write_test.py \
     pypaimon/tests/write/write_buffer_test.py
   ```
   
   An additional local comparison matched the old and new column-statistics 
results in 1,522 cases per version, including nulls, NaN, numeric/string types, 
and chunked arrays. No new test files are included in this PR. Upstream Flake8 
and `git diff --check` passed.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to