huangxiaopingRD opened a new pull request, #8660: URL: https://github.com/apache/paimon/pull/8660
### Purpose Improve writable column vector capacity growth for very large batches. Previously, `AbstractWritableVector.reserve` always expanded to `requiredCapacity * 2`. For deeply nested or large collection columns, this can cause a single reserve call to allocate much more memory than actually needed and trigger `OutOfMemoryError`. This change keeps the existing doubling behavior for normal-sized vectors, but uses more conservative growth for huge vectors. It also releases oversized heap vector arrays on `reset()` by restoring capacity to the initial capacity, so one unusually large batch does not make the vector retain a huge backing array forever. ### Tests Added unit tests for normal and huge vector capacity growth, reset behavior, max capacity rejection, and heap vector backing array release. The new tests pass locally. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
