zeroshade opened a new pull request, #690: URL: https://github.com/apache/arrow-go/pull/690
### Rationale for this change Issue reported in https://github.com/apache/arrow-go/issues/622#issuecomment-3994896058 where accumulated data on a given page exceeds the DataPageSize. ### What changes are included in this PR? Removing a broken mid-batch flush in `writeValues`/`writeValuesSpaced`, instead relying back on `encoder.Put()/encoder.PutSpaced()`. Updated `WriteBatch` to use an adaptive batch sizing approach for ByteArray/FLBA writing to properly handle v2 data page row-boundary alignment without breaking on very large individual values. ### Are these changes tested? New tests are added to cover this scenario to ensure test coverage. ### Are there any user-facing changes? No -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
