voidstar69 opened a new pull request, #38593: URL: https://github.com/apache/arrow/pull/38593
### Rationale for this change Allow for record batches larger than 2 GB. ### What changes are included in this PR? Make TotalLength a long instead of an int to allow for a larger record batch. ### Are these changes tested? Not yet, tests are WIP. Potential issues: - Even with TotalLength allowed to be larger than 2GB, will underlying buffer(s) support data larger than 2GB? - How to test this? A test that generates a 2GB+ buffer to exercise this functionality, may be fairly slow. ### Are there any user-facing changes? No -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
