jjbskir commented on issue #34046: URL: https://github.com/apache/arrow/issues/34046#issuecomment-1660582514
Hey! I ran into the same issue recently. I wanted to see if there was any progress to support variables between 1GB to 2GB? Or any supported work arounds? Happy to open a PR to support this. I think an solution would to add an additional check in [reallocDataBuffer](https://github.com/apache/arrow/blob/main/java/vector/src/main/java/org/apache/arrow/vector/BaseVariableWidthVector.java#L539 ) if the `desiredAllocSize` is greater then 1GB, but less then 2GB to just set the `newAllocationSize` to the max value. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
