PeterSansan opened a new issue #8081:
URL: https://github.com/apache/arrow/issues/8081
Hi. I use Float8Vector to store data which stand for relationship table with
consecutive addresses in java version. If I want to build a 1000 fields *
150000 rows' relationship table which reshapes 1.5*10^8 rows' Float8Vector, it
causes error like this:
```
java.lang.IllegalArgumentException: the requested size must be non-negative
at
org.apache.arrow.util.Preconditions.checkArgument(Preconditions.java:136)
at org.apache.arrow.memory.BaseAllocator.buffer(BaseAllocator.java:292)
at org.apache.arrow.memory.BaseAllocator.buffer(BaseAllocator.java:281)
at
org.apache.arrow.vector.BaseValueVector.allocFixedDataAndValidityBufs(BaseValueVector.java:194)
at
org.apache.arrow.vector.BaseFixedWidthVector.allocateBytes(BaseFixedWidthVector.java:329)
at
org.apache.arrow.vector.BaseFixedWidthVector.allocateNew(BaseFixedWidthVector.java:299)
at
org.apache.arrow.vector.BaseFixedWidthVector.allocateNew(BaseFixedWidthVector.java:264)
```
I use the api are "setInitialCapacity" and "allocateNew". So I ask it's
possible to create a Float8Vector larger than Integer.Max byte, or does arrow
have a data structure to stand for a relationship table with consecutive
addresses. Consecutive addresses are important to me, because can transfer it
to the other Computing system with the same memory.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
