David Vogelbacher created ARROW-15382:
-----------------------------------------

             Summary: SplitAndTransfer throws for (0,0) if vector empty
                 Key: ARROW-15382
                 URL: https://issues.apache.org/jira/browse/ARROW-15382
             Project: Apache Arrow
          Issue Type: Bug
          Components: Java
            Reporter: David Vogelbacher


I've hit a bug where `splitAndTransfer` on vectors throws if the vector is 
completely empty and the offset buffer is empty.

An easy repro is:
{noformat}
        BufferAllocator allocator = new RootAllocator(Long.MAX_VALUE);
        ListVector listVector = ListVector.empty("listVector", allocator);
        
listVector.getTransferPair(listVector.getAllocator()).splitAndTransfer(0, 0);
{noformat}

This results in the following stacktrace:
{noformat}
java.lang.IndexOutOfBoundsException: index: 0, length: 4 (expected: range(0, 0))
        at io.netty.buffer.ArrowBuf.checkIndexD(ArrowBuf.java:335)
        at io.netty.buffer.ArrowBuf.chk(ArrowBuf.java:322)
        at io.netty.buffer.ArrowBuf.getInt(ArrowBuf.java:441)
        at 
org.apache.arrow.vector.complex.ListVector$TransferImpl.splitAndTransfer(ListVector.java:484)
{noformat}

In production we hit this when calling {{VectorSchemaRoot.slice}}. The schema 
root contains a {{ListVector}} with a {{VarCharVector}} value vector. The list 
vector isn't empty, but all the strings in the var char vector are. 
{{splitAndTransfer}} on the list vector works, but then when underlying var 
char vector is split we get the same exception:

{noformat}
java.lang.IndexOutOfBoundsException: index: 0, length: 4 (expected: range(0, 0))
        at io.netty.buffer.ArrowBuf.checkIndexD(ArrowBuf.java:335)
        at io.netty.buffer.ArrowBuf.chk(ArrowBuf.java:322)
        at io.netty.buffer.ArrowBuf.getInt(ArrowBuf.java:441)
        at 
org.apache.arrow.vector.BaseVariableWidthVector.splitAndTransferOffsetBuffer(BaseVariableWidthVector.java:728)
        at 
org.apache.arrow.vector.BaseVariableWidthVector.splitAndTransferTo(BaseVariableWidthVector.java:712)
        at 
org.apache.arrow.vector.VarCharVector$TransferImpl.splitAndTransfer(VarCharVector.java:321)
        at 
org.apache.arrow.vector.complex.ListVector$TransferImpl.splitAndTransfer(ListVector.java:496)
        at 
org.apache.arrow.vector.VectorSchemaRoot.lambda$slice$1(VectorSchemaRoot.java:308)
        at 
java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
        at 
java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1655)
        at 
java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
        at 
java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
        at 
java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
        at 
java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at 
java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
        at 
org.apache.arrow.vector.VectorSchemaRoot.slice(VectorSchemaRoot.java:310)
{noformat} 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to